Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

8,836

Full-text search

Active filters: imatrix

bartowski/Sky-T1-32B-Preview-GGUF

Text Generation • Updated 4 days ago • 12.5k • 47

bartowski/phi-4-GGUF

Text Generation • Updated 4 days ago • 29.7k • 36

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated Dec 7, 2024 • 66

bartowski/Phi-3.5-MoE-instruct-GGUF

Text Generation • Updated 5 days ago • 1.3k • 5

bartowski/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated Nov 10, 2024 • 20.6k • 50

bartowski/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 42k • 48

mradermacher/Phi-4-AbliteratedRP-i1-GGUF

Updated 4 days ago • 1.04k • 4

bartowski/Qwen2.5-72b-RP-Ink-GGUF

Text Generation • Updated 1 day ago • 899 • 4

bartowski/Qwentile2.5-32B-Instruct-GGUF

Text Generation • Updated 11 days ago • 1.42k • 5

mradermacher/phi-4-abliterated-i1-GGUF

Updated 6 days ago • 1.5k • 3

bartowski/Rombos-Qwen2.5-Writer-32b-GGUF

Text Generation • Updated 4 days ago • 1.09k • 3

bartowski/gemma-2-27b-it-GGUF

Text Generation • Updated Aug 3, 2024 • 24.2k • 164

bartowski/Qwen2.5-32B-AGI-GGUF

Text Generation • Updated Sep 22, 2024 • 30.8k • 31

mradermacher/UnslopSmall-22B-v1-i1-GGUF

Updated Dec 4, 2024 • 1.15k • 2

bartowski/Monstral-123B-v2-GGUF

Text Generation • Updated Dec 4, 2024 • 5.46k • 4

bartowski/Qwen2-VL-72B-Instruct-GGUF

Image-Text-to-Text • Updated 28 days ago • 3.97k • 8

mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-i1-GGUF

Updated 29 days ago • 1.19k • 3

bartowski/SmallThinker-3B-Preview-GGUF

Text Generation • Updated 16 days ago • 80.6k • 25

mradermacher/14B-Qwen2.5-Freya-x1-i1-GGUF

Updated 14 days ago • 2.31k • 2

bartowski/32B-Qwen2.5-Kunou-v1-GGUF

Text Generation • Updated 11 days ago • 2.89k • 2

mradermacher/phi-4-i1-GGUF

Updated 6 days ago • 1.85k • 2

mradermacher/AetherUncensored-i1-GGUF

Updated 1 day ago • 514 • 2

bartowski/Negative-Anubis-70B-v1-GGUF

Text Generation • Updated 2 days ago • 801 • 2

mradermacher/gemma-2-2b-neogenesis-ita-i1-GGUF

Updated about 1 hour ago • 460 • 2

bartowski/L3.3-MS-Nevoria-70b-GGUF

Text Generation • Updated 1 day ago • 652 • 2

bartowski/Negative_LLAMA_70B-GGUF

Text Generation • Updated 4 days ago • 1.7k • 6

mradermacher/Midnight-Rose-70B-v2.0.3-i1-GGUF

Updated May 10, 2024 • 167 • 1

Lewdiculous/LemonadeRP-4.5.3-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 103 • 13

Lewdiculous/Prima-LelantaclesV6.69-7b-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 33 • 5

Lewdiculous/Prima-LelantaclesV6.3-7b-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 38 • 4