Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

8,851

Full-text search

Active filters: imatrix

backyardai/WizardLM-2-8x22B-GGUF

Updated May 22, 2024 • 248 • 1

bartowski/Scarlett-Llama-3-8B-v1.0-GGUF

Text Generation • Updated May 1, 2024 • 203 • 1

bartowski/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated Jun 30, 2024 • 2.18M • 48

bartowski/Einstein-v6.1-Llama3-8B-GGUF

Text Generation • Updated May 2, 2024 • 1.13k • 8

mradermacher/Poppy_Porpoise-0.72-L3-8B-i1-GGUF

Updated about 1 month ago • 137 • 5

bartowski/35b-beta-long-GGUF

Text Generation • Updated May 6, 2024 • 2.91k • 26

backyardai/Fimbulvetr-11B-v2-GGUF

Updated May 22, 2024 • 1.77k • 7

Lewdiculous/llama-3-cat-8b-instruct-v1-GGUF-IQ-Imatrix

Updated May 13, 2024 • 3 • 18

bartowski/Cat-Llama-3-70B-instruct-GGUF

Text Generation • Updated May 13, 2024 • 521 • 10

mradermacher/Ninja-v1-NSFW-RP-i1-GGUF

Updated about 1 month ago • 1.13k • 2

Lewdiculous/L3-8B-Stheno-v3.1-GGUF-IQ-Imatrix

Updated Sep 3, 2024 • 766 • 92

SakuraLLM/GalTransl-7B-v2.6

Updated Oct 4, 2024 • 6.97k • 28

Lewdiculous/rogue-enchantress-32k-7B-GGUF-IQ-Imatrix

Updated May 22, 2024 • 16 • 5

legraphista/DeepSeek-V2-Lite-Chat-IMat-GGUF

Text Generation • Updated May 26, 2024 • 3.14k • 10

mradermacher/Mahou-1.2a-llama3-8B-i1-GGUF

Updated about 1 month ago • 133 • 2

Lewdiculous/phencyclidine-8b-v1-GGUF-IQ-Imatrix

Updated May 28, 2024 • 27 • 2

Lewdiculous/Halu-8B-Llama3-Blackroot-GGUF-IQ-Imatrix

Updated May 28, 2024 • 42 • 7

Lewdiculous/Neural-SOVLish-Devil-8B-L3-GGUF-IQ-Imatrix

Updated May 29, 2024 • 5 • 6

cognitivecomputations/dolphin-2.9.2-qwen2-72b-gguf

Updated May 29, 2024 • 1.05k • 19

DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF-imatrix

Text Generation • Updated Nov 14, 2024 • 173 • 9

mmnga/umiyuki-Umievo-itr012-Gleipnir-7B-gguf

Updated May 29, 2024 • 1.08k • 6

Lewdiculous/llama-3-Stheno-Mahou-8B-GGUF-IQ-Imatrix

Updated Dec 12, 2024 • 788 • 22

mradermacher/Awanllm-Llama-3-8B-Cumulus-v1.0-i1-GGUF

Updated about 1 month ago • 176 • 1

mradermacher/Mahou-1.4-llama3-8B-i1-GGUF

Updated about 1 month ago • 167 • 1

mradermacher/Poppy_Porpoise-1.30-L3-8B-i1-GGUF

Updated 7 days ago • 147 • 2

mradermacher/Poppy_Porpoise-1.0-L3-8B-i1-GGUF

Updated about 1 month ago • 129 • 2

Lewdiculous/Fimbulvetr-11B-v2-GGUF-IQ-Imatrix

Updated Oct 2, 2024 • 2.29k • 21

mradermacher/L3-8B-Stheno-v3.2-i1-GGUF

Updated Aug 2, 2024 • 1.56k • 13

Lewdiculous/L3-8B-Stheno-v3.2-GGUF-IQ-Imatrix

Updated Sep 3, 2024 • 9.8k • 131

Lewdiculous/llama3-8B-aifeifei-1.1-GGUF-IQ-Imatrix

Updated Jun 6, 2024 • 12 • 2