Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

12,375

Full-text search

Active filters: 8-bit

mlx-community/phi-4-8bit

Text Generation • Updated 3 days ago • 14.9k • 9

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 2.17M • 82

huihui-ai/Llama-3.3-70B-Instruct-abliterated-finetuned-GPTQ-Int8

Text Generation • Updated 9 days ago • 204k • 5

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 18, 2024 • 23.4k • 12

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 1.69M • 10

MaziyarPanahi/Qwen2.5-Coder-0.5B-QwQ-draft-GGUF

Text Generation • Updated 8 days ago • 135 • 2

MaziyarPanahi/phi-4-GGUF

Text Generation • Updated 7 days ago • 203k • 2

nejumi/phi-4-GPTQ-Int8-calib-ja-1k

Updated 4 days ago • 50 • 2

rycont/kakaobrain__kogpt-6b-8bit

Text Generation • Updated May 30, 2023 • 24 • 2

samadpls/querypls-prompt2sql

Text2Text Generation • Updated Nov 2, 2024 • 69 • 6

Undi95/Llama2-13B-no_robots-alpaca-lora

Text Generation • Updated Nov 17, 2023 • 583 • 10

ecastera/eva-mistral-dolphin-7b-spanish

Text Generation • Updated Mar 16, 2024 • 41 • 12

ecastera/eva-mistral-catmacaroni-7b-spanish

Text Generation • Updated Jan 29, 2024 • 13 • 2

MaziyarPanahi/ANIMA-Phi-Neptune-Mistral-7B-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26, 2024 • 55 • 1

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 88 • 3

MaziyarPanahi/Yi-9B-200K-GGUF

Text Generation • Updated Mar 18, 2024 • 135 • 6

Vision-CAIR/MiniGPT4-Video

Updated Jul 24, 2024 • 22 • 31

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 1.04M • 74

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 18.8k • 126

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 2.15M • 73

Zoyd/mlabonne_NeuralDaredevil-8B-abliterated-8_0bpw_exl2

Text Generation • Updated May 28, 2024 • 19 • 2

kim512/Llama-3-70b-Arimas-story-RP-V1.6-8.0bpw-h8-exl2

Text Generation • Updated Jun 17, 2024 • 23 • 1

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Oct 3, 2024 • 465 • 24

neuralmagic/Meta-Llama-3-8B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18, 2024 • 8.63k • 3

neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18, 2024 • 306 • 4

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22, 2024 • 2.16M • 40

neuralmagic/Mistral-7B-Instruct-v0.3-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 280 • 1

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7, 2024 • 1.85k • 32

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29, 2024 • 2.12M • 38

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 4.53k • 13