Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

12,486

Full-text search

Active filters: 8-bit

noneUsername/Qwen2.5-Coder-14B-Instruct-abliterated-W8A8-Dynamic-Per-Token

Updated Nov 14, 2024 • 40 • 1

tiiuae/Falcon3-7B-Base-1.58bit

Text Generation • Updated 26 days ago • 181 • 2

PrunaAI/distributed-optimized-gpt2-1b-bnb-8bit-smashed

Updated Dec 10, 2024 • 13 • 1

Vikhrmodels/Vikhr-Qwen-2.5-1.5B-Instruct-MLX_8bit

Text Generation • Updated Nov 26, 2024 • 21 • 8

HuggingFaceTB/SmolLM2-135M-Instruct-Q8-mlx

Text Generation • Updated Nov 27, 2024 • 36 • 2

mlx-community/QwQ-32B-Preview-8bit

Text Generation • Updated Nov 27, 2024 • 188 • 5

marquesafonso/NuExtract-openvino-8bit

Updated Dec 2, 2024 • 5 • 1

MaziyarPanahi/Sailor2-1B-Chat-GGUF

Text Generation • Updated Dec 3, 2024 • 423k • 4

BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_8.0bpw_h8

Text Generation • Updated Dec 9, 2024 • 263 • 2

mlx-community/Llama-3.3-70B-Instruct-8bit

Text Generation • Updated Dec 6, 2024 • 8.42k • 9

jackboyla/Phi-3-mini-4k-instruct-graph-GGUF

Text Generation • Updated Dec 7, 2024 • 15 • 1

reinforce20001/SakuraLLM.Sakura-7B-Qwen2.5-v1.0-W8A8-Int8

Updated Dec 8, 2024 • 10 • 1

mlx-community/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-8-bit

Text Generation • Updated Dec 9, 2024 • 49 • 1

PrunaAI/DiatWork-GPT-Neox-MentalHealth-Finetune-10epoch-bnb-8bit-smashed

Updated Dec 10, 2024 • 4 • 1

PrunaAI/Sakalti-Saba1.5-Pro-bnb-8bit-smashed

Updated Dec 12, 2024 • 5 • 1

PrunaAI/Sakalti-magro-7B-bnb-8bit-smashed

Updated Dec 11, 2024 • 3 • 1

PrunaAI/nqzfaizal77ai-swiftstrike-aero-init-580m-bnb-8bit-smashed

Updated Dec 12, 2024 • 5 • 1

PrunaAI/nqzfaizal77ai-mirabel-tempest-init-570m-bnb-8bit-smashed

Updated Dec 12, 2024 • 4 • 1

prithivMLmods/QwQ-LCoT-3B-Instruct-GGUF

Text Generation • Updated Dec 13, 2024 • 1.16k • 10

ai-sage/GigaChat-20B-A3B-instruct-int8

Updated Dec 14, 2024 • 383 • 4

PrunaAI/prithivMLmods-QwQ-LCoT-3B-Instruct-bnb-8bit-smashed

Updated Dec 13, 2024 • 23 • 3

PrunaAI/sakaltcommunity-sakaltum-7b-bnb-8bit-smashed

Updated Dec 14, 2024 • 4 • 1

PrunaAI/sakaltcommunity-wasser-4b-bnb-8bit-smashed

Updated Dec 14, 2024 • 4 • 1

PrunaAI/EpistemeAI-Polypsyche-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto-Logic-bnb-8bit-smashed

Updated Dec 14, 2024 • 6 • 1

vitekkor/T-pro-it-1.0-bnb-8bit

Updated about 1 month ago • 87 • 1

PrunaAI/Sakalti-Saba1-3B-bnb-8bit-smashed

Updated Dec 15, 2024 • 5 • 1

MaziyarPanahi/patricide-12B-Unslop-Mell-v2-GGUF

Text Generation • Updated 30 days ago • 300 • 3

tiiuae/Falcon3-10B-Base-1.58bit

Text Generation • Updated 26 days ago • 215 • 4

MaziyarPanahi/HELVETE-X-GGUF

Text Generation • Updated 30 days ago • 157 • 1

PrunaAI/Pinkstack-PARM-V2-QwQ-Qwen-2.5-o1-3B-VLLM-bnb-8bit-smashed

Updated 29 days ago • 44 • 1