Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

12,492

Full-text search

Active filters: 8-bit

linxsxs/opt-125m-8bit

Text Generation • Updated Jun 14, 2024 • 21

bullerwins/Meta-Llama-3-8B-Instruct_exl2_8.0bpw

Text Generation • Updated Jun 14, 2024 • 18

broken-pipeline/MCQA-specialized-t5-base-int8

Text2Text Generation • Updated Jun 14, 2024 • 15

Douxe/quantizeTestThr1

Text2Text Generation • Updated Jun 14, 2024 • 13

broken-pipeline/MCQA-specialized-aligned-t5-base-int8

Text2Text Generation • Updated Jun 14, 2024 • 13

nali24mai/base_quantized_model

Text Generation • Updated Jun 14, 2024 • 20

Douxe/Quantize_MCQA-SciQ

Text2Text Generation • Updated Jun 14, 2024 • 13

chrisswillss98/dpo_mcqa_BBQ_v1.02

Text Generation • Updated Jun 14, 2024 • 20

rombirli/q8

Text2Text Generation • Updated Jun 14, 2024 • 11

Peaky8linders/football_lora_axolotl

Updated Jun 17, 2024 • 1

TeeZee/BigMaid-20B-v2.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 15, 2024 • 17

robertgshaw2/llama-3-w8a8-static-per-tensor-test

Text Generation • Updated Jun 15, 2024 • 21

robertgshaw2/llama-3-w8a8-dynamic-per-token-test

Text Generation • Updated Jun 15, 2024 • 23

grimjim/Llama-3-Oasis-v1-OAS-8B-8bpw_h8_exl2

Text Generation • Updated Aug 27, 2024 • 17

MaziyarPanahi/mergekit-slerp-oztfijl-GGUF

Text Generation • Updated Jun 15, 2024 • 20

MaziyarPanahi/EvoluzioneRed-GGUF

Text Generation • Updated Jun 15, 2024 • 20

MaziyarPanahi/mergekit-slerp-zwbosgo-GGUF

Text Generation • Updated Jun 15, 2024 • 18

MaziyarPanahi/Fimburs11V3-GGUF

Text Generation • Updated Jun 15, 2024 • 21

MaziyarPanahi/mergekit-passthrough-zpfenfn-GGUF

Text Generation • Updated Jun 15, 2024 • 24

TeeZee/DarkForest-20B-v3.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 15, 2024 • 15

MaziyarPanahi/TopEvolution7RAG-GGUF

Text Generation • Updated Jun 15, 2024 • 28

KakaoL0L/Llama38B_CVetOFFRE2_4bit

Text Generation • Updated Jun 15, 2024 • 22

MaziyarPanahi/TopEvolutionWiz-GGUF

Text Generation • Updated Jun 15, 2024 • 53

MaziyarPanahi/TopEvolution-DPO-32K-GGUF

Text Generation • Updated Jun 15, 2024 • 16

strickvl/isafpr-mistral-lora-templatefree

Updated Jun 16, 2024 • 1

MaziyarPanahi/mergekit-slerp-jovftfd-GGUF

Text Generation • Updated Jun 15, 2024 • 20

MaziyarPanahi/Superevolution-GGUF

Text Generation • Updated Jun 15, 2024 • 24

MaziyarPanahi/TopEvolution16-GGUF

Text Generation • Updated Jun 15, 2024 • 21

MaziyarPanahi/nMer1-GGUF

Text Generation • Updated Jun 15, 2024 • 18

MaziyarPanahi/Evolver-GGUF

Text Generation • Updated Jun 15, 2024 • 22