Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
arxiv:
2309.05516
4-bit precision
custom_code
Inference Endpoints
AutoTrain Compatible
text-generation-inference
Misc with no match
Eval Results
Merge
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
93
Full-text search
Edit filters
Sort: Trending
Active filters:
2309.05516
Clear all
Intel/Mistral-7B-Instruct-v0.2-int2-inc
Updated
Sep 23, 2024
Intel/Qwen2-0.5B-Instuct-int4-inc
Text Generation
•
Updated
Jun 6, 2024
•
29
Intel/Qwen2-7B-int4-inc
Text Generation
•
Updated
Oct 24, 2024
•
165
•
5
Intel/SOLAR-10.7B-Instruct-v1.0-int4-inc-v0.2
Updated
Jun 28, 2024
Intel/SOLAR-10.7B-Instruct-v1.0-int4-inc-v0.3
Updated
Jun 28, 2024
•
1
fbaldassarri/modello-italia-9b-autoround-w4g128-cpu
Text Generation
•
Updated
Jun 22, 2024
•
20
fbaldassarri/modello-italia-9b-autoround-w4g128-gpu
Text Generation
•
Updated
Jun 22, 2024
•
18
Intel/Qwen2-57B-A14B-Instruct-int4-inc
Updated
Oct 24, 2024
•
57
•
1
Intel/Qwen2.5-3B-Instruct-int4-inc
Updated
Oct 10, 2024
Intel/Qwen2.5-7B-Instruct-int4-inc
Updated
Oct 10, 2024
Intel/Qwen2.5-14B-Instruct-int4-inc
Updated
Oct 10, 2024
Intel/Qwen2.5-32B-Instruct-int4-inc
Updated
Oct 10, 2024
Intel/Qwen2.5-72B-Instruct-int4-inc
Updated
Oct 10, 2024
Intel/meta-Llama-3.2-3B-Instruct-Int4-INC-Autoround
Updated
Oct 10, 2024
OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc
Updated
24 days ago
•
8
•
1
OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc
Updated
2 days ago
•
24
•
1
OPEA/Qwen2.5-14B-Instruct-int4-sym-inc
Updated
3 days ago
•
18
OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc
Updated
5 days ago
•
49
•
1
OPEA/Phi-3.5-vision-instruct-int4-sym-inc
Updated
22 days ago
•
38
OPEA/Qwen2.5-7B-Instruct-int4-sym-inc
Updated
5 days ago
•
26
OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc
Updated
22 days ago
•
76
•
2
OPEA/llava-v1.5-7b-int4-sym-inc
Updated
22 days ago
•
10
OPEA/cogvlm2-llama3-chat-19B-int4-sym-inc
Updated
2 days ago
•
7
OPEA/Qwen2.5-72B-Instruct-int4-sym-inc
Updated
1 day ago
•
11
OPEA/Qwen2-7B-int4-sym-inc
Updated
5 days ago
•
12
OPEA/Llama-3.2-90B-Vision-Instruct-int4-sym-inc
Updated
22 days ago
•
81
OPEA/Qwen2.5-0.5B-Instruct-int4-sym-inc
Updated
5 days ago
•
29
OPEA/Qwen2.5-1.5B-Instruct-int4-sym-inc
Updated
5 days ago
•
16
OPEA/Qwen2.5-3B-Instruct-int4-sym-inc
Updated
5 days ago
•
23
OPEA/QwQ-32B-Preview-int4-sym-mixed-inc
Updated
24 days ago
•
10
•
8
Previous
1
2
3
4
Next