For inference. CPU is enough for both quantization and inference.
-
QuantFactory/OpenCoder-8B-Instruct-GGUF
Text Generation • Updated • 146 • 6 -
QuantFactory/OpenCoder-8B-Base-GGUF
Text Generation • Updated • 88 • 3 -
bartowski/starcoder2-15b-instruct-GGUF
Text Generation • Updated • 463 • 2 -
QuantFactory/starcoder2-15b-GGUF
Text Generation • Updated • 142 • 2