quantized versions?

#2
by cameronbergh - opened

I am wondering if it will be possible to convert this to GGUF for inference?

Chester111 changed discussion status to closed

Sign up or log in to comment