Gemma 2 2B Neogenesis ITA
Chat with an Italian Small Model
Datasets and models for Neogenesis: Post-training recipe for improving Gemma 2 for a specific language. Notebook: https://t.ly/iuKdy
Chat with an Italian Small Model
Note Try the 2B model!
Note Final 2B model: SFT + DPO starting from gemma-2-2b-it
Note 9B model: DPO starting from SauerkrautLM-gemma-2-9b-it
Note Intermediate 2B model: SFT starting from gemma-2-2b-it
Note Static GGUF quants
Note Weighted/imatrix quants
Note Initial dataset to translate
Note Italian SFT dataset, obtained from FineTome-single-turn-dedup with LLM-aided translation
Note Italian Preference dataset, obtained by reranking efederici/evol-dpo-ita
Note On-policy data generated with gemma-2-2b-ita-sft and evaluated with Llama-3.3-70B-Instruct to do DPO