Various useful datasets with preference optimization
Nicholas Beerbower PRO
nbeerbower
AI & ML interests
QLoRA finetuning and merging LLMs for fun
Recent Activity
liked
a model
about 5 hours ago
Sao10K/32B-Qwen2.5-Kunou-v1
liked
a model
about 5 hours ago
Sao10K/70B-L3.3-Cirrus-x1
liked
a model
about 5 hours ago
Daemontatox/PathFinderAi3.0
Organizations
models
142
nbeerbower/mistral-nemo-narwhal-12B
Text Generation
•
Updated
•
28
•
1
nbeerbower/mistral-nemo-bophades3-12B
Text Generation
•
Updated
•
33
•
1
nbeerbower/Gigaberg-Mistral-Large-123B
Text Generation
•
Updated
•
27
•
1
nbeerbower/mistral-nemo-kartoffel-12B
Text Generation
•
Updated
•
36
•
1
nbeerbower/mistral-nemo-gutenberg3-12B
Text Generation
•
Updated
•
68
•
3
nbeerbower/llama-3-gutenberg-8B
Text Generation
•
Updated
•
107
•
8
nbeerbower/SmolNemo-12B-FFT-experimental
Text Generation
•
Updated
•
14
nbeerbower/Nemo-Loony-12B-experimental
Text Generation
•
Updated
•
15
nbeerbower/Mistral-Nemo-Moderne-12B-FFT-experimental
Text Generation
•
Updated
•
21
•
1
nbeerbower/Mistral-Gutenberg-Doppel-7B-FFT
Text Generation
•
Updated
•
45
•
2
datasets
8
nbeerbower/cover-images
Viewer
•
Updated
•
5
•
313
•
1
nbeerbower/reddit-dpo
Viewer
•
Updated
•
76.9k
•
33
•
1
nbeerbower/gutenberg-moderne-dpo
Viewer
•
Updated
•
346
•
71
•
2
nbeerbower/gutenberg2-dpo
Viewer
•
Updated
•
293
•
74
•
18
nbeerbower/Schule-DPO
Viewer
•
Updated
•
34
•
48
•
1
nbeerbower/Arkhaios-DPO
Viewer
•
Updated
•
222
•
80
•
8
nbeerbower/Purpura-DPO
Viewer
•
Updated
•
230
•
51
•
7
nbeerbower/bible-dpo
Viewer
•
Updated
•
31.1k
•
37