Zhenggang/MV-DUSt3R
Image-to-3D
•
Updated
•
6
Fernando Molina
TheFernandoM
·
AI & ML interests
None yet
Recent Activity
liked
a model
about 16 hours ago
Zhenggang/MV-DUSt3R
liked
a model
about 17 hours ago
MAmmoTH-VL/MAmmoTH-VL-8B-SI
liked
a dataset
about 17 hours ago
MAmmoTH-VL/MAmmoTH-VL-Instruct-12M
Organizations
TheFernandoM's activity
liked
a
model
about 16 hours ago
liked
a
model
about 17 hours ago
liked
a
dataset
about 17 hours ago
reacted to
Jaward's
post with 👀
about 18 hours ago
Post
1186
minimal single script implementation of knowledge distillation in LLMs. In this implementation, we use GPT-2 (124M) as student model and GPT-2 Medium (340M) as teacher via reverse Kullback-Leibler (KL) divergence, trained on a small chunk of openwebtext.
Code: https://github.com/Jaykef/ai-algorithms/blob/main/llm_knowledge_distillation.ipynb
Code: https://github.com/Jaykef/ai-algorithms/blob/main/llm_knowledge_distillation.ipynb
liked
a
model
about 21 hours ago
liked
a
dataset
about 21 hours ago
liked
a
Space
about 21 hours ago
liked
a
dataset
about 21 hours ago
liked
2
models
about 21 hours ago
upvoted
a
collection
about 22 hours ago
liked
a
model
about 22 hours ago
liked
a
dataset
about 22 hours ago
liked
a
model
about 22 hours ago
upvoted
a
collection
about 22 hours ago
liked
a
dataset
about 22 hours ago
liked
a
model
about 22 hours ago
liked
a
model
about 23 hours ago
liked
2
models
1 day ago
