Hugging Face's logo
rasgaard's picture
4 16

rasgaard

rasgaard
davanstrien's profile picture 21world's profile picture jfcalvo's profile picture
·

AI & ML interests

None yet

Recent Activity

reacted to davanstrien's post with 🤗 1 day ago
Introducing scandi-fine-web-cleaner https://huggingface.co/davanstrien/scandi-fine-web-cleaner, the first model trained on FineWeb-C community annotations! FineWeb2 is a massive multilingual dataset for pre-training language models. Like any web-scale dataset, it contains low-quality content. How can we improve it? Over the past months, an amazing community of 400+ annotators has been labelling content quality (using Argilla) across 23 languages through the FineWeb-C initiative. Today, I'm happy to share the first classifier trained on this data. 🔍 What we've built: - A lightweight classifier that efficiently removes low-quality content - 90%+ precision demonstrated on Danish & Swedish - Can process the 43M+ documents in Danish FineWeb2 with minimal compute 🌍 Why this matters: The approach can be reproduced for any of the 23 languages in FineWeb-C (https://huggingface.co/datasets/data-is-better-together/fineweb-c). We can improve training data quality at scale without massive compute resources by starting with community annotations and training small, efficient classifiers. Want to build a classifier for your language? Check out the full blog post with code examples and implementation details: https://danielvanstrien.xyz/posts/2025/FineWeb-c/scandinavian-content-filtering-fineweb.html
upvoted a collection about 1 month ago
Danish Text Datasets
liked a dataset about 1 month ago
HuggingFaceFW/fineweb-2
View all activity

Organizations

Hugging Face Discord Community's profile picture

Papers 1