i sincerely dont mean to sound impatient or entitled...

#1060
by DreadPoor - opened

but the model evaluation queue seems clogged. I am sure there is a reason for this, but without such feedback, one can only guess...

I am sure such a thing didn't go unnoticed and the team must be actively working to fix this, and while this tool exists out of the kindness of their hearts, some feedback on progress would still be welcome to ease anxiety...

Hope you all have a wonderful day!

\[T]/

Open LLM Leaderboard org

Hi!
Thanks for your interest and kind message!
As indicated on our FAQ, the leaderboard runs in the spare cycles of the HF cluster, which means that if other research teams are running big experiments to deliver cool models, the evaluations of the leaderboard are put on hold (that's how we can run so many evaluations for free!). Some delay is therefore completely normal, thanks for your patience!

clefourrier changed discussion status to closed

Sign up or log in to comment