HackerNoon
Follow
We Used Benchmaxxers' Favourite Trick to Climb 10 Places on the Hugging Face Open ASR Leaderboard
There is a well-known trick for climbing ASR leaderboards: fine-tune on data that closely resembles a testset, submit, watch your rank improve. We did exactly that with AMI, the one testset that consistently separates serious models from optimised ones. We went from rank 26 to rank 16. Here is what actually happened, what broke along the way, and what it means for how you read anyone's leaderboard score.