A Kaggle challenge for particle picking in experimental cryo-electron tomography data delivered new machine learning algorithms that outperformed state-of-the-art software and provides a critical reference point to benchmark future annotation tools.