The advantages of training foundation models for single-cell datasets on large (tens of millions of cells) datasets have not been systematically tested. We evaluated the role of the size and diversity of the training dataset in the performance of single-cell foundation models and found little gain in increasing dataset size beyond a set point.