In this Perspective, Vogg et al. discuss the progress and challenges of using computer vision approaches in the behavioral analysis of primates in their natural environment.