Despite numerous studies on solid-state high-harmonic generation (HHG), there is a lack of microscopic understanding of decoherence effects. Here, the authors study experimentally and by real-time ab-initio simulations the wavelength dependence of HHG in monolayer films, promoting momentum-resolved electron-phonon scattering as the dominant many-body interaction causing ultrafast decoherence.