Understanding loss mechanisms in nanomechanical resonators has enabled ultracoherent devices with improved sensitivity. Now these resonators are found to be sensitive to non-contact friction from nearby materials, thus limiting mechanical coherence.