RNA polymerase II drives gene transcription through dynamic chromatin interactions. Here, the authors use single-molecule imaging to show that most binding events are short-lived, with rare productive events, and identify TAF1 as a regulator promoting pause release and elongation.