Authors present a method for providing fast and robust drift correction in single molecule localization microscopy, by pairing the nearest molecules in data segments and calculating their displacements within a small search radius.