Li, He, Liu and colleagues characterize the dynamic bivalent chromatin landscape during mouse peri-implantation development. They find that factor ZBTB17 works with KDM6A/B to resolve transiently maintained bivalent domains and prime gene activation.