500X Scalability of Experiment... Note

500X Scalability of Experiment Metric Computing with Unified Dynamic Framework

Pinterest's experimentation platform, Helium, runs daily experiments generating insights for product decisions and business strategies. However, as the scale of experimentation grew, challenges arose, including delays in upstream data ingestion, difficulties in backfilling skipped metrics, and frequent scalability issues. To address these challenges, Pinterest developed the Unified Dynamic Framework (UDF), a scalable and resilient solution that has transformed how experiment metrics are computed. UDF supports 100X more metrics and is designed to scale to 500X in the future, accelerating metric delivery and reducing engineering effort from months to days. The framework achieves standardization of metric processing, offloading infrastructure challenges and pipeline creation complexities. UDF addresses upstream dependencies, backfill complexity, and scalability issues, enabling faster experimentation and innovation. The framework has improved developer velocity, flexibility, scalability, speed, and reliability, driving innovation and business outcomes. The standardization of metric computing across the experimentation platform has led to immense improvements, empowering experimentation and delivering value to users. The UDF has revolutionized experiment metric computing at Pinterest, and its impact will continue to grow in the future.
CdXz5zHNQW_HsQvhLZ0Fu.png