Delivering Faster Analytics at... Note

Delivering Faster Analytics at Pinterest

Pinterest migrated its real-time analytics data to StarRocks to meet increasing scale and requirements. StarRocks provides standard SQL support, joins, and native ingestion, eliminating external dependencies. The migration to StarRocks resulted in a 50% reduction in p90 latency and a 3-fold increase in cost-performance efficiency. The data ingestion process was streamlined, achieving a data freshness of just 10 seconds. StarRocks' MySQL compatibility simplified integration with existing tools. The challenges of Partner Insights, a real-time analytics tool for advertisers, include high-volume and complex queries. The internal architecture of Partner Insights using StarRocks includes frontend and backend nodes, as well as Archmage, a Pinterest service that simplifies deployment and operations. Archmage uses connection pooling to minimize JDBC connection setup time. Future optimizations include leveraging query cache and materialized views to further enhance performance. Pinterest is exploring opportunities to collaborate with the StarRocks community to contribute to the project's growth and evolution.