Netflix TechBlog | Medium
Follow
A Recap of the Data Engineering Open Forum at Netflix
The Data Engineering Open Forum at Netflix in 2024 brought together experts to share insights and solutions for data engineering challenges. Max Schmeiser highlighted the importance of data engineering in data-driven decision-making. Stephanie Vezich Tamayo and Binbing Hou presented an ML-powered auto remediation system for job failures on Netflix's data platform. Jide Ogunjobi discussed using generative AI for enterprise data modeling and architecture. Tulika Bhatt shared how Netflix manages 18 billion impressions daily for real-time adaptive recommendations. Jessica Larson discussed considerations for data platform creation in the post-GDPR era. Jason Reid explored the pros and cons of data warehouse bundling and unbundling. Clark Wright shared Airbnb's approach to data quality through their Data Quality Score. Iaroslav Zeigerman highlighted the benefits of SQLMesh for data pipeline management. The event was organized by Chris Colburn, Xinran Waibel, Jai Balani, Rashmi Shamprasad, and Patricia Ho.