Netflix Live Origin Note

Netflix Live Origin

The Netflix Live Origin is a custom-built origin server that plays a crucial role in the company's live streaming pipeline, acting as a broker between the cloud live streaming pipelines and the distribution system, Open Connect. The Live Origin is a multi-tenant microservice operating on EC2 instances within the AWS cloud, using standard HTTP protocol features to communicate with the Live Origin. The architecture of the Live Origin is influenced by key technical decisions, including resilience achieved through redundant regional live streaming pipelines and the implementation of epoch locking at the cloud encoder. The Live Origin features multi-pipeline and multi-region awareness, allowing it to select the first valid segment from each pipeline in a deterministic order. The system also detects segment defects via lightweight media inspection at the packager and provides this information as metadata when the segment is published to the Live Origin. To optimize interactions with the Origin Server, the proxy-caching functionality of nginx has been extended to address Live-specific needs, including millisecond grain caching and the ability to hold open requests for segments that are not yet available. The Live Origin also provides streaming metadata enhancement through the use of HTTP headers, which can be used to convey notifications of events within the stream to client devices. The system includes an invalidation system that can be used to flush all content associated with an event, as well as an enhanced cache invalidation system that takes into account the encoding pipeline and region used to generate each segment. The Origin storage architecture was initially based on AWS S3 but was later optimized to meet the unique latency and workload requirements of live streaming, using a KeyValue Storage Abstraction that leverages Apache Cassandra to provide chunked storage of large values.
CdXz5zHNQW_BNFU9LegnF.png