Kubernetes v1.34: Snapshottabl... Note

Kubernetes v1.34: Snapshottable API server cache

Kubernetes has significantly improved API server stability and performance by addressing issues with list requests. A major advancement is the snapshottable API server cache, now in Beta in v1.34, allowing most read requests to be served directly from the API server's memory. This feature builds upon previous enhancements like consistent reads from the watch cache, introduced in v1.31, which enabled filtered collections to bypass etcd. In v1.33, streaming encoders were added to handle large responses efficiently by sending items individually, preventing memory spikes. The snapshottable cache addresses the final gap by enabling historical LIST requests, commonly used for pagination, to also be served from the cache. It works by creating lightweight, memory-efficient snapshots of the cache's state for each update. When a historical request arrives, the API server retrieves the relevant snapshot and serves the data directly from memory. This synergy of features drastically reduces memory pressure on the API server and the load on etcd. Consequently, Kubernetes control planes are now more stable, scalable, and reliable. The SnapshottableCache feature is enabled by default in Kubernetes v1.34, requiring no user action to benefit from these improvements.