Kubernetes Blog
Follow
Announcing the AI Gateway Working Group
The Kubernetes community is expanding with the formation of the AI Gateway Working Group, focusing on AI workload networking. An AI Gateway is network infrastructure using the Gateway API, enhancing it for AI workloads. This includes features like token-based rate limiting, access controls, and payload inspection. The working group aims to create standards and best practices for AI infrastructure in Kubernetes. Their goals include creating APIs, fostering collaboration, and ensuring extensibility for AI-specific gateway extensions. Active proposals address payload processing for security and optimization, as well as defining egress gateways. These proposals enable secure external AI service integration and advanced traffic management. The group addresses needs of platform operators, developers, and compliance engineers. The working group will present its findings at KubeCon + CloudNativeCon Europe 2026. The AI Gateway Working Group welcomes contributions from various stakeholders to shape the future of AI-aware gateway capabilities within Kubernetes. Interested individuals can review proposals, join meetings, and participate in discussions. The group operates under an open contribution model to develop standards for AI workload networking.