The Envoy agentic stack: Routing models, tokens, and MCP
At Google Cloud, we believe the next generation of AI and agentic systems must be built on open, battle-tested foundations. Envoy, an open-source edge and service proxy designed for cloud-native applications, has already transformed microservices and modern cloud networking, powering everything from Google Cloud’s Application Load Balancers to the Agent Substrate dataplane on Google Kubernetes Engine. Now, Envoy is uniquely positioned to become the open standard for AI traffic, MCP tooling, and agent-to-agent communication.
Earlier this year, we presented the technical case for Envoy networking in the agentic AI era, examining how autonomous AI agents fundamentally challenge traditional Layer 7 networking assumptions. Unlike microservices, autonomous agent workloads choose who they communicate with. In addition, their routing attributes live deep within request bodies, with their traffic governed by token budgets as well as request rates, and their multi-turn reasoning loops requiring stateful session affinity and strict tool execution boundaries.
At...
Copyright of this story solely belongs to cloud.google.com. To see the full text click HERE