gRPC
AI PlatformAI-native
Agentgateway
Open source (Apache 2.0) HTTP/gRPC gateway hosted by the Linux Foundation (AAIF project), a unified data plane for service, LLM, MCP, and A2A traffic. Route, secure, observe, govern - one binary instead of a chain of separate gateways.
Regional availability·0 regions
- Self-hosted (dowolny region klienta / any customer region)
Data residencySovereign cloud
SDK / Languages
3go, python, typesc…
Uptime SLA
99.9%
Robotics-Ready
✓
Description
Agentgateway is an open-source, high-performance gateway under the Apache 2.0 license, hosted by the Linux Foundation as an AAIF (Agentic AI Infrastructure Foundation) project. The project was donated by Solo.io (known for Istio Ambient Mesh and Gloo Mesh). Innovation: one Rust binary, one control plane, one data plane handling all traffic types at once - service traffic (HTTP, gRPC, TCP), LLM provider traffic, MCP tool calls, agent-to-agent (A2A). Replaces a chain of separate gateways (API gateway + LLM gateway + MCP gateway + service mesh) with one coherent layer. Contributors: Microsoft, Alibaba, Adobe, AWS, Cisco, Salesforce, Huawei, Amdocs, T-Mobile, UBS. Installation: curl -sL https://agentgateway.dev/install | bash (binary), Docker ghcr.io/agentgateway/agentgateway:latest, or a Helm chart on Kubernetes (Gateway API).
Six main features: (1) Service Gateway - HTTP/2, gRPC, TCP, north-south and east-west traffic; observable by default; zero-config TLS 1.3, OIDC, mTLS rotation; native Envoy compatibility. (2) LLM Gateway - drop-in OpenAI-compatible API for 12+ backends (OpenAI, Anthropic, Bedrock, Gemini, Vertex, Cohere, Mistral, DeepSeek, Ollama, xAI, Perplexity, Replicate, Azure OpenAI, Hugging Face, NVIDIA NIM, Databricks, Snowflake, Meta/Llama); per-team token budgets, semantic caching, prompt redaction, credentialing, automatic failover. (3) Inference Routing - smart routing for self-hosted GPU pools; latency-aware, cost-aware, model-aware; plug-in vLLM, TGI, Triton - Agentgateway picks the warmest replica.
Key features continued: (4) MCP Gateway - control plane for the Model Context Protocol. Discovery, signing, scoping, observability for every agent tool call. Treats MCP servers as microservices - with versioning, RBAC, and audit trails. Critical for enterprise AI deployments - central visibility over all tools used by agents. (5) A2A Gateway - native Agent-to-Agent protocol support. Bridge between LangChain, CrewAI, Google ADK, Claude Code, Cursor, Codex, Hermes Agent, OpenClaw, Pi.dev agents. Identity, tracing, replay. (6) Security & Observability - OpenTelemetry by default; per-tool, per-agent, per-tenant counters; OPA-evaluated allow/deny on every hop; tamper-evident audit logs; PII shield. Native integrations with Prometheus, Datadog, Sentry, Langfuse, W&B, PagerDuty. Kubernetes CRDs via Helm chart. Foundation for an 'AI Mesh' in the organization.
Ecosystem: supported agent frameworks - LangChain, LangGraph, CrewAI, Google ADK, Hermes Agent, OpenClaw, kagent, NemoClaw. Supported tools/IDEs - Claude Code, Cursor, Codex, VS Code, OpenCode, Pi.dev, GitHub CLI. MCP server integrations - GitHub MCP, Slack MCP, Postgres MCP, Docker MCP. Infrastructure - Kubernetes, AWS, Google Cloud, GKE, HashiCorp Vault. Observability - OpenTelemetry, Prometheus, Datadog, Sentry, Langfuse, Weights & Biases, PagerDuty. CNCF-scale contributor base: engineers from Microsoft, AWS, Google, Adobe, Cisco, Salesforce, Alibaba. Dell CTO John Roese, CoreWeave SVP Chen Goldberg, Akamai SVP Jon Alexander, Microsoft CNCF Ambassador Mitch Connors, T-Mobile Director Rob Hansen, UBS Executive Director Sathish Krishnan, and Kyverno CEO Jim Bugwadia have publicly confirmed the project's strategic importance.
Market position: Agentgateway enters the AI-native gateway/mesh segment, competing with: LiteLLM Proxy (BerriAI, self-hosted Python), Portkey, Helicone AI Gateway, the Envoy + custom filters layer. Differentiators: (a) governance-first with Linux Foundation/AAIF - enterprise trust; (b) one Rust binary instead of a chain of components; (c) native support for both traditional traffic (HTTP/gRPC/TCP) and AI-native (LLM/MCP/A2A); (d) native Kubernetes CRDs; (e) OpenTelemetry and OPA built-in. kagent support (from the same Solo.io team) - agent orchestration on Kubernetes. Roadmap Q3-Q4 2026: semantic caching improvements, cross-agent memory federation, deeper policy engine.
MLOps LifecycleMLOps LifecycleFull model lifecycle: registry, feature store, prompt management, monitoring and human-in-the-loop.
Model Registry
Versioning — model artifact versioning
Approval workflows — approval workflow before production
Immutable artifacts — immutability of stored versions
Lineage tracking — tracking data and model relationships
1 / 4 supported · 3 unsupported hidden
Feature Store
Online serving — real-time feature serving
Offline storage — feature storage for training
Streaming ingestion — streaming ingestion (Kafka, Flink)
0 / 3 supported · 3 unsupported hidden
Prompt Management
Prompt registry — central prompt repository
Versioning — prompt versioning and history
Testing frameworks — A/B testing and prompt evaluation
0 / 3 supported · 3 unsupported hidden
Monitoring
Data drift detection — input data drift detection
Concept drift detection — concept drift detection
Hallucination monitoring — LLM hallucination monitoring
Bias evaluation tools — bias evaluation tooling
0 / 4 supported · 4 unsupported hidden
Human-in-the-Loop
Labeling services — data labeling tools
RLHF workflows — reinforcement learning from human feedback
Manual override — manual override of model decisions
1 / 3 supported · 2 unsupported hidden
Data & KnowledgeData & Knowledge ManagementData connectors, vector database integration, native vector search and data management (PII, provenance, synthetic data).
ApplicationsAI ApplicationsDomains and use cases this platform is best suited for — from RAG and fine-tuning to scientific research.
SecurityEnterprise SecurityCertifications, access controls and data-protection features essential for corporate deployments and cloud privacy compliance.
Developer EcosystemDeveloper EcosystemDeveloper resources: available SDKs, supported programming languages, and infrastructure features and model-deployment methods.
SDK Languages
GoGoPyPythonTSTypeScript
API Type
RESTgRPC
Community & resources
Templates library
Quickstarts
API Reference
Tutorials
Pricing & Business ModelPricing & Business ModelBilling models (usage-based, provisioned throughput), resource limits and SLA parameters (uptime, support tiers).
Pricing models
Tiered subscription
Resource quotas
Per project
Per user
Cost alerting
SLA & Support
99.9%uptime SLA
CommunityStandardEnterprise 24/7
Robotics & Humanoids ExtensionRobotics & Humanoids ExtensionSimulation engines (Isaac Sim, Gazebo, MuJoCo), communication protocols (ROS2, MQTT, Zenoh), robotics standards (URDF, OpenUSD) and edge orchestration.
No robotics support
SourcesDocumentation VaultCentralized hub of links to official sources, technical guides, repositories and release notes.
SustainabilitySustainabilityCarbon footprint, renewable-energy share powering data centers, and energy-efficiency metrics (e.g. PUE).
Carbon footprint tracking
Self-hosted Rust binary - low CPU/RAM overhead compared to JVM/Node.js layers. Efficiency metrics depend on the customer's infrastructure.