Different Markets for AI Gateways
Augusto Marietti, CEO of Kong, on the end of tokenmaxxing
This split matters because these products sell to different buyers for different jobs, even when they all sit between an app and a model. OpenRouter is a developer marketplace for shopping tokens across providers. Cloudflare and Vercel are developer platform features that simplify access and billing inside app stacks. Kong is an internal control layer for large companies that need routing, security, and policy enforcement on employee and application LLM traffic.
-
OpenRouter behaves like a broker. Developers send prompts through one endpoint, compare providers, and let the service route to the cheapest or fastest option. The business model is a take rate on usage, and the product wins when teams care most about price arbitrage and broad model coverage.
-
Public gateways from Vercel and Cloudflare are closer to developer convenience infrastructure. They let a startup use many models with one API layer, and in Cloudflare's case unified billing can remove the need to pass provider keys. This is a natural add on for teams already deploying apps on those platforms.
-
Enterprise gateways like Kong are bought by platform and security teams, not just app developers. The product sits inside existing API infrastructure, applies authentication and policy controls, watches usage across departments, and routes prompts to lower cost models before token spend balloons across thousands of employees and internal tools.
Going forward, the category name will matter less than the control point each company owns. OpenRouter is pushing deeper into model commerce. Cloudflare and Vercel will bundle gateway features into broader developer clouds. Kong is positioned to become the policy and traffic layer for enterprise AI, where cost control and governance become recurring operational needs.