Specialized Search Pipes for Agents

Diving deeper into

Will Bryk, CEO of Exa, on building search for AI agents

Interview
What might have to happen is either you have a bunch of different types of tools that each individually search over their categories, or organizations partner with those data sources.
Analyzed 4 sources

Search for AI agents is likely to look more like a bundle of specialized pipes than one universal index. The reason is simple, the best data is increasingly locked inside separate systems, contracts, and formats. Open web search can cover a large base layer, but high value use cases in finance, law, medicine, people search, and regional search work better when the agent can call a purpose built tool or a partner feed that knows that domain deeply.

  • Large customers already route different query types differently. Ecosia sends only complex research style queries to Exa, keeps navigational or shopping queries on regular search, and built its stack so it can swap providers quickly. That is a practical sign that agent search is fragmenting by job, economics, and latency needs, not just by index quality.
  • The next layer of fragmentation is proprietary data access. Cohere described the real upgrade as dedicated knowledge bases for things like medical journals, filings, and legal sources, because open web results are often noisy remixes. Exa is already pushing in that direction with domain specific streams and products like Websets and Research.
  • This also explains why partnerships matter as much as crawling. Even when provider quality looks similar, contracts, support, data rights, and packaging decide who wins an integration. Ecosia avoided Google and Microsoft for AI overview use cases partly because contractual constraints made that path harder, then chose Exa on pricing, flexibility, and product fit over Parallel, Tavily, and Brave.

The market is heading toward a two layer stack. One layer will be broad search over the open web, fast and cheap enough to sit inside every agent. The other layer will be premium domain connectors and licensed datasets that make agents trustworthy for expensive workflows. Companies that combine both cleanly will become the default infrastructure for agent search.