Perplexity Dominates New AI Search Benchmarks, But the Real Winner Is Search Budget
Perplexity has emerged as the top-performing AI search engine in the first comprehensive benchmark comparing how different models and search backends handle real-world research tasks. In tests published August 14, 2026, Perplexity paired with Anthropic's Claude Opus 5 model won on three of four evaluation sets, including hard-to-locate facts, exhaustive list retrieval, and expert-level questions. However, the benchmark's most surprising finding has nothing to do with which engine won: it's that the number of search attempts an AI agent is allowed to make matters far more than the choice of engine itself.
Which AI Search Engine Actually Performs Best?
OpenRouter, a platform that lets developers mix and match AI models with different search backends, tested four models across four different search engines and published the results as a public leaderboard. The engines tested were Exa, Parallel, Perplexity, and each model's built-in native search. Perplexity consistently ranked at or near the top across multiple benchmarks, but the data reveals a more nuanced picture than a simple winner-takes-all ranking.
The benchmark included four different evaluation sets, each designed to catch different failure modes that AI agents encounter when searching the live web:
- BrowseComp: Tests an agent's ability to chase down hard-to-find facts through multiple dependent search steps; Perplexity plus Claude Opus 5 scored 89.0%.
- DeepSearchQA: Measures exhaustive retrieval for list-answer questions without padding with irrelevant filler; Perplexity plus Claude Opus 5 scored 76.5%.
- HLE (Humanity's Last Exam): Expert-level questions answered with live search; Perplexity plus Claude Opus 5 scored 77.4%.
- WideSearch: Filling an entire table with answer-item accuracy; Perplexity plus GPT-5.6 Sol scored 84.0%.
No single combination of model and engine swept all four benchmarks. This matters because it means the "best" AI search engine depends entirely on what task you're trying to accomplish. A leaderboard-topper on one workload is not automatically the right default for another.
Why Search Budget Beats Everything Else?
The most actionable finding from the benchmark may surprise teams building AI agents: increasing the number of search attempts an AI is allowed to make had a bigger impact on results than switching to a different model or engine. Going from a budget of one search attempt to 25 attempts roughly doubled scores on the BrowseComp benchmark, a larger effect than either model choice or engine choice produced independently.
This reorders the default engineering instinct. Most teams building AI search integrations spend their first design pass picking a provider and treat the search attempt limit as an afterthought, capped low to control costs. The benchmark data suggests that approach is backwards for quality-sensitive workloads: the search budget is the lever with the largest single effect, and it's the one most agent builders under-tune.
Model choice edges out engine choice when both are held constant. Swapping models moved scores by an average of 15 points, while swapping the search engine shifted scores by about 10 points on average. Interestingly, a lab's own native search is not automatically the best option. GPT-5.6 Sol's native search won roughly 50 percent of the time against third-party engines across the benchmarks, a coin flip rather than a clear advantage.
How to Optimize Your AI Search Stack for Quality and Cost
- Prioritize search budget first: Allocate more search attempts before optimizing model or engine choice; the search budget has the largest single effect on result quality.
- Match the engine to your specific task: Test which combination wins on benchmarks that resemble your actual workload rather than assuming one provider is universally best.
- Monitor failed search costs: Failed searches burn nearly double the search attempts of successful ones; a generous budget doesn't rescue a bad query strategy, it just makes failures more expensive.
- Consider cost-quality tradeoffs: Parallel plus DeepSeek V4 Flash achieved strong results at $0.091 per query on one benchmark, while Perplexity plus Claude Opus 5 led on quality at roughly 89 percent higher cost.
For teams tracking monthly AI agent spending, this finding is easy to miss in a token-cost spreadsheet: the marginal cost of a search-grounded agent is not dominated by tokens per call, but by how many calls a wrong turn generates before the budget runs out.
The Hidden Cost Trap: Failed Searches Are Expensive
On a 25-attempt budget for the BrowseComp benchmark, models averaged 10.3 searches when they got the answer right and 19.7 searches when they got it wrong. That's nearly double the search calls for failed attempts, and every one of those extra calls is billed. Two consequences follow directly: raising the search budget helps quality on the margin, but it also compounds the cost of failures you were already going to have. A generous budget doesn't rescue a bad query strategy; it just lets the agent search longer before giving up on the wrong path.
If you already expect a high failure rate on a given task type, such as ambiguous queries or sparse-coverage domains, cutting the search budget is a legitimate cost control, not just a quality tradeoff. You're mostly cutting the expensive failure tail, not the cheap successes.
What This Means for AI Search Adoption
The benchmark results arrive as AI answer engines continue to reshape how people research major decisions. A separate survey of 1,097 U.S. adults found that 77 percent use at least one AI answer engine, with nearly half using them to research expensive purchases or major life decisions. ChatGPT leads in both usage and trust, with 64 percent of respondents using it compared with 50 percent for Google Gemini. Among those who trust at least one AI platform, 59.9 percent named ChatGPT their most trusted for important life decisions, versus 20.3 percent for Gemini.
Trust in AI answer engines is rising. More than 53 percent of survey respondents said they trust AI answer engines more than they did one year ago, while fewer than 16 percent reported lower trust. Adoption increases with income: 92 percent of respondents in households earning $150,000 or more use AI answer engines, compared with 70 percent among households earning $50,000 to $74,999.
"More than ever before, consumers are now turning to AI answer engines to help them make decisions on what products they buy, what companies they hire, and what services they use. Brands that optimize their visibility in answer engines like ChatGPT and Google Gemini have a huge advantage over their competitors," said Mike Perez, founder of Hoverboard AI.
Mike Perez, Founder at Hoverboard AI
The survey also found that AI answer engine usage is spread across multiple platforms. Respondents used an average of 2.3 answer engines, underscoring the need for brands to understand their visibility across more than one model. For marketers and business owners, the findings point to a fragmented search journey in which traditional search, reviews, and AI-generated answers all influence consideration.
The practical takeaway for anyone building production AI search systems is clear: don't chase a single leaderboard number. Instead, pick the axis that matters for your product, whether that's quality, cost, or speed, then check which combination wins on that axis for a benchmark that resembles your actual workload. The data shows that no single combination of model and engine wins across all three dimensions simultaneously.
" }