2605.28721v1 May 27, 2026 cs.AI

LiveBrowseComp: Are Search Agents Searching, or Just Verifying What They Already Know?

Qianyue Wang
Qianyue Wang
Citations: 53
h-index: 4
Zheng Chu
Zheng Chu
Citations: 476
h-index: 8
Huiming Fan
Huiming Fan
Citations: 33
h-index: 3
Bing Qin
Bing Qin
Citations: 682
h-index: 12
Ming Liu
Ming Liu
Citations: 627
h-index: 12
Zhuo Wang
Zhuo Wang
Citations: 18
h-index: 3
Xiao Wang
Xiao Wang
Citations: 9
h-index: 2
Xingyu
Xingyu
Citations: 150
h-index: 4

Are LLM-based search agents genuinely searching, or using the web to verify what they already know? We study this question on BrowseComp with three diagnostics. Our analysis reveals Intrinsic Knowledge Dependence (IKD): even with tool access, agents often rely on intrinsic knowledge -- information encoded in the model before retrieval -- rather than on external evidence. Agents answer up to 44.5% of BrowseComp questions without tools, generate more than half of their search queries from internally produced hypotheses rather than retrieved leads, and perform worse than closed-book baselines when answer-supporting evidence is removed. These results suggest that static search benchmarks can reward memory-backed verification rather than evidence-driven discovery, conflating what agents already know with what they can find. We then introduce LiveBrowseComp, a deep-search benchmark designed to evaluate agents beyond intrinsic coverage. It contains 335 human-authored questions whose answers depend on facts published within the 90 days preceding benchmark construction, drawn from six updated sources and filtered to exclude globally salient events. On LiveBrowseComp, all evaluated agents fall below 2% closed-book accuracy, search-augmented scores drop by 25-40 points relative to BrowseComp, and prior model rankings no longer reliably predict performance. LiveBrowseComp is available at https://huggingface.co/datasets/Forival/LiveBrowseComp.

0 Citations
0 Influential
26 Altmetric
130.0 Score
Original PDF
0

No Analysis Report Yet

This paper hasn't been analyzed by Gemini yet.

Log in to request an AI analysis.

댓글

댓글을 작성하려면 로그인하세요.

아직 댓글이 없습니다. 첫 번째 댓글을 남겨보세요!