2605.29442v1 May 28, 2026 cs.SE

How Coding Agents Fail Their Users: A Large-Scale Analysis of Developer-Agent Misalignment in 20,574 Real-World Sessions

Ningzhi Tang
Ningzhi Tang
Citations: 189
h-index: 7
Gelei Xu
Gelei Xu
Citations: 68
h-index: 4
Yiyu Shi
Yiyu Shi
Citations: 67
h-index: 4
Collin McMillan
Collin McMillan
Citations: 156
h-index: 7
Tao Dong
Tao Dong
Citations: 8
h-index: 1
T. Li
T. Li
Citations: 279
h-index: 8
Chaoran Chen
Chaoran Chen
Citations: 237
h-index: 8
Yu Huang
Yu Huang
Citations: 74
h-index: 5

AI coding agents increasingly act directly within software environments, yet existing analyses of their failures rely on benchmark trajectories that miss how developers actually experience misalignment. We present an observational study of 20,574 coding-agent sessions from 1,639 repositories across IDE and CLI workflows. We operationalize misalignment as a breakdown made visible through developer pushback, and annotate each episode along four axes: form, cause, cost, and resolution. We identify seven recurring forms, spanning how agents read projects, interpret developer intent, follow rules, bound their actions, implement and execute code, and report progress. 90.50\% of episodes impose effort and trust costs rather than irreversible system damage, yet 91.49\% of visible resolutions still require explicit user correction. Misalignment patterns also differ across IDE and CLI settings, persist across adjacent sessions, and shift over time: while overall rates decline, constraint violations and inaccurate self-reporting grow in share. Our findings inform the design of training, evaluation, and interfaces for keeping coding agents aligned with real developer workflows.

0 Citations
0 Influential
4 Altmetric
20.0 Score
Original PDF

No Analysis Report Yet

This paper hasn't been analyzed by Gemini yet.

Log in to request an AI analysis.

댓글

댓글을 작성하려면 로그인하세요.

아직 댓글이 없습니다. 첫 번째 댓글을 남겨보세요!