2605.29888v1 May 28, 2026 cs.LG

LaRA: Layer-wise Representation Analysis for Detecting Data Contamination in RL Post-Training

Alan Ritter
Alan Ritter
Citations: 9
h-index: 2
Minju Gwak
Minju Gwak
Yonsei University
Citations: 127
h-index: 3
Minseok Kwak
Minseok Kwak
Citations: 2
h-index: 1
Dongseok Lee
Dongseok Lee
Citations: 21
h-index: 2
Guijin Son
Guijin Son
Citations: 3
h-index: 1
Jaehyung Kim
Jaehyung Kim
Citations: 3
h-index: 1

Reinforcement learning (RL) post-training has shown to improve reasoning in large language models (LLMs). However, there has been little exploration on the problem of data contamination in RL post-training, potentially undermining generalization and evaluation reliability of the training process itself. Existing detection methods primarily rely on output-level signals such as likelihood or entropy, which become unreliable for RL-trained models since RL shapes behavior through trajectory-level rewards rather than token likelihoods. We propose LaRA, a layer-wise representation analysis framework for detecting contamination in RL post-trained LLMs. LaRA introduces three complementary metrics, measuring perturbation sensitivity, directional collapse, and local representation rigidity under controlled perturbations. We find that contamination produces progressive geometric deviations across layers, including amplified perturbation sensitivity, stronger directional collapse, and enhanced local rigidity. Based on our findings, we also develop a contamination detection protocol that aggregates representation-level deviations across layers and metrics. Experiments on RL-trained reasoning models show that our protocol outperforms existing output-level baselines for contamination detection.

0 Citations
0 Influential
1.5 Altmetric
7.5 Score
Original PDF

No Analysis Report Yet

This paper hasn't been analyzed by Gemini yet.

Log in to request an AI analysis.

댓글

댓글을 작성하려면 로그인하세요.

아직 댓글이 없습니다. 첫 번째 댓글을 남겨보세요!