← feed
NOTABLE
arXiv: sandbagging detectors tested against fixed attacks lose to adaptive ones
Sandbagging — scoring low on evals on purpose — turns a low benchmark score into false reassurance. The authors build sandbaggers (small open models that fail GSM8K only under an audit marker) and show detectors usually validated once against a fixed attack degrade once the model adapts to what gets flagged.
released 2026-11-11 · ingested 2026-11-13T12:20Z
Sources
Primary source
Cite this
APA
AI Security Index. (2026). arXiv: sandbagging detectors tested against fixed attacks lose to adaptive ones. AI Security Index. https://arxiv.org/abs/2611.14950
BibTeX
@misc{aisec-2026-11-13-arxiv-2611-14950-sandbagging-detection-adaptive-attack,
title = {arXiv: sandbagging detectors tested against fixed attacks lose to adaptive ones},
year = {2026},
howpublished = {\url{https://arxiv.org/abs/2611.14950}},
note = {AI Security Index item 2026-11-13-arxiv-2611-14950-sandbagging-detection-adaptive-attack}
}