ai_security▌

← feed

NOTABLE

arXiv: sandbagging detectors tested against fixed attacks lose to adaptive ones

Sandbagging — scoring low on evals on purpose — turns a low benchmark score into false reassurance. The authors build sandbaggers (small open models that fail GSM8K only under an audit marker) and show detectors usually validated once against a fixed attack degrade once the model adapts to what gets flagged.

released 2026-11-11 · ingested 2026-11-13T12:20Z

Sources

Primary source

Cite this

APA

AI Security Index. (2026). arXiv: sandbagging detectors tested against fixed attacks lose to adaptive ones. AI Security Index. https://arxiv.org/abs/2611.14950

BibTeX

@misc{aisec-2026-11-13-arxiv-2611-14950-sandbagging-detection-adaptive-attack,
  title  = {arXiv: sandbagging detectors tested against fixed attacks lose to adaptive ones},
  year   = {2026},
  howpublished = {\url{https://arxiv.org/abs/2611.14950}},
  note   = {AI Security Index item 2026-11-13-arxiv-2611-14950-sandbagging-detection-adaptive-attack}
}