← feed
NOTABLE
arXiv 2611.24362 shows high red-team attack rates do not translate into defender robustness, proposes PIPETTE purple-teaming
Two RL-based prompt-injection red teamers (RL-Hammer, PISmith) mode-collapse into repeatedly finding similar attacks, so adversarial training on their findings adds no robustness. PIPETTE pairs a dictionary-learning reward that broadens discovered attack coverage with an on-policy adversarial-training pipeline, reaching near-zero attack success on static attacks and standing up to strong adaptive attacks while keeping benign task utility near the undefended baseline (v1 Nov 18, first publication).
released 2026-11-19 · ingested 2026-11-19T12:30Z
Sources
Primary source
Cite this
APA
AI Security Index. (2026). arXiv 2611.24362 shows high red-team attack rates do not translate into defender robustness, proposes PIPETTE purple-teaming. AI Security Index. https://arxiv.org/abs/2611.24362
BibTeX
@misc{aisec-2026-11-19-arxiv-2611-24362-pipette-purple-teaming-prompt-injection,
title = {arXiv 2611.24362 shows high red-team attack rates do not translate into defender robustness, proposes PIPETTE purple-teaming},
year = {2026},
howpublished = {\url{https://arxiv.org/abs/2611.24362}},
note = {AI Security Index item 2026-11-19-arxiv-2611-24362-pipette-purple-teaming-prompt-injection}
}