ai_security▌

← feed

NOTABLE

arXiv 2611.24362 shows high red-team attack rates do not translate into defender robustness, proposes PIPETTE purple-teaming

Two RL-based prompt-injection red teamers (RL-Hammer, PISmith) mode-collapse into repeatedly finding similar attacks, so adversarial training on their findings adds no robustness. PIPETTE pairs a dictionary-learning reward that broadens discovered attack coverage with an on-policy adversarial-training pipeline, reaching near-zero attack success on static attacks and standing up to strong adaptive attacks while keeping benign task utility near the undefended baseline (v1 Nov 18, first publication).

released 2026-11-19 · ingested 2026-11-19T12:30Z

Sources

Primary source

Cite this

APA

AI Security Index. (2026). arXiv 2611.24362 shows high red-team attack rates do not translate into defender robustness, proposes PIPETTE purple-teaming. AI Security Index. https://arxiv.org/abs/2611.24362

BibTeX

@misc{aisec-2026-11-19-arxiv-2611-24362-pipette-purple-teaming-prompt-injection,
  title  = {arXiv 2611.24362 shows high red-team attack rates do not translate into defender robustness, proposes PIPETTE purple-teaming},
  year   = {2026},
  howpublished = {\url{https://arxiv.org/abs/2611.24362}},
  note   = {AI Security Index item 2026-11-19-arxiv-2611-24362-pipette-purple-teaming-prompt-injection}
}