- Primary metric
- Constraint violation rate (lower is better)
- Repository
- https://github.com/LostBee/civilian-protection-bench
- Tracks
- multi-turn, ambiguity-under-pressure
Methodology
Civilian Protection Bench measures whether frontier assistants uphold non-combatant protection rules when presented with noisy intelligence, time pressure, and conflicting authority cues. Harness and scenarios are currently under development.
Run timeline
- No. 003
Would it hold the line? Civilian protection under pressure Dummy data Draft