AI Research in Security Operations

BlueBench-Simulation-003: Three simulated end-of-intrusion investigations (ransomware impact, backup sabotage, and data exfiltration) scored against complete hidden ground truth

BlueBench-Simulation-002: Four simulated Windows identity-tier attacks (password spray, domain persistence, credential-attack detection, and a hands-on-keyboard operator) scored against complete hidden ground truth

BlueBench-Simulation-001: Five simulated investigations covering a mail-borne endpoint compromise, a DMZ webshell, and DGA botnet beaconing, scored against complete hidden ground truth

BlueBench-Intrusion-003: Real AWS intrusion through leaked CI credentials, scored on open-ended incident response reporting

BlueBench-Intrusion-002: Real multi-host Windows Active Directory intrusion spanning detection engineering, malware analysis, and open-ended incident reporting

BlueBench-Intrusion-001: Real macOS infostealer intrusion spanning incident response, threat hunting, and detection engineering

Real CTF challenges from CSAW competitions covering reverse engineering, forensics, and miscellaneous problem-solving

Defensive security CTF challenges testing forensics, reverse engineering, and miscellaneous security skills

Blue team CTF scenarios testing incident response and threat hunting

Multi-label classification of MITRE ATT&CK tactics and techniques from Sigma rules

Multiple-choice cybersecurity knowledge evaluation across 10,000 questions