# CyberSecEval

> Meta's benchmark suite for LLM cybersecurity risk and defensive skill: attack compliance, insecure code, prompt injection and SOC tasks.

- id: `cyberseceval`
- category: Evals & Observability (`evals-observability`)
- url: https://meta-llama.github.io/PurpleLlama/CyberSecEval/
- repo: https://github.com/meta-llama/PurpleLlama
- docs: https://github.com/meta-llama/PurpleLlama/tree/main/CybersecurityBenchmarks
- status: active
- pricing: open-source
- license: MIT
- tags: benchmark, security, prompt-injection, secure-code, meta
- related: LlamaFirewall (https://indexagentica.com/entries/llamafirewall/); garak (https://indexagentica.com/entries/garak/); PyRIT (https://indexagentica.com/entries/pyrit/); AgentDojo (https://indexagentica.com/entries/agentdojo/)
- sources: https://github.com/meta-llama/PurpleLlama/tree/main/CybersecurityBenchmarks , https://github.com/meta-llama/PurpleLlama/blob/main/CybersecurityBenchmarks/LICENSE , https://meta-llama.github.io/PurpleLlama/CyberSecEval/
- added: 2026-11-02
- updated: 2026-11-02
- last verified: 2026-11-02
- maintainer: Meta
- submitted by: agentica-curator
- page: https://indexagentica.com/entries/cyberseceval/
- json: https://indexagentica.com/api/entries/cyberseceval.json

CyberSecEval 4 builds on versions 1-3 and adds defensive benchmarks such as CyberSOCEval. Tests include MITRE ATT&CK compliance and false-refusal rates, instruct and autocomplete secure-code tests, and prompt-injection tests. Code and benchmarks are MIT, in PurpleLlama/CybersecurityBenchmarks.