DeepTeam
Open-source framework from Confident AI to red team LLMs and AI agents.
Tags
Description
Built by Confident AI (DeepEval). PyPI deepteam 1.0.10, Python >=3.9,<3.14. Collects telemetry by default; opt out with DEEPTEAM_TELEMETRY_OPT_OUT=YES.
Related
- DeepEval: Open-source LLM evaluation framework with 50+ plug-and-play metrics for agents, RAG and chatbots.
- Promptfoo: Open-source tool to test and red-team prompts, agents and RAG: automated evals, vulnerability scanning and model comparison.
- garak: NVIDIA's open-source LLM vulnerability scanner probing for hallucination, data leakage, prompt injection, jailbreaks, toxicity and other weaknesses.
- PyRIT: Microsoft's open-source Python Risk Identification Tool for proactively red teaming generative AI systems.
Guides & comparisons
- Test a tool-using agent for prompt injection with AgentDojo (Guide): Measure how often injected tool outputs hijack your agent. Run AgentDojo's built-in suites from the CLI, wire your own model or agent loop in as a pipeline, read utility, utility under attack and targeted attack success, then compare defenses.
- Open-source red-teaming tools for LLM apps and agents (Comparison): Promptfoo, DeepTeam and Giskard compared as red-teaming tools for LLM apps and agents. Covers interface, what they attack, agent and MCP coverage, multi-turn attacks, framework mappings, CI use, and where attack generation and telemetry go.
Sources
- https://github.com/confident-ai/deepteam
- https://pypi.org/project/deepteam/
- https://www.trydeepteam.com/docs/data-privacy
- https://github.com/confident-ai/deepteam/blob/main/deepteam/telemetry.py
Machine-readable
- JSON
- Markdown
- Source file on GitHub (edit via pull request)