AI governance tools, by the job they do
This field reference tracks AI governance point tools across six lifecycle stages: test, evaluate, monitor, attack, guard, and secure. It currently lists 8 evidence-gated tools across 4 active chapters, backed by 363 dated single-source facts that cleared deterministic and two-judge review.
The toolchain by lifecycle stage
- Test Ch. 01 · Evaluate
- Evaluate Ch. 01 · Evaluate
- Monitor Ch. 02 · Monitor
- Attack Ch. 03 · Red-team
- Guard Ch. 04 · Guard
- Secure Ch. 05 · Posture
Each stage links to the chapter covering point tools built for that job: test and evaluate (Ch. 01), monitor (Ch. 02), attack and red-team (Ch. 03), guard at runtime (Ch. 04), and secure posture (Ch. 05).
Tool index
| # | Tool | Stage | Licence | What it does | Evidence | Last fact |
|---|---|---|---|---|---|---|
| 01 | Azure AI Content Safety | Guard | Licence unknown | In 2023, TechCrunch reported that Azure AI Content Safety was a productized version of the safety system powering Microsoft's chatbot in Bing and GitHub's Copilot code-generating service. | ||
| 02 | Fiddler AI | Monitor | Licence unknown | Fiddler lists 100+ pre-defined metrics and support for custom metrics. | ||
| 03 | garak (NVIDIA) | Red-team | Licence unknown | AppSecSanta describes garak as NVIDIA’s open-source LLM vulnerability scanner with 50+ probe modules for prompt injection, jailbreaks, and hallucinations. | ||
| 04 | Lakera | Guard | Licence unknown | In 2025, Atomico reported that Lakera’s co-founders were David Haber, Matthias Kraft and Mateo Rojas-Carulla. | ||
| 05 | LangSmith | Evaluate | Licence unknown | DropAgentic identifies LangSmith Engine as a LangChain tool. | ||
| 06 | Mindgard | Red-team | Licence unknown | Mindgard's GitHub profile describes it as a provider of AI red teaming and security testing solutions. | ||
| 07 | NVIDIA NeMo Guardrails | Guard | Licence unknown | AppSecSanta describes NeMo Guardrails as an open-source toolkit by NVIDIA for adding programmable guardrails to LLM-based conversational applications. | ||
| 08 | Promptfoo | Red-team | Licence unknown | TechCrunch describes Promptfoo as an AI security startup founded in 2024 to protect LLMs from online adversaries. |
Point tools versus governance platforms
This reference covers standalone technical point tools that perform a specific governance function—evaluation, observability, red teaming, guardrails, or AI security posture. Broad enterprise compliance suites and agent-runtime control planes are out of scope here.
The ordering rule
Organic order follows search demand plus evidence completeness; sponsored entries are labelled.