Solutions  ·  2026-10-18

NVIDIA garak v0.17.1 adds hit@k attack-success-rate metric

SolutionsLow impactGlobal
garak v0.17.1 (Oct 16) adds a hit@k attack success rate metric, exposed per probe/detector pair in terminal output and the final digest entry of report.json.
Gives teams using the widely deployed garak red-teaming framework a probabilistic success-rate measure (rather than binary pass/fail) for jailbreak/prompt-injection probes — useful for comparing detectors and tuning defenses.
ML security and LLM red-team engineers already on garak should upgrade and adopt hit@k in their eval dashboards.
NVIDIA/garak v0.17.1 release
See this in the live feed Explore related AI security and governance findings — updated every morning.
Open the feed →