🧀 BigCheese.ai

Social

Garak, LLM Vulnerability Scanner

🧀

The NVIDIA GitHub repository garak is a toolkit for security probing of Large Language Models (LLMs). It includes various plugins for testing LLM vulnerabilities like data leakage, hallucination, toxicity, etc. The tool is free and open-source under the Apache-2.0 license with community contributions.

  • Garak is a free LLM vulnerability scanner
  • It's under the Apache-2.0 license
  • Latest release is v0.10.0 as of Oct 31, 2024
  • Uses plugins to test LLM vulnerabilities
  • Repository has over 1.5k stars on GitHub