Vigil

Overview 🏕️

⚡ Security scanner for LLM prompts ⚡

`Vigil` is a Python library and REST API for assessing Large Language Model prompts and responses against a set of scanners to detect prompt injections, jailbreaks, and other potential threats. This repository also provides the detection signatures and datasets needed to get started with self-hosting.

This application is currently in an **alpha** state and should be considered experimental / for research purposes.

For an enterprise-ready AI firewall, I kindly refer you to my employer, [Robust Intelligence](https://www.robustintelligence.com).

• Full documentation
• Release Blog

Highlights ✨

• Analyze LLM prompts for common injections and risky inputs
• Use Vigil as a Python library or REST API
• Scanners are modular and easily extensible
• Evaluate detections and pipelines with Vigil-Eval (coming soon)
• Available scan modules
  • Vector database / text similarity
    • Auto-updating on detected prompts
  • Heuristics via YARA
  • Transformer model
  • Prompt-response similarity
  • Canary Tokens
  • Sentiment analysis
  • Relevance (via LiteLLM)
  • Paraphrasing
• Supports local embeddings and/or OpenAI
• Signatures and embeddings for common attacks
• Custom detections via YARA signatures
• Streamlit web UI playground

Background 🏗️

...