promptmap

                              _________       __O     __O o_.-._ 
  Humans, Do Not Resist!  \|/   ,-'-.____()  / /\_,  / /\_|_.-._|
    _____   /            --O-- (____.--""" ___/\   ___/\  |      
   ( o.o ) /  Utku Sen's  /|\  -'--'_          /_      /__|_     
    | - | / _ __ _ _ ___ _ __  _ __| |_ _ __  __ _ _ __|___ \    
  /|     | | '_ \ '_/ _ \ '  \| '_ \  _| '  \/ _` | '_ \ __) |   
 / |     | | .__/_| \___/_|_|_| .__/\__|_|_|_\__,_| .__// __/    
/  |-----| |_|                |_|                 |_|  |_____|    

promptmap2 is a an automated prompt injection scanner for custom LLM applications. It supports two testing modes:

• **White-box testing:** Provide your system prompts and the model information. promptmap2 runs the target LLM itself and tests it.

• **Black-box testing:** Point promptmap2 at an external HTTP endpoint. It sends attack prompts over HTTP and inspects the returned outputs.

It operates using a dual-LLM architecture:

• Target LLM: The LLM application being tested for vulnerabilities
• Controller LLM: An independent LLM that analyzes the target's responses to determine if attacks succeeded

The tool sends attack prompts to your target LLM and uses the controller LLM to evaluate whether the attack was successful based on predefined conditions.

It includes comprehensive test rules across multiple categories including prompt stealing, jailbreaking, harmful content generation, bias testing, and more.

[!IMPORTANT] promptmap was initially released in 2023 but completely rewritten in 2025.

📖 Want to secure your LLM apps? [You can buy my e-book](https://utkusen.gumroad.com/l/securing-gpt-attack-defend-chatgpt-applications)

Features

• Multiple LLM Provider Support:
  • OpenAI GPT models
  • Anthropic Claude models
  • Google Gemini models
  • XAI Grok models
  • Open source models via Ollama (Deepseek, Llama, Mistral, Qwen, etc.)
• Comprehensive Test Rules: 50+ pre-built rules across 6 categories

...