utkusen

Promptmap — Security skill for Claude Code

Security community intermediate

Security scanner for custom LLM apps.

How to install Promptmap

This entry records only its repository, not the path inside it, so there is no exact command to give. Open utkusen/promptmap and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Promptmap does

Multiple LLM Provider Support: - OpenAI GPT models - Anthropic Claude models - Google Gemini models - XAI Grok models - Open source models via Ollama (Deepseek, Llama, Mistral, Qwen, etc.) - Comprehensive Test Rules: 50+ pre-built rules across 6 categories

Alternatives in Security

Claude Bootstrap — Opinionated project initialization with security-first guardrails, spec-driven atomic todos, LLM testing patte 536 ★
OpenTag — Open-source, channel-native agent gateway for Slack 499 ★
Agentseal — Security toolkit for AI agents 344 ★

README

                              _________       __O     __O o_.-._ 
  Humans, Do Not Resist!  \|/   ,-'-.____()  / /\_,  / /\_|_.-._|
    _____   /            --O-- (____.--""" ___/\   ___/\  |      
   ( o.o ) /  Utku Sen's  /|\  -'--'_          /_      /__|_     
    | - | / _ __ _ _ ___ _ __  _ __| |_ _ __  __ _ _ __|___ \    
  /|     | | '_ \ '_/ _ \ '  \| '_ \  _| '  \/ _` | '_ \ __) |   
 / |     | | .__/_| \___/_|_|_| .__/\__|_|_|_\__,_| .__// __/    
/  |-----| |_|                |_|                 |_|  |_____|

promptmap2 is a an automated prompt injection scanner for custom LLM applications. It supports two testing modes:

**White-box testing:** Provide your system prompts and the model information. promptmap2 runs the target LLM itself and tests it.
**Black-box testing:** Point promptmap2 at an external HTTP endpoint. It sends attack prompts over HTTP and inspects the returned outputs.

It operates using a dual-LLM architecture:

Target LLM: The LLM application being tested for vulnerabilities
Controller LLM: An independent LLM that analyzes the target's responses to determine if attacks succeeded

The tool sends attack prompts to your target LLM and uses the controller LLM to evaluate whether the attack was successful based on predefined conditions.

It includes comprehensive test rules across multiple categories including prompt stealing, jailbreaking, harmful content generation, bias testing, and more.

[!IMPORTANT] promptmap was initially released in 2023 but completely rewritten in 2025.

📖 Want to secure your LLM apps? [You can buy my e-book](https://utkusen.gumroad.com/l/securing-gpt-attack-defend-chatgpt-applications)

Features

Multiple LLM Provider Support:
- OpenAI GPT models
- Anthropic Claude models
- Google Gemini models
- XAI Grok models
- Open source models via Ollama (Deepseek, Llama, Mistral, Qwen, etc.)
Comprehensive Test Rules: 50+ pre-built rules across 6 categories

...