Julius

Julius: LLM Service Fingerprinting Tool

Identify Ollama, vLLM, LiteLLM, and 60+ AI services running on any endpoint in seconds.

[](https://golang.org/) [](LICENSE) [](https://github.com/praetorian-inc/julius/actions) [](https://goreportcard.com/report/github.com/praetorian-inc/julius)

**Julius** is an LLM service fingerprinting tool for security professionals. It detects which AI server software is running on network endpoints during penetration tests, attack surface discovery, and security assessments.

Unlike model fingerprinting tools that identify which LLM generated text, Julius identifies the **server infrastructure**: Is that endpoint running Ollama? vLLM? LiteLLM? A Hugging Face deployment? Julius answers in seconds.

Table of Contents

• The Problem
• Features
• Quick Start
• Supported LLM Services
• Usage
  • Single Target
  • Multiple Targets
  • Output Formats
  • Model Discovery
• How It Works
• Architecture
• Adding Custom Probes
• FAQ
• Troubleshooting
• Contributing
• Security
• Support
• License

The Problem

You've discovered an open port during a security assessme