Agent Judge

[!IMPORTANT] **This repository is no longer maintained.**

Active development has moved to [markpollack/agent-judge](https://github.com/markpollack/agent-judge). Current documentation is available at [lab.pollack.ai](https://lab.pollack.ai/projects/agent-judge).

This repository remains available for historical Spring AI Community releases. Its Apache 2.0 license and historical contents are unchanged. Please submit new issues and pull requests to the active repository.

Agent Judge

Agent-agnostic evaluation framework with deterministic, command, and LLM judges. Compose judges into juries with configurable voting strategies. Zero coupling to any specific agent implementation.

Modules

Module	Description
agent-judge-core	Core Judge API and abstractions (zero external deps)
agent-judge-exec	Command execution judges (build, test, coverage)
agent-judge-llm	LLM-powered evaluation via Spring AI
agent-judge-file	File comparison judges (Java AST, Maven POM, XML, text)

Maven Central

    org.springaicommunity
    agent-judge-core
    0.9.1

Additional modules:

agent-judge-exec
agent-judge-llm
agent-judge-file

Quick Example

// Deterministic judge
Judge buildJudge = BuildSuccessJudge.maven("compile");

// Jury with voting
Jury jury = SimpleJury.builder()
    .name("eval")
    .judge(buildJudge)
    .judge(FileExistsJudge.of("target/classes/App.class"))
    .votingStrategy(VotingStrategy.majority())
    .build();

Verdict verdict = jury.vote(context);

Documentation

Full API reference, built-in judges, jury system, and voting strategies: https://springaicommunity.mintlify.app/projects/incubating/agent-judge

License

Apache License 2.0