JanuaryLabs

AI Agent Eval Writer — Testing & QA agent for Claude Code

Testing & QA community

Use this agent when you need to write evaluation tests for AI agents using Evalite or Autoevals frameworks.

How to install AI Agent Eval Writer

Installs to ~/.claude/agents/januarylabs-deepagents-ai-agent-eval-writer.md

Terminal

mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/JanuaryLabs/deepagents/HEAD/.claude/agents/ai-agent-eval-writer.md -o ~/.claude/agents/januarylabs-deepagents-ai-agent-eval-writer.md

Restart Claude Code, or start a new session, for it to be picked up.

What AI Agent Eval Writer does

name: ai-agent-eval-writer description: Use this agent when you need to write evaluation tests for AI agents using Evalite or Autoevals frameworks. This includes creating evaluation suites to test LLM outputs, agent behaviors, response quality, factual accuracy, or any other AI system performance metrics. Examples of when to invoke this agent:\n\n\nContext: The user has just finished implementing an AI agent or LLM-based feature and wants to ensure it performs correctly.\nuser: "I j

Alternatives in Testing & QA

Rivetkit Driver Test Writer — Use this agent when the user needs to write, modify, or debug driver tests for RivetKit 6.1k ★
Testing Expert — Use this agent for Output.ai testing strategies including Vitest configuration, Temporal workflow testing, LLM 434 ★
Module Test Writer — Use this agent to write feature tests for LaraDashboard module CRUD operations, services, policies, and Livewi 407 ★