Live Eval And Cost
Description
# Live Evaluation & Cost Analysis — GenAI IDP Accelerator Use this when validating a change against **real deployed stacks**: benchmark A/B tests (model, prompt, config), v0.5→v0.6-style upgrade tests, and reading accuracy/cost/confidence from a run. This is the "prove it live" workflow, complementary to unit tests (`testing-qa.md`). > All AWS + `idp-cli` calls use `AWS_PROFILE=default`. Confirm the account first: > `AWS_PROFILE=default aws sts get-caller-identity`. Never clobber the > `Config
Installation
Installs to ~/.claude/skills/aws-solutions-library-samples-accelerated-intelligent-document-processing-on-aws-live-eval-and-cost/SKILL.md
mkdir -p ~/.claude/skills/aws-solutions-library-samples-accelerated-intelligent-document-processing-on-aws-live-eval-and-cost && curl -fsSL https://raw.githubusercontent.com/aws-solutions-library-samples/accelerated-intelligent-document-processing-on-aws/HEAD/.claude/skills/live-eval-and-cost.md -o ~/.claude/skills/aws-solutions-library-samples-accelerated-intelligent-document-processing-on-aws-live-eval-and-cost/SKILL.md Restart Claude Code, or start a new session, for it to be picked up.
Full documentation available on GitHub
View Source RepositoryRelated Skills
Auto Update
Pull the latest ECC repo changes and reinstall the current managed targets.
Ecc Guide
Navigate ECC's current agents, skills, commands, hooks, install profiles, and docs from the live repository su
Epic Claim
Claim an epic issue, stamp coordination state, and sync local ownership.
Epic Publish
Publish a validated epic update back to the issue and local cache.
Epic Review
Mark epic review requested, approved, or changes requested.
Epic Unblock
Sweep blocked epic issues and reopen anything whose dependencies are closed.