Llm Coordination Harness banner
aak204 aak204

Llm Coordination Harness

AI community

Description

Reproducible evaluation harness for hidden coordination variables in multi-agent LLM systems.

Installation

This entry records only its repository, not the path inside it, so there is no exact command to give. Open the source below and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

README

Llm coordination harness

[![Python](https://img.shields.io/badge/python-3.12-blue.svg)](./pyproject.toml) [![Stage](https://img.shields.io/badge/stage-clean%20%2B%20stress-darkgreen.svg)](./docs/CLAIM.md) [![Mode](https://img.shields.io/badge/openrouter-research_strict-black.svg)](./docs/RUNBOOK.md) [![Result](https://img.shields.io/badge/result-honest%20negative%20%2F%20methods-orange.svg)](./docs/TECHNICAL_REPORT_DRAFT.md) [![Status](https://img.shields.io/badge/release-freeze-lightgrey.svg)](./configs/RELEASE_FREEZE.json)

`llm-coordination-harness` is a reproducible measurement rig for hidden coordination variables in multi-agent LLM systems under fixed billed-token budgets.

This repository is intentionally positioned as:

  • an eval / harness project
  • a measurement-first research artifact
  • a negative-results / methods result

This repository is not positioned as:

  • a generic swarm framework
  • a production routing layer
  • a claim that a universal coordination law has already been proved

What It Measures

The harness extracts and logs:

  • F: critical-fact survival fidelity through the graph
  • rho: shared-error correlation under no communication
  • B: propagation balance over edge fact-survival ratios
  • C: fan-in pressure from incoming peer-token load vs quota

The important property is that these variables are recomputed from logs offline, rather than living only in process memory.

Golden Artifacts

The `outputs/` directory is intentionally frozen to the two gold runs:

Frozen configs:

Visuals

Feature importance from the offline predictor analysis:

![Feature Importance](./docs/figures/feature_importance_help_vs_rest.png)

Topology penalt