Models & Harnesses Tested

Every harness and model XYZ has been evaluated with, from the committed harnesses registry. Full narratives live in the repo's HARNESS-MODELS-REGISTRY.md; benchmark artifacts in TESTS-RESULTS/.

Evaluated pairs — grades

Harness	Model	Grade	Gate	Diff cleanliness /5	Seam reliability /5	Failure mode	Evals
commandcode	Qwen 3.8-Max	A-	✓ passed	5	5	none	24
dsh	deepseek/deepseek-v4-pro	A	✓ passed	5	5	none	1

Grades come from the evaluations ledger: A-range means the pairing is production-usable as driven; B-range usable with caveats; C or N/A means not recommended for that pairing. “Evals” counts the individual verified invocations behind each row.

Harnesses

ID	Name	Engine	Reasoning effort	Standing role
`agy`	Antigravity CLI	native_cli	yes	Cost-blind cross-model builder/reviewer
`aider`	Aider	python_litellm	no	Builder only
`claude`	Claude Code	native_cli	yes	Orchestrator and final reviewer
`codex`	Codex CLI	native_cli	yes	Cost-blind default builder and reviewer
`commandcode`	Command Code	node_langbase	yes	Builder & Systems Reviewer
`dsh`	DeepSeek Harness	node_cordis	yes	Autonomous Headless Builder
`muse`	Muse Code	native_cli	yes	Evaluation only (GH-518)
`pi`	Pi Agent	node_multi	no	Builder only

Models

Model	Lab	Gateway	Context	Status
Qwen 3.7-Flash	Alibaba	openrouter	1M	active
Qwen 3.8-Max	Alibaba	openrouter	1M	active
antigravity/gemini-2.5-pro	Antigravity	google	1M	active
Gemini 3.5 Flash	Auto	google	1M	active
claude-sonnet-4-6	Auto	anthropic	1M	active
deepseek/deepseek-v4-pro	Auto	openrouter	1M	active
qwen3.8-max	Auto	alibaba	1M	active
DeepSeek V3	DeepSeek	openrouter	1M	active
DeepSeek V4 Pro	DeepSeek	openrouter	1M	active
Gemma 4 31B QAT	Google	lmstudio	32,768	active
Muse Spark 1.3	Meta	meta	1,007,997	active
Muse Spark 1.3 Contributor	Meta	meta	1,007,997	active
openai/gpt-mini-latest	Openai	pi	1M	active
openrouter/qwen/qwen3.8-max	Qwen	openrouter	1M	active
qwen/qwen3.8-max	Qwen	openrouter	1M	active
qwen/qwen3.8-max-0902	Qwen	openrouter	1M	active
Stealth Ox-Alpha	Stealth	openrouter	1M	active
stealth/ox-alpha	Stealth	openrouter	1M	active
GLM 5.3 High	Z.ai	openrouter	1M	active
zai-org/glm-5.3	Zai-org	openrouter	1M	active