Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editable
Abstract
The capability of a modern AI agent depends not only on its foundation model but also on its harness, which constructs prompts, manages state, invokes tools, and coordinates execution. As models, APIs, environments, and requirements evolve, the harness must be continually modified. Before such a change can be made, a developer or coding agent must identify all code locations that implement the target behavior. This is difficult because production harnesses are large, tightly coupled, and behaviorally distributed, while modification requests describe what the system should do and repositories are organized by files and modules. Code search, repository indexing, and long-context processing ease inspection, but still leave this behavior-to-code mapping to be recovered by hand. Behavior localization is therefore a central bottleneck in harness evolution. We introduce the Harness Handbook, a behavior-centric representation synthesized automatically from a harness codebase via static analysis and LLM-assisted structuring, linking each behavior to its corresponding source. We also introduce Behavior-Guided Progressive Disclosure (BGPD), which guides agents from high-level behaviors to relevant implementation details and verifies candidate locations against the current source. On diverse modification requests from two open-source harnesses, Handbook-Assisted planning improves behavior localization and edit-plan quality while using fewer planner tokens, with the largest gains on scattered sites, rarely executed paths, and cross-module interactions. Evolving complex agentic systems thus depends not only on generating edits, but also on determining where those edits should be made.
Community
Github Link: https://github.com/Ruhan-Wang/Harness_Handbook
Blog: https://ruhan-wang.github.io/Harness-Handbook/
Codex Handbook: https://ruhan-wang.github.io/Harness-Handbook/codex-handbook/index.html
Terminus 2 Handbook: https://ruhan-wang.github.io/Harness-Handbook/terminus-handbook/index.html
Handbook Studio Demo: https://ruhan-wang.github.io/Harness-Handbook/studio/index.html
Nice idea!
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- From Failed Trajectories to Reliable LLM Agents: Diagnosing and Repairing Harness Flaws (2026)
- From Question Answering to Task Completion: A Survey on Agent System and Harness Design (2026)
- Harness-Bench: Measuring Harness Effects across Models in Realistic Agent Workflows (2026)
- FeatX: Editing Software by Editing Features for Repository-Level Code Evolution (2026)
- Self-Harness: Harnesses That Improve Themselves (2026)
- Formal Skill: Programmable Runtime Skills for Efficient and Accurate LLM Agents (2026)
- Governed Evolution of Agent Runtimes through Executable Operational Cognition (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2607.13285 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper