Evidence-First Agent Reporting
Rocky should not sound confident because it can write polished prose. It should sound confident only when it has evidence. A good report explains what was changed, what was actually run, and what the system returned.
Official Hermes Agent docs: https://hermes-agent.nousresearch.com/docs
What belongs in a report
- The exact pages, files, commands, or systems touched.
- The verification checks that ran successfully.
- The live URLs or artifact paths that were checked.
- Any generated assets and where they were saved.
- Known risks, skipped checks, or blockers.
- A clear no-deploy explanation when validation fails.
What to avoid
- Vague claims such as “tested thoroughly” without naming the test.
- Fabricated output or assumed success from a command that failed.
- Private customer details in a public-facing summary.
- Over-promising future automation that has not been built.
- Hiding partial failure behind optimistic language.
Checklist for Rocky operators
- Did the final answer mention real evidence, not just intent?
- Did every claim map to a command, screenshot, endpoint, file, or source document?
- Were failures described directly?
- Were public URLs verified after deployment?
- Is the remaining manual work specific enough for a person to act on?
Pitfalls
A report can be too long and still not useful. The goal is not to dump logs; the goal is to provide enough receipts that a busy operator can trust the result and know the next step.
Verification steps
- Re-read the final report against the original request.
- Confirm every required deliverable is named.
- Confirm any blocker explains why the job stopped.
- Confirm no secret, token, private path, or customer record appears in the public report.
