Skip to content

review: verdicts record a disposition per lifted claim - #231

Merged
Jammy2211 merged 1 commit into
mainfrom
claude/automind-falsified-by-checkpoint-cmsqsi
Aug 18, 2026
Merged

review: verdicts record a disposition per lifted claim#231
Jammy2211 merged 1 commit into
mainfrom
claude/automind-falsified-by-checkpoint-cmsqsi

Conversation

@Jammy2211

Copy link
Copy Markdown
Contributor

The change the 2026-08-18 falsified-by efficacy review recommended (agent_failure_modes.md item 6 Outcome, merged in #230): across 22 ship gates the ledger could not distinguish a healthy adversarial claim pass from a skipped one — both wrote a bare "review CLEAN". Executes the PyAutoMind prompt review_claim_dispositions.md; the Mind-side record ships in the paired PyAutoMind PR on the same branch name.

The rule: when the ReviewSurface lifts any claims to falsify, the reviewing agent's verdict carries one disposition line per claim —

claim: "<lifted line>" → basis-cited: <the test/measurement/diff that shows it> | idle | FINDING (unverified-claim)

— written by the reviewer at verdict time, never by the author. A bare CLEAN over a non-empty claims surface is malformed evidence, not CLEAN. An empty surface requires nothing, so the 74–95% of ships that lift no claims gain no busywork. No trigger-vocabulary change (measured as neither empty nor saturated).

Surfaces:

  • agents/faculties/review/AGENTS.md — step 2a disposition format + step 3 malformed-evidence rule
  • agents/faculties/review/_review.py — human-emit epilogue demands dispositions, guarded to print only when claims were lifted
  • AUTONOMY.md — autonomous-ship-gate review leg carries the requirement
  • skills/ship_library/reference.md--auto validation-checklist gate line
  • docs/agent_failure_modes.md — item 6 Outcome updated from "filed" to "implemented"
  • tests/test_review_claims.py — 2 new pinning tests; suite 351 passed

Dogfood: the faculty was run on this branch itself — surface produced, zero claims lifted from the commit message, no disposition demand printed on the empty surface (the guard's no-busywork path), reviewer verdict CLEAN with no dispositions owed.

🤖 Generated with Claude Code

https://claude.ai/code/session_01WH4NizvBK2jki2Uh5TMABh


Generated by Claude Code

The change the 2026-08-18 falsified-by efficacy review recommended
(agent_failure_modes.md item 6 Outcome): across 22 ship gates the ledger
could not distinguish a healthy adversarial claim pass from a skipped
one — both wrote a bare 'review CLEAN'. Now, when the ReviewSurface
lifts any 'claims to falsify', the verdict carries one disposition line
per claim (basis-cited / idle / FINDING unverified-claim), written by
the reviewer at verdict time; a bare CLEAN over a non-empty claims
surface is malformed evidence. An empty surface requires nothing, so
the 74-95% of ships that lift no claims gain no busywork.

Surfaces: faculty AGENTS.md step 2a + verdict mapping; _review.py
human-emit epilogue (printed only when claims lifted); AUTONOMY.md
autonomous-ship-gate review leg; ship_library reference.md gate
evidence line. No trigger-vocabulary change (measured as neither empty
nor saturated). 2 new pinning tests; suite 351 passed.

Co-Authored-By: Claude <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01WH4NizvBK2jki2Uh5TMABh
@Jammy2211
Jammy2211 merged commit ce49a49 into main Aug 18, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants