Skip to content

docs(methods): sampler-benchmarks points at the autofit inference search catalogue (search-ext A5 consumers) - #132

Merged
Jammy2211 merged 1 commit into
mainfrom
feature/search-ext-a5-consumers
Oct 15, 2026
Merged

Jammy2211 merged 1 commit into
mainfrom
feature/search-ext-a5-consumers

Conversation

@Jammy2211

@Jammy2211 Jammy2211 commented Oct 15, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Search-extensibility A5 (consumers), ruling 6. wiki/methods/concepts/sampler-benchmarks.md gains a hand-written section, "The search catalogue — every PyAutoFit search, per task (2026-10)", pointing at autofit_inference's catalogue/search_catalogue.json at commit 3463aa19014b6bd83563018568f0fb4a2376f8eb: protocol id gaussian_x3@1, campaign task gaussian_x3_search_wave1, the three tasks and their protocol judges, "wave 1 ranks nothing", pilot coverage (223 of 520 runs) and per-search statuses (13 measured, NSS deferred, Drawer unsupported), and the embedded manifest snapshot that keys rows by registry name. Frontmatter sources names the catalogue; the methods index.md entry and the append-only log.md are updated. Last in the A5 consumers PR order (after PyAutoLabs/PyAutoHands#311 and PyAutoLabs/PyAutoBrain#523, whose samplers faculty lists the same catalogue cells).

Decisions taken (decide-and-flag)

  1. The page already existed (the ruling says "one page ... add it to the methods index"): it was extended rather than created, and it was already in the methods index, whose entry now names the catalogue. No new page.
  2. No benchmark verdict is added — the section says to quote no "fastest search" from wave 1.

Heart RED override

Quoted from #310 ("Heart RED override"):

The live human answered the AskUserQuestion "Invoke the Heart RED development override for this batch?" with "Yes, override for development (Recommended)" on 2026-10-15, for tasks search-ext-b5b-score, search-ext-a5-consumers and search-ext-b4b-dev-retire (this issue: search-ext-a5-consumers).

Exact RED reasons at the door (Heart verdict, 2026-10-15): "Heart: RED — Release RED; monitoring RED · 10/100 · 415 unresolved"; "[red] release validation FAILED (stage integrate)"; "[red] PyAutoHands/workflows/Python Version Matrix: failure"; "[red] PyAutoHeart/workflows/Release Integrate: failure"; "[red] PyAutoMind/workflows/Lifecycle Drift: failure"; "[red] PyAutoArray/Tests: red"; "[red] autofit_workspace_test/Smoke Tests: red"; "[red] autogalaxy_workspace_test/Smoke Tests: red"; "[red] autolens_workspace_test/Smoke Tests: red"; "[red] Release validation: NOT release_ready — v2026.10.15.1.dev81701 profile=release (2026-10-15T07:04:34+00:00)"; "[red] Worktree drift: 5 orphan / 0 missing / 4 dirty"; "[red] autolens_inference: red"; "[red] autolens_profiling: red"; "[red] euclid_strong_lens_modeling_pipeline: red"

Permitted: commit, push, PR-open. Merge stays a separate human act; no release or rehearsal; this branch does not fix Heart.

Passed branch gates (tests, smoke, review) are recorded in the PR body at ship; a failed gate cannot be overridden.

Test plan

  • make validate — literature citations, structure, wikilinks all valid (no new unresolved targets).
  • Tests / smoke: n/a — wiki prose only.

Ship gate

Leg Result
1 Tests PyAutoHands full suite 507 passed (+ test_search_roster.py 28 after the last fix); PyAutoBrain full suite 1265 passed (one test, test_grouped_organ_consumers, fails only when activate.sh exports PYAUTO_MIND, and passes in a clean env; unrelated to this diff); the doc repos have no test dir (n/a); PyAutoMemory make validate green
2 Smoke n/a: no script in any smoke_tests.txt changed. al/ag guides/modeling/searches.py is a docstring-only edit (py_compile clean, not smoke-listed). The workspace smoke CI on these PRs is the record.
3 Review Two independent fresh-context reviews over Hands + Brain. Round 1 was FINDINGS (1 major, 12 minor/nit, 1 status note); all fixed in Hands e720263 and Brain db0916b. Round 2 confirmed 12/13 resolved, with one partial: the installed-mode manifest could still read a source checkout via the cwd. That is fixed in Hands 5e4224e with a test. No third round was run (decide-and-flag).
4 Heart RED. The human development override is recorded on PyAutoLabs/PyAutoHands#310 (quoted above).
Witness 6/7. ✓ --check regenerates byte-identically against the installed autofit 2026.10.12.1 in every consumer (output shown in each consumer PR). ✓ navigator --roster writes the curated llms.txt block. ✓ af/al/ag assistant blocks come from the same manifest. ✓ Brain promoted tier and gaps are keyed by manifest name and integration_test. ✓ The workspace CI search_roster job checks anchors against the installed release, not main; it goes live once Hands merges. ✓ al/ag guides are domain advice plus a matrix link. ✗ Capability matrix → B3 catalogue card link: this is in PyAutoFit docs/_generate_searches.py, which is not in this task's repos.
Firewall PyAutoBrain needs the Mind FIREWALL_ALLOWLIST to add "autofit_inference" for agents/faculties/samplers/_samplers.py and samplers.sh. Until then the Brain PR's firewall leg is red; its pytest leg is green.

🤖 Generated with Claude Code

…rch catalogue

Hand-written section: catalogue/search_catalogue.json at 3463aa1, protocol
gaussian_x3@1, per-task grouping, wave 1 ranks nothing, pilot coverage and
statuses; index entry and log updated (search-ext A5 consumers,
PyAutoLabs/PyAutoHands#310).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@Jammy2211
Jammy2211 merged commit ae6a3f7 into main Oct 15, 2026
1 check passed
@Jammy2211
Jammy2211 deleted the feature/search-ext-a5-consumers branch October 15, 2026 15:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant