Skip to content

B5c-2a: autofit_inference — correlated_nd pilot judged under @1, correlated_nd@2 frozen (44c5e77f1fb0); Now -> B5c-2b - #71

Merged
Jammy2211 merged 1 commit into
mainfrom
feature/search-ext-b5c2a-freeze
Oct 16, 2026
Merged

Jammy2211 merged 1 commit into
mainfrom
feature/search-ext-b5c2a-freeze

Conversation

@Jammy2211

Copy link
Copy Markdown
Contributor

Summary

B5c-2a, the Cortex ledger for autofit_inference. A new 2026-10-16 result entry sits at the top of ## Log (newest first; nothing backdated). It records:

  • the pilot headline numbers: 1040 expected = 749 rows + 177 failed + 4 oom + 0 missing + 110 deferred; 307 accepted and 623 rejected under correlated_nd@1;
  • the failure breakdown;
  • the new oom attempt class;
  • the A2 ruling;
  • the freeze sha 44c5e77f1fb0 (44c5e77f1fb0779f675a8f51247d812183e93b48).

## Now now points at B5c-2b (draft/research/autofit_inference/search_ext_b5c2b_scored_wave_submit.md). Both edits were written with scripts/cortex.py log / now. The board was rendered only from this worktree, with _cortex.py dashboard --cortex . --apply; the canonical checkout is untouched. dashboard --check passes, cortex check: OK, and pytest tests gives 65 passed.

Parent: PyAutoLabs/autofit_inference#18 (judge, calibration, freeze). Nothing was submitted, so no run line was added.

Decisions taken

Each one is flagged for the human. Each has a one-line revert.

  1. A2 memory headroom is 2×. --mem = max(8 G, ceil(2 × peak)) per cell class (dataset × search × settings, both backends). The peak is the largest sampled sacct MaxRSS, or 8 G when any pilot task was OOM-killed. Sampled RSS undercounts the peak at a kill: task 304 read 3.1 G when it died at 8 G. This raises two cells: d50 Nautilus n_live_400 to 16 G and d100 cold NUTS to 17 G (MaxRSS 8.1 G). Revert: set MEMORY_HEADROOM in calibrate_correlated_nd.py and regenerate.
  2. d100 Nautilus n_live_200 is deferred from the scored menu, along with n_live_400 and n_live_100. All 40 n_live_200/400 attempts failed at the pin within 31–74 s, before the first bound was sampled. The cause is nautilus's HDF5 checkpoint: it cannot store a D = 100 bound attribute (h5py "object header message is too large"). Affordability therefore cannot be judged from the pilot walls; for comparison, d50 n_live_200 took a median of 820 s. n_live_100 is deferred by construction: Nautilus needs n_live > D. d100 warm NUTS is deferred with its provider. Revert: drop the entries from _correlated_nd.A2_DEFERRED in a later amendment, after a library or nautilus fix.
  3. The OOM cells. d50 Nautilus n_live_100 (both backends) and d50 warm NUTS are deferred by the §7 cap rule, read as "no attempt ended on its own". In each, 9 of 10 attempts hit the 4 h cap and the 10th was OOM-killed before the cap. Revert: calibrate with "every attempt Terminated at the cap" only. Those two cells would then get timeouts from zero completed rows, so they would be probe-first.
  4. σ-ratio bands are per task under @2, read literally from "a band moves only on ≥ 20 completed pilot rows of its task". The evidence task moves to [0.85, 1.1] on 79 rows. The posterior task has 1 row, so it keeps [0.5, 2.0]. @1 had one shared band. With a single band, 34 of the 307 accepted pilot rows would have flipped, all of them BlackJAX NUTS (500 samples), judged by Nautilus σ noise. Revert: FROZEN_CND2 bands as plain tuples (one band for both tasks).
  5. The evidence calibration set also requires §4(c). This was added after seeing the pilot. 6 collapsed banana Nautilus n_live_200 rows (σ ratios 0.04–0.13) pass the medians against the banana's wide reference σ, and without §4(c) they would drag the lower band edge to 0. Revert: drop the (c) filter in calibrate_correlated_nd.calibrate.
  6. New oom attempt class. SLURM's OOM SIGKILL exits 137 under timeout, the same code as the cap's own kill. The pilot submit therefore wrote cap stubs (process wall = the 4 h limit) for the 4 OOM tasks, which would have been counted as censored cap failures. cnd_cap_stub.py --reconcile-oom rewrote them from the committed sacct extract (MaxRSS, real wall). Under @2, an oom run is rerun once at twice its cell's request, and a second oom is a failed attempt. Revert: git revert the reconcile commit.
  7. Harness fix in this phase. All 80 Emcee/Zeus pilot rows (d20 and the banana) failed after the search in _posterior.chain_diagnostics, which relabelled by g0.centre. The fix is relabel=False for families with no label symmetry. Pilot verdicts stay @1 (failed). Those 8 cells have no completed row, so they are probe-first in the scored wave. Revert: revert commit b3845e8's _posterior/_runner hunks.

Witness checklist

  • The Cortex Log entry and the Insight correlated_nd_pilot row are closed with the pilot verdicts.
  • correlated_nd@2 is frozen (autofit_inference 44c5e77f1fb0), and the sha is recorded in both organs.
  • NO scored run exists or was submitted in this phase.

🤖 Generated with Claude Code

…@2 frozen (44c5e77f1fb0); Now -> B5c-2b

Log entry (newest first, 2026-10-16) with the pilot headline numbers, the oom
class, the A2 ruling and the freeze sha; Now points at B5c-2b. Dashboard
rendered from this worktree (--cortex .).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@Jammy2211
Jammy2211 merged commit 9e8b3d4 into main Oct 16, 2026
2 checks passed
@Jammy2211
Jammy2211 deleted the feature/search-ext-b5c2a-freeze branch October 16, 2026 15:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant