From ce06a1e23e4a100bb4a14e12d15670a813a19500 Mon Sep 17 00:00:00 2001 From: Jammy2211 Date: Wed, 14 Oct 2026 15:48:36 +0100 Subject: [PATCH 1/2] feat: fit fixture + autofit campaign for the B4b EP / graphical baselines - tests/fixtures/autofit_profiling_v2.json: autofit_profiling's catalogue on its B4b branch (9 setups, 31 records: the B4a breakdown plus runtime and memory host_peak_rss records for the EP / graphical N3/N10/N30 baselines and the analytic parity cell); the fixture test now expects the memory axis. - campaigns.yaml: autofit campaign and task next-line for B4b at PR. - tasks/autofit_profiling_bootstrap.md: B4b check-in (host pin, reproduction verdicts, analytic parity). - dashboard re-rendered offline for the campaign ledger. The fit receipt and snapshot are refreshed on this branch after the autofit_profiling PR merges and its Pages deploy is live. Co-Authored-By: Claude Fable 5.1 --- campaigns.yaml | 20 +- dashboard.html | 2 +- dashboard.md | 8 +- tasks/autofit_profiling_bootstrap.md | 9 + tests/fixtures/autofit_profiling_v2.json | 1520 +++++++++++++++++++++- tests/test_catalogue.py | 9 +- 6 files changed, 1518 insertions(+), 50 deletions(-) diff --git a/campaigns.yaml b/campaigns.yaml index eb2a342..cf8fda1 100644 --- a/campaigns.yaml +++ b/campaigns.yaml @@ -80,11 +80,11 @@ campaigns: title: PyAutoFit profiling bootstrap status: active updated: '2026-10-14' - next: 'B4a at PR; B4b next. B4a = autofit_profiling#3 (search.fit breakdown cell, profiling-summary@2 - exporter, Pages) then this Pulse fit row, then the autofit_workspace_developer retirement PR, merged in that - order. Epic-1 ranked table filed in tasks/autofit_profiling_bootstrap.md (2026-10-14); epic 2 not opened. - B4b = the EP / graphical baseline port.' - evidence: https://github.com/PyAutoLabs/autofit_profiling/pull/3 + next: 'B4a merged (autofit_profiling#3, Pulse#60); B4b at PR (issue autofit_profiling#4) ports the EP / + graphical N3/N10/N30 baselines and the analytic parity cell (runtime + memory records, same laptop host as + B4a). Truth logL sums and both N30 sanity FAILs reproduce exactly; every wall is faster than the committed + developer baseline beyond 2x (improved). Receipt/snapshot refresh after its Pages deploy. Epic 2 not opened.' + evidence: https://github.com/PyAutoLabs/autofit_profiling/issues/4 - id: critical-curves title: Critical curves and evaluation grids status: needs-decision @@ -232,11 +232,11 @@ tasks: priority: normal path: tasks/autofit_profiling_bootstrap.md updated: '2026-10-14' - next: 'B4a at PR; B4b next. B4a = autofit_profiling#3 (search.fit breakdown cell, profiling-summary@2 - exporter, Pages) then this Pulse fit row, then the autofit_workspace_developer retirement PR, merged in that - order. Epic-1 ranked table filed in tasks/autofit_profiling_bootstrap.md (2026-10-14); epic 2 not opened. - B4b = the EP / graphical baseline port.' - evidence: https://github.com/PyAutoLabs/autofit_profiling/pull/3 + next: 'B4a merged (autofit_profiling#3, Pulse#60); B4b at PR (issue autofit_profiling#4) ports the EP / + graphical N3/N10/N30 baselines and the analytic parity cell (runtime + memory records, same laptop host as + B4a). Truth logL sums and both N30 sanity FAILs reproduce exactly; every wall is faster than the committed + developer baseline beyond 2x (improved). Receipt/snapshot refresh after its Pages deploy. Epic 2 not opened.' + evidence: https://github.com/PyAutoLabs/autofit_profiling/issues/4 - id: cluster_pointsolver_speed campaign: cluster-pointsolver title: Cluster PointSolver — robustness, analysis settings and performance diff --git a/dashboard.html b/dashboard.html index 1b9f51a..4c2dcb9 100644 --- a/dashboard.html +++ b/dashboard.html @@ -646,7 +646,7 @@ - PyAutoPulse: https://github.com/PyAutoLabs/PyAutoPulse - autolens_profiling: https://github.com/PyAutoLabs/autolens_profiling - autofit_profiling: https://github.com/PyAutoLabs/autofit_profiling
Last updated 2026-10-14 09:52:00 UTC
↻ Update

-

Active campaigns

CampaignStatusLinks
Setup baseline collection and scientific acceptance
2 tasks · next step

Review the Pulse collection choices (candidate input hashes and 31-worker resource plan verified without execution) alongside project correctness audit #417. Resolve data origin/suitability, named host/stack/full settings, witness/tolerances and background-load method. No freeze, compute or acceptance authorized.

Reviewed 2026-10-13

Active tasks

Freeze the setup baseline specification, then collect and review evidence↗

needs-decision · high

HST/MGE raw fixed-parameter CPU runner merged in #416; Pulse handoff #55 merged and Mind implementation closed. Resolve exact production host/stack/data, full settings, independent correctness witness/tolerances and background-load method. No collection, campaign freeze or acceptance authorized; global compile dispatch remains unavailable.

Prepare and review the HST/MGE fp64 CPU pilot↗

needs-decision · high

Review the Pulse collection choices (candidate input hashes and 31-worker resource plan verified without execution) alongside project correctness audit #417. Resolve data origin/suitability, named host/stack/full settings, witness/tolerances and background-load method. No freeze, compute or acceptance authorized.

needs-decision
↗☷
Point-source image plane · CPU
1 task · next step

No new committed campaign measurements. Phases 1–4 remain shipped; epic closure is a human decision. Carried leftovers remain pending. RAL queue empty at review, but transfer preview timed out: cleanup folders and unpulled results unverified. Select one owed cleanup/measurement phase only after review.

Reviewed 2026-10-13

Active tasks

active
↗☷
Point-source image plane · A100
1 task · next step

No new image-plane fit measurement found. Correctness fix #768 remains shipped; current libraries now have release 2026.10.12.1, not a measured performance baseline. Image-plane admission measurement still needs authorization. #411 merged 2026-10-13, recording the paired-round MDI reinterpretation; no new measurement.

Reviewed 2026-10-13

Active tasks

needs-decision
↗☷
Point-source source plane
2 tasks · next step

Core remains parked; autolens_inference#21 reorganized setup evidence but added no point-source gradient admission measurement. #408 merged median fields into 11 runtime cells; #412 merged 2026-10-13, completing headline/repeat support. No new runtime sweep; keep Blackjax parked.

Reviewed 2026-10-13

Active tasks

parked
↗☷
Cluster PointSolver robustness and performance
2 tasks · next step

No campaign wiki/results change or new matching implementation claim found. Representative cluster baseline and observable-overflow policy remain unstarted. Choose one bounded phase; inherited single-source results do not qualify a representative cluster baseline.

Reviewed 2026-10-13

Active tasks

active
↗☷
Interferometer likelihood and streaming
4 tasks · next step

No new committed measurements. Decision matrix remains filled; streaming 1e8 CPU/A100 rows and the #332 memo after-measurement still need authorization. #411 merged 2026-10-13: the historical numba kill gate is INCONCLUSIVE (four rounds). Curvature preload needs the fixed-mapper science decision; FFT levers remain unstarted.

Reviewed 2026-10-13

Active tasks

active
↗☷
Linear-solver accuracy and cost
0 tasks · next step

Retain the 2026-10-08 human decision: Jacobi for Mapper, raw+polish for MGE-only, no default change. Project wiki still says decision pending (stale). No new solver measurements after the recorded phase-5 results; release 2026.10.12.1 does not supply a rerun. Wide-prior/interferometer gaps remain evidence gaps, not authorized tasks.

Reviewed 2026-10-13

Active tasks

No open tasks.

active
↗☷
Production imaging and likelihood breakdown
3 tasks · next step

No new production-over-sampling or post-certified measurements. #408 now adds median headline fields to runtime cells; #412 merged 2026-10-13 and extends remaining headline surfaces. Production presets, memo-blind harness, cumulative MGE steps and quick-update costs remain separate pending work. Scope production-preset phase 1 (CPU smoke only); A100 measurement separately authorized.

Reviewed 2026-10-13

Active tasks

active
↗☷
Measurement reliability and profiling tools
8 tasks · next step

Timing audit #410–#412 and raw HST/MGE pilot producer #416 merged; implementation issues #362/#415 closed. No fresh production measurements or scientific acceptance. C1/C11 repeat counts, C5 estimator policy, memo interpretation, fresh runtime repeats and other tools remain pending.

Reviewed 2026-10-13

Active tasks

active
↗☷
PyAutoFit profiling bootstrap
1 task · next step

B4a at PR; B4b next. B4a = autofit_profiling#3 (search.fit breakdown cell, profiling-summary@2 exporter, Pages) then this Pulse fit row, then the autofit_workspace_developer retirement PR, merged in that order. Epic-1 ranked table filed in tasks/autofit_profiling_bootstrap.md (2026-10-14); epic 2 not opened. B4b = the EP / graphical baseline port.

Reviewed 2026-10-14

Active tasks

autofit_profiling: bootstrap the repo + general PyAutoFit profiling epic

active · normal

B4a at PR; B4b next. B4a = autofit_profiling#3 (search.fit breakdown cell, profiling-summary@2 exporter, Pages) then this Pulse fit row, then the autofit_workspace_developer retirement PR, merged in that order. Epic-1 ranked table filed in tasks/autofit_profiling_bootstrap.md (2026-10-14); epic 2 not opened. B4b = the EP / graphical baseline port.

active
↗☷
Critical curves and evaluation grids
0 tasks · next step

No new campaign measurement. Phase 3b cap fix remains shipped; project wiki still incorrectly says #646 awaits merge/release. Seed coverage and path completion remain unresolved; retain marching-squares decision and ask the human whether to scope the next phase.

Reviewed 2026-10-13

Active tasks

No open tasks.

needs-decision
↗☷
Certified positive solver
0 tasks · next step

Parked unchanged. No new campaign evidence; existing C2/library/workspace drafts remain pending. Do not infer admission from solver timing, and do not change default or restart the campaign.

Reviewed 2026-10-13

Active tasks

No open tasks.

parked
↗☷

Open means tracked, not necessarily running. Full ledger ↗

Profiling Results

Decision History

Keep Jacobi PDIP as the Mapper default and raw+polish as the MGE-only default

Decision History

Keep Jacobi PDIP as the Mapper default and raw+polish as the MGE-only default