diff --git a/campaigns.yaml b/campaigns.yaml index 24b5093..11458a8 100644 --- a/campaigns.yaml +++ b/campaigns.yaml @@ -1,38 +1,42 @@ version: 1 -last_checkin: '2026-10-04T17:18:38Z' +last_checkin: '2026-10-07T18:43:45Z' campaigns: - id: setup-baseline title: Setup baseline collection and scientific acceptance status: needs-decision - updated: '2026-10-06' - next: 'Specification is draft (autolens_profiling#384); no baseline collection or acceptance authorized. - Resolve immutable software and dependency lock, dataset hashes/settings, hardware/threads/load and - timing/cache/memory methodology/witnesses; freeze the manifest before separately authorizing collection. - Compile probe builder remains unavailable; archived timings are context only.' - evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/62a6ad1e82735e360c7cf25be62253a286493b17/wiki/campaigns/setup_baseline.md + updated: '2026-10-07' + next: 'Specification merged as draft v1 (autolens_profiling#385, 2026-10-06; issue #384 closed). Six unknowns + remain: no frozen revisions/env lock; no collection authorization/window; hardware/affinity identity unselected; + each cell needs complete settings, input hashes, witness + tolerances; compile per-cell builder unavailable; + proposed fp64/mixed coverage is not evidence of support. Human freezes the manifest before separately + authorizing collection.' + evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/719459fefb40c7e5be157f652818dbf923830557/wiki/campaigns/setup_baseline.md - id: point-source-image-cpu title: Point-source image plane · CPU status: active - updated: '2026-10-04' - next: 'Phases 1–4 shipped; PyAutoLens#764 (extent warning) released in 2026.10.4.1. Next: docs-only autolens_profiling - PR writing campaign completion evidence and fixing stale wiki/index lines (#763 ''in flight'' → #764 merged). - RAL leftover folders present; mirror sync unverified.' - evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/a93f37a7ade16fcb7673a7777dfde505183728ed/wiki/campaigns/point_source_image_plane_cpu.md + updated: '2026-10-07' + next: 'Phases 1–4 shipped; completion evidence merged (autolens_profiling#373, 2026-10-04). Closing the epic is + the human''s call. Owed leftovers (RAL cleanup, test move, register_model grad-zero prompt, CI smoke cells, + constant_folding A/B, nopad deletion, quiet re-runs) are in the Mind draft point_source_cpu_campaign_owed_leftovers.md. + RAL leftover folders not re-listed 2026-10-07 (unverified).' + evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/719459fefb40c7e5be157f652818dbf923830557/results/notes/point_source_cpu_campaign.md#campaign-completion-evidence-2026-10-04 - id: point-source-image-gpu title: Point-source image plane · A100 status: needs-decision - updated: '2026-10-04' - next: 'Phase 0+1 shipped (profiling#353 merged 2026-09-30; wiki stale). Forward-mode gradient NaN is unfixed and - live in 2026.10.4.1 but only a Mind draft. Human decisions: issue that bug; authorize the autolens_inference - image-plane fit measurement.' - evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/a93f37a7ade16fcb7673a7777dfde505183728ed/wiki/campaigns/point_source_gpu_breakdown.md + updated: '2026-10-07' + next: 'Phase 0+1 shipped. Forward-mode gradient NaN (PyAutoLens#767) fixed by PyAutoLens#768 (merged 2026-10-04) + and released in 2026.10.7.1 (correctness). Remaining human decision: authorize the autolens_inference image-plane + fit measurement. Heart unit-test timing rose on the rewritten #768 test file; not a controlled cost comparison + (gradient_cost_probe is the instrument).' + evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/719459fefb40c7e5be157f652818dbf923830557/wiki/campaigns/point_source_gpu_breakdown.md - id: point-source-source title: Point-source source plane status: parked - updated: '2026-10-04' - next: 'Core complete. Nautilus leaf autolens_inference#17 merged 2026-10-02 (wiki still says open). Blackjax parked: - gradient-sampler admission not met. Warm-up task awaits the human''s option (a)/(b)/(c).' - evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/a93f37a7ade16fcb7673a7777dfde505183728ed/wiki/campaigns/point_source_source_plane.md + updated: '2026-10-07' + next: 'Core complete; parked. Nautilus leaf autolens_inference#17 merged 2026-10-02; no gradient-sampler leaf yet, + so Blackjax stays parked (admission not met). Warm-up task option (a) merged as autolens_profiling#374 (2026-10-04); + imaging cells and a release sweep remain.' + evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/719459fefb40c7e5be157f652818dbf923830557/wiki/campaigns/point_source_source_plane.md - id: cluster-pointsolver title: Cluster PointSolver robustness and performance status: active @@ -44,18 +48,21 @@ campaigns: - id: interferometer title: Interferometer likelihood and streaming status: active - updated: '2026-10-04' - next: 'Last CPU cell ran (RAL job 375978_3 COMPLETED 1:11:36, JSON on RAL, not on main) but misses the ≤1e-3 nat - CPU/A100 witness: human decision needed. Streaming phases 3–5 shipped; the scaling measurement needs compute - authorization. Curvature, memo and FFT tasks unstarted.' - evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/a93f37a7ade16fcb7673a7777dfde505183728ed/wiki/campaigns/interferometer_likelihood.md + updated: '2026-10-07' + next: 'Decision matrix complete: last cell merged (autolens_profiling#372, 2026-10-04; 1.59e-3 nat CPU/A100 gap + accepted by the human). Streaming scaling phase 1 CPU rows merged (#375); 1e8 CPU and A100 rows need compute + authorization. fnnls memo back-off released in 2026.10.7.1 (PyAutoArray#615); the #332 after-measurement is + owed. Curvature preload and W~ FFT tasks unstarted.' + evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/719459fefb40c7e5be157f652818dbf923830557/wiki/campaigns/interferometer_likelihood.md - id: linear-solver title: Linear-solver accuracy and cost - status: blocked - updated: '2026-10-04' - next: 'Release half met: PyAutoArray#595 is in 2026.10.2.1 and 2026.10.4.1. RAL mirror sync (HPCPullPyAuto, plus - a dependency-floor diff) unverified; phase 3 GPU/vmap parity and timing waits on it.' - evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/a93f37a7ade16fcb7673a7777dfde505183728ed/wiki/campaigns/linear_solver_accuracy.md + status: ready + updated: '2026-10-07' + next: 'Human decision 2026-10-07: the shared RAL mirror /mnt/ral/jnightin/PyAuto is NEVER synced (HPCPullPyAuto) while + euclid_dr1 depends on it. Phase 3 GPU/vmap parity and timing run from a PRIVATE checkout at tag 2026.10.7.1 (contains + PyAutoArray#595) with its own environment; note Nerves at that tag excludes jax 0.10.*, RAL has jax 0.10.2. Queue + was empty at ~18:40Z (one probe); mirror HEAD/tag unverified and no longer needed.' + evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/719459fefb40c7e5be157f652818dbf923830557/wiki/campaigns/linear_solver_accuracy.md - id: imaging title: Production imaging and likelihood breakdown status: active @@ -67,23 +74,26 @@ campaigns: - id: measurement-tools title: Measurement reliability and profiling tools status: active - updated: '2026-10-04' - next: 'Only timing_noise_audit is issued (autolens_profiling#362: open, no comments, unassigned); start its audit - phase via start_dev. Other nine tasks unchanged and unissued; mass_field superseded confirmed.' - evidence: https://github.com/PyAutoLabs/PyAutoPulse/tree/f1801514ddcf2272b832c2b53713cd2257aea5c0/tasks + updated: '2026-10-07' + next: 'Only timing_noise_audit is issued (autolens_profiling#362: open, 0 comments, unassigned, unchanged since + 2026-10-02); start its audit phase via start_dev. New related Mind draft draft/bug/autolens_profiling/call_accounting_ci_timing_threshold.md + (2026-10-06). Other tasks unchanged and unissued.' + evidence: https://github.com/PyAutoLabs/autolens_profiling/issues/362 - id: autofit title: PyAutoFit profiling bootstrap - status: needs-decision - updated: '2026-10-04' - next: PyAutoLabs/autofit_profiling does not exist (gh, 2026-10-04). Human decision pending on repo creation; no - producer registration until it exists with ported baselines. - evidence: https://github.com/PyAutoLabs/PyAutoPulse/tree/f1801514ddcf2272b832c2b53713cd2257aea5c0/tasks + status: ready + updated: '2026-10-07' + next: PyAutoLabs/autofit_profiling created 2026-10-07 (one Initial commit, LICENSE only, no PRs); the repo-creation + decision is answered. Porting/bootstrap unstarted; no producer registration until baselines are ported. + evidence: https://github.com/PyAutoLabs/autofit_profiling - id: critical-curves title: Critical curves and evaluation grids status: needs-decision - updated: '2026-10-04' - next: 'Release gate met: PyAutoGalaxy#646 first released in 2026.10.4.1. 2026-10-04: /prm of autolens_workspace_test#343 was denied by the auto-mode classifier ("Merge Without Review"); the human runs it outside auto mode to close the evaluation-grid-cap-field task.' - evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/a93f37a7ade16fcb7673a7777dfde505183728ed/wiki/campaigns/critical_curves.md + updated: '2026-10-07' + next: 'Phase 3b cap fix shipped: PyAutoGalaxy#646 released in 2026.10.4.1 and autolens_workspace_test#343 merged + 2026-10-04. Remaining per the wiki Next line: investigate seed coverage/path completion before cluster engine + selection (human picks whether to scope it). Wiki page itself is stale (last edited 2026-10-02, still says #646 open).' + evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/719459fefb40c7e5be157f652818dbf923830557/wiki/campaigns/critical_curves.md - id: certified-solver title: Certified positive solver status: parked @@ -98,11 +108,12 @@ tasks: status: needs-decision priority: high path: tasks/setup_baseline_campaign.md - updated: '2026-10-06' - next: 'Human resolves draft manifest choices and freezes the specification; collection requires separate - compute authorization. The report prepares evidence for human scientific review and never promotes - baselines. CPU production arrays use ral only; compile capability gap remains open.' - evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/62a6ad1e82735e360c7cf25be62253a286493b17/baseline/campaign.json + updated: '2026-10-07' + next: 'Specification merged as draft v1 (autolens_profiling#385, 2026-10-06). Human resolves the six recorded + unknowns and freezes the specification; collection requires separate compute authorization. The report prepares + evidence for human scientific review and never promotes baselines. CPU production arrays use ral only.' + issue: https://github.com/PyAutoLabs/autolens_profiling/issues/384 + evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/719459fefb40c7e5be157f652818dbf923830557/baseline/campaign.json - id: runtime_cell_single_jit_gpu_warmup campaign: point-source-source title: Runtime cells' A100 `single_jit` includes the post-compile warm-up — source-plane 0.642 ms vs a steady @@ -110,19 +121,23 @@ tasks: status: active priority: low path: tasks/runtime_cell_single_jit_gpu_warmup.md - updated: '2026-10-04' - next: 'Execution 2026-10-04: human chose option (a). Branch feature/runtime-single-jit-median @87a7fcc (issue autolens_profiling#371) parked at Heart RED. Local CPU witness: single_jit 0.417 ms, median 0.388 ms (p10 0.320, p90 0.545). Imaging cells not yet wired.' + updated: '2026-10-07' + next: 'Option (a) merged (autolens_profiling#374, 2026-10-04): full_pipeline_single_jit_median_ms (p10/p90) beside + unchanged single_jit; GPU headline labelled "first block after compile". Imaging release-sweep cells not wired. + No release sweep on main yet (results/ commits since 2026-10-04: #375 streaming rows, a README refactor), so the + new field has no sweep rows.' issue: https://github.com/PyAutoLabs/autolens_profiling/issues/371 - evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/a93f37a7ade16fcb7673a7777dfde505183728ed/scripts/point_source_source/likelihood_runtime/source_plane_solved.py + evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/719459fefb40c7e5be157f652818dbf923830557/scripts/point_source_source/source_plane/likelihood_runtime_solved.py - id: timing_noise_audit campaign: measurement-tools title: Audit timing tests and profiling gates for measurement noise status: ready priority: high path: tasks/timing_noise_audit.md - updated: '2026-10-04' - next: Issued as autolens_profiling#362 (open, 0 comments, unassigned). Start its read-and-classify audit phase - via start_dev. + updated: '2026-10-07' + next: 'Issued as autolens_profiling#362 (open, 0 comments, unassigned, unchanged since 2026-10-02). Related new + Mind draft draft/bug/autolens_profiling/call_accounting_ci_timing_threshold.md (2026-10-06). Start the read-and-classify + audit phase via start_dev.' issue: https://github.com/PyAutoLabs/autolens_profiling/issues/362 - id: mge_likelihood_breakdown_steps_are_cumulative_an campaign: measurement-tools @@ -138,9 +153,11 @@ tasks: status: ready priority: low path: tasks/gradient_cost_probe.md - updated: '2026-10-04' - next: Unchanged and unissued (workspace_developer#117 closed 2026-07-28). Select one bounded step when prioritised. - evidence: https://github.com/PyAutoLabs/autolens_workspace_developer/issues/117 + updated: '2026-10-07' + next: 'Unissued. New context 2026-10-07: Heart unit-test timing flagged PyAutoLens forward-gradient tests +150%/+96% + after PyAutoLens#768 rewrote that test file; not a controlled comparison, and this probe is the right instrument. + Select one bounded step when prioritised.' + evidence: https://github.com/PyAutoLabs/PyAutoLens/pull/768 - id: numba_breakdown_harness_memo_blind campaign: measurement-tools title: 'Numba breakdown harness: perturb the instance so the operated-matrix memo cannot hide a step' @@ -182,21 +199,24 @@ tasks: - id: mge_nnls_fix_pyautoarray_571_slam_60 campaign: linear-solver title: 'Linear-solver programme phase 3: GPU/vmap/A100 timing and parity rows for the solver corpus' - status: blocked + status: ready priority: medium path: tasks/mge_nnls_fix_pyautoarray_571_slam_60.md - updated: '2026-10-04' - next: 'RAL sync SKIPPED 2026-10-04: 180 euclid_dr1 tasks RUNNING on the shared base; mirror at 2026-09-27 state, 16–35 commits behind tag 2026.10.4.1; a sync pulls MAINS and also needs a jax reinstall (Nerves main excludes jax 0.10.2). Next: sync when `squeue -u jnightin -t R` shows no euclid_dr1 jobs on the shared base, or the human accepts the risk.' + updated: '2026-10-07' + next: 'Human decision 2026-10-07: do not HPCPullPyAuto the shared mirror (euclid_dr1 needs it). Next bounded step: + plan the phase-3 A100 cells from a private RAL checkout at tag 2026.10.7.1 with a jax that satisfies Nerves + (jax 0.10.* excluded; RAL has 0.10.2), then request compute authorization for the parity/timing rows.' evidence: https://github.com/PyAutoLabs/PyAutoArray/pull/595 - id: autofit_profiling_bootstrap campaign: autofit title: 'autofit_profiling: bootstrap the repo + general PyAutoFit profiling epic' - status: needs-decision + status: ready priority: normal path: tasks/autofit_profiling_bootstrap.md - updated: '2026-10-04' - next: Human answers the single repo-creation question (PyAutoLabs/autofit_profiling absent, 2026-10-04) before - any porting. + updated: '2026-10-07' + next: PyAutoLabs/autofit_profiling created 2026-10-07 (LICENSE-only Initial commit, no PRs). Bootstrap/porting + unstarted; start the first bounded phase via start_dev. No producer registration until baselines are ported. + evidence: https://github.com/PyAutoLabs/autofit_profiling - id: cluster_pointsolver_speed campaign: cluster-pointsolver title: Cluster PointSolver — robustness, analysis settings and performance @@ -220,39 +240,47 @@ tasks: campaign: interferometer title: Interferometer decision matrix — fill the last cell (CPU rect 39² at alma_high r5.0) and flip the wiki row to shipped - status: active + status: complete priority: normal path: tasks/interferometer_decision_matrix_last_cell.md - updated: '2026-10-04' - next: 'Execution 2026-10-04: human decision ACCEPT the 1.59e-3 nat CPU/A100 gap (precedent r3.5 at 1.5e-3). Branch feature/interferometer-decision-matrix-last-cell @93a002a committed locally; ship PARKED at Heart RED (release validation FAILED, stage integrate). Caveat: the A100 row''s own A/B shows certified solver = PDIP to 0.0 nat, so the gap may be F/D on older revisions rather than solver. Correction: PyAutoArray#582 first released 2026.9.27.2. Next: ship once Heart clears.' + updated: '2026-10-07' + next: 'Complete: autolens_profiling#372 merged 2026-10-04 (RAL 375978_3; 1.59e-3 nat CPU/A100 gap accepted by the + human). Every decision-matrix cell is filled. Caveat retained: the gap may be F/D on older revisions rather than solver.' issue: https://github.com/PyAutoLabs/autolens_profiling/issues/369 + evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/719459fefb40c7e5be157f652818dbf923830557/wiki/campaigns/interferometer_likelihood.md - id: interferometer_fixed_mapper_curvature_preload campaign: interferometer title: 'Interferometer fixed-mapper searches: reuse the W~ curvature matrix across likelihood calls via `preloads.curvature_matrix`' status: ready priority: normal path: tasks/interferometer_fixed_mapper_curvature_preload.md - updated: '2026-10-04' - next: Phase 1 sliced 2026-10-04 into a Mind draft (PyAutoArray preload plumbing + CPU breakdown lever, no GPU); run it through start_dev. Human science call first - no production SLaM stage holds the mapper fixed today. + updated: '2026-10-07' + next: Phase 1 Mind draft (2026-10-04) still unstarted; run it through start_dev. Human science call first - no production SLaM stage holds the mapper fixed today. evidence: https://github.com/PyAutoLabs/PyAutoMind/blob/55a453cf/draft/feature/autoarray/interferometer_curvature_preload_phase1.md - id: interferometer_nnls_memo_scattered_stream_guard campaign: interferometer title: 'fnnls warm-start memo: stop it slowing scattered evaluation streams (interferometer CPU, autolens_profiling#332)' - status: ready + status: active priority: medium path: tasks/interferometer_nnls_memo_scattered_stream_guard.md - updated: '2026-10-04' - next: Unstarted (no PR/issue/branch/results, 2026-10-04). Select one bounded step when prioritised. + updated: '2026-10-07' + next: 'Library half shipped: PyAutoArray#615 (closes #613) merged 2026-10-06, in 2026.10.7.1. Local solver-only + witness (n=576): iid memo on/off 1.49x → 1.17x; walk 0.18x unchanged. Owed: re-run the autolens_profiling#332 + ALMA Delaunay 2.17x after-measurement (needs compute authorization).' + issue: https://github.com/PyAutoLabs/PyAutoArray/issues/613 + evidence: https://github.com/PyAutoLabs/PyAutoArray/pull/615 - id: interferometer_streaming_scaling campaign: interferometer title: 'Campaign: interferometer streaming (array-free) vs in-memory — memory and time scaling to 2e8 visibilities' status: active priority: high path: tasks/interferometer_streaming_scaling.md - updated: '2026-10-04' - next: 'Execution 2026-10-04: branch feature/interferometer-streaming-scaling @4a0ef46 (issue autolens_profiling#368) parked at Heart RED. Laptop CPU 8-thread indicative rows recorded (chunk 65536 to 5e7 vis; in-memory first failure 1e6 under a 10 GB cap; parity 1.2e-9 nats at 5e5; 1e8 skipped). Go/no-go overtaken; recorded as release evidence for 2026.10.4.1. nufft_chunk_size arm hits a second memory wall in transformer.image_from (library candidate, no issue filed).' + updated: '2026-10-07' + next: 'Phase 1 CPU cells + results/streaming_scaling rows merged (autolens_profiling#375, 2026-10-04); wiki/campaigns/interferometer_streaming.md. + Optional: 1e8 CPU row and A100 rows (compute authorization). Library candidate unfiled: chunk transformer.image_from + in apply_sparse_operator (memory).' issue: https://github.com/PyAutoLabs/autolens_profiling/issues/368 - evidence: https://github.com/PyAutoLabs/PyAutoArray/pull/601 + evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/719459fefb40c7e5be157f652818dbf923830557/wiki/campaigns/interferometer_streaming.md - id: interferometer_w_tilde_fft_size_levers campaign: interferometer title: 'Interferometer W~ curvature matrix is FFT-bound on the mask extent: pruned padded FFT and real-space pixel @@ -277,9 +305,11 @@ tasks: status: needs-decision priority: high path: tasks/point_source_image_plane_gpu_breakdown.md - updated: '2026-10-04' - next: 'Execution 2026-10-04: forward-mode NaN issued as PyAutoLens#767 (reproduced on CPU fp64: forward [nan]x5, reverse finite; stack 2026.10.4.1+3 b695e57b6); Mind registry 0112ccba. The autolens_inference image-plane fit measurement still awaits human authorisation.' - evidence: https://github.com/PyAutoLabs/PyAutoLens/issues/767 + updated: '2026-10-07' + next: 'Forward-mode NaN (PyAutoLens#767) closed: fixed by PyAutoLens#768 (merged 2026-10-04, 0659903d4), released + in 2026.10.7.1. The autolens_inference image-plane fit measurement still awaits human authorisation.' + issue: https://github.com/PyAutoLabs/PyAutoLens/issues/767 + evidence: https://github.com/PyAutoLabs/PyAutoLens/pull/768 - id: point_source_source_plane_chi_squared_speed campaign: point-source-source title: Point-source source-plane chi-squared speed-up campaign — remaining candidates (phases 1–2e shipped) @@ -296,10 +326,12 @@ tasks: status: ready priority: low path: tasks/pointsolver_cpu_speed_campaign_remainder.md - updated: '2026-10-04' - next: 'Execution 2026-10-04: docs-only branch feature/point-source-wiki-reconcile @0560284 (issue autolens_profiling#370), parked at Heart RED. Still owed: RAL cleanup, register_model grad-zero prompt, test move, CI smoke cells, nopad deletion.' + updated: '2026-10-07' + next: 'Completion evidence merged (autolens_profiling#373, 2026-10-04). Still owed, via Mind draft draft/maintenance/autolens/point_source_cpu_campaign_owed_leftovers.md: + RAL cleanup, test move, register_model grad-zero prompt, CI smoke cells, constant_folding A/B, nopad deletion, + quiet re-runs.' issue: https://github.com/PyAutoLabs/autolens_profiling/issues/370 - evidence: https://github.com/PyAutoLabs/PyAutoLens/pull/764 + evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/719459fefb40c7e5be157f652818dbf923830557/results/notes/point_source_cpu_campaign.md#campaign-completion-evidence-2026-10-04 - id: post_certified_solver_likelihood_breakdown campaign: imaging title: Assess remaining likelihood bottlenecks after certified solver integration on CPU and GPUs @@ -335,9 +367,9 @@ tasks: status: ready priority: high path: tasks/pair_jax_xla_env_vars_with_measured.md - updated: '2026-10-04' - next: 'Unchanged and unissued. Context: jax-version policy changes merged to library mains 2026-10-04, unreleased. - Select one bounded step when prioritised.' + updated: '2026-10-07' + next: 'Unchanged and unissued. Context: the jax-version policy is now released (2026.10.7.1 libraries require Nerves + with the JAX deadlock exclusions). Select one bounded step when prioritised.' - id: quick_update_plotting_cost campaign: imaging title: Quick-update plotting cost — minutes per update, and it is not JAX compile diff --git a/dashboard.html b/dashboard.html index ad00aad..9551611 100644 --- a/dashboard.html +++ b/dashboard.html @@ -645,7 +645,7 @@ Work on GitHub: - PyAutoPulse: https://github.com/PyAutoLabs/PyAutoPulse - autolens_profiling: https://github.com/PyAutoLabs/autolens_profiling
Last updated 2026-10-07 18:28:24 UTC
↻ Update

-

Active campaigns

CampaignStatusLinks
Setup baseline collection and scientific acceptance
1 task · next step

Specification is draft (autolens_profiling#384); no baseline collection or acceptance authorized. Resolve immutable software and dependency lock, dataset hashes/settings, hardware/threads/load and timing/cache/memory methodology/witnesses; freeze the manifest before separately authorizing collection. Compile probe builder remains unavailable; archived timings are context only.

Reviewed 2026-10-06

Active tasks

Freeze the setup baseline specification, then collect and review evidence

needs-decision · high

Human resolves draft manifest choices and freezes the specification; collection requires separate compute authorization. The report prepares evidence for human scientific review and never promotes baselines. CPU production arrays use ral only; compile capability gap remains open.

needs-decision
Point-source image plane · CPU
1 task · next step

Phases 1–4 shipped; PyAutoLens#764 (extent warning) released in 2026.10.4.1. Next: docs-only autolens_profiling PR writing campaign completion evidence and fixing stale wiki/index lines (#763 'in flight' → #764 merged). RAL leftover folders present; mirror sync unverified.

Reviewed 2026-10-04

Active tasks

active
Point-source image plane · A100
1 task · next step

Phase 0+1 shipped (profiling#353 merged 2026-09-30; wiki stale). Forward-mode gradient NaN is unfixed and live in 2026.10.4.1 but only a Mind draft. Human decisions: issue that bug; authorize the autolens_inference image-plane fit measurement.

Reviewed 2026-10-04

Active tasks

needs-decision
Point-source source plane
2 tasks · next step

Core complete. Nautilus leaf autolens_inference#17 merged 2026-10-02 (wiki still says open). Blackjax parked: gradient-sampler admission not met. Warm-up task awaits the human's option (a)/(b)/(c).

Reviewed 2026-10-04

Active tasks

parked
Cluster PointSolver robustness and performance
2 tasks · next step

Unchanged since 2026-09-27; nothing issued or claimed. Wiki still points at the removed Mind draft (now Pulse tasks/). Pick one bounded phase: observable-overflow invalid-result policy + CI witness, or a representative-data baseline cell.

Reviewed 2026-10-04

Active tasks

active
Interferometer likelihood and streaming
5 tasks · next step

Last CPU cell ran (RAL job 375978_3 COMPLETED 1:11:36, JSON on RAL, not on main) but misses the ≤1e-3 nat CPU/A100 witness: human decision needed. Streaming phases 3–5 shipped; the scaling measurement needs compute authorization. Curvature, memo and FFT tasks unstarted.

Reviewed 2026-10-04

Active tasks

Interferometer decision matrix — fill the last cell (CPU rect 39² at alma_high r5.0) and flip the wiki row to shipped↗

active · normal

Execution 2026-10-04: human decision ACCEPT the 1.59e-3 nat CPU/A100 gap (precedent r3.5 at 1.5e-3). Branch feature/interferometer-decision-matrix-last-cell @93a002a committed locally; ship PARKED at Heart RED (release validation FAILED, stage integrate). Caveat: the A100 row's own A/B shows certified solver = PDIP to 0.0 nat, so the gap may be F/D on older revisions rather than solver. Correction: PyAutoArray#582 first released 2026.9.27.2. Next: ship once Heart clears.

Campaign: interferometer streaming (array-free) vs in-memory — memory and time scaling to 2e8 visibilities↗

active · high

Execution 2026-10-04: branch feature/interferometer-streaming-scaling @4a0ef46 (issue autolens_profiling#368) parked at Heart RED. Laptop CPU 8-thread indicative rows recorded (chunk 65536 to 5e7 vis; in-memory first failure 1e6 under a 10 GB cap; parity 1.2e-9 nats at 5e5; 1e8 skipped). Go/no-go overtaken; recorded as release evidence for 2026.10.4.1. nufft_chunk_size arm hits a second memory wall in transformer.image_from (library candidate, no issue filed).

active
Linear-solver accuracy and cost
1 task · next step

Release half met: PyAutoArray#595 is in 2026.10.2.1 and 2026.10.4.1. RAL mirror sync (HPCPullPyAuto, plus a dependency-floor diff) unverified; phase 3 GPU/vmap parity and timing waits on it.

Reviewed 2026-10-04

Active tasks

Linear-solver programme phase 3: GPU/vmap/A100 timing and parity rows for the solver corpus

blocked · medium

RAL sync SKIPPED 2026-10-04: 180 euclid_dr1 tasks RUNNING on the shared base; mirror at 2026-09-27 state, 16–35 commits behind tag 2026.10.4.1; a sync pulls MAINS and also needs a jax reinstall (Nerves main excludes jax 0.10.2). Next: sync when `squeue -u jnightin -t R` shows no euclid_dr1 jobs on the shared base, or the human accepts the risk.

blocked
Production imaging and likelihood breakdown
3 tasks · next step

No new results since the pin. Over-sampling phase 1: add --instrument production presets to the JAX Delaunay cells (CPU smoke only); PyAutoArray#606 S/N over-sampling helper (in 2026.10.4.1) is new context. Post-certified Blocked-by is stale (resolved 2026-09-27).

Reviewed 2026-10-04

Active tasks

active
Measurement reliability and profiling tools
9 tasks · next step

Only timing_noise_audit is issued (autolens_profiling#362: open, no comments, unassigned); start its audit phase via start_dev. Other nine tasks unchanged and unissued; mass_field superseded confirmed.

Reviewed 2026-10-04

Active tasks

active
PyAutoFit profiling bootstrap
1 task · next step

PyAutoLabs/autofit_profiling does not exist (gh, 2026-10-04). Human decision pending on repo creation; no producer registration until it exists with ported baselines.

Reviewed 2026-10-04

Active tasks

needs-decision
Critical curves and evaluation grids
0 tasks · next step

Release gate met: PyAutoGalaxy#646 first released in 2026.10.4.1. 2026-10-04: /prm of autolens_workspace_test#343 was denied by the auto-mode classifier ("Merge Without Review"); the human runs it outside auto mode to close the evaluation-grid-cap-field task.

Reviewed 2026-10-04

Active tasks

No open tasks.

needs-decision
Certified positive solver
0 tasks · next step

Parked by choice; wiki unchanged since ab1e4fd (2026-09-27). Its three library/workspace Mind drafts remain in Mind. Retain parked; read the project ledger before proposing new work.

Reviewed 2026-10-04

Active tasks

No open tasks.

parked

Open means tracked, not necessarily running. Full ledger ↗

Profiling Results