Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 5 additions & 2 deletions campaigns.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -142,8 +142,11 @@ tasks:
next: 'Phase 1 (inventory) MERGED 2026-10-08 as autolens_profiling#402 (main un-reddened first by #403, a Brain theme
drift); Mind record complete/2026/10/timing-noise-audit-p1-inventory.md. 31 gates: 11 SOUND / 10 FRAGILE / 10 UNSAFE-SILENT;
worst is dashboard qualify() (laptop / no-loadavg / no-host rows qualify, and Pulse accepts evidence on that flag).
Next: file phase 2 = fix (1) shared overhead verdict for the #361 test + production cell (reuse #362); then fix (2)
dashboard qualification + drift wording, which changes profiling-summary and needs Pulse coordination.'
Phase 2 STARTED 2026-10-08 (human: "do the next step"): fix (1) shared ABBA overhead verdict for the #361 test and the
fixed-light numba cell, budget in ms of excess, t-interval vs budget, visible INCONCLUSIVE; Mind
active/timing_noise_audit_phase2_overhead_verdict.md, worktree timing-noise-audit-p2-overhead-verdict, Opus executing;
superseded "relax it a bit" draft retired. Next: /prm on its PR; then fix (2) dashboard qualification + drift wording
(profiling-summary contract change, Pulse coordination).'
issue: https://github.com/PyAutoLabs/autolens_profiling/issues/362
evidence: https://github.com/PyAutoLabs/autolens_profiling/blob/main/results/notes/timing_noise_audit_2026_10.md
- id: mge_likelihood_breakdown_steps_are_cumulative_an
Expand Down
2 changes: 1 addition & 1 deletion dashboard.html

Large diffs are not rendered by default.

4 changes: 2 additions & 2 deletions dashboard.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# PyAutoPulse β€” profiling dashboard

<!-- pulse-campaigns:161570e1ff092d4786d763e82ad44cc4dd4fff6307169d73eb409c75fa36d052 -->
<!-- pulse-campaigns:9bb9ffb230c27eaee9126701594f90c5e513d7e288bcaaab839cdbce7921b822 -->
## Profiling Check In

<details><summary>Full check-in prompt</summary>
Expand Down Expand Up @@ -139,7 +139,7 @@ Reviewed 2026-10-08. timing_noise_audit phase 1 merged (autolens_profiling#402):

### Active tasks

- [Audit timing tests and profiling gates for measurement noise](https://github.com/PyAutoLabs/PyAutoPulse/blob/main/tasks/timing_noise_audit.md) β€” active: Phase 1 (inventory) MERGED 2026-10-08 as autolens_profiling#402 (main un-reddened first by #403, a Brain theme drift); Mind record complete/2026/10/timing-noise-audit-p1-inventory.md. 31 gates: 11 SOUND / 10 FRAGILE / 10 UNSAFE-SILENT; worst is dashboard qualify() (laptop / no-loadavg / no-host rows qualify, and Pulse accepts evidence on that flag). Next: file phase 2 = fix (1) shared overhead verdict for the #361 test + production cell (reuse #362); then fix (2) dashboard qualification + drift wording, which changes profiling-summary and needs Pulse coordination.
- [Audit timing tests and profiling gates for measurement noise](https://github.com/PyAutoLabs/PyAutoPulse/blob/main/tasks/timing_noise_audit.md) β€” active: Phase 1 (inventory) MERGED 2026-10-08 as autolens_profiling#402 (main un-reddened first by #403, a Brain theme drift); Mind record complete/2026/10/timing-noise-audit-p1-inventory.md. 31 gates: 11 SOUND / 10 FRAGILE / 10 UNSAFE-SILENT; worst is dashboard qualify() (laptop / no-loadavg / no-host rows qualify, and Pulse accepts evidence on that flag). Phase 2 STARTED 2026-10-08 (human: &quot;do the next step&quot;): fix (1) shared ABBA overhead verdict for the #361 test and the fixed-light numba cell, budget in ms of excess, t-interval vs budget, visible INCONCLUSIVE; Mind active/timing_noise_audit_phase2_overhead_verdict.md, worktree timing-noise-audit-p2-overhead-verdict, Opus executing; superseded &quot;relax it a bit&quot; draft retired. Next: /prm on its PR; then fix (2) dashboard qualification + drift wording (profiling-summary contract change, Pulse coordination).
- [MGE likelihood_breakdown steps are cumulative and `linear_gaussians` is reported as 0](https://github.com/PyAutoLabs/PyAutoPulse/blob/main/tasks/mge_likelihood_breakdown_steps_are_cumulative_an.md) β€” ready: Unchanged and unissued (no GitHub refs, 2026-10-04). Select one bounded step when measurement-tools is prioritised.
- [A gradient-cost probe: forward vs `value_and_grad` ms/eval and a strict FD check, on any registry cell](https://github.com/PyAutoLabs/PyAutoPulse/blob/main/tasks/gradient_cost_probe.md) β€” ready: Unissued. New context 2026-10-07: Heart unit-test timing flagged PyAutoLens forward-gradient tests +150%/+96% after PyAutoLens#768 rewrote that test file; not a controlled comparison, and this probe is the right instrument. Select one bounded step when prioritised.
- [Numba breakdown harness: perturb the instance so the operated-matrix memo cannot hide a step](https://github.com/PyAutoLabs/PyAutoPulse/blob/main/tasks/numba_breakdown_harness_memo_blind.md) β€” ready: Unchanged and unissued (PyAutoArray#496 closed 2026-08-27). Select one bounded step when prioritised.
Expand Down
6 changes: 6 additions & 0 deletions tasks/timing_noise_audit.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,12 @@ The original task below is retained verbatim. Current scheduling state lives in
- Lister `scripts/misc/tooling/list_timing_assertions.py --check` is in lint.yml; campaign page `wiki/campaigns/measurement_tools.md` created.
- Proposed fix phases: (1) shared overhead verdict (test + cell, interval vs excess over budget, visible INCONCLUSIVE); (2) dashboard qualification + drift wording (contract change β†’ Pulse coordination); (3) INCONCLUSIVE for go / lever rules, tie sets instead of argmax. Next: file phase 2 = fix (1) from this task, reusing #362; retire the subsumed Mind draft `call_accounting_ci_timing_threshold.md` when it is filed.


### Phase 2 started 2026-10-08

- Human: "do the next step" β†’ fix phase (1) of the audit note, plan approved in chat; issue #362 reused (plan comment posted); Mind `active/timing_noise_audit_phase2_overhead_verdict.md` (3a3d4fc6); worktree `timing-noise-audit-p2-overhead-verdict`; Opus executes. The superseded Mind draft `call_accounting_ci_timing_threshold.md` ("increase it a bit so merge goes through") was retired on the human's approval β€” the guard is fixed, not relaxed.
- Scope: one `abba_overhead_verdict` used by both the CI test and `fixed_light_numba.py`; budget 12 ms of excess over the clean call; one-sided small-sample t-interval of the excess vs budget β†’ PASS / FAIL / FAIL_GROSS / INCONCLUSIVE; n < 3 and below-1 ratios INCONCLUSIVE; cell raises only on FAIL/FAIL_GROSS and keeps the JSON otherwise; promotion requires PASS; the test warns visibly on INCONCLUSIVE; the 1.031 ratio constant goes. No budget raised.

---

# Audit timing tests and profiling gates for measurement noise
Expand Down
Loading