Skip to content

metrics: record baseline receipts and the render arm - #24

Merged
docxology merged 1 commit into
mainfrom
estate/gate-metrics-baseline
Nov 12, 2026
Merged

docxology merged 1 commit into
mainfrom
estate/gate-metrics-baseline

Conversation

@docxology

Copy link
Copy Markdown
Collaborator

What changed

Persists the measured before/after gate numbers in the repository via the metrics producer, instead of only in the PR.

  • docs/_generated/gate-baseline.json records the pre-change arm commands and their measured wall times (activeblockference-gate-baseline/v1), including per-command seconds and a comparable flag.
  • scripts/gate_metrics.py now reads both receipts and renders a Before and after table plus explicit notes for baseline workloads that are not equivalent: types (old mypy targeted 3.12), test-full (baseline was uv run pytest without --cov/--cov-fail-under=90), docs (links only), manuscript (no variables check).
  • docs/_generated/gate-timings.json was re-recorded with --arm all --arm test --arm render, so the render arm is now recorded rather than "not recorded".
  • docs/gate.md and docs/development.md point at the before/after record; docs/_generated/README.md lists the baseline receipt.

Verification

GNN_ROOT=../Generalized_Notation_Notation \
GNN_PYTHON=../Generalized_Notation_Notation/.venv/bin/python \
  uv run python scripts/release_check.py --arm all --arm test --arm render \
    --timings docs/_generated/gate-timings.json
uv run python scripts/gate_metrics.py --check
uv run python scripts/release_check.py --arm docs
uv run python scripts/check_docs_links.py

All pass. Recorded after times (s): lint 0.05, types 0.28, test 15.18, test-full 77.03, docs 10.25, manuscript 7.73, gnn 5.74, smoke 6.10, package 12.87, render 11.65; total run 146.96 s.

@docxology
docxology merged commit 13bd068 into main Nov 12, 2026
0 of 6 checks passed
@docxology
docxology deleted the estate/gate-metrics-baseline branch November 12, 2026 15:52
@docxology
docxology restored the estate/gate-metrics-baseline branch November 12, 2026 15:54
@docxology
docxology deleted the estate/gate-metrics-baseline branch November 12, 2026 16:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant