Commit 68a50d3
authored
ci: Fix benchmarks (#591)
* bench: fetch-main reads report results via per-uuid GET
Bencher's reports LIST endpoint stopped inlining each report's
`results` (it now carries only a `counts` summary), which fetch-main
read as "report found, zero rows" — every !benchmark base fetch on
every backend then exited 3 and silently fell back to a FULL base-side
rerun (rebuild the base binaries + re-measure), ~5 min of redundant
work per entry despite the rows sitting on bencher.
Fetch each SHA-matched report by uuid (the single-report GET still
returns full results) before row parsing; an inlined results array is
still used directly if the API populates it again. Validated against
live bencher at main@7da4132: the aiur-sharded-env/ISLB fetch that
drove the fallback in run 32749751301 now returns its row (5 measures,
empty missing list, exit 0), and a compile fetch at the same SHA
exercises the multi-report-per-testbed aggregation.
* bench: display titles for the aiur-sharded-env-check plots
The five new plots synced with the slug fallback ("aiur-sharded-env-
check: check-time"); name them in the house style — Aiur Env Check
Time / Throughput / Peak RAM Usage, Aiur Env Constants, Aiur Env
Shards. Verified via `ix bench plots --dry-run`.
* ci: lean-update sweeps every Benchmarks package via the /** glob
`. Benchmarks/**` replaces the hand-listed ". Benchmarks/Compile":
the recursive form reaches all seven packages under Benchmarks/
(Catalog, CatalogReal, CatalogSpine, Compile, CompileFC, and Catalog's
nested RelocFixture workspaces) while skipping dotted directories, so
.lake dependency checkouts stay untouched. CompileFC was previously
left pinned to an old toolchain on purpose; it now updates with the
rest.1 parent e47a1b7 commit 68a50d3
3 files changed
Lines changed: 33 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
32 | 32 | | |
33 | 33 | | |
34 | 34 | | |
35 | | - | |
36 | | - | |
37 | | - | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
38 | 41 | | |
39 | 42 | | |
40 | 43 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
78 | 78 | | |
79 | 79 | | |
80 | 80 | | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
81 | 86 | | |
82 | 87 | | |
83 | 88 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
822 | 822 | | |
823 | 823 | | |
824 | 824 | | |
| 825 | + | |
| 826 | + | |
| 827 | + | |
| 828 | + | |
| 829 | + | |
| 830 | + | |
| 831 | + | |
| 832 | + | |
| 833 | + | |
| 834 | + | |
| 835 | + | |
| 836 | + | |
| 837 | + | |
| 838 | + | |
| 839 | + | |
| 840 | + | |
| 841 | + | |
| 842 | + | |
| 843 | + | |
| 844 | + | |
| 845 | + | |
825 | 846 | | |
826 | 847 | | |
827 | | - | |
| 848 | + | |
828 | 849 | | |
829 | 850 | | |
830 | 851 | | |
| |||
0 commit comments