Skip to content

perf(CI-07): balance validation shards from measured timings - #753

Merged
ellainng merged 6 commits into
mainfrom
perf/CI-07-measured-shards
Nov 2, 2026
Merged

ellainng merged 6 commits into
mainfrom
perf/CI-07-measured-shards

Conversation

@ellainng

@ellainng ellainng commented Nov 2, 2026 •

Copy link
Copy Markdown
Member

Case-count estimates gave browser shards 337–714s of observed work and interpreter shards 272–573s. The scheduler now prefers 672 recorded command timings while retaining deterministic fallback estimates for new checks. Selection and preparation/packaging order are unchanged.

The importer reads complete successful runner reports, rejects failures/incomplete/invalid samples, deduplicates reports, ignores removed IDs and records hashes/revisions plus workflow provenance. Repeated samples use their median. New runner reports identify the host and worker configuration.

The initial Linux inventory comes from conformance/interpreter run 41423024431 and integration run 41424015512. One source job reached its deadline after all 99 checks and every upload/cleanup step succeeded; its complete zero-failure runner report is retained.

Validation: 19 focused Python tests, real artifact import, complete/disjoint/deterministic assignments and unchanged commands. All 16 jobs pass in CI run 41425342727. All four interpreter jobs finish within the existing 10-minute deadline (slowest 8m34s). The slowest browser-conformance job is 10m37s versus 14m49s in run 41422170365; timings vary across runners and cache state. Deadlines, runner count, full PR regression gates and lightweight main smoke are unchanged.

#752 is merged. Closes #749.

@ellainng
ellainng changed the base branch from perf/CI-06-console-batches to main November 2, 2026 10:07
@ellainng
ellainng merged commit a8c31a7 into main Nov 2, 2026
@ellainng
ellainng deleted the perf/CI-07-measured-shards branch November 2, 2026 10:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

CI-07: Balance validation shards from recorded command timings

1 participant