Skip to content

perf(CI-06): batch bulk console language acceptance - #752

Merged
ellainng merged 4 commits into
mainfrom
perf/CI-06-console-batches
Nov 2, 2026
Merged

ellainng merged 4 commits into
mainfrom
perf/CI-06-console-batches

Conversation

@ellainng

@ellainng ellainng commented Nov 2, 2026 •

Copy link
Copy Markdown
Member

The console smoke previously submitted its entire successful-language corpus through Playwright form operations and reran CPython for each source. Bulk comparisons now use two installed console host/worker sessions, retaining the shipped language/library/grant/resource boundaries and fresh module state for every program. Adopted corpus expectations are shared with the independently validated differential matrix; new examples still use isolated CPython.

The existing error/diagnostic checks, offline reloads, service-worker/profile updates and all Stop/Restart cycles remain on their UI paths. Reports identify UI versus worker counts and total time.

Validation: full Chromium smoke, 4,086 program records and 158 check groups exactly matching the pre-change CI artifact; all 222 Stop/Restart cycles retained. Local smoke: 258.4s, with 1,591 UI calls and 4,086 batched comparisons. The prior Linux CI smoke was 426.1s; upcoming CI supplies a same-platform measurement. Two focused expectation tests and 13 runner/reference tests pass.

#751 is merged. Closes #748.

CI verification: all 16 regression jobs pass in run 41424015512. The Linux console completes in 312.2s versus the preceding run's 426.1s, with all 4,086 program records, 158 check groups and 222 Stop/Restart cycles retained. Parent reconciliation resolves only overlapping documentation text; the focused implementation diff is unchanged.

ellainng added a commit that referenced this pull request Nov 2, 2026
Overlap two isolated browser workers with deterministic responses and per-case deadlines. Retain every profile and driver, with cleanup on failures and a serial override.

Validation: worker-pool tests, four-size real Chromium differential benchmark, and all 16 passing regression jobs on descendant #752 (run 41424015512).

Closes #747.
@ellainng
ellainng changed the base branch from perf/CI-05-browser-workers to main November 2, 2026 10:07
@ellainng
ellainng merged commit 8edb5e5 into main Nov 2, 2026
@ellainng
ellainng deleted the perf/CI-06-console-batches branch November 2, 2026 10:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

CI-06: Batch console language acceptance while retaining UI coverage

1 participant