Skip to content

Reduce pipeline compile time with direct docstring parsing - #175

Merged
trissim merged 2 commits into
mainfrom
codex/perf-direct-docstring-dependency
Sep 29, 2026
Merged

trissim merged 2 commits into
mainfrom
codex/perf-direct-docstring-dependency

Conversation

@trissim

@trissim trissim commented Sep 29, 2026 •

Copy link
Copy Markdown
Collaborator

The official 30-case one-well sweep spent 100.1 s in compilation. This updates the python-introspect submodule to OpenHCSDev/python-introspect#4, which removes source/AST work that returned the same docstring parser result. No OpenHCS runtime or benchmark path changes.

In a targeted A/B/A check, ExampleFly compilation was 3.989 → 2.260 → 3.976 s (old/direct/old), and advanced segmentation was 6.259 → 3.176 → 6.303 s. In the full official30 fresh-server sweep, all 30 cases completed and compiled faster: compile sum 100.065 → 58.632 s, observed total sum 375.020 → 311.858 s. The patch has no runtime execution path; execution and startup differences were not attributed to it. The upstream suite passes (127 tests), and 114 real CellProfiler callable docstrings had identical parser results.

This PR is ready for review; merge the upstream dependency PR before landing this submodule update. Closes #174. Upstream issue: python-introspect#3.

The paired CSVs, native CP summary, native-relative figures, and measurement caveats are committed in benchmark/results/perf_direct_docstring_20260929.

@trissim
trissim marked this pull request as ready for review September 29, 2026 13:39
@trissim
trissim merged commit 84d665d into main Sep 29, 2026
14 of 35 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Reduce repeated docstring parsing during pipeline compilation

1 participant