diff --git a/benchmark/results/perf_direct_docstring_20260929/README.md b/benchmark/results/perf_direct_docstring_20260929/README.md new file mode 100644 index 0000000000..592625abb5 --- /dev/null +++ b/benchmark/results/perf_direct_docstring_20260929/README.md @@ -0,0 +1,28 @@ +# Direct docstring parser: official30 one-well benchmark (2026-09-29) + +The changed dependency is python-introspect `5bb79d5` → `4e8f8bd` ([upstream PR #4](https://github.com/OpenHCSDev/python-introspect/pull/4)). The two fresh-server runs used the same OpenHCS integration checkout, containing the separately proposed single-thread performance changes through `38ec4fbc1`; only the python-introspect checkout changed between control and direct-parser runs. The direct-parser checkout was then committed as `8ace32939` for the reused-server run. This report accompanies the isolated submodule bump in [OpenHCS PR #175](https://github.com/OpenHCSDev/openhcs/pull/175). + +All 30 official portable cases succeeded in each run. `control_fresh.csv` and `direct_fresh.csv` use a fresh client-owned ZMQ server per observation. `direct_reused.csv` uses one client-owned server across the sweep. `native_cp_summary.csv` is the fresh native CellProfiler 4.2.8.1 baseline used to project native execution time by well count. Each CSV carries `server_lifecycle` where applicable. + +| 30-case sum (s) | Control fresh | Direct fresh | Direct reused | +| --- | ---: | ---: | ---: | +| Server compilation jobs | 100.065 | 58.632 | 22.607 | +| Server execution jobs | 103.767 | 93.115 | 93.564 | +| Non-job (`total - compile - execute`) | 171.189 | 160.110 | 25.773 | +| Per-observation `total_seconds` | 375.020 | 311.858 | 141.944 | + +All 30 cases compiled faster after the parser change; the median case saved 1.342 s in compilation. The direct-parser patch changes compilation metadata extraction, not runtime execution. The execution and fresh-server non-job differences are observed variation and should not be attributed to the patch. The reused-server total excludes its once-per-sweep startup/shutdown, while the fresh-server total includes startup/shutdown for every observation. Reuse also benefits from warm in-process compilation and cache state, so the 169.914 s fresh-to-reused difference is not a measured whole-sweep wall-time speedup. + +A targeted A/B/A check gave ExampleFly compile times 3.989 → 2.260 → 3.976 s and advanced segmentation 6.259 → 3.176 → 6.303 s (old/direct/old). Direct parsing produced identical `DocstringInfo` for 114 real CellProfiler callables. The upstream test suite passed 127 tests. + +`direct_fresh_native_relative.png` and `direct_reused_native_relative.png` show **execution** speedup relative to the native CP baseline. They do not depict total time or multiple-well scaling. The completed four-mode native-relative execution sweep predating this compile-only change is stored separately at `official30-four-modes-native-relative-fresh-v2-20260928` in the benchmark run workspace; a new 120-observation sweep was intentionally not used as evidence for this patch because its execution path did not change. + +Fresh command (repeat with `--reuse-execution-server` for the reused run): + +```bash +OPENHCS_CPU_ONLY=true .venv/bin/python scripts/benchmark_cppipe_well_throughput.py \ + --manifest benchmark/manifests/official30_portable_axis1.json \ + --output-dir /path/to/output \ + --native-summary-csv benchmark/results/perf_direct_docstring_20260929/native_cp_summary.csv \ + --mode 1w_1t --figures +``` diff --git a/benchmark/results/perf_direct_docstring_20260929/control_fresh.csv b/benchmark/results/perf_direct_docstring_20260929/control_fresh.csv new file mode 100644 index 0000000000..de1661da5e --- /dev/null +++ b/benchmark/results/perf_direct_docstring_20260929/control_fresh.csv @@ -0,0 +1,31 @@ +case_name,mode_name,worker_count,well_count,compile_seconds,prepare_seconds,execute_seconds,total_seconds,wells_per_second,successful_wells,native_single_sample_execution_seconds,projected_native_execution_seconds,projected_execution_speedup,peak_memory_mb,status,memory_limit_mb,error_message,execution_route,server_lifecycle,run_input_sha256 +ExampleColocalization,1w_1t,1,1,3.7952799797058105,0.0,4.710984706878662,14.525511140935123,0.212269846374128,1,37.035618890076876,37.035618890076876,7.861545132167371,1356.85546875,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleCometAssay,1w_1t,1,1,3.530890703201294,0.0,2.856804847717285,11.883519758936018,0.35004141105369685,1,13.304211451206356,13.304211451206356,4.657024949337025,1280.359375,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleFly,1w_1t,1,1,3.9887683391571045,0.0,2.0932228565216064,12.123057164251804,0.47773221894860285,1,8.094948755111545,8.094948755111545,3.8672178310546688,959.3984375,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleFlyURL,1w_1t,1,1,3.3167309761047363,0.0,1.085144281387329,10.569152536336333,0.9215364418835859,1,4.900778113398701,4.900778113398701,4.516245625082392,896.078125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleHuman,1w_1t,1,1,3.4526987075805664,0.0,1.19232177734375,10.470840559806675,0.8386997696442283,1,4.420192994643003,4.420192994643003,3.707214846390118,876.77734375,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleIlluminationCorrection_Example1_AllMethod,1w_1t,1,1,2.596431016921997,0.0,3.8865044116973877,12.078059430234134,0.25730062134761894,1,946.6214662808925,946.6214662808925,243.56629145506773,1299.75390625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleIlluminationCorrection_Example1_EachMethod,1w_1t,1,1,2.450819730758667,0.0,0.17623472213745117,7.973976640030742,5.674250725802306,1,4.54475614009425,4.54475614009425,25.788085826524288,800.22265625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleIlluminationCorrection_Example2,1w_1t,1,1,3.406686782836914,0.0,2.164682388305664,11.383527447935194,0.4619615355131697,1,48.04419008316472,48.04419008316472,22.194567823305373,1049.32421875,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleIlluminationCorrection_Example3,1w_1t,1,1,3.1361730098724365,0.0,0.7579882144927979,9.801032058894634,1.3192817261270249,1,2.1520505752414465,2.1520505752414465,2.8391609976171925,836.4140625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleImagingFlowCytometryObjectsInGrid,1w_1t,1,1,4.411989450454712,0.0,23.148673057556152,33.60791293112561,0.04319902041527955,1,61.60158259188756,61.60158259188756,2.6611280240004804,2599.453125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleNeighbors,1w_1t,1,1,3.132838726043701,0.0,1.3849973678588867,10.27791321510449,0.7220230328278047,1,4.5466188420541584,4.5466188420541584,3.2827635254519847,912.40625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExamplePercentPositive,1w_1t,1,1,3.2013676166534424,0.0,0.48795175552368164,9.249851203057915,2.0493829332098126,1,2.5050158216618,2.5050158216618,5.133736672334249,853.01171875,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleSpeckles,1w_1t,1,1,2.9727139472961426,0.0,0.9613838195800781,9.074604033026844,1.0401672876466643,1,3.179383432958275,3.179383432958275,3.307090641848949,985.56640625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleTrackObjects,1w_1t,1,1,2.8912010192871094,0.0,3.975447654724121,12.278937883209437,0.2515439987775152,1,9.587221414782107,9.587221414782107,2.411608011839718,1643.51171875,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleTumor,1w_1t,1,1,2.7188608646392822,0.0,1.5136144161224365,9.700594955123961,0.660670240286024,1,4.360487373080105,4.360487373080105,2.880844240537006,1095.109375,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleUntangleAndStraightenWorms,1w_1t,1,1,3.427931070327759,0.0,1.4363837242126465,10.562146157957613,0.6961927952421975,1,3.4416790287941694,3.4416790287941694,2.396072143382664,893.65625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleUntangleWorms,1w_1t,1,1,3.342055559158325,0.0,2.3640949726104736,11.418135286774486,0.42299485070846504,1,4.618807300925255,4.618807300925255,1.9537317047060465,944.69921875,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleUntangleWormsBrightField,1w_1t,1,1,3.7159950733184814,0.0,3.9000895023345947,13.530524459667504,0.2564043721051529,1,7.377188352867961,7.377188352867961,1.8915433475185566,1056.5,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleVitra,1w_1t,1,1,3.1241512298583984,0.0,1.5152015686035156,10.796134633012116,0.6599781974365624,1,4.122247557155788,4.122247557155788,2.7205935121589495,994.03125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleWoundHealing,1w_1t,1,1,2.546600341796875,0.0,3.990922212600708,12.103351315949112,0.250568652238487,1,4.702593941241503,4.702593941241503,1.1783226258817583,1310.16015625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleYeastColonies,1w_1t,1,1,3.508812189102173,0.0,3.352222442626953,12.572134739719331,0.2983095594385302,1,12.096297012176365,12.096297012176365,3.6084410325399405,1155.59375,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +ExampleYeastPatches,1w_1t,1,1,3.55591082572937,0.0,3.5286455154418945,12.408702468965203,0.2833948594790399,1,5.990533472970128,5.990533472970128,1.6976863917768543,1161.3125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +cp_tutorial_3d_monolayer,1w_1t,1,1,4.238352060317993,0.0,11.372286319732666,21.959275498986244,0.0879330656901283,1,14.058660756796598,14.058660756796598,1.2362211398426242,1490.5078125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +cp_tutorial_advanced_segmentation_final,1w_1t,1,1,6.258520603179932,0.0,10.826166152954102,23.582449715118855,0.09236880220308952,1,36.253466514870524,36.253466514870524,3.3486892776884045,1161.5546875,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +cp_tutorial_quality_control,1w_1t,1,1,2.458336353302002,0.0,0.6694271564483643,8.554739723913372,1.4938145104621763,1,4.787729676347226,4.787729676347226,7.151980062697866,872.07421875,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +cp_tutorial_beginner_segmentation_final,1w_1t,1,1,4.205931663513184,0.0,7.010474681854248,17.030014875344932,0.14264369324211057,1,16.074153264053166,16.074153264053166,2.2928765873242702,1074.6484375,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +cp_tutorial_pixel_based_classification,1w_1t,1,1,2.822808265686035,0.0,1.9511425495147705,10.231026147026569,0.5125202155263796,1,4.208680049050599,4.208680049050599,2.157033605820987,1083.15625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +cp_tutorial_translocation_final,1w_1t,1,1,3.1146538257598877,0.0,1.0031156539916992,9.29117836104706,0.9968940231574484,1,3.004684013314545,3.004684013314545,2.995351534350005,944.1484375,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +cp4_supplement_combine_objects,1w_1t,1,1,2.2870330810546875,0.0,0.1528942584991455,7.976566542871296,6.540467966660689,1,1.8334413380362093,1.8334413380362093,11.991564340177339,839.62890625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b +cp_tutorial_translocation_start,1w_1t,1,1,2.454098701477051,0.0,0.2975425720214844,8.005126714706421,3.360863600815395,1,2.1760300607420504,2.1760300607420504,7.31334022542807,880.6484375,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,2b5c4e662dc67ed43cb7f22fe155ad3ada3f695cf7ab39ba4196cf20b2fa1c7b diff --git a/benchmark/results/perf_direct_docstring_20260929/direct_fresh.csv b/benchmark/results/perf_direct_docstring_20260929/direct_fresh.csv new file mode 100644 index 0000000000..d81a262e71 --- /dev/null +++ b/benchmark/results/perf_direct_docstring_20260929/direct_fresh.csv @@ -0,0 +1,31 @@ +case_name,mode_name,worker_count,well_count,compile_seconds,prepare_seconds,execute_seconds,total_seconds,wells_per_second,successful_wells,native_single_sample_execution_seconds,projected_native_execution_seconds,projected_execution_speedup,peak_memory_mb,status,memory_limit_mb,error_message,execution_route,server_lifecycle,run_input_sha256 +ExampleColocalization,1w_1t,1,1,2.2928268909454346,0.0,3.9878079891204834,11.62109541380778,0.25076433036098894,1,37.035618890076876,37.035618890076876,9.287212170474922,1344.6640625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleCometAssay,1w_1t,1,1,2.0185365676879883,0.0,2.8911311626434326,9.938480501063168,0.3458853797161092,1,13.304211451206356,13.304211451206356,4.601732229623919,1263.62109375,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleFly,1w_1t,1,1,2.2488327026367188,0.0,2.1445205211639404,10.066884044092149,0.46630470080894776,1,8.094948755111545,8.094948755111545,3.774712657316053,946.58203125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleFlyURL,1w_1t,1,1,1.9677801132202148,0.0,1.019911527633667,8.41873428830877,0.9804772011158023,1,4.900778113398701,4.900778113398701,4.80510120791474,883.3203125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleHuman,1w_1t,1,1,1.923978567123413,0.0,1.0841801166534424,8.417618672829121,0.9223559670940262,1,4.420192994643003,4.420192994643003,4.0769913843161865,852.3828125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleIlluminationCorrection_Example1_AllMethod,1w_1t,1,1,1.5901720523834229,0.0,4.088348627090454,10.868056402076036,0.24459753587884892,1,946.6214662808925,946.6214662808925,231.54127806232916,1269.7265625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleIlluminationCorrection_Example1_EachMethod,1w_1t,1,1,1.5006680488586426,0.0,0.17162799835205078,6.682493566069752,5.826555163504015,1,4.54475614009425,4.54475614009425,26.48027235493273,790.26953125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleIlluminationCorrection_Example2,1w_1t,1,1,1.881812334060669,0.0,2.101905107498169,9.374385974835604,0.47575887057540306,1,48.04419008316472,48.04419008316472,22.85744961167643,995.20703125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleIlluminationCorrection_Example3,1w_1t,1,1,1.8129961490631104,0.0,0.7289443016052246,7.743487971834838,1.3718469268473292,1,2.1520505752414465,2.1520505752414465,2.9522839680650055,827.015625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleImagingFlowCytometryObjectsInGrid,1w_1t,1,1,2.560279607772827,0.0,23.013134479522705,30.937172566074878,0.04345344615657676,1,61.60158259188756,61.60158259188756,2.6768010523165024,2518.06640625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleNeighbors,1w_1t,1,1,1.74615478515625,0.0,1.3547496795654297,8.286614634096622,0.7381437435148723,1,4.5466188420541584,4.5466188420541584,3.3560582524091105,901.8671875,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExamplePercentPositive,1w_1t,1,1,1.7290244102478027,0.0,0.42984962463378906,7.382856552023441,2.326394959288266,1,2.5050158216618,2.5050158216618,5.827656180451365,842.484375,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleSpeckles,1w_1t,1,1,1.637129306793213,0.0,0.822502613067627,7.375865648966283,1.2158016085448948,1,3.179383432958275,3.179383432958275,3.86549949197166,976.84765625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleTrackObjects,1w_1t,1,1,1.716566562652588,0.0,3.287581205368042,10.32921796804294,0.3041749960022815,1,9.587221414782107,9.587221414782107,2.916193035514335,1670.55078125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleTumor,1w_1t,1,1,1.6034469604492188,0.0,0.8798391819000244,7.372601582668722,1.1365713423224535,1,4.360487373080105,4.360487373080105,4.956004986801763,1072.33203125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleUntangleAndStraightenWorms,1w_1t,1,1,2.0078978538513184,0.0,1.2335312366485596,8.449991872068495,0.8106807272403965,1,3.4416790287941694,3.4416790287941694,2.790102857990879,888.4375,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleUntangleWorms,1w_1t,1,1,2.0958409309387207,0.0,2.062998056411743,10.002663507126272,0.48473143098318805,1,4.618807300925255,4.618807300925255,2.238881072413095,934.63671875,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleUntangleWormsBrightField,1w_1t,1,1,2.1711883544921875,0.0,3.5632073879241943,11.496679156087339,0.2806460278986362,1,7.377188352867961,7.377188352867961,2.0703786082924758,1045.79296875,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleVitra,1w_1t,1,1,1.8910613059997559,0.0,1.2376892566680908,8.538714677095413,0.8079572433972968,1,4.122247557155788,4.122247557155788,3.330599772880831,960.13671875,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleWoundHealing,1w_1t,1,1,1.5049092769622803,0.0,2.042593240737915,8.341959646902978,0.4895737340434634,1,4.702593941241503,4.702593941241503,2.3022664755037696,1272.14453125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleYeastColonies,1w_1t,1,1,2.1904988288879395,0.0,2.0774261951446533,10.033609306905419,0.48136487464016453,1,12.096297012176365,12.096297012176365,5.8227324948764725,1121.2578125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +ExampleYeastPatches,1w_1t,1,1,2.182415246963501,0.0,2.6008615493774414,10.576405676081777,0.3844879787005065,1,5.990533472970128,5.990533472970128,2.30328810636001,1177.07421875,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +cp_tutorial_3d_monolayer,1w_1t,1,1,2.876032829284668,0.0,10.151128053665161,18.547642110381275,0.09851121911903579,1,14.058660756796598,14.058660756796598,1.3849358103329792,1453.578125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +cp_tutorial_advanced_segmentation_final,1w_1t,1,1,3.3548684120178223,0.0,10.546051740646362,20.040677363052964,0.09482221636992562,1,36.253466514870524,36.253466514870524,3.437634046032906,1147.62890625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +cp_tutorial_quality_control,1w_1t,1,1,1.3814642429351807,0.0,0.6194014549255371,7.224075731821358,1.6144618196291087,1,4.787729676347226,4.787729676347226,7.729606765167826,855.1953125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +cp_tutorial_beginner_segmentation_final,1w_1t,1,1,2.4305648803710938,0.0,6.888291358947754,14.83460831688717,0.14517388244633697,1,16.074153264053166,16.074153264053166,2.333547236380058,1046.05078125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +cp_tutorial_pixel_based_classification,1w_1t,1,1,1.6967191696166992,0.0,0.8674452304840088,7.88223431725055,1.1528105347262438,1,4.208680049050599,4.208680049050599,4.851810697837696,1035.89453125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +cp_tutorial_translocation_final,1w_1t,1,1,1.854893445968628,0.0,0.8097820281982422,7.803559121210128,1.2349002141045178,1,3.004684013314545,3.004684013314545,3.710484931358554,931.90625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +cp4_supplement_combine_objects,1w_1t,1,1,1.3613243103027344,0.0,0.14962530136108398,6.642139645293355,6.683361643407789,1,1.8334413380362093,1.8334413380362093,12.253551514069457,825.0390625,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 +cp_tutorial_translocation_start,1w_1t,1,1,1.402390956878662,0.0,0.25930023193359375,6.627473204862326,3.856533380410157,1,2.1760300607420504,2.1760300607420504,8.39193256602766,866.1328125,success,,,ordinary-zmq-outcomes-v1,fresh-per-observation,dbed67c7d17c4e678119e0e634ed4eb2a7c6b0d51b7b581196590fed56cc8818 diff --git a/benchmark/results/perf_direct_docstring_20260929/direct_fresh_native_relative.png b/benchmark/results/perf_direct_docstring_20260929/direct_fresh_native_relative.png new file mode 100644 index 0000000000..09d4e57721 Binary files /dev/null and b/benchmark/results/perf_direct_docstring_20260929/direct_fresh_native_relative.png differ diff --git a/benchmark/results/perf_direct_docstring_20260929/direct_reused.csv b/benchmark/results/perf_direct_docstring_20260929/direct_reused.csv new file mode 100644 index 0000000000..34604790ba --- /dev/null +++ b/benchmark/results/perf_direct_docstring_20260929/direct_reused.csv @@ -0,0 +1,31 @@ +case_name,mode_name,worker_count,well_count,compile_seconds,prepare_seconds,execute_seconds,total_seconds,wells_per_second,successful_wells,native_single_sample_execution_seconds,projected_native_execution_seconds,projected_execution_speedup,peak_memory_mb,status,memory_limit_mb,error_message,execution_route,server_lifecycle,run_input_sha256 +ExampleColocalization,1w_1t,1,1,2.275078535079956,0.0,3.8731281757354736,7.093568831216544,0.2581892348063355,1,37.035618890076876,37.035618890076876,9.562198101808013,1362.99609375,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleCometAssay,1w_1t,1,1,0.757594108581543,0.0,2.1370835304260254,3.899495764169842,0.4679274280873107,1,13.304211451206356,13.304211451206356,6.225405447092737,1333.90625,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleFly,1w_1t,1,1,1.0364749431610107,0.0,1.9227569103240967,3.9989050328731537,0.5200865458501677,1,8.094948755111545,8.094948755111545,4.210073936880078,1251.90234375,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleFlyURL,1w_1t,1,1,0.7084007263183594,0.0,0.9469513893127441,2.4109492748975754,1.0560204159220425,1,4.900778113398701,4.900778113398701,5.1753217416529385,1255.60546875,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleHuman,1w_1t,1,1,0.677196741104126,0.0,0.9924261569976807,2.39992200396955,1.0076316438748774,1,4.420192994643003,4.420192994643003,4.453926333436345,1256.6640625,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleIlluminationCorrection_Example1_AllMethod,1w_1t,1,1,0.3896982669830322,0.0,4.225855112075806,5.292650785762817,0.2366384964648692,1,946.6214662808925,946.6214662808925,224.00708050208027,1696.6484375,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleIlluminationCorrection_Example1_EachMethod,1w_1t,1,1,0.30150794982910156,0.0,0.141249418258667,1.1838909592479467,7.079675175502116,1,4.54475614009425,4.54475614009425,32.175397223736084,1295.19921875,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleIlluminationCorrection_Example2,1w_1t,1,1,0.6343739032745361,0.0,1.688868522644043,3.3518645162694156,0.5921124034181354,1,48.04419008316472,48.04419008316472,28.447560860420413,1250.890625,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleIlluminationCorrection_Example3,1w_1t,1,1,0.5378930568695068,0.0,0.6715884208679199,2.304088276810944,1.4890072087717965,1,2.1520505752414465,2.1520505752414465,3.2044188201760053,1251.1953125,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleImagingFlowCytometryObjectsInGrid,1w_1t,1,1,1.3400790691375732,0.0,21.6649808883667,24.275829169899225,0.04615743744029626,1,61.60158259188756,61.60158259188756,2.8433711947082934,2695.21875,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleNeighbors,1w_1t,1,1,0.5508284568786621,0.0,1.2736480236053467,2.8441328261978924,0.7851462739048387,1,4.5466188420541584,4.5466188420541584,3.569760842704355,2548.40625,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExamplePercentPositive,1w_1t,1,1,0.5565066337585449,0.0,0.3549513816833496,1.7957199006341398,2.8172872444037846,1,2.5050158216618,2.5050158216618,7.057349121397455,2551.0078125,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleSpeckles,1w_1t,1,1,0.45949292182922363,0.0,0.6256496906280518,1.7574823410250247,1.5983385191098882,1,3.179383432958275,3.179383432958275,5.081731007917043,2550.98828125,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleTrackObjects,1w_1t,1,1,0.5293912887573242,0.0,6.150654315948486,7.870234882924706,0.1625843282083056,1,9.587221414782107,9.587221414782107,1.55873195310663,2927.08203125,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleTumor,1w_1t,1,1,0.4582710266113281,0.0,1.9637956619262695,2.8960104966536164,0.5092179493965828,1,4.360487373080105,4.360487373080105,2.220438438489543,2503.5234375,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleUntangleAndStraightenWorms,1w_1t,1,1,0.6865320205688477,0.0,1.1707863807678223,2.916666515637189,0.8541267787418081,1,3.4416790287941694,3.4416790287941694,2.9396302223271986,2350.734375,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleUntangleWorms,1w_1t,1,1,0.6761653423309326,0.0,1.9148118495941162,3.4279239396564662,0.5222445224641631,1,4.618807300925255,4.618807300925255,2.4121468132256996,2373.72265625,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleUntangleWormsBrightField,1w_1t,1,1,0.8134655952453613,0.0,3.5010592937469482,4.950905143748969,0.2856278389189368,1,7.377188352867961,7.377188352867961,2.1071303665276266,2401.625,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleVitra,1w_1t,1,1,0.6106522083282471,0.0,1.2011234760284424,2.906488480977714,0.832553871402577,1,4.122247557155788,4.122247557155788,3.4319931625898668,2424.7265625,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleWoundHealing,1w_1t,1,1,0.37561821937561035,0.0,3.4614524841308594,4.23716031992808,0.28889606446557686,1,4.702593941241503,4.702593941241503,1.3585608824043365,2514.1171875,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleYeastColonies,1w_1t,1,1,0.8389763832092285,0.0,1.9496333599090576,3.46960087493062,0.5129169517527367,1,12.096297012176365,12.096297012176365,6.204395790981237,2253.125,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +ExampleYeastPatches,1w_1t,1,1,0.8161354064941406,0.0,2.603236198425293,4.0244246339425445,0.3841372521651718,1,5.990533472970128,5.990533472970128,2.3011870673102286,2311.6484375,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +cp_tutorial_3d_monolayer,1w_1t,1,1,1.4751613140106201,0.0,9.611752271652222,11.89710896089673,0.10403930227678496,1,14.058660756796598,14.058660756796598,1.4626532560831358,2382.0234375,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +cp_tutorial_advanced_segmentation_final,1w_1t,1,1,1.852088451385498,0.0,10.535007953643799,13.752627617213875,0.0949216179427871,1,36.253466514870524,36.253466514870524,3.4412376976261654,2329.75,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +cp_tutorial_quality_control,1w_1t,1,1,0.33776116371154785,0.0,0.5711023807525635,1.7376364096999168,1.750999529510386,1,4.787729676347226,4.787729676347226,8.383312410706905,2328.91015625,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +cp_tutorial_beginner_segmentation_final,1w_1t,1,1,1.1776235103607178,0.0,6.571040153503418,8.808831247035414,0.15218290813012908,1,16.074153264053166,16.074153264053166,2.4462113894530177,2333.9453125,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +cp_tutorial_pixel_based_classification,1w_1t,1,1,0.48173093795776367,0.0,0.7632899284362793,1.7692263550125062,1.3101181644681974,1,4.208680049050599,4.208680049050599,5.513868180696094,2352.77734375,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +cp_tutorial_translocation_final,1w_1t,1,1,0.6264386177062988,0.0,0.7527263164520264,2.359983111731708,1.3285041032091152,1,3.004684013314545,3.004684013314545,3.9917350405352052,2353.28125,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +cp4_supplement_combine_objects,1w_1t,1,1,0.3130831718444824,0.0,0.1282191276550293,1.1227338793687522,7.799148366462746,1,1.8334413380362093,1.8334413380362093,14.299281016550372,2353.29296875,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 +cp_tutorial_translocation_start,1w_1t,1,1,0.3132333755493164,0.0,0.19467592239379883,1.188382430933416,5.1367420670397905,1,2.1760300607420504,2.1760300607420504,11.177705152156841,2353.30859375,success,,,ordinary-zmq-outcomes-v1,reused-per-sweep,9a0f96957aaeb67336aff19b0f315f5ca4b3ccf33d718ecc8e8ea8e8b57bfd44 diff --git a/benchmark/results/perf_direct_docstring_20260929/direct_reused_native_relative.png b/benchmark/results/perf_direct_docstring_20260929/direct_reused_native_relative.png new file mode 100644 index 0000000000..709850dc2f Binary files /dev/null and b/benchmark/results/perf_direct_docstring_20260929/direct_reused_native_relative.png differ diff --git a/benchmark/results/perf_direct_docstring_20260929/native_cp_summary.csv b/benchmark/results/perf_direct_docstring_20260929/native_cp_summary.csv new file mode 100644 index 0000000000..32394feaf5 --- /dev/null +++ b/benchmark/results/perf_direct_docstring_20260929/native_cp_summary.csv @@ -0,0 +1,31 @@ +case_name,assay_category,module_category,n,equivalent_count,median_native_execution_seconds,median_openhcs_execution_seconds,median_native_total_phase_seconds,median_openhcs_total_phase_seconds,median_native_peak_memory_mb,median_openhcs_peak_memory_mb,median_speedup,median_total_phase_speedup,speedup_target,meets_execution_speedup_target,meets_total_phase_speedup_target,meets_speedup_target,min_parity_accuracy +ExampleColocalization,,,1,1,37.035618890076876,17.959853410720825,39.35332336090505,26.953527031932026,,,2.062133695811186,1.4600435525296152,5.0,False,False,False,1.0 +ExampleCometAssay,,,1,1,13.304211451206356,2.57122540473938,14.30461646290496,8.059360695071518,,,5.1742688239947885,1.774907093021976,5.0,True,False,True,1.0 +ExampleFly,,,1,1,8.094948755111545,2.572516441345215,9.810052920132875,16.424860467668623,,,3.1467043805864083,0.5972685697661414,5.0,False,False,False,1.0 +ExampleFlyURL,,,1,1,4.900778113398701,1.587127923965454,6.021430939435959,8.042698163539171,,,3.0878280442285084,0.7486829440813233,5.0,False,False,False,1.0 +ExampleHuman,,,1,1,4.420192994643003,2.1705381870269775,5.455457073636353,11.446641855407506,,,2.036450232049322,0.47659891368568863,5.0,False,False,False,1.0 +ExampleIlluminationCorrection_Example1_AllMethod,,,1,1,946.6214662808925,6.739018201828003,946.862535060849,9.857038384769112,,,140.46875048120737,96.0595361507287,5.0,True,True,True,1.0 +ExampleIlluminationCorrection_Example1_EachMethod,,,1,1,4.54475614009425,0.2049102783203125,4.6763526406139135,3.222155754920095,,,22.17924926630552,1.4513117913289328,5.0,True,False,True,1.0 +ExampleIlluminationCorrection_Example2,,,1,1,48.04419008316472,2.1667985916137695,48.96783200325444,6.28821934806183,,,22.17289150413504,7.787233442858101,5.0,True,True,True,1.0 +ExampleIlluminationCorrection_Example3,,,1,1,2.1520505752414465,2.0806398391723633,2.7176199601963162,6.080346302129328,,,1.0343215268325772,0.4469515098580174,5.0,False,False,False,1.0 +ExampleImagingFlowCytometryObjectsInGrid,,,1,1,61.60158259188756,36.9328293800354,64.14507223013788,98.14512260677293,,,1.667935644951893,0.6535737133585411,5.0,False,False,False,1.0 +ExampleNeighbors,,,1,1,4.5466188420541584,2.789321184158325,5.234509553294629,14.297266059555113,,,1.6300090745648914,0.3661196155607886,5.0,False,False,False,1.0 +ExamplePercentPositive,,,1,1,2.5050158216618,0.9022600650787354,3.3950326037593186,5.097386521752924,,,2.776378916253155,0.666033974326085,5.0,False,False,False,1.0 +ExampleSpeckles,,,1,1,3.179383432958275,0.9791054725646973,3.897916650865227,4.4375677248463035,,,3.2472328283796696,0.8783903463693576,5.0,False,False,False,1.0 +ExampleTrackObjects,,,1,1,9.587221414782107,3.7285819053649902,10.388708942104131,7.917243284638971,,,2.5712782119623614,1.3121623990335494,5.0,False,False,False,1.0 +ExampleTumor,,,1,1,4.360487373080105,1.1599302291870117,4.82744375616312,4.7034944533370435,,,3.759266948440808,1.026352598914651,5.0,False,False,False,1.0 +ExampleUntangleAndStraightenWorms,,,1,1,3.4416790287941694,2.619752883911133,4.3137561599723995,6.864017297513783,,,1.3137418608948912,0.628459395277877,5.0,False,False,False,1.0 +ExampleUntangleWorms,,,1,1,4.618807300925255,4.506817102432251,5.426323775202036,8.279627295210958,,,1.0248490666356451,0.655382613459025,5.0,False,False,False,1.0 +ExampleUntangleWormsBrightField,,,1,1,7.377188352867961,7.678912878036499,8.610389334149659,13.188176837284118,,,0.960707390491232,0.6528870093557847,5.0,False,False,False,1.0 +ExampleVitra,,,1,1,4.122247557155788,3.466949462890625,4.8610909334383905,12.178178021218628,,,1.1890128775395525,0.39916405598347116,5.0,False,False,False,1.0 +ExampleWoundHealing,,,1,1,4.702593941241503,2.663236141204834,5.02863251324743,5.365988084580749,,,1.7657442644624348,0.9371307639868386,5.0,False,False,False,1.0 +ExampleYeastColonies,,,1,1,12.096297012176365,4.731346368789673,13.198869303334504,16.91469065612182,,,2.5566289316651156,0.7803198752888529,5.0,False,False,False,1.0 +ExampleYeastPatches,,,1,1,5.990533472970128,5.013910531997681,7.104359833989292,10.384889775887132,,,1.1947826820482443,0.684105463544258,5.0,False,False,False,1.0 +cp4_supplement_combine_objects,Object-combination benchmark,Object set algebra,1,1,1.8334413380362093,0.18567681312561035,1.9359478713013232,2.6644571498036385,,,9.874368841067335,0.7265824753248503,5.0,True,False,True,1.0 +cp_tutorial_3d_monolayer,3D monolayer morphology,3D segmentation + measurement,1,1,14.058660756796598,13.644547939300537,15.750524973962456,19.772331691812724,,,1.0303500577181666,0.7965942115205559,5.0,False,False,False,1.0 +cp_tutorial_advanced_segmentation_final,Cell Painting morphology,Advanced segmentation + measurement,1,1,36.253466514870524,21.642004013061523,45.43951385235414,50.77297239517793,,,1.67514369246908,0.8949547703980725,5.0,False,False,False,1.0 +cp_tutorial_beginner_segmentation_final,Cell morphology,Segmentation + intensity measurement,1,1,16.074153264053166,8.612112760543823,18.3711662706919,36.70200763596222,,,1.8664587553586724,0.5005493555805115,5.0,False,False,False,1.0 +cp_tutorial_pixel_based_classification,Pixel classification,Pixel classification,1,1,4.208680049050599,0.9723286628723145,4.7289649839513,4.328970203641802,,,4.328454163449134,1.092399522633119,5.0,False,False,False,1.0 +cp_tutorial_quality_control,Cell Painting quality control,Image quality measurement,1,1,4.787729676347226,1.2474637031555176,8.168980250600725,7.120973748154938,,,3.8379711283273736,1.147171796935402,5.0,False,False,False,1.0 +cp_tutorial_translocation_final,Translocation assay,Segmentation + classification,1,1,3.004684013314545,1.9986815452575684,3.8793991575948894,5.977722632698715,,,1.5033330449485558,0.6489761061134227,5.0,False,False,False,1.0 +cp_tutorial_translocation_start,Translocation assay,Starter nuclei segmentation,1,1,2.1760300607420504,0.33385229110717773,2.4812272735871375,2.8119246223941445,,,6.517942571325569,0.882394660876278,5.0,True,False,True,1.0 diff --git a/external/python-introspect b/external/python-introspect index 5bb79d5edb..4e8f8bde5f 160000 --- a/external/python-introspect +++ b/external/python-introspect @@ -1 +1 @@ -Subproject commit 5bb79d5edb7250083a09ab77b2d9177e3ba202ab +Subproject commit 4e8f8bde5f750d9a50eacac80acd3806123addd8