Skip to content

Add pco-inspired lightweight numeric encodings - #9544

Draft
lwwmanning wants to merge 79 commits into
developfrom
wm/pcodec-fixed-bin-experiment
Draft

Add pco-inspired lightweight numeric encodings#9544
lwwmanning wants to merge 79 commits into
developfrom
wm/pcodec-fixed-bin-experiment

Conversation

@lwwmanning

@lwwmanning lwwmanning commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Summary

Add native BlockResidual, OrderedFloat, and FloatQuant arrays for numeric data that Pco compresses well but ALP and ALP-RD do not. These arrays retain fast scalar access and use composable Vortex children. The selectors use cheap sample analysis and calibrated access-cost factors. The new arrays belong to the draft core:2026.08.4 edition.

Changes

  • BlockResidual adds one block-local reference with packed residuals and optional patches.
  • OrderedFloat maps floating-point values to ordered integers before BlockResidual compression.
  • FloatQuant splits floating-point bit patterns into packed primary and optional secondary children.
  • Fused FastLanes paths accelerate common encode and decode trees.
  • Conformance tests cover validation, slices, scalar access, nulls, and serialization.
  • Compression and random-access benchmarks cover tabular data and vector embeddings.

Results

The final benchmark compared 17 datasets with five timed iterations per operation. The corpus included GloVe f32 and OpenAI-on-C4 f64 embeddings.

Metric vs Prior Default Result
Aggregate size 11.67% smaller
Aggregate encode time 4.04% faster
Aggregate decode time 0.56% faster
Geometric-mean size 5.69% smaller
Geometric-mean encode time 10.49% faster
Geometric-mean decode time 4.99% faster
Geometric-mean scalar access 10.97% faster

Signed-off-by: "Will Manning" <will@willmanning.io>
Signed-off-by: "Will Manning" <will@willmanning.io>
Signed-off-by: "Will Manning" <will@willmanning.io>
Signed-off-by: "Will Manning" <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Will Manning <will@willmanning.io>
@lwwmanning lwwmanning added the changelog/feature A new feature label Aug 21, 2026
@lwwmanning lwwmanning changed the title Add pco-inspired lightweight numeric schemes Add pco-inspired lightweight numeric encodings Aug 21, 2026
@lwwmanning lwwmanning added action/bench-random-access Run only the random-access benchmark on this PR action/bench-compress Run only the compression benchmark on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Aug 21, 2026
@github-actions github-actions Bot removed action/bench-random-access Run only the random-access benchmark on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/bench-compress Run only the compression benchmark on this PR labels Aug 21, 2026
@codspeed-hq

codspeed-hq Bot commented Aug 21, 2026

Copy link
Copy Markdown

Merging this PR will regress 1 benchmark

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 3 improved benchmarks
❌ 1 regressed benchmark
✅ 1977 untouched benchmarks
🆕 172 new benchmarks
⏩ 54 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation cold_misaligned[(16, 64)] 378.6 µs 429.7 µs -11.89%
Simulation fsst_decompress_string 518.7 µs 206.7 µs ×2.5
Simulation decompress[alp_for_bp_f64] 170.1 µs 117.4 µs +44.85%
Simulation zstd_decompress_string 135.8 µs 115.9 µs +17.16%
🆕 Simulation block_local_block_residual_compress[i16] N/A 221.1 µs N/A
🆕 Simulation block_local_block_residual_compress[i32] N/A 267.1 µs N/A
🆕 Simulation block_local_block_residual_compress[i64] N/A 280.2 µs N/A
🆕 Simulation block_local_block_residual_compress[i8] N/A 219.3 µs N/A
🆕 Simulation block_local_block_residual_compress[u16] N/A 219.2 µs N/A
🆕 Simulation block_local_block_residual_compress[u32] N/A 266.9 µs N/A
🆕 Simulation block_local_block_residual_compress[u64] N/A 401 µs N/A
🆕 Simulation block_local_block_residual_compress[u8] N/A 218.7 µs N/A
🆕 Simulation block_local_block_residual_decompress[i16] N/A 47 µs N/A
🆕 Simulation block_local_block_residual_decompress[i32] N/A 69.3 µs N/A
🆕 Simulation block_local_block_residual_decompress[i64] N/A 101.4 µs N/A
🆕 Simulation block_local_block_residual_decompress[i8] N/A 39.1 µs N/A
🆕 Simulation block_local_block_residual_decompress[u16] N/A 46.8 µs N/A
🆕 Simulation block_local_block_residual_decompress[u32] N/A 67 µs N/A
🆕 Simulation block_local_block_residual_decompress[u64] N/A 97.3 µs N/A
🆕 Simulation block_local_block_residual_decompress[u8] N/A 38.2 µs N/A
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing wm/pcodec-fixed-bin-experiment (815e0ce) with develop (332ae0b)

Open in CodSpeed

Footnotes

  1. 54 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@lwwmanning lwwmanning added the action/bench-compress Run only the compression benchmark on this PR label Aug 21, 2026
@github-actions github-actions Bot removed the action/bench-compress Run only the compression benchmark on this PR label Aug 21, 2026
@github-actions

github-actions Bot commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 6a23456 compress-bench 1 Explore Profiling Data
🟢 Done 6a23456 random-access-bench 1 Explore Profiling Data
🟢 Done 6a23456 statpopgen 1 Explore Profiling Data
🟢 Done 6a23456 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 6a23456 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 6a23456 fineweb-s3 1 Explore Profiling Data
🟢 Done 6a23456 fineweb 1 Explore Profiling Data
🟢 Done 6a23456 clickbench-nvme 1 Explore Profiling Data
🟢 Done 6a23456 tpcds-nvme 1 Explore Profiling Data
🟢 Done 6a23456 polarsignals 1 Explore Profiling Data
🟢 Done 6a23456 tpch-s3 1 Explore Profiling Data
🟢 Done 6a23456 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 6a234562 vs base 68cdf004
Vortex (geomean): hot 0.990x ➖ · cold 0.955x ➖


datafusion / vortex-file-compressed / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 107768370 / 104271718 / +3.4% 194051773 / 199051133 / -2.5% 0.56 / 0.52 / +6.0%
polarsignals_q01/datafusion:vortex-file-compressed 160092050 / 158401635 / +1.1% 266350831 / 264395924 / +0.7% 0.60 / 0.60 / +0.3%
polarsignals_q02/datafusion:vortex-file-compressed 22218663 / 21918240 / +1.4% 86087973 / 83555192 / +3.0% 0.26 / 0.26 / -1.6%
polarsignals_q03/datafusion:vortex-file-compressed 160039214 / 162885424 / -1.7% 265280221 / 282171249 / -6.0% 0.60 / 0.58 / +4.5%
polarsignals_q04/datafusion:vortex-file-compressed 10693429 / 11096001 / -3.6% 70944422 / 79282858 / -10.5% 🟢 0.15 / 0.14 / +7.7%
polarsignals_q05/datafusion:vortex-file-compressed 14592574 / 13533920 / +7.8% 83881937 / 87260714 / -3.9% 0.17 / 0.16 / +12.2%
polarsignals_q06/datafusion:vortex-file-compressed 22718176 / 24607808 / -7.7% 86583622 / 92871055 / -6.8% 0.26 / 0.26 / -1.0%
polarsignals_q07/datafusion:vortex-file-compressed 12368202 / 12463541 / -0.8% 78479315 / 84199711 / -6.8% 0.16 / 0.15 / +6.5%
polarsignals_q08/datafusion:vortex-file-compressed 275892932 / 272599469 / +1.2% 376105428 / 389771028 / -3.5% 0.73 / 0.70 / +4.9%
polarsignals_q09/datafusion:vortex-file-compressed 11326076 / 12514970 / -9.5% 71703509 / 77948605 / -8.0% 0.16 / 0.16 / -1.6%

File Size Changes (1 files changed, -3.8% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 685.81 MB 659.92 MB 25.89 MB -3.8%

Totals:

  • vortex-file-compressed: 685.81 MB → 659.92 MB (-3.8%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 6a234562 vs base acd8bb47
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (-1.8%, environment too noisy confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): hot 0.990x ➖ · cold 0.975x ➖
Parquet (geomean): hot 1.006x ➖ · cold 0.983x ➖
Shifts: Parquet (control) +0.6% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 44120485 / 43477493 / +1.5% 95631065 / 103760608 / -7.8% 0.46 / 0.42 / +10.1%
tpch_q02/datafusion:vortex-file-compressed 23806654 / 25149177 / -5.3% 67666737 / 73802810 / -8.3% 0.35 / 0.34 / +3.2%
tpch_q03/datafusion:vortex-file-compressed 29745055 / 30209886 / -1.5% 91202029 / 87846088 / +3.8% 0.33 / 0.34 / -5.2%
tpch_q04/datafusion:vortex-file-compressed 15575266 / 15717919 / -0.9% 58900339 / 62932261 / -6.4% 0.26 / 0.25 / +5.9%
tpch_q05/datafusion:vortex-file-compressed 49905048 / 50474083 / -1.1% 113885786 / 117001066 / -2.7% 0.44 / 0.43 / +1.6%
tpch_q06/datafusion:vortex-file-compressed 8264710 / 8251962 / +0.2% 54384830 / 54697282 / -0.6% 0.15 / 0.15 / +0.7%
tpch_q07/datafusion:vortex-file-compressed 55296293 / 54579360 / +1.3% 118004439 / 127704859 / -7.6% 0.47 / 0.43 / +9.6%
tpch_q08/datafusion:vortex-file-compressed 45267046 / 46435690 / -2.5% 111359523 / 115614498 / -3.7% 0.41 / 0.40 / +1.2%
tpch_q09/datafusion:vortex-file-compressed 56205315 / 55518231 / +1.2% 126507502 / 126319024 / +0.1% 0.44 / 0.44 / +1.1%
tpch_q10/datafusion:vortex-file-compressed 29239859 / 28643297 / +2.1% 93068426 / 98811697 / -5.8% 0.31 / 0.29 / +8.4%
tpch_q11/datafusion:vortex-file-compressed 17461121 / 17794808 / -1.9% 59346546 / 63082887 / -5.9% 0.29 / 0.28 / +4.3%
tpch_q12/datafusion:vortex-file-compressed 26942752 / 26210474 / +2.8% 67724897 / 71528218 / -5.3% 0.40 / 0.37 / +8.6%
tpch_q13/datafusion:vortex-file-compressed 24154438 / 24195891 / -0.2% 65721448 / 70467847 / -6.7% 0.37 / 0.34 / +7.0%
tpch_q14/datafusion:vortex-file-compressed 16330499 / 15896918 / +2.7% 67280997 / 70745843 / -4.9% 0.24 / 0.22 / +8.0%
tpch_q15/datafusion:vortex-file-compressed 20850304 / 20652240 / +1.0% 74546584 / 78103992 / -4.6% 0.28 / 0.26 / +5.8%
tpch_q16/datafusion:vortex-file-compressed 24607018 / 24946294 / -1.4% 71430976 / 75859451 / -5.8% 0.34 / 0.33 / +4.8%
tpch_q17/datafusion:vortex-file-compressed 55836855 / 55584829 / +0.5% 119790698 / 119297544 / +0.4% 0.47 / 0.47 / +0.0%
tpch_q18/datafusion:vortex-file-compressed 66728725 / 67927462 / -1.8% 122040879 / 126856450 / -3.8% 0.55 / 0.54 / +2.1%
tpch_q19/datafusion:vortex-file-compressed 16409350 / 15509855 / +5.8% 60703351 / 67112537 / -9.5% 0.27 / 0.23 / +17.0%
tpch_q20/datafusion:vortex-file-compressed 30586696 / 30528148 / +0.2% 82437670 / 83905760 / -1.7% 0.37 / 0.36 / +2.0%
tpch_q21/datafusion:vortex-file-compressed 58969405 / 61590387 / -4.3% 132946488 / 135537743 / -1.9% 0.44 / 0.45 / -2.4%
tpch_q22/datafusion:vortex-file-compressed 12613204 / 13004636 / -3.0% 51314345 / 55562326 / -7.6% 0.25 / 0.23 / +5.0%
datafusion / parquet / ns (1.016x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 111940477 / 117170235 / -4.5% 204818870 / 236828196 / -13.5% 🟢 0.55 / 0.49 / +10.5%
tpch_q02/datafusion:parquet 69032198 / 69893558 / -1.2% 118375950 / 118518009 / -0.1% 0.58 / 0.59 / -1.1%
tpch_q03/datafusion:parquet 95127764 / 105359399 / -9.7% 145539577 / 164882621 / -11.7% 🟢 0.65 / 0.64 / +2.3%
tpch_q04/datafusion:parquet 49935993 / 50871589 / -1.8% 103881595 / 105955530 / -2.0% 0.48 / 0.48 / +0.1%
tpch_q05/datafusion:parquet 130167889 / 120596616 / +7.9% 200191120 / 188300564 / +6.3% 0.65 / 0.64 / +1.5%
tpch_q06/datafusion:parquet 47296931 / 37813592 / +25.1% 🔴 91054521 / 92840811 / -1.9% 0.52 / 0.41 / +27.5%
tpch_q07/datafusion:parquet 130525048 / 124852210 / +4.5% 201384869 / 195601313 / +3.0% 0.65 / 0.64 / +1.5%
tpch_q08/datafusion:parquet 119014552 / 120444164 / -1.2% 189152001 / 186956229 / +1.2% 0.63 / 0.64 / -2.3%
tpch_q09/datafusion:parquet 158953398 / 158021446 / +0.6% 218356729 / 237915594 / -8.2% 0.73 / 0.66 / +9.6%
tpch_q10/datafusion:parquet 123799302 / 115599894 / +7.1% 194140504 / 197024778 / -1.5% 0.64 / 0.59 / +8.7%
tpch_q11/datafusion:parquet 49221468 / 48473633 / +1.5% 98497855 / 97885375 / +0.6% 0.50 / 0.50 / +0.9%
tpch_q12/datafusion:parquet 94715648 / 99529727 / -4.8% 155618572 / 137405054 / +13.3% 🔴 0.61 / 0.72 / -16.0%
tpch_q13/datafusion:parquet 215935855 / 217604143 / -0.8% 262558248 / 264124014 / -0.6% 0.82 / 0.82 / -0.2%
tpch_q14/datafusion:parquet 49748043 / 47872848 / +3.9% 98831247 / 107620413 / -8.2% 0.50 / 0.44 / +13.2%
tpch_q15/datafusion:parquet 69308788 / 68182647 / +1.7% 119771747 / 126505682 / -5.3% 0.58 / 0.54 / +7.4%
tpch_q16/datafusion:parquet 48926375 / 49226847 / -0.6% 101389310 / 109080595 / -7.1% 0.48 / 0.45 / +6.9%
tpch_q17/datafusion:parquet 132187769 / 143138108 / -7.7% 189399791 / 202896602 / -6.7% 0.70 / 0.71 / -1.1%
tpch_q18/datafusion:parquet 173597558 / 178759440 / -2.9% 221354525 / 247792068 / -10.7% 🟢 0.78 / 0.72 / +8.7%
tpch_q19/datafusion:parquet 84521641 / 68423732 / +23.5% 🔴 142056588 / 140305894 / +1.2% 0.59 / 0.49 / +22.0%
tpch_q20/datafusion:parquet 90151353 / 83855472 / +7.5% 153371691 / 157329850 / -2.5% 0.59 / 0.53 / +10.3%
tpch_q21/datafusion:parquet 160066438 / 164943173 / -3.0% 230902918 / 235865747 / -2.1% 0.69 / 0.70 / -0.9%
tpch_q22/datafusion:parquet 55020079 / 56433700 / -2.5% 95257026 / 101247113 / -5.9% 0.58 / 0.56 / +3.6%
duckdb / vortex-file-compressed / ns (0.982x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 23261306 / 24700717 / -5.8% 65008407 / 67387522 / -3.5% 0.36 / 0.37 / -2.4%
tpch_q02/duckdb:vortex-file-compressed 30623467 / 30339839 / +0.9% 48913812 / 49662140 / -1.5% 0.63 / 0.61 / +2.5%
tpch_q03/duckdb:vortex-file-compressed 35046928 / 35105451 / -0.2% 74410369 / 87023507 / -14.5% 🟢 0.47 / 0.40 / +16.8%
tpch_q04/duckdb:vortex-file-compressed 31630948 / 33448892 / -5.4% 64256253 / 71409115 / -10.0% 🟢 0.49 / 0.47 / +5.1%
tpch_q05/duckdb:vortex-file-compressed 41019939 / 40911725 / +0.3% 87017906 / 78021583 / +11.5% 🔴 0.47 / 0.52 / -10.1%
tpch_q06/duckdb:vortex-file-compressed 9314299 / 9853354 / -5.5% 42035306 / 40066274 / +4.9% 0.22 / 0.25 / -9.9%
tpch_q07/duckdb:vortex-file-compressed 39489960 / 39089927 / +1.0% 85995358 / 84028389 / +2.3% 0.46 / 0.47 / -1.3%
tpch_q08/duckdb:vortex-file-compressed 46460662 / 48381595 / -4.0% 89999749 / 91739400 / -1.9% 0.52 / 0.53 / -2.1%
tpch_q09/duckdb:vortex-file-compressed 58688545 / 60194494 / -2.5% 109152576 / 106055073 / +2.9% 0.54 / 0.57 / -5.3%
tpch_q10/duckdb:vortex-file-compressed 50589926 / 49392348 / +2.4% 80322451 / 86633961 / -7.3% 0.63 / 0.57 / +10.5%
tpch_q11/duckdb:vortex-file-compressed 16660745 / 16274883 / +2.4% 41372328 / 38157570 / +8.4% 0.40 / 0.43 / -5.6%
tpch_q12/duckdb:vortex-file-compressed 26857419 / 28399540 / -5.4% 61062276 / 60870930 / +0.3% 0.44 / 0.47 / -5.7%
tpch_q13/duckdb:vortex-file-compressed 42209807 / 42977256 / -1.8% 121966953 / 109909331 / +11.0% 🔴 0.35 / 0.39 / -11.5%
tpch_q14/duckdb:vortex-file-compressed 21484298 / 21509747 / -0.1% 60450320 / 63836217 / -5.3% 0.36 / 0.34 / +5.5%
tpch_q15/duckdb:vortex-file-compressed 17705231 / 18889896 / -6.3% 58186648 / 55430446 / +5.0% 0.30 / 0.34 / -10.7%
tpch_q16/duckdb:vortex-file-compressed 29705848 / 30529679 / -2.7% 43399851 / 48090313 / -9.8% 0.68 / 0.63 / +7.8%
tpch_q17/duckdb:vortex-file-compressed 31143177 / 33089540 / -5.9% 83801790 / 89830290 / -6.7% 0.37 / 0.37 / +0.9%
tpch_q18/duckdb:vortex-file-compressed 48321338 / 47865100 / +1.0% 88276315 / 85457346 / +3.3% 0.55 / 0.56 / -2.3%
tpch_q19/duckdb:vortex-file-compressed 37310179 / 37339771 / -0.1% 66044955 / 68470570 / -3.5% 0.56 / 0.55 / +3.6%
tpch_q20/duckdb:vortex-file-compressed 35519472 / 36007932 / -1.4% 84962127 / 83514077 / +1.7% 0.42 / 0.43 / -3.0%
tpch_q21/duckdb:vortex-file-compressed 119088380 / 119638944 / -0.5% 162509702 / 158680906 / +2.4% 0.73 / 0.75 / -2.8%
tpch_q22/duckdb:vortex-file-compressed 21078807 / 20944123 / +0.6% 42775517 / 41487498 / +3.1% 0.49 / 0.50 / -2.4%
duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 81713023 / 81814437 / -0.1% 92882024 / 92508938 / +0.4% 0.88 / 0.88 / -0.5%
tpch_q02/duckdb:parquet 46056461 / 45927823 / +0.3% 60918786 / 62828358 / -3.0% 0.76 / 0.73 / +3.4%
tpch_q03/duckdb:parquet 81049702 / 80892677 / +0.2% 99133529 / 100639423 / -1.5% 0.82 / 0.80 / +1.7%
tpch_q04/duckdb:parquet 57811822 / 58119800 / -0.5% 73460500 / 74906375 / -1.9% 0.79 / 0.78 / +1.4%
tpch_q05/duckdb:parquet 78797434 / 78869271 / -0.1% 99327316 / 100282062 / -1.0% 0.79 / 0.79 / +0.9%
tpch_q06/duckdb:parquet 25097504 / 25210913 / -0.4% 32220861 / 32934196 / -2.2% 0.78 / 0.77 / +1.8%
tpch_q07/duckdb:parquet 80005004 / 81279341 / -1.6% 98622254 / 98656001 / -0.0% 0.81 / 0.82 / -1.5%
tpch_q08/duckdb:parquet 96306698 / 97880051 / -1.6% 140492210 / 119741619 / +17.3% 🔴 0.69 / 0.82 / -16.1%
tpch_q09/duckdb:parquet 149427157 / 148919264 / +0.3% 169124895 / 170090425 / -0.6% 0.88 / 0.88 / +0.9%
tpch_q10/duckdb:parquet 142668973 / 140958808 / +1.2% 163758844 / 173652067 / -5.7% 0.87 / 0.81 / +7.3%
tpch_q11/duckdb:parquet 25378140 / 25557831 / -0.7% 33399740 / 34003193 / -1.8% 0.76 / 0.75 / +1.1%
tpch_q12/duckdb:parquet 53326777 / 53519239 / -0.4% 67264582 / 67248085 / +0.0% 0.79 / 0.80 / -0.4%
tpch_q13/duckdb:parquet 289584582 / 288028065 / +0.5% 307037712 / 304404640 / +0.9% 0.94 / 0.95 / -0.3%
tpch_q14/duckdb:parquet 56272774 / 56270554 / +0.0% 72100559 / 71525478 / +0.8% 0.78 / 0.79 / -0.8%
tpch_q15/duckdb:parquet 31148068 / 30744859 / +1.3% 43588045 / 43215088 / +0.9% 0.71 / 0.71 / +0.4%
tpch_q16/duckdb:parquet 66280785 / 66214578 / +0.1% 79805153 / 84288097 / -5.3% 0.83 / 0.79 / +5.7%
tpch_q17/duckdb:parquet 58451547 / 58363475 / +0.2% 75744080 / 76373258 / -0.8% 0.77 / 0.76 / +1.0%
tpch_q18/duckdb:parquet 126253011 / 129487613 / -2.5% 141363028 / 147799605 / -4.4% 0.89 / 0.88 / +1.9%
tpch_q19/duckdb:parquet 77764779 / 77661689 / +0.1% 95102428 / 95215843 / -0.1% 0.82 / 0.82 / +0.3%
tpch_q20/duckdb:parquet 77195118 / 77689896 / -0.6% 100289068 / 103912055 / -3.5% 0.77 / 0.75 / +3.0%
tpch_q21/duckdb:parquet 189464954 / 201455597 / -6.0% 226256718 / 205008866 / +10.4% 🔴 0.84 / 0.98 / -14.8%
tpch_q22/duckdb:parquet 64018744 / 64425675 / -0.6% 76912546 / 79285534 / -3.0% 0.83 / 0.81 / +2.4%

File Size Changes (17 files changed, -45.4% overall, 2↑ 15↓)
File Scale Format Base HEAD Change %
region.vortex 1.0 vortex-file-compressed 6.69 KB 6.90 KB +216 B +3.2%
nation.vortex 1.0 vortex-file-compressed 10.72 KB 10.93 KB +216 B +2.0%
partsupp.vortex 1.0 vortex-file-compressed 23.83 MB 23.61 MB 218.45 KB -0.9%
supplier.vortex 1.0 vortex-file-compressed 610.41 KB 599.34 KB 11.08 KB -1.8%
orders.vortex 1.0 vortex-file-compressed 39.38 MB 38.46 MB 945.18 KB -2.3%
customer.vortex 1.0 vortex-file-compressed 8.78 MB 8.57 MB 211.32 KB -2.4%
lineitem.vortex 1.0 vortex-file-compressed 164.62 MB 159.58 MB 5.03 MB -3.1%
part.vortex 1.0 vortex-file-compressed 5.33 MB 5.16 MB 175.73 KB -3.2%
customer.vortex 1.0 vortex-compact 7.40 MB 0 B 7.40 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 1.0 vortex-compact 125.99 MB 0 B 125.99 MB -100.0%
nation.vortex 1.0 vortex-compact 7.68 KB 0 B 7.68 KB -100.0%
orders.vortex 1.0 vortex-compact 31.72 MB 0 B 31.72 MB -100.0%
part.vortex 1.0 vortex-compact 3.55 MB 0 B 3.55 MB -100.0%
partsupp.vortex 1.0 vortex-compact 20.29 MB 0 B 20.29 MB -100.0%
region.vortex 1.0 vortex-compact 5.87 KB 0 B 5.87 KB -100.0%
supplier.vortex 1.0 vortex-compact 495.77 KB 0 B 495.77 KB -100.0%

Totals:

  • vortex-compact: 189.71 MB → 0 B (-100.0%)
  • vortex-file-compressed: 242.81 MB → 236.25 MB (-2.7%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 6a234562 vs base 68cdf004
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.8%
Engines: DataFusion No clear signal (-3.3%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.984x ➖ · cold 0.980x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.986x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.975x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 8025461 / 8185206 / -2.0% 33345636 / 35814837 / -6.9% 0.24 / 0.23 / +5.3%
fineweb_q01/datafusion:vortex-file-compressed 30547307 / 32061528 / -4.7% 95569756 / 97103650 / -1.6% 0.32 / 0.33 / -3.2%
fineweb_q02/datafusion:vortex-file-compressed 33503573 / 33068678 / +1.3% 94763824 / 104276837 / -9.1% 0.35 / 0.32 / +11.5%
fineweb_q03/datafusion:vortex-file-compressed 41724168 / 43381508 / -3.8% 180533261 / 183053732 / -1.4% 0.23 / 0.24 / -2.5%
fineweb_q04/datafusion:vortex-file-compressed 203980871 / 209077251 / -2.4% 334662387 / 317786686 / +5.3% 0.61 / 0.66 / -7.4%
fineweb_q05/datafusion:vortex-file-compressed 154593284 / 153261166 / +0.9% 263143671 / 282500435 / -6.9% 0.59 / 0.54 / +8.3%
fineweb_q06/datafusion:vortex-file-compressed 37867220 / 39273020 / -3.6% 184056818 / 189767576 / -3.0% 0.21 / 0.21 / -0.6%
fineweb_q07/datafusion:vortex-file-compressed 35523526 / 39437544 / -9.9% 176006163 / 182614189 / -3.6% 0.20 / 0.22 / -6.5%
fineweb_q08/datafusion:vortex-file-compressed 18829196 / 18346632 / +2.6% 77657681 / 84769995 / -8.4% 0.24 / 0.22 / +12.0%
datafusion / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 8796502 / 8638804 / +1.8% 47864720 / 48874807 / -2.1% 0.18 / 0.18 / +4.0%
fineweb_q01/datafusion:parquet 196493043 / 196613558 / -0.1% 328910680 / 331479567 / -0.8% 0.60 / 0.59 / +0.7%
fineweb_q02/datafusion:parquet 199607136 / 196975838 / +1.3% 330824471 / 332570585 / -0.5% 0.60 / 0.59 / +1.9%
fineweb_q03/datafusion:parquet 191039090 / 190052631 / +0.5% 282298078 / 289742571 / -2.6% 0.68 / 0.66 / +3.2%
fineweb_q04/datafusion:parquet 208419573 / 206221434 / +1.1% 301986115 / 300649871 / +0.4% 0.69 / 0.69 / +0.6%
fineweb_q05/datafusion:parquet 207493724 / 204632256 / +1.4% 294702539 / 300153637 / -1.8% 0.70 / 0.68 / +3.3%
fineweb_q06/datafusion:parquet 197609029 / 199169208 / -0.8% 334703133 / 335384082 / -0.2% 0.59 / 0.59 / -0.6%
fineweb_q07/datafusion:parquet 190606726 / 188883638 / +0.9% 281121998 / 285717866 / -1.6% 0.68 / 0.66 / +2.6%
fineweb_q08/datafusion:parquet 189855328 / 187528122 / +1.2% 275587116 / 281851528 / -2.2% 0.69 / 0.67 / +3.5%
duckdb / vortex-file-compressed / ns (0.992x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 3602896 / 4592406 / -21.5% 🟢 15815624 / 15570328 / +1.6% 0.23 / 0.29 / -22.8%
fineweb_q01/duckdb:vortex-file-compressed 38461776 / 37585306 / +2.3% 111851878 / 116462737 / -4.0% 0.34 / 0.32 / +6.6%
fineweb_q02/duckdb:vortex-file-compressed 48597832 / 49324590 / -1.5% 144986151 / 122751942 / +18.1% 🔴 0.34 / 0.40 / -16.6%
fineweb_q03/duckdb:vortex-file-compressed 151558312 / 134709753 / +12.5% 🔴 284376798 / 261832578 / +8.6% 0.53 / 0.51 / +3.6%
fineweb_q04/duckdb:vortex-file-compressed 281810092 / 273667989 / +3.0% 390399033 / 384161777 / +1.6% 0.72 / 0.71 / +1.3%
fineweb_q05/duckdb:vortex-file-compressed 221161136 / 222109212 / -0.4% 335104848 / 344690281 / -2.8% 0.66 / 0.64 / +2.4%
fineweb_q06/duckdb:vortex-file-compressed 60348597 / 67689362 / -10.8% 🟢 211848482 / 283627528 / -25.3% 🟢 0.28 / 0.24 / +19.4%
fineweb_q07/duckdb:vortex-file-compressed 62898904 / 63553412 / -1.0% 183446013 / 180146470 / +1.8% 0.34 / 0.35 / -2.8%
fineweb_q08/duckdb:vortex-file-compressed 30547196 / 26388462 / +15.8% 🔴 97912698 / 91925364 / +6.5% 0.31 / 0.29 / +8.7%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 34654766 / 35393852 / -2.1% 40740289 / 37942206 / +7.4% 0.85 / 0.93 / -8.8%
fineweb_q01/duckdb:parquet 73894429 / 78603526 / -6.0% 101935184 / 112244325 / -9.2% 0.72 / 0.70 / +3.5%
fineweb_q02/duckdb:parquet 79039396 / 77486570 / +2.0% 106928595 / 111471686 / -4.1% 0.74 / 0.70 / +6.3%
fineweb_q03/duckdb:parquet 206010926 / 208630730 / -1.3% 416819868 / 415114485 / +0.4% 0.49 / 0.50 / -1.7%
fineweb_q04/duckdb:parquet 234741192 / 233724998 / +0.4% 450345630 / 436849220 / +3.1% 0.52 / 0.54 / -2.6%
fineweb_q05/duckdb:parquet 204490014 / 205226256 / -0.4% 427864624 / 430749141 / -0.7% 0.48 / 0.48 / +0.3%
fineweb_q06/duckdb:parquet 144341450 / 144459282 / -0.1% 277125432 / 291788832 / -5.0% 0.52 / 0.50 / +5.2%
fineweb_q07/duckdb:parquet 145702634 / 147483846 / -1.2% 340189183 / 336594040 / +1.1% 0.43 / 0.44 / -2.3%
fineweb_q08/duckdb:parquet 38492978 / 36498177 / +5.5% 38919661 / 41509977 / -6.2% 0.99 / 0.88 / +12.5%

File Size Changes (3 files changed, -46.5% overall, 0↑ 3↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.42 GB 7.00 MB -0.5%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.42 GB (-0.5%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 6a234562 vs base acd8bb47
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (-1.2%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.939x ➖
Parquet (geomean): hot 1.011x ➖ · cold 0.973x ➖
Shifts: Parquet (control) +1.1% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 387932170 / 403179399 / -3.8% 667840921 / 966326688 / -30.9% 🟢 0.58 / 0.42 / +39.2%
clickbench-sorted_q24/datafusion:vortex-file-compressed 22493232 / 25653048 / -12.3% 🟢 87290372 / 89555597 / -2.5% 0.26 / 0.29 / -10.0%
clickbench-sorted_q26/datafusion:vortex-file-compressed 26969905 / 23359088 / +15.5% 🔴 87630748 / 98284211 / -10.8% 🟢 0.31 / 0.24 / +29.5%
clickbench-sorted_q36/datafusion:vortex-file-compressed 47567930 / 47965482 / -0.8% 123079296 / 125776407 / -2.1% 0.39 / 0.38 / +1.3%
clickbench-sorted_q37/datafusion:vortex-file-compressed 36149230 / 36831136 / -1.9% 102455935 / 109351845 / -6.3% 0.35 / 0.34 / +4.8%
clickbench-sorted_q38/datafusion:vortex-file-compressed 34870037 / 33375001 / +4.5% 95421677 / 101301043 / -5.8% 0.37 / 0.33 / +10.9%
clickbench-sorted_q39/datafusion:vortex-file-compressed 83936786 / 81630258 / +2.8% 165143604 / 186891116 / -11.6% 🟢 0.51 / 0.44 / +16.4%
clickbench-sorted_q40/datafusion:vortex-file-compressed 16845654 / 17535262 / -3.9% 72613657 / 76709287 / -5.3% 0.23 / 0.23 / +1.5%
clickbench-sorted_q41/datafusion:vortex-file-compressed 16254438 / 17012828 / -4.5% 74342337 / 75324212 / -1.3% 0.22 / 0.23 / -3.2%
clickbench-sorted_q42/datafusion:vortex-file-compressed 12519180 / 12329939 / +1.5% 61626844 / 62557056 / -1.5% 0.20 / 0.20 / +3.1%
datafusion / parquet / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 2899533763 / 2925841993 / -0.9% 3367877185 / 3398475305 / -0.9% 0.86 / 0.86 / +0.0%
clickbench-sorted_q24/datafusion:parquet 33229328 / 33785766 / -1.6% 153575524 / 154587513 / -0.7% 0.22 / 0.22 / -1.0%
clickbench-sorted_q26/datafusion:parquet 33133720 / 32569222 / +1.7% 150075601 / 156635328 / -4.2% 0.22 / 0.21 / +6.2%
clickbench-sorted_q36/datafusion:parquet 172662855 / 175513359 / -1.6% 296668621 / 309773678 / -4.2% 0.58 / 0.57 / +2.7%
clickbench-sorted_q37/datafusion:parquet 110141529 / 105484700 / +4.4% 215456353 / 239494238 / -10.0% 🟢 0.51 / 0.44 / +16.1%
clickbench-sorted_q38/datafusion:parquet 158422973 / 164795236 / -3.9% 269698045 / 287703023 / -6.3% 0.59 / 0.57 / +2.6%
clickbench-sorted_q39/datafusion:parquet 310467772 / 298126599 / +4.1% 454080302 / 453318786 / +0.2% 0.68 / 0.66 / +4.0%
clickbench-sorted_q40/datafusion:parquet 62998718 / 61231138 / +2.9% 190980903 / 200289479 / -4.6% 0.33 / 0.31 / +7.9%
clickbench-sorted_q41/datafusion:parquet 58647268 / 62186184 / -5.7% 181849484 / 185569523 / -2.0% 0.32 / 0.34 / -3.8%
clickbench-sorted_q42/datafusion:parquet 36116156 / 33259840 / +8.6% 145216546 / 150570399 / -3.6% 0.25 / 0.22 / +12.6%
duckdb / vortex-file-compressed / ns (1.010x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 106333132 / 79330410 / +34.0% 🔴 197787320 / 188923715 / +4.7% 0.54 / 0.42 / +28.0%
clickbench-sorted_q24/duckdb:vortex-file-compressed 28259836 / 28513988 / -0.9% 69545280 / 84952617 / -18.1% 🟢 0.41 / 0.34 / +21.1%
clickbench-sorted_q26/duckdb:vortex-file-compressed 27180082 / 22275325 / +22.0% 🔴 68681050 / 74395717 / -7.7% 0.40 / 0.30 / +32.2%
clickbench-sorted_q36/duckdb:vortex-file-compressed 61022431 / 62925689 / -3.0% 183769938 / 191640894 / -4.1% 0.33 / 0.33 / +1.1%
clickbench-sorted_q37/duckdb:vortex-file-compressed 46091016 / 47412450 / -2.8% 162402971 / 158035515 / +2.8% 0.28 / 0.30 / -5.4%
clickbench-sorted_q38/duckdb:vortex-file-compressed 49415874 / 53863434 / -8.3% 163370140 / 169449043 / -3.6% 0.30 / 0.32 / -4.8%
clickbench-sorted_q39/duckdb:vortex-file-compressed 105440704 / 111448242 / -5.4% 229043673 / 261788260 / -12.5% 🟢 0.46 / 0.43 / +8.1%
clickbench-sorted_q40/duckdb:vortex-file-compressed 26989114 / 26638520 / +1.3% 103194954 / 113316075 / -8.9% 0.26 / 0.24 / +11.3%
clickbench-sorted_q41/duckdb:vortex-file-compressed 26283022 / 27873895 / -5.7% 116194193 / 108275582 / +7.3% 0.23 / 0.26 / -12.1%
clickbench-sorted_q42/duckdb:vortex-file-compressed 21394276 / 24659369 / -13.2% 🟢 110632849 / 106536670 / +3.8% 0.19 / 0.23 / -16.5%
duckdb / parquet / ns (1.014x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 214380308 / 215377724 / -0.5% 255063260 / 267577733 / -4.7% 0.84 / 0.80 / +4.4%
clickbench-sorted_q24/duckdb:parquet 33023787 / 33485268 / -1.4% 55653277 / 59721194 / -6.8% 0.59 / 0.56 / +5.8%
clickbench-sorted_q26/duckdb:parquet 27662997 / 27082848 / +2.1% 48385678 / 49436734 / -2.1% 0.57 / 0.55 / +4.4%
clickbench-sorted_q36/duckdb:parquet 69803837 / 68076304 / +2.5% 100251477 / 96509770 / +3.9% 0.70 / 0.71 / -1.3%
clickbench-sorted_q37/duckdb:parquet 61675712 / 60247694 / +2.4% 94412925 / 87344394 / +8.1% 0.65 / 0.69 / -5.3%
clickbench-sorted_q38/duckdb:parquet 61793707 / 65649137 / -5.9% 93471227 / 93868491 / -0.4% 0.66 / 0.70 / -5.5%
clickbench-sorted_q39/duckdb:parquet 107588102 / 104910013 / +2.6% 154142968 / 158053682 / -2.5% 0.70 / 0.66 / +5.2%
clickbench-sorted_q40/duckdb:parquet 31328666 / 30510165 / +2.7% 68093949 / 71333641 / -4.5% 0.46 / 0.43 / +7.6%
clickbench-sorted_q41/duckdb:parquet 30881320 / 29344320 / +5.2% 61983703 / 63522620 / -2.4% 0.50 / 0.46 / +7.9%
clickbench-sorted_q42/duckdb:parquet 20964372 / 20004725 / +4.8% 41879288 / 43745462 / -4.3% 0.50 / 0.46 / +9.5%

File Size Changes (201 files changed, -44.6% overall, 0↑ 201↓)
File Scale Format Base HEAD Change %
hits_085.vortex 1.0 vortex-file-compressed 198.35 MB 194.63 MB 3.72 MB -1.9%
hits_081.vortex 1.0 vortex-file-compressed 198.58 MB 194.55 MB 4.02 MB -2.0%
hits_055.vortex 1.0 vortex-file-compressed 198.24 MB 193.94 MB 4.29 MB -2.2%
hits_001.vortex 1.0 vortex-file-compressed 194.98 MB 190.50 MB 4.48 MB -2.3%
hits_018.vortex 1.0 vortex-file-compressed 198.67 MB 194.09 MB 4.58 MB -2.3%
hits_066.vortex 1.0 vortex-file-compressed 162.92 MB 158.93 MB 3.99 MB -2.4%
hits_022.vortex 1.0 vortex-file-compressed 198.98 MB 194.01 MB 4.97 MB -2.5%
hits_029.vortex 1.0 vortex-file-compressed 199.76 MB 194.70 MB 5.07 MB -2.5%
hits_011.vortex 1.0 vortex-file-compressed 198.31 MB 193.26 MB 5.06 MB -2.5%
hits_033.vortex 1.0 vortex-file-compressed 199.87 MB 194.63 MB 5.24 MB -2.6%
hits_092.vortex 1.0 vortex-file-compressed 199.42 MB 194.13 MB 5.29 MB -2.7%
hits_007.vortex 1.0 vortex-file-compressed 200.11 MB 194.77 MB 5.34 MB -2.7%
hits_070.vortex 1.0 vortex-file-compressed 199.90 MB 194.43 MB 5.47 MB -2.7%
hits_060.vortex 1.0 vortex-file-compressed 193.10 MB 187.76 MB 5.34 MB -2.8%
hits_059.vortex 1.0 vortex-file-compressed 199.08 MB 193.57 MB 5.51 MB -2.8%
hits_088.vortex 1.0 vortex-file-compressed 172.17 MB 167.37 MB 4.80 MB -2.8%
hits_014.vortex 1.0 vortex-file-compressed 171.99 MB 167.19 MB 4.80 MB -2.8%
hits_090.vortex 1.0 vortex-file-compressed 192.62 MB 187.24 MB 5.37 MB -2.8%
hits_099.vortex 1.0 vortex-file-compressed 171.28 MB 166.50 MB 4.78 MB -2.8%
hits_096.vortex 1.0 vortex-file-compressed 199.53 MB 193.95 MB 5.58 MB -2.8%
hits_049.vortex 1.0 vortex-file-compressed 191.39 MB 186.02 MB 5.38 MB -2.8%
hits_048.vortex 1.0 vortex-file-compressed 199.39 MB 193.78 MB 5.61 MB -2.8%
hits_062.vortex 1.0 vortex-file-compressed 170.86 MB 166.04 MB 4.81 MB -2.8%
hits_077.vortex 1.0 vortex-file-compressed 172.32 MB 167.44 MB 4.88 MB -2.8%
hits_075.vortex 1.0 vortex-file-compressed 189.49 MB 184.07 MB 5.42 MB -2.9%
hits_073.vortex 1.0 vortex-file-compressed 172.80 MB 167.83 MB 4.97 MB -2.9%
hits_025.vortex 1.0 vortex-file-compressed 172.00 MB 167.05 MB 4.95 MB -2.9%
hits_097.vortex 1.0 vortex-file-compressed 192.88 MB 187.32 MB 5.56 MB -2.9%
hits_051.vortex 1.0 vortex-file-compressed 172.47 MB 167.45 MB 5.02 MB -2.9%
hits_064.vortex 1.0 vortex-file-compressed 190.93 MB 185.31 MB 5.61 MB -2.9%
hits_002.vortex 1.0 vortex-file-compressed 160.81 MB 156.08 MB 4.73 MB -2.9%
hits_036.vortex 1.0 vortex-file-compressed 171.55 MB 166.48 MB 5.07 MB -3.0%
hits_023.vortex 1.0 vortex-file-compressed 197.68 MB 191.81 MB 5.88 MB -3.0%
hits_086.vortex 1.0 vortex-file-compressed 192.38 MB 186.65 MB 5.73 MB -3.0%
hits_024.vortex 1.0 vortex-file-compressed 160.52 MB 155.65 MB 4.87 MB -3.0%
hits_038.vortex 1.0 vortex-file-compressed 190.03 MB 184.25 MB 5.78 MB -3.0%
hits_050.vortex 1.0 vortex-file-compressed 161.10 MB 156.18 MB 4.91 MB -3.0%
hits_013.vortex 1.0 vortex-file-compressed 161.22 MB 156.26 MB 4.96 MB -3.1%
hits_087.vortex 1.0 vortex-file-compressed 160.98 MB 156.00 MB 4.98 MB -3.1%
hits_010.vortex 1.0 vortex-file-compressed 169.03 MB 163.78 MB 5.25 MB -3.1%
hits_053.vortex 1.0 vortex-file-compressed 189.85 MB 183.90 MB 5.95 MB -3.1%
hits_065.vortex 1.0 vortex-file-compressed 161.25 MB 156.14 MB 5.11 MB -3.2%
hits_042.vortex 1.0 vortex-file-compressed 202.09 MB 195.67 MB 6.42 MB -3.2%
hits_031.vortex 1.0 vortex-file-compressed 159.47 MB 154.39 MB 5.08 MB -3.2%
hits_016.vortex 1.0 vortex-file-compressed 180.39 MB 174.61 MB 5.78 MB -3.2%
hits_044.vortex 1.0 vortex-file-compressed 200.13 MB 193.71 MB 6.41 MB -3.2%
hits_039.vortex 1.0 vortex-file-compressed 161.13 MB 155.92 MB 5.21 MB -3.2%
hits_040.vortex 1.0 vortex-file-compressed 143.49 MB 138.84 MB 4.66 MB -3.2%
hits_061.vortex 1.0 vortex-file-compressed 160.74 MB 155.49 MB 5.24 MB -3.3%
hits_084.vortex 1.0 vortex-file-compressed 154.42 MB 149.29 MB 5.13 MB -3.3%
hits_047.vortex 1.0 vortex-file-compressed 154.39 MB 149.25 MB 5.14 MB -3.3%
hits_032.vortex 1.0 vortex-file-compressed 154.54 MB 149.36 MB 5.19 MB -3.4%
hits_021.vortex 1.0 vortex-file-compressed 154.33 MB 149.13 MB 5.21 MB -3.4%
hits_074.vortex 1.0 vortex-file-compressed 199.49 MB 192.71 MB 6.79 MB -3.4%
hits_058.vortex 1.0 vortex-file-compressed 155.06 MB 149.77 MB 5.30 MB -3.4%
hits_079.vortex 1.0 vortex-file-compressed 181.13 MB 174.93 MB 6.20 MB -3.4%
hits_034.vortex 1.0 vortex-file-compressed 182.38 MB 176.05 MB 6.32 MB -3.5%
hits_095.vortex 1.0 vortex-file-compressed 154.55 MB 149.12 MB 5.43 MB -3.5%
hits_057.vortex 1.0 vortex-file-compressed 159.98 MB 154.33 MB 5.65 MB -3.5%
hits_017.vortex 1.0 vortex-file-compressed 146.83 MB 141.64 MB 5.19 MB -3.5%
hits_052.vortex 1.0 vortex-file-compressed 130.82 MB 126.15 MB 4.67 MB -3.6%
hits_091.vortex 1.0 vortex-file-compressed 146.96 MB 141.69 MB 5.26 MB -3.6%
hits_056.vortex 1.0 vortex-file-compressed 136.15 MB 131.20 MB 4.95 MB -3.6%
hits_054.vortex 1.0 vortex-file-compressed 146.96 MB 141.60 MB 5.36 MB -3.6%
hits_043.vortex 1.0 vortex-file-compressed 126.42 MB 121.80 MB 4.62 MB -3.7%
hits_037.vortex 1.0 vortex-file-compressed 177.40 MB 170.91 MB 6.50 MB -3.7%
hits_083.vortex 1.0 vortex-file-compressed 157.01 MB 151.23 MB 5.78 MB -3.7%
hits_089.vortex 1.0 vortex-file-compressed 131.32 MB 126.48 MB 4.85 MB -3.7%
hits_028.vortex 1.0 vortex-file-compressed 151.72 MB 146.09 MB 5.63 MB -3.7%
hits_006.vortex 1.0 vortex-file-compressed 126.35 MB 121.65 MB 4.70 MB -3.7%
hits_069.vortex 1.0 vortex-file-compressed 142.27 MB 136.96 MB 5.30 MB -3.7%
hits_098.vortex 1.0 vortex-file-compressed 137.44 MB 132.30 MB 5.14 MB -3.7%
hits_080.vortex 1.0 vortex-file-compressed 126.84 MB 122.08 MB 4.76 MB -3.8%
hits_026.vortex 1.0 vortex-file-compressed 131.41 MB 126.48 MB 4.94 MB -3.8%
hits_093.vortex 1.0 vortex-file-compressed 131.69 MB 126.72 MB 4.97 MB -3.8%
hits_094.vortex 1.0 vortex-file-compressed 158.98 MB 152.95 MB 6.02 MB -3.8%
hits_000.vortex 1.0 vortex-file-compressed 131.56 MB 126.57 MB 4.99 MB -3.8%
hits_063.vortex 1.0 vortex-file-compressed 131.67 MB 126.68 MB 4.99 MB -3.8%
hits_076.vortex 1.0 vortex-file-compressed 160.88 MB 154.78 MB 6.11 MB -3.8%
hits_003.vortex 1.0 vortex-file-compressed 136.47 MB 131.26 MB 5.21 MB -3.8%
hits_078.vortex 1.0 vortex-file-compressed 131.16 MB 126.14 MB 5.02 MB -3.8%
hits_045.vortex 1.0 vortex-file-compressed 140.01 MB 134.62 MB 5.39 MB -3.8%
hits_005.vortex 1.0 vortex-file-compressed 168.29 MB 161.74 MB 6.54 MB -3.9%
hits_030.vortex 1.0 vortex-file-compressed 132.21 MB 127.03 MB 5.18 MB -3.9%
hits_008.vortex 1.0 vortex-file-compressed 139.93 MB 134.39 MB 5.54 MB -4.0%
hits_041.vortex 1.0 vortex-file-compressed 131.37 MB 126.14 MB 5.23 MB -4.0%
hits_004.vortex 1.0 vortex-file-compressed 131.41 MB 126.18 MB 5.23 MB -4.0%
hits_012.vortex 1.0 vortex-file-compressed 193.06 MB 185.34 MB 7.72 MB -4.0%
hits_015.vortex 1.0 vortex-file-compressed 131.50 MB 126.18 MB 5.32 MB -4.0%
hits_019.vortex 1.0 vortex-file-compressed 140.77 MB 135.06 MB 5.71 MB -4.1%
hits_027.vortex 1.0 vortex-file-compressed 191.68 MB 183.88 MB 7.80 MB -4.1%
hits_020.vortex 1.0 vortex-file-compressed 161.14 MB 154.52 MB 6.62 MB -4.1%
hits_067.vortex 1.0 vortex-file-compressed 131.74 MB 126.17 MB 5.57 MB -4.2%
hits_071.vortex 1.0 vortex-file-compressed 140.90 MB 134.81 MB 6.09 MB -4.3%
hits_082.vortex 1.0 vortex-file-compressed 140.28 MB 134.19 MB 6.09 MB -4.3%
hits_068.vortex 1.0 vortex-file-compressed 160.86 MB 153.77 MB 7.09 MB -4.4%
hits_072.vortex 1.0 vortex-file-compressed 102.27 MB 97.02 MB 5.25 MB -5.1%
hits_046.vortex 1.0 vortex-file-compressed 101.18 MB 95.80 MB 5.37 MB -5.3%
hits_009.vortex 1.0 vortex-file-compressed 101.52 MB 96.02 MB 5.50 MB -5.4%
hits_035.vortex 1.0 vortex-file-compressed 103.23 MB 97.35 MB 5.88 MB -5.7%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-compact 97.87 MB 0 B 97.87 MB -100.0%
hits_001.vortex 1.0 vortex-compact 139.15 MB 0 B 139.15 MB -100.0%
hits_002.vortex 1.0 vortex-compact 125.00 MB 0 B 125.00 MB -100.0%
hits_003.vortex 1.0 vortex-compact 104.57 MB 0 B 104.57 MB -100.0%
hits_004.vortex 1.0 vortex-compact 97.03 MB 0 B 97.03 MB -100.0%
hits_005.vortex 1.0 vortex-compact 115.81 MB 0 B 115.81 MB -100.0%
hits_006.vortex 1.0 vortex-compact 94.10 MB 0 B 94.10 MB -100.0%
hits_007.vortex 1.0 vortex-compact 153.68 MB 0 B 153.68 MB -100.0%
hits_008.vortex 1.0 vortex-compact 105.68 MB 0 B 105.68 MB -100.0%
hits_009.vortex 1.0 vortex-compact 75.20 MB 0 B 75.20 MB -100.0%
hits_010.vortex 1.0 vortex-compact 123.46 MB 0 B 123.46 MB -100.0%
hits_011.vortex 1.0 vortex-compact 152.64 MB 0 B 152.64 MB -100.0%
hits_012.vortex 1.0 vortex-compact 140.08 MB 0 B 140.08 MB -100.0%
hits_013.vortex 1.0 vortex-compact 125.82 MB 0 B 125.82 MB -100.0%
hits_014.vortex 1.0 vortex-compact 134.10 MB 0 B 134.10 MB -100.0%
hits_015.vortex 1.0 vortex-compact 97.34 MB 0 B 97.34 MB -100.0%
hits_016.vortex 1.0 vortex-compact 127.55 MB 0 B 127.55 MB -100.0%
hits_017.vortex 1.0 vortex-compact 111.69 MB 0 B 111.69 MB -100.0%
hits_018.vortex 1.0 vortex-compact 152.89 MB 0 B 152.89 MB -100.0%
hits_019.vortex 1.0 vortex-compact 106.62 MB 0 B 106.62 MB -100.0%
hits_020.vortex 1.0 vortex-compact 111.72 MB 0 B 111.72 MB -100.0%
hits_021.vortex 1.0 vortex-compact 110.60 MB 0 B 110.60 MB -100.0%
hits_022.vortex 1.0 vortex-compact 153.14 MB 0 B 153.14 MB -100.0%
hits_023.vortex 1.0 vortex-compact 142.59 MB 0 B 142.59 MB -100.0%
hits_024.vortex 1.0 vortex-compact 125.17 MB 0 B 125.17 MB -100.0%
hits_025.vortex 1.0 vortex-compact 133.66 MB 0 B 133.66 MB -100.0%
hits_026.vortex 1.0 vortex-compact 98.65 MB 0 B 98.65 MB -100.0%
hits_027.vortex 1.0 vortex-compact 139.34 MB 0 B 139.34 MB -100.0%
hits_028.vortex 1.0 vortex-compact 115.65 MB 0 B 115.65 MB -100.0%
hits_029.vortex 1.0 vortex-compact 153.37 MB 0 B 153.37 MB -100.0%
hits_030.vortex 1.0 vortex-compact 98.99 MB 0 B 98.99 MB -100.0%
hits_031.vortex 1.0 vortex-compact 111.52 MB 0 B 111.52 MB -100.0%
hits_032.vortex 1.0 vortex-compact 110.97 MB 0 B 110.97 MB -100.0%
hits_033.vortex 1.0 vortex-compact 153.50 MB 0 B 153.50 MB -100.0%
hits_034.vortex 1.0 vortex-compact 133.79 MB 0 B 133.79 MB -100.0%
hits_035.vortex 1.0 vortex-compact 75.91 MB 0 B 75.91 MB -100.0%
hits_036.vortex 1.0 vortex-compact 133.35 MB 0 B 133.35 MB -100.0%
hits_037.vortex 1.0 vortex-compact 132.19 MB 0 B 132.19 MB -100.0%
hits_038.vortex 1.0 vortex-compact 139.45 MB 0 B 139.45 MB -100.0%
hits_039.vortex 1.0 vortex-compact 125.28 MB 0 B 125.28 MB -100.0%
hits_040.vortex 1.0 vortex-compact 110.45 MB 0 B 110.45 MB -100.0%
hits_041.vortex 1.0 vortex-compact 98.32 MB 0 B 98.32 MB -100.0%
hits_042.vortex 1.0 vortex-compact 136.29 MB 0 B 136.29 MB -100.0%
hits_043.vortex 1.0 vortex-compact 94.28 MB 0 B 94.28 MB -100.0%
hits_044.vortex 1.0 vortex-compact 153.57 MB 0 B 153.57 MB -100.0%
hits_045.vortex 1.0 vortex-compact 106.12 MB 0 B 106.12 MB -100.0%
hits_046.vortex 1.0 vortex-compact 74.97 MB 0 B 74.97 MB -100.0%
hits_047.vortex 1.0 vortex-compact 110.47 MB 0 B 110.47 MB -100.0%
hits_048.vortex 1.0 vortex-compact 153.35 MB 0 B 153.35 MB -100.0%
hits_049.vortex 1.0 vortex-compact 140.51 MB 0 B 140.51 MB -100.0%
hits_050.vortex 1.0 vortex-compact 125.76 MB 0 B 125.76 MB -100.0%
hits_051.vortex 1.0 vortex-compact 133.96 MB 0 B 133.96 MB -100.0%
hits_052.vortex 1.0 vortex-compact 96.89 MB 0 B 96.89 MB -100.0%
hits_053.vortex 1.0 vortex-compact 138.54 MB 0 B 138.54 MB -100.0%
hits_054.vortex 1.0 vortex-compact 112.10 MB 0 B 112.10 MB -100.0%
hits_055.vortex 1.0 vortex-compact 153.29 MB 0 B 153.29 MB -100.0%
hits_056.vortex 1.0 vortex-compact 101.15 MB 0 B 101.15 MB -100.0%
hits_057.vortex 1.0 vortex-compact 111.82 MB 0 B 111.82 MB -100.0%
hits_058.vortex 1.0 vortex-compact 110.82 MB 0 B 110.82 MB -100.0%
hits_059.vortex 1.0 vortex-compact 153.00 MB 0 B 153.00 MB -100.0%
hits_060.vortex 1.0 vortex-compact 140.08 MB 0 B 140.08 MB -100.0%
hits_061.vortex 1.0 vortex-compact 125.33 MB 0 B 125.33 MB -100.0%
hits_062.vortex 1.0 vortex-compact 132.49 MB 0 B 132.49 MB -100.0%
hits_063.vortex 1.0 vortex-compact 98.16 MB 0 B 98.16 MB -100.0%
hits_064.vortex 1.0 vortex-compact 140.02 MB 0 B 140.02 MB -100.0%
hits_065.vortex 1.0 vortex-compact 123.94 MB 0 B 123.94 MB -100.0%
hits_066.vortex 1.0 vortex-compact 117.39 MB 0 B 117.39 MB -100.0%
hits_067.vortex 1.0 vortex-compact 99.37 MB 0 B 99.37 MB -100.0%
hits_068.vortex 1.0 vortex-compact 112.47 MB 0 B 112.47 MB -100.0%
hits_069.vortex 1.0 vortex-compact 99.77 MB 0 B 99.77 MB -100.0%
hits_070.vortex 1.0 vortex-compact 153.83 MB 0 B 153.83 MB -100.0%
hits_071.vortex 1.0 vortex-compact 105.69 MB 0 B 105.69 MB -100.0%
hits_072.vortex 1.0 vortex-compact 75.55 MB 0 B 75.55 MB -100.0%
hits_073.vortex 1.0 vortex-compact 134.16 MB 0 B 134.16 MB -100.0%
hits_074.vortex 1.0 vortex-compact 153.30 MB 0 B 153.30 MB -100.0%
hits_075.vortex 1.0 vortex-compact 137.70 MB 0 B 137.70 MB -100.0%
hits_076.vortex 1.0 vortex-compact 125.67 MB 0 B 125.67 MB -100.0%
hits_077.vortex 1.0 vortex-compact 134.14 MB 0 B 134.14 MB -100.0%
hits_078.vortex 1.0 vortex-compact 96.98 MB 0 B 96.98 MB -100.0%
hits_079.vortex 1.0 vortex-compact 128.17 MB 0 B 128.17 MB -100.0%
hits_080.vortex 1.0 vortex-compact 97.08 MB 0 B 97.08 MB -100.0%
hits_081.vortex 1.0 vortex-compact 153.46 MB 0 B 153.46 MB -100.0%
hits_082.vortex 1.0 vortex-compact 106.18 MB 0 B 106.18 MB -100.0%
hits_083.vortex 1.0 vortex-compact 109.91 MB 0 B 109.91 MB -100.0%
hits_084.vortex 1.0 vortex-compact 110.65 MB 0 B 110.65 MB -100.0%
hits_085.vortex 1.0 vortex-compact 153.22 MB 0 B 153.22 MB -100.0%
hits_086.vortex 1.0 vortex-compact 140.71 MB 0 B 140.71 MB -100.0%
hits_087.vortex 1.0 vortex-compact 125.14 MB 0 B 125.14 MB -100.0%
hits_088.vortex 1.0 vortex-compact 134.11 MB 0 B 134.11 MB -100.0%
hits_089.vortex 1.0 vortex-compact 99.01 MB 0 B 99.01 MB -100.0%
hits_090.vortex 1.0 vortex-compact 141.22 MB 0 B 141.22 MB -100.0%
hits_091.vortex 1.0 vortex-compact 112.26 MB 0 B 112.26 MB -100.0%
hits_092.vortex 1.0 vortex-compact 153.28 MB 0 B 153.28 MB -100.0%
hits_093.vortex 1.0 vortex-compact 98.13 MB 0 B 98.13 MB -100.0%
hits_094.vortex 1.0 vortex-compact 110.52 MB 0 B 110.52 MB -100.0%
hits_095.vortex 1.0 vortex-compact 110.44 MB 0 B 110.44 MB -100.0%
hits_096.vortex 1.0 vortex-compact 153.14 MB 0 B 153.14 MB -100.0%
hits_097.vortex 1.0 vortex-compact 140.27 MB 0 B 140.27 MB -100.0%
hits_098.vortex 1.0 vortex-compact 104.06 MB 0 B 104.06 MB -100.0%
hits_099.vortex 1.0 vortex-compact 133.06 MB 0 B 133.06 MB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 15.97 GB → 15.44 GB (-3.3%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 6a234562 vs base acd8bb47
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (+0.6%, environment too noisy confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.996x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.998x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.992x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 28405130 / 28371146 / +0.1% 84725831 / 83852607 / +1.0% 0.34 / 0.34 / -0.9%
tpcds_q02/datafusion:vortex-file-compressed 51498402 / 51261719 / +0.5% 101428959 / 103775876 / -2.3% 0.51 / 0.49 / +2.8%
tpcds_q03/datafusion:vortex-file-compressed 14902938 / 14481880 / +2.9% 61999147 / 64664943 / -4.1% 0.24 / 0.22 / +7.3%
tpcds_q04/datafusion:vortex-file-compressed 203835794 / 209872556 / -2.9% 281279075 / 278303658 / +1.1% 0.72 / 0.75 / -3.9%
tpcds_q05/datafusion:vortex-file-compressed 63736489 / 63325418 / +0.6% 122341414 / 125054754 / -2.2% 0.52 / 0.51 / +2.9%
tpcds_q06/datafusion:vortex-file-compressed 25563328 / 25504251 / +0.2% 80855049 / 75031912 / +7.8% 0.32 / 0.34 / -7.0%
tpcds_q07/datafusion:vortex-file-compressed 43803604 / 42906208 / +2.1% 104109723 / 103951063 / +0.2% 0.42 / 0.41 / +1.9%
tpcds_q08/datafusion:vortex-file-compressed 33395302 / 34202138 / -2.4% 85242919 / 90359594 / -5.7% 0.39 / 0.38 / +3.5%
tpcds_q09/datafusion:vortex-file-compressed 25336754 / 26164402 / -3.2% 68339656 / 68597752 / -0.4% 0.37 / 0.38 / -2.8%
tpcds_q10/datafusion:vortex-file-compressed 35639732 / 36192356 / -1.5% 83790299 / 85864654 / -2.4% 0.43 / 0.42 / +0.9%
tpcds_q11/datafusion:vortex-file-compressed 111824571 / 113473306 / -1.5% 179888546 / 187562523 / -4.1% 0.62 / 0.60 / +2.8%
tpcds_q12/datafusion:vortex-file-compressed 21022034 / 21367857 / -1.6% 68033951 / 70805487 / -3.9% 0.31 / 0.30 / +2.4%
tpcds_q13/datafusion:vortex-file-compressed 38924234 / 43121442 / -9.7% 88006926 / 96790300 / -9.1% 0.44 / 0.45 / -0.7%
tpcds_q14/datafusion:vortex-file-compressed 194635688 / 194005843 / +0.3% 259965145 / 264533595 / -1.7% 0.75 / 0.73 / +2.1%
tpcds_q15/datafusion:vortex-file-compressed 29154380 / 29782872 / -2.1% 77009820 / 76535402 / +0.6% 0.38 / 0.39 / -2.7%
tpcds_q16/datafusion:vortex-file-compressed 24764286 / 25299004 / -2.1% 72535207 / 76126363 / -4.7% 0.34 / 0.33 / +2.7%
tpcds_q17/datafusion:vortex-file-compressed 72673557 / 72222430 / +0.6% 135313655 / 136650811 / -1.0% 0.54 / 0.53 / +1.6%
tpcds_q18/datafusion:vortex-file-compressed 85934586 / 84956576 / +1.2% 150474164 / 147651615 / +1.9% 0.57 / 0.58 / -0.7%
tpcds_q19/datafusion:vortex-file-compressed 23130609 / 22634976 / +2.2% 73557502 / 72630713 / +1.3% 0.31 / 0.31 / +0.9%
tpcds_q20/datafusion:vortex-file-compressed 26189451 / 27718744 / -5.5% 72603454 / 79526998 / -8.7% 0.36 / 0.35 / +3.5%
tpcds_q21/datafusion:vortex-file-compressed 31026846 / 31181884 / -0.5% 89095605 / 89825833 / -0.8% 0.35 / 0.35 / +0.3%
tpcds_q22/datafusion:vortex-file-compressed 89637198 / 111774994 / -19.8% 🟢 191167749 / 137885358 / +38.6% 🔴 0.47 / 0.81 / -42.2%
tpcds_q23/datafusion:vortex-file-compressed 125269548 / 125519027 / -0.2% 198141665 / 197676908 / +0.2% 0.63 / 0.63 / -0.4%
tpcds_q24/datafusion:vortex-file-compressed 94708126 / 93393003 / +1.4% 170276301 / 167240390 / +1.8% 0.56 / 0.56 / -0.4%
tpcds_q25/datafusion:vortex-file-compressed 71677934 / 71886918 / -0.3% 145887986 / 153251094 / -4.8% 0.49 / 0.47 / +4.7%
tpcds_q26/datafusion:vortex-file-compressed 37303900 / 38349311 / -2.7% 88390511 / 87420895 / +1.1% 0.42 / 0.44 / -3.8%
tpcds_q27/datafusion:vortex-file-compressed 93093556 / 90912428 / +2.4% 176989638 / 168358095 / +5.1% 0.53 / 0.54 / -2.6%
tpcds_q28/datafusion:vortex-file-compressed 24459284 / 23542108 / +3.9% 64603772 / 73327332 / -11.9% 🟢 0.38 / 0.32 / +17.9%
tpcds_q29/datafusion:vortex-file-compressed 69827627 / 70496904 / -0.9% 137806074 / 138880829 / -0.8% 0.51 / 0.51 / -0.2%
tpcds_q30/datafusion:vortex-file-compressed 32289841 / 33104130 / -2.5% 75398002 / 78882255 / -4.4% 0.43 / 0.42 / +2.0%
tpcds_q31/datafusion:vortex-file-compressed 72109838 / 72818032 / -1.0% 137640006 / 140543556 / -2.1% 0.52 / 0.52 / +1.1%
tpcds_q32/datafusion:vortex-file-compressed 18513597 / 18688326 / -0.9% 65184381 / 64187272 / +1.6% 0.28 / 0.29 / -2.5%
tpcds_q33/datafusion:vortex-file-compressed 31803310 / 31878120 / -0.2% 88932603 / 90118825 / -1.3% 0.36 / 0.35 / +1.1%
tpcds_q34/datafusion:vortex-file-compressed 26973220 / 26379367 / +2.3% 77278981 / 79308686 / -2.6% 0.35 / 0.33 / +4.9%
tpcds_q35/datafusion:vortex-file-compressed 45866118 / 45081806 / +1.7% 100850106 / 96204996 / +4.8% 0.45 / 0.47 / -2.9%
tpcds_q36/datafusion:vortex-file-compressed 59433258 / 60192054 / -1.3% 134830707 / 134773537 / +0.0% 0.44 / 0.45 / -1.3%
tpcds_q37/datafusion:vortex-file-compressed 18192911 / 18861535 / -3.5% 65544723 / 66666648 / -1.7% 0.28 / 0.28 / -1.9%
tpcds_q38/datafusion:vortex-file-compressed 39250178 / 39449527 / -0.5% 96556231 / 98410846 / -1.9% 0.41 / 0.40 / +1.4%
tpcds_q39/datafusion:vortex-file-compressed 88637635 / 88955882 / -0.4% 149397068 / 148962282 / +0.3% 0.59 / 0.60 / -0.6%
tpcds_q40/datafusion:vortex-file-compressed 31989594 / 31981860 / +0.0% 94075210 / 91468471 / +2.8% 0.34 / 0.35 / -2.7%
tpcds_q41/datafusion:vortex-file-compressed 20523218 / 20956878 / -2.1% 49442772 / 52635191 / -6.1% 0.42 / 0.40 / +4.3%
tpcds_q42/datafusion:vortex-file-compressed 13593384 / 14028388 / -3.1% 58290632 / 59674729 / -2.3% 0.23 / 0.24 / -0.8%
tpcds_q43/datafusion:vortex-file-compressed 19143367 / 18711484 / +2.3% 64897048 / 66781949 / -2.8% 0.29 / 0.28 / +5.3%
tpcds_q44/datafusion:vortex-file-compressed 31241414 / 32826679 / -4.8% 88751436 / 86746590 / +2.3% 0.35 / 0.38 / -7.0%
tpcds_q45/datafusion:vortex-file-compressed 34074003 / 33402738 / +2.0% 80739742 / 85330884 / -5.4% 0.42 / 0.39 / +7.8%
tpcds_q46/datafusion:vortex-file-compressed 33515650 / 33991788 / -1.4% 96426535 / 95425604 / +1.0% 0.35 / 0.36 / -2.4%
tpcds_q47/datafusion:vortex-file-compressed 121400379 / 122446921 / -0.9% 197645857 / 198890796 / -0.6% 0.61 / 0.62 / -0.2%
tpcds_q48/datafusion:vortex-file-compressed 34553592 / 34570022 / -0.0% 83150892 / 84585411 / -1.7% 0.42 / 0.41 / +1.7%
tpcds_q49/datafusion:vortex-file-compressed 64023772 / 65218424 / -1.8% 127546520 / 126122839 / +1.1% 0.50 / 0.52 / -2.9%
tpcds_q50/datafusion:vortex-file-compressed 45217434 / 45122573 / +0.2% 98580457 / 105073451 / -6.2% 0.46 / 0.43 / +6.8%
tpcds_q51/datafusion:vortex-file-compressed 74730730 / 72778190 / +2.7% 143252955 / 141325442 / +1.4% 0.52 / 0.51 / +1.3%
tpcds_q52/datafusion:vortex-file-compressed 14264390 / 14437018 / -1.2% 59333575 / 61326432 / -3.2% 0.24 / 0.24 / +2.1%
tpcds_q53/datafusion:vortex-file-compressed 23828970 / 23191227 / +2.7% 71190606 / 76989494 / -7.5% 0.33 / 0.30 / +11.1%
tpcds_q54/datafusion:vortex-file-compressed 37108151 / 36820116 / +0.8% 92070509 / 90727967 / +1.5% 0.40 / 0.41 / -0.7%
tpcds_q55/datafusion:vortex-file-compressed 14203586 / 14336788 / -0.9% 59682715 / 59658692 / +0.0% 0.24 / 0.24 / -1.0%
tpcds_q56/datafusion:vortex-file-compressed 31541466 / 32499116 / -2.9% 86561835 / 90782654 / -4.6% 0.36 / 0.36 / +1.8%
tpcds_q57/datafusion:vortex-file-compressed 95566534 / 95385410 / +0.2% 167096069 / 166406976 / +0.4% 0.57 / 0.57 / -0.2%
tpcds_q58/datafusion:vortex-file-compressed 56996055 / 57999870 / -1.7% 120099370 / 123138680 / -2.5% 0.47 / 0.47 / +0.8%
tpcds_q59/datafusion:vortex-file-compressed 54148412 / 54022240 / +0.2% 102904837 / 106832844 / -3.7% 0.53 / 0.51 / +4.1%
tpcds_q60/datafusion:vortex-file-compressed 31669163 / 31205568 / +1.5% 88435762 / 89179009 / -0.8% 0.36 / 0.35 / +2.3%
tpcds_q61/datafusion:vortex-file-compressed 36087014 / 35147932 / +2.7% 87055989 / 90411452 / -3.7% 0.41 / 0.39 / +6.6%
tpcds_q62/datafusion:vortex-file-compressed 23597776 / 21129285 / +11.7% 🔴 67177150 / 65922741 / +1.9% 0.35 / 0.32 / +9.6%
tpcds_q63/datafusion:vortex-file-compressed 23715439 / 22986436 / +3.2% 70458126 / 73852968 / -4.6% 0.34 / 0.31 / +8.1%
tpcds_q64/datafusion:vortex-file-compressed 438880860 / 458346256 / -4.2% 558454483 / 553506438 / +0.9% 0.79 / 0.83 / -5.1%
tpcds_q65/datafusion:vortex-file-compressed 68145529 / 68558716 / -0.6% 129300160 / 130355278 / -0.8% 0.53 / 0.53 / +0.2%
tpcds_q66/datafusion:vortex-file-compressed 74977363 / 76787286 / -2.4% 134887014 / 135325017 / -0.3% 0.56 / 0.57 / -2.0%
tpcds_q67/datafusion:vortex-file-compressed 108479274 / 111365040 / -2.6% 188851133 / 187784250 / +0.6% 0.57 / 0.59 / -3.1%
tpcds_q68/datafusion:vortex-file-compressed 33033518 / 32858191 / +0.5% 98087587 / 101107489 / -3.0% 0.34 / 0.32 / +3.6%
tpcds_q69/datafusion:vortex-file-compressed 34236438 / 35486412 / -3.5% 77175341 / 84193236 / -8.3% 0.44 / 0.42 / +5.3%
tpcds_q70/datafusion:vortex-file-compressed 109207658 / 109057004 / +0.1% 166642874 / 171158312 / -2.6% 0.66 / 0.64 / +2.9%
tpcds_q71/datafusion:vortex-file-compressed 22020930 / 23692194 / -7.1% 71776354 / 71930537 / -0.2% 0.31 / 0.33 / -6.9%
tpcds_q72/datafusion:vortex-file-compressed 1463226122 / 1459992392 / +0.2% 1518000174 / 1561912763 / -2.8% 0.96 / 0.93 / +3.1%
tpcds_q73/datafusion:vortex-file-compressed 24876734 / 24567284 / +1.3% 75717825 / 80750211 / -6.2% 0.33 / 0.30 / +8.0%
tpcds_q74/datafusion:vortex-file-compressed 70627464 / 71050610 / -0.6% 136495255 / 138883445 / -1.7% 0.52 / 0.51 / +1.1%
tpcds_q75/datafusion:vortex-file-compressed 129993611 / 131613067 / -1.2% 204632732 / 207857907 / -1.6% 0.64 / 0.63 / +0.3%
tpcds_q76/datafusion:vortex-file-compressed 38858394 / 40761800 / -4.7% 89674606 / 91117037 / -1.6% 0.43 / 0.45 / -3.1%
tpcds_q77/datafusion:vortex-file-compressed 41535324 / 41847683 / -0.7% 97636393 / 99688398 / -2.1% 0.43 / 0.42 / +1.3%
tpcds_q78/datafusion:vortex-file-compressed 102774201 / 103490288 / -0.7% 171242063 / 177431043 / -3.5% 0.60 / 0.58 / +2.9%
tpcds_q79/datafusion:vortex-file-compressed 28496821 / 28300752 / +0.7% 82828132 / 88239254 / -6.1% 0.34 / 0.32 / +7.3%
tpcds_q80/datafusion:vortex-file-compressed 94512172 / 95672257 / -1.2% 186791635 / 184462379 / +1.3% 0.51 / 0.52 / -2.4%
tpcds_q81/datafusion:vortex-file-compressed 33429681 / 33226062 / +0.6% 74249394 / 82026052 / -9.5% 0.45 / 0.41 / +11.2%
tpcds_q82/datafusion:vortex-file-compressed 19188152 / 20141984 / -4.7% 68482417 / 65628508 / +4.3% 0.28 / 0.31 / -8.7%
tpcds_q83/datafusion:vortex-file-compressed 44891640 / 42263620 / +6.2% 87500083 / 85876717 / +1.9% 0.51 / 0.49 / +4.2%
tpcds_q84/datafusion:vortex-file-compressed 14341660 / 14411187 / -0.5% 52489049 / 53344778 / -1.6% 0.27 / 0.27 / +1.1%
tpcds_q85/datafusion:vortex-file-compressed 97147492 / 97401628 / -0.3% 164107429 / 166421927 / -1.4% 0.59 / 0.59 / +1.1%
tpcds_q86/datafusion:vortex-file-compressed 18975280 / 19329298 / -1.8% 63258804 / 65214230 / -3.0% 0.30 / 0.30 / +1.2%
tpcds_q87/datafusion:vortex-file-compressed 39004012 / 39602954 / -1.5% 93263213 / 96959265 / -3.8% 0.42 / 0.41 / +2.4%
tpcds_q88/datafusion:vortex-file-compressed 50960679 / 51852552 / -1.7% 115123189 / 110389956 / +4.3% 0.44 / 0.47 / -5.8%
tpcds_q89/datafusion:vortex-file-compressed 25771306 / 27530322 / -6.4% 77127155 / 81990747 / -5.9% 0.33 / 0.34 / -0.5%
tpcds_q90/datafusion:vortex-file-compressed 14540526 / 14436830 / +0.7% 55089920 / 54573128 / +0.9% 0.26 / 0.26 / -0.2%
tpcds_q91/datafusion:vortex-file-compressed 20526618 / 20994404 / -2.2% 56595670 / 58112971 / -2.6% 0.36 / 0.36 / +0.4%
tpcds_q92/datafusion:vortex-file-compressed 17650870 / 17516178 / +0.8% 64563071 / 64603536 / -0.1% 0.27 / 0.27 / +0.8%
tpcds_q93/datafusion:vortex-file-compressed 31793358 / 30639236 / +3.8% 82960150 / 88205063 / -5.9% 0.38 / 0.35 / +10.3%
tpcds_q94/datafusion:vortex-file-compressed 23313058 / 22582112 / +3.2% 65813306 / 66479667 / -1.0% 0.35 / 0.34 / +4.3%
tpcds_q95/datafusion:vortex-file-compressed 60035134 / 59580282 / +0.8% 117009397 / 120837817 / -3.2% 0.51 / 0.49 / +4.1%
tpcds_q96/datafusion:vortex-file-compressed 11490894 / 11705958 / -1.8% 50665377 / 55318320 / -8.4% 0.23 / 0.21 / +7.2%
tpcds_q97/datafusion:vortex-file-compressed 26889291 / 27216862 / -1.2% 83068799 / 81890445 / +1.4% 0.32 / 0.33 / -2.6%
tpcds_q98/datafusion:vortex-file-compressed 24291962 / 23782006 / +2.1% 77924558 / 81456336 / -4.3% 0.31 / 0.29 / +6.8%
tpcds_q99/datafusion:vortex-file-compressed 26939547 / 29141138 / -7.6% 74674316 / 71545170 / +4.4% 0.36 / 0.41 / -11.4%
datafusion / parquet / ns (0.999x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 31988676 / 30447342 / +5.1% 77361463 / 75627983 / +2.3% 0.41 / 0.40 / +2.7%
tpcds_q02/datafusion:parquet 50980880 / 53787647 / -5.2% 97427061 / 100840857 / -3.4% 0.52 / 0.53 / -1.9%
tpcds_q03/datafusion:parquet 18059988 / 17822649 / +1.3% 61232657 / 58195696 / +5.2% 0.29 / 0.31 / -3.7%
tpcds_q04/datafusion:parquet 331575199 / 328731119 / +0.9% 412416824 / 425762796 / -3.1% 0.80 / 0.77 / +4.1%
tpcds_q05/datafusion:parquet 84317624 / 81120314 / +3.9% 141036712 / 145662300 / -3.2% 0.60 / 0.56 / +7.4%
tpcds_q06/datafusion:parquet 30152649 / 29225082 / +3.2% 78381260 / 80531768 / -2.7% 0.38 / 0.36 / +6.0%
tpcds_q07/datafusion:parquet 95013102 / 96033824 / -1.1% 154839339 / 156895764 / -1.3% 0.61 / 0.61 / +0.3%
tpcds_q08/datafusion:parquet 38555376 / 37832565 / +1.9% 84695693 / 87319141 / -3.0% 0.46 / 0.43 / +5.1%
tpcds_q09/datafusion:parquet 35268482 / 34043866 / +3.6% 91034521 / 89948320 / +1.2% 0.39 / 0.38 / +2.4%
tpcds_q10/datafusion:parquet 90133684 / 89472198 / +0.7% 136533664 / 141128251 / -3.3% 0.66 / 0.63 / +4.1%
tpcds_q11/datafusion:parquet 164261815 / 160376695 / +2.4% 229569814 / 224499321 / +2.3% 0.72 / 0.71 / +0.2%
tpcds_q12/datafusion:parquet 26704655 / 27158848 / -1.7% 60607802 / 63421591 / -4.4% 0.44 / 0.43 / +2.9%
tpcds_q13/datafusion:parquet 96209361 / 97983521 / -1.8% 168600591 / 161847020 / +4.2% 0.57 / 0.61 / -5.7%
tpcds_q14/datafusion:parquet 255404448 / 267799028 / -4.6% 347813684 / 341146561 / +2.0% 0.73 / 0.78 / -6.5%
tpcds_q15/datafusion:parquet 36626822 / 36620201 / +0.0% 82024279 / 86127514 / -4.8% 0.45 / 0.43 / +5.0%
tpcds_q16/datafusion:parquet 46681092 / 47151236 / -1.0% 89558444 / 90314223 / -0.8% 0.52 / 0.52 / -0.2%
tpcds_q17/datafusion:parquet 107617920 / 107475792 / +0.1% 176888903 / 175152380 / +1.0% 0.61 / 0.61 / -0.9%
tpcds_q18/datafusion:parquet 126156368 / 126896728 / -0.6% 184496472 / 184540502 / -0.0% 0.68 / 0.69 / -0.6%
tpcds_q19/datafusion:parquet 29892260 / 31177760 / -4.1% 78595834 / 81453176 / -3.5% 0.38 / 0.38 / -0.6%
tpcds_q20/datafusion:parquet 29496420 / 29776100 / -0.9% 70974312 / 71992813 / -1.4% 0.42 / 0.41 / +0.5%
tpcds_q21/datafusion:parquet 23425582 / 23410360 / +0.1% 69737489 / 63872609 / +9.2% 0.34 / 0.37 / -8.4%
tpcds_q22/datafusion:parquet 102205212 / 127244700 / -19.7% 🟢 220230676 / 175996358 / +25.1% 🔴 0.46 / 0.72 / -35.8%
tpcds_q23/datafusion:parquet 164608122 / 163409468 / +0.7% 239468075 / 235702145 / +1.6% 0.69 / 0.69 / -0.9%
tpcds_q24/datafusion:parquet 134034127 / 134374854 / -0.3% 202530369 / 205151954 / -1.3% 0.66 / 0.66 / +1.0%
tpcds_q25/datafusion:parquet 108835176 / 105222070 / +3.4% 178094979 / 178190464 / -0.1% 0.61 / 0.59 / +3.5%
tpcds_q26/datafusion:parquet 83228083 / 86783362 / -4.1% 138473733 / 135582287 / +2.1% 0.60 / 0.64 / -6.1%
tpcds_q27/datafusion:parquet 151437426 / 149559224 / +1.3% 238142638 / 243734799 / -2.3% 0.64 / 0.61 / +3.6%
tpcds_q28/datafusion:parquet 36551872 / 36658714 / -0.3% 94158193 / 96465999 / -2.4% 0.39 / 0.38 / +2.2%
tpcds_q29/datafusion:parquet 107359316 / 107067646 / +0.3% 176397195 / 176649478 / -0.1% 0.61 / 0.61 / +0.4%
tpcds_q30/datafusion:parquet 44593524 / 44172280 / +1.0% 94256337 / 95624138 / -1.4% 0.47 / 0.46 / +2.4%
tpcds_q31/datafusion:parquet 90241340 / 90958299 / -0.8% 144336663 / 142453556 / +1.3% 0.63 / 0.64 / -2.1%
tpcds_q32/datafusion:parquet 25179430 / 26209307 / -3.9% 64422007 / 61561330 / +4.6% 0.39 / 0.43 / -8.2%
tpcds_q33/datafusion:parquet 41559357 / 39830579 / +4.3% 90639883 / 87556623 / +3.5% 0.46 / 0.45 / +0.8%
tpcds_q34/datafusion:parquet 29332086 / 28896232 / +1.5% 70831355 / 69625152 / +1.7% 0.41 / 0.42 / -0.2%
tpcds_q35/datafusion:parquet 94465322 / 93844493 / +0.7% 141029767 / 147614821 / -4.5% 0.67 / 0.64 / +5.4%
tpcds_q36/datafusion:parquet 65016738 / 68715379 / -5.4% 141405636 / 144353526 / -2.0% 0.46 / 0.48 / -3.4%
tpcds_q37/datafusion:parquet 23991888 / 26071271 / -8.0% 66464046 / 65550425 / +1.4% 0.36 / 0.40 / -9.2%
tpcds_q38/datafusion:parquet 55609385 / 57140839 / -2.7% 110589959 / 111506097 / -0.8% 0.50 / 0.51 / -1.9%
tpcds_q39/datafusion:parquet 77498304 / 77600923 / -0.1% 151081172 / 129945163 / +16.3% 🔴 0.51 / 0.60 / -14.1%
tpcds_q40/datafusion:parquet 33786343 / 33642380 / +0.4% 83670716 / 81965716 / +2.1% 0.40 / 0.41 / -1.6%
tpcds_q41/datafusion:parquet 22714969 / 21538406 / +5.5% 48520046 / 51526895 / -5.8% 0.47 / 0.42 / +12.0%
tpcds_q42/datafusion:parquet 16893420 / 16612123 / +1.7% 57335699 / 54682735 / +4.9% 0.29 / 0.30 / -3.0%
tpcds_q43/datafusion:parquet 22589206 / 24019945 / -6.0% 66352770 / 66662485 / -0.5% 0.34 / 0.36 / -5.5%
tpcds_q44/datafusion:parquet 38436149 / 40122670 / -4.2% 91079620 / 101235410 / -10.0% 🟢 0.42 / 0.40 / +6.5%
tpcds_q45/datafusion:parquet 45823760 / 46337072 / -1.1% 93014367 / 94962603 / -2.1% 0.49 / 0.49 / +1.0%
tpcds_q46/datafusion:parquet 40824028 / 39676761 / +2.9% 98431159 / 97870879 / +0.6% 0.41 / 0.41 / +2.3%
tpcds_q47/datafusion:parquet 140586754 / 141183548 / -0.4% 205474373 / 209854031 / -2.1% 0.68 / 0.67 / +1.7%
tpcds_q48/datafusion:parquet 87028994 / 86312146 / +0.8% 136198290 / 140490951 / -3.1% 0.64 / 0.61 / +4.0%
tpcds_q49/datafusion:parquet 74501005 / 71268792 / +4.5% 138297641 / 141686278 / -2.4% 0.54 / 0.50 / +7.1%
tpcds_q50/datafusion:parquet 72525588 / 69238404 / +4.7% 120800340 / 121674846 / -0.7% 0.60 / 0.57 / +5.5%
tpcds_q51/datafusion:parquet 80295644 / 78878942 / +1.8% 137949698 / 140629334 / -1.9% 0.58 / 0.56 / +3.8%
tpcds_q52/datafusion:parquet 17167042 / 16435838 / +4.4% 55671987 / 58885873 / -5.5% 0.31 / 0.28 / +10.5%
tpcds_q53/datafusion:parquet 25840100 / 25839688 / +0.0% 67656689 / 71210763 / -5.0% 0.38 / 0.36 / +5.3%
tpcds_q54/datafusion:parquet 45125373 / 45067634 / +0.1% 94095983 / 95757790 / -1.7% 0.48 / 0.47 / +1.9%
tpcds_q55/datafusion:parquet 16620581 / 16047537 / +3.6% 60065867 / 56171397 / +6.9% 0.28 / 0.29 / -3.1%
tpcds_q56/datafusion:parquet 38609766 / 37464782 / +3.1% 90907381 / 93275534 / -2.5% 0.42 / 0.40 / +5.7%
tpcds_q57/datafusion:parquet 122426697 / 119673188 / +2.3% 180130613 / 192753478 / -6.5% 0.68 / 0.62 / +9.5%
tpcds_q58/datafusion:parquet 79962200 / 80953341 / -1.2% 137080933 / 140479751 / -2.4% 0.58 / 0.58 / +1.2%
tpcds_q59/datafusion:parquet 72798372 / 71881910 / +1.3% 121752764 / 121254893 / +0.4% 0.60 / 0.59 / +0.9%
tpcds_q60/datafusion:parquet 38239215 / 36421776 / +5.0% 93142618 / 94675202 / -1.6% 0.41 / 0.38 / +6.7%
tpcds_q61/datafusion:parquet 46919184 / 45585327 / +2.9% 103479890 / 102955262 / +0.5% 0.45 / 0.44 / +2.4%
tpcds_q62/datafusion:parquet 32707178 / 30070162 / +8.8% 74775960 / 65876285 / +13.5% 🔴 0.44 / 0.46 / -4.2%
tpcds_q63/datafusion:parquet 25756200 / 26352764 / -2.3% 67512156 / 74700845 / -9.6% 0.38 / 0.35 / +8.1%
tpcds_q64/datafusion:parquet 349391536 / 353095648 / -1.0% 438723199 / 436079746 / +0.6% 0.80 / 0.81 / -1.6%
tpcds_q65/datafusion:parquet 47391990 / 46273060 / +2.4% 102052037 / 105852937 / -3.6% 0.46 / 0.44 / +6.2%
tpcds_q66/datafusion:parquet 85289074 / 89155342 / -4.3% 128902422 / 131619264 / -2.1% 0.66 / 0.68 / -2.3%
tpcds_q67/datafusion:parquet 131467346 / 134846706 / -2.5% 208057658 / 211535619 / -1.6% 0.63 / 0.64 / -0.9%
tpcds_q68/datafusion:parquet 39366730 / 40479234 / -2.7% 98259691 / 97687210 / +0.6% 0.40 / 0.41 / -3.3%
tpcds_q69/datafusion:parquet 83879994 / 88780687 / -5.5% 131211641 / 133260069 / -1.5% 0.64 / 0.67 / -4.0%
tpcds_q70/datafusion:parquet 44779818 / 41774336 / +7.2% 92421589 / 96700572 / -4.4% 0.48 / 0.43 / +12.2%
tpcds_q71/datafusion:parquet 28370010 / 28116364 / +0.9% 74989778 / 74998267 / -0.0% 0.38 / 0.37 / +0.9%
tpcds_q72/datafusion:parquet 437657756 / 437094996 / +0.1% 562545198 / 544785506 / +3.3% 0.78 / 0.80 / -3.0%
tpcds_q73/datafusion:parquet 29573466 / 29936493 / -1.2% 72773132 / 74285968 / -2.0% 0.41 / 0.40 / +0.8%
tpcds_q74/datafusion:parquet 95588218 / 94840550 / +0.8% 153427444 / 156407129 / -1.9% 0.62 / 0.61 / +2.7%
tpcds_q75/datafusion:parquet 160107414 / 159389242 / +0.5% 239543312 / 237638504 / +0.8% 0.67 / 0.67 / -0.3%
tpcds_q76/datafusion:parquet 58758127 / 56879618 / +3.3% 102046091 / 105207062 / -3.0% 0.58 / 0.54 / +6.5%
tpcds_q77/datafusion:parquet 54401977 / 53009812 / +2.6% 110307581 / 106165939 / +3.9% 0.49 / 0.50 / -1.2%
tpcds_q78/datafusion:parquet 113929042 / 118451042 / -3.8% 197594578 / 194911572 / +1.4% 0.58 / 0.61 / -5.1%
tpcds_q79/datafusion:parquet 34414178 / 34142440 / +0.8% 83015280 / 83600436 / -0.7% 0.41 / 0.41 / +1.5%
tpcds_q80/datafusion:parquet 92055234 / 93949120 / -2.0% 180552732 / 181264550 / -0.4% 0.51 / 0.52 / -1.6%
tpcds_q81/datafusion:parquet 40839602 / 40618200 / +0.5% 90410450 / 92399766 / -2.2% 0.45 / 0.44 / +2.8%
tpcds_q82/datafusion:parquet 25195992 / 24805108 / +1.6% 68421210 / 69210463 / -1.1% 0.37 / 0.36 / +2.7%
tpcds_q83/datafusion:parquet 56215688 / 56320131 / -0.2% 103588649 / 102743115 / +0.8% 0.54 / 0.55 / -1.0%
tpcds_q84/datafusion:parquet 47023472 / 46940084 / +0.2% 86641832 / 88040569 / -1.6% 0.54 / 0.53 / +1.8%
tpcds_q85/datafusion:parquet 181617313 / 182508334 / -0.5% 260643955 / 257717323 / +1.1% 0.70 / 0.71 / -1.6%
tpcds_q86/datafusion:parquet 24344544 / 23734326 / +2.6% 61246093 / 62791886 / -2.5% 0.40 / 0.38 / +5.2%
tpcds_q87/datafusion:parquet 57840330 / 60014979 / -3.6% 108224070 / 111011428 / -2.5% 0.53 / 0.54 / -1.1%
tpcds_q88/datafusion:parquet 56604959 / 57463703 / -1.5% 114579094 / 118811786 / -3.6% 0.49 / 0.48 / +2.1%
tpcds_q89/datafusion:parquet 29427123 / 29179304 / +0.8% 74119275 / 77875332 / -4.8% 0.40 / 0.37 / +6.0%
tpcds_q90/datafusion:parquet 19896512 / 19120574 / +4.1% 54683265 / 53527528 / +2.2% 0.36 / 0.36 / +1.9%
tpcds_q91/datafusion:parquet 63561128 / 64190888 / -1.0% 103882785 / 104387286 / -0.5% 0.61 / 0.61 / -0.5%
tpcds_q92/datafusion:parquet 24402106 / 24631882 / -0.9% 64306255 / 66160983 / -2.8% 0.38 / 0.37 / +1.9%
tpcds_q93/datafusion:parquet 33692176 / 33767210 / -0.2% 89713049 / 91284963 / -1.7% 0.38 / 0.37 / +1.5%
tpcds_q94/datafusion:parquet 31551020 / 31665800 / -0.4% 77313568 / 72959251 / +6.0% 0.41 / 0.43 / -6.0%
tpcds_q95/datafusion:parquet 83177396 / 85090016 / -2.2% 145443923 / 143483731 / +1.4% 0.57 / 0.59 / -3.6%
tpcds_q96/datafusion:parquet 15789013 / 16465652 / -4.1% 51977371 / 55362504 / -6.1% 0.30 / 0.30 / +2.1%
tpcds_q97/datafusion:parquet 37235977 / 37724479 / -1.3% 84377216 / 85813227 / -1.7% 0.44 / 0.44 / +0.4%
tpcds_q98/datafusion:parquet 27563870 / 26816376 / +2.8% 70801729 / 71680926 / -1.2% 0.39 / 0.37 / +4.1%
tpcds_q99/datafusion:parquet 34225786 / 34679712 / -1.3% 67479586 / 68868602 / -2.0% 0.51 / 0.50 / +0.7%
duckdb / vortex-file-compressed / ns (1.005x ➖, 3↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 24962263 / 24413846 / +2.2% 44256080 / 43286000 / +2.2% 0.56 / 0.56 / +0.0%
tpcds_q02/duckdb:vortex-file-compressed 28339861 / 28530206 / -0.7% 49391775 / 44287118 / +11.5% 🔴 0.57 / 0.64 / -10.9%
tpcds_q03/duckdb:vortex-file-compressed 19842515 / 19052767 / +4.1% 41391403 / 42137433 / -1.8% 0.48 / 0.45 / +6.0%
tpcds_q04/duckdb:vortex-file-compressed 93807182 / 89402986 / +4.9% 121153183 / 119933531 / +1.0% 0.77 / 0.75 / +3.9%
tpcds_q05/duckdb:vortex-file-compressed 34687176 / 33710449 / +2.9% 58824090 / 61923101 / -5.0% 0.59 / 0.54 / +8.3%
tpcds_q06/duckdb:vortex-file-compressed 43620638 / 42443728 / +2.8% 72510975 / 72036132 / +0.7% 0.60 / 0.59 / +2.1%
tpcds_q07/duckdb:vortex-file-compressed 28294636 / 29470179 / -4.0% 63595295 / 62683287 / +1.5% 0.44 / 0.47 / -5.4%
tpcds_q08/duckdb:vortex-file-compressed 32584967 / 31753620 / +2.6% 52137088 / 58308573 / -10.6% 🟢 0.62 / 0.54 / +14.8%
tpcds_q09/duckdb:vortex-file-compressed 16663572 / 18350515 / -9.2% 48886827 / 51920396 / -5.8% 0.34 / 0.35 / -3.6%
tpcds_q10/duckdb:vortex-file-compressed 48111066 / 50822103 / -5.3% 82815886 / 89626310 / -7.6% 0.58 / 0.57 / +2.5%
tpcds_q11/duckdb:vortex-file-compressed 71586862 / 71807615 / -0.3% 100317915 / 98444132 / +1.9% 0.71 / 0.73 / -2.2%
tpcds_q12/duckdb:vortex-file-compressed 16603708 / 16348602 / +1.6% 32425152 / 33086841 / -2.0% 0.51 / 0.49 / +3.6%
tpcds_q13/duckdb:vortex-file-compressed 36144790 / 36937876 / -2.1% 68821643 / 69151083 / -0.5% 0.53 / 0.53 / -1.7%
tpcds_q14/duckdb:vortex-file-compressed 103812852 / 103635844 / +0.2% 147366319 / 150476730 / -2.1% 0.70 / 0.69 / +2.3%
tpcds_q15/duckdb:vortex-file-compressed 32839221 / 31271896 / +5.0% 49145146 / 45378308 / +8.3% 0.67 / 0.69 / -3.0%
tpcds_q16/duckdb:vortex-file-compressed 32023514 / 28758254 / +11.4% 🔴 53334124 / 52796878 / +1.0% 0.60 / 0.54 / +10.2%
tpcds_q17/duckdb:vortex-file-compressed 50022026 / 50164356 / -0.3% 85671479 / 88523477 / -3.2% 0.58 / 0.57 / +3.0%
tpcds_q18/duckdb:vortex-file-compressed 46851016 / 47583904 / -1.5% 68299359 / 69756414 / -2.1% 0.69 / 0.68 / +0.6%
tpcds_q19/duckdb:vortex-file-compressed 36917511 / 39269400 / -6.0% 73206463 / 67530794 / +8.4% 0.50 / 0.58 / -13.3%
tpcds_q20/duckdb:vortex-file-compressed 18434219 / 18388906 / +0.2% 34509012 / 34722847 / -0.6% 0.53 / 0.53 / +0.9%
tpcds_q21/duckdb:vortex-file-compressed 22830908 / 21079153 / +8.3% 54566914 / 54771594 / -0.4% 0.42 / 0.38 / +8.7%
tpcds_q22/duckdb:vortex-file-compressed 65234392 / 66603369 / -2.1% 105218225 / 108229614 / -2.8% 0.62 / 0.62 / +0.7%
tpcds_q23/duckdb:vortex-file-compressed 70256596 / 70966498 / -1.0% 112198629 / 115006982 / -2.4% 0.63 / 0.62 / +1.5%
tpcds_q24/duckdb:vortex-file-compressed 51332598 / 49492540 / +3.7% 82095986 / 78263496 / +4.9% 0.63 / 0.63 / -1.1%
tpcds_q25/duckdb:vortex-file-compressed 44280140 / 43704236 / +1.3% 76672411 / 74076080 / +3.5% 0.58 / 0.59 / -2.1%
tpcds_q26/duckdb:vortex-file-compressed 23909822 / 21264308 / +12.4% 🔴 38688644 / 39960758 / -3.2% 0.62 / 0.53 / +16.1%
tpcds_q27/duckdb:vortex-file-compressed 30814208 / 29593934 / +4.1% 57806123 / 58549661 / -1.3% 0.53 / 0.51 / +5.5%
tpcds_q28/duckdb:vortex-file-compressed 11891092 / 13102414 / -9.2% 29160341 / 26085581 / +11.8% 🔴 0.41 / 0.50 / -18.8%
tpcds_q29/duckdb:vortex-file-compressed 49318704 / 48518274 / +1.6% 91905260 / 89679778 / +2.5% 0.54 / 0.54 / -0.8%
tpcds_q30/duckdb:vortex-file-compressed 30907479 / 31717360 / -2.6% 56455742 / 53465894 / +5.6% 0.55 / 0.59 / -7.7%
tpcds_q31/duckdb:vortex-file-compressed 33145618 / 32210478 / +2.9% 57811284 / 53840271 / +7.4% 0.57 / 0.60 / -4.2%
tpcds_q32/duckdb:vortex-file-compressed 18299284 / 16520184 / +10.8% 🔴 37598456 / 32010353 / +17.5% 🔴 0.49 / 0.52 / -5.7%
tpcds_q33/duckdb:vortex-file-compressed 31642857 / 29549852 / +7.1% 67073245 / 58384514 / +14.9% 🔴 0.47 / 0.51 / -6.8%
tpcds_q34/duckdb:vortex-file-compressed 27291063 / 27096089 / +0.7% 47697842 / 47091197 / +1.3% 0.57 / 0.58 / -0.6%
tpcds_q35/duckdb:vortex-file-compressed 76799626 / 75332228 / +1.9% 109186588 / 121700688 / -10.3% 🟢 0.70 / 0.62 / +13.6%
tpcds_q36/duckdb:vortex-file-compressed 26787036 / 27661058 / -3.2% 63644030 / 65419607 / -2.7% 0.42 / 0.42 / -0.5%
tpcds_q37/duckdb:vortex-file-compressed 25084277 / 24370762 / +2.9% 52577446 / 55540710 / -5.3% 0.48 / 0.44 / +8.7%
tpcds_q38/duckdb:vortex-file-compressed 38540270 / 38876118 / -0.9% 63957963 / 63551805 / +0.6% 0.60 / 0.61 / -1.5%
tpcds_q39/duckdb:vortex-file-compressed 33578462 / 38151486 / -12.0% 🟢 70793455 / 58909027 / +20.2% 🔴 0.47 / 0.65 / -26.8%
tpcds_q40/duckdb:vortex-file-compressed 22521694 / 23034820 / -2.2% 41035137 / 39362880 / +4.2% 0.55 / 0.59 / -6.2%
tpcds_q41/duckdb:vortex-file-compressed 9209733 / 9045118 / +1.8% 19958868 / 20671833 / -3.4% 0.46 / 0.44 / +5.5%
tpcds_q42/duckdb:vortex-file-compressed 14284200 / 16034166 / -10.9% 🟢 41005082 / 38671299 / +6.0% 0.35 / 0.41 / -16.0%
tpcds_q43/duckdb:vortex-file-compressed 20185367 / 19047508 / +6.0% 39182771 / 41363679 / -5.3% 0.52 / 0.46 / +11.9%
tpcds_q44/duckdb:vortex-file-compressed 26120412 / 25325614 / +3.1% 61425569 / 64592892 / -4.9% 0.43 / 0.39 / +8.5%
tpcds_q45/duckdb:vortex-file-compressed 33602484 / 34839650 / -3.6% 53993555 / 48426740 / +11.5% 🔴 0.62 / 0.72 / -13.5%
tpcds_q46/duckdb:vortex-file-compressed 33382032 / 33943566 / -1.7% 62393203 / 57171737 / +9.1% 0.54 / 0.59 / -9.9%
tpcds_q47/duckdb:vortex-file-compressed 54346906 / 53702258 / +1.2% 85513033 / 84985103 / +0.6% 0.64 / 0.63 / +0.6%
tpcds_q48/duckdb:vortex-file-compressed 36158352 / 35263159 / +2.5% 64887341 / 64837879 / +0.1% 0.56 / 0.54 / +2.5%
tpcds_q49/duckdb:vortex-file-compressed 31323592 / 33392154 / -6.2% 67432910 / 70006818 / -3.7% 0.46 / 0.48 / -2.6%
tpcds_q50/duckdb:vortex-file-compressed 31774966 / 32670126 / -2.7% 61597302 / 62520955 / -1.5% 0.52 / 0.52 / -1.3%
tpcds_q51/duckdb:vortex-file-compressed 112696756 / 93960552 / +19.9% 🔴 127831795 / 119983044 / +6.5% 0.88 / 0.78 / +12.6%
tpcds_q52/duckdb:vortex-file-compressed 17623138 / 16265053 / +8.3% 39671848 / 43975261 / -9.8% 0.44 / 0.37 / +20.1%
tpcds_q53/duckdb:vortex-file-compressed 25779418 / 24467094 / +5.4% 48853997 / 54313174 / -10.1% 🟢 0.53 / 0.45 / +17.1%
tpcds_q54/duckdb:vortex-file-compressed 37447798 / 37094798 / +1.0% 65842648 / 72131328 / -8.7% 0.57 / 0.51 / +10.6%
tpcds_q55/duckdb:vortex-file-compressed 15303900 / 15319370 / -0.1% 37780951 / 39128886 / -3.4% 0.41 / 0.39 / +3.5%
tpcds_q56/duckdb:vortex-file-compressed 29920767 / 28850332 / +3.7% 62593055 / 59489154 / +5.2% 0.48 / 0.48 / -1.4%
tpcds_q57/duckdb:vortex-file-compressed 40988741 / 41257595 / -0.7% 58683643 / 58586648 / +0.2% 0.70 / 0.70 / -0.8%
tpcds_q58/duckdb:vortex-file-compressed 33006296 / 31008083 / +6.4% 57116802 / 59825208 / -4.5% 0.58 / 0.52 / +11.5%
tpcds_q59/duckdb:vortex-file-compressed 38513230 / 38386614 / +0.3% 48762250 / 56306060 / -13.4% 🟢 0.79 / 0.68 / +15.9%
tpcds_q60/duckdb:vortex-file-compressed 30864964 / 30431730 / +1.4% 63020409 / 66564545 / -5.3% 0.49 / 0.46 / +7.1%
tpcds_q61/duckdb:vortex-file-compressed 34919563 / 35041996 / -0.3% 76215064 / 74883722 / +1.8% 0.46 / 0.47 / -2.1%
tpcds_q62/duckdb:vortex-file-compressed 18546892 / 18459770 / +0.5% 34507996 / 37289883 / -7.5% 0.54 / 0.50 / +8.6%
tpcds_q63/duckdb:vortex-file-compressed 22334770 / 21631516 / +3.3% 45291283 / 47103801 / -3.8% 0.49 / 0.46 / +7.4%
tpcds_q64/duckdb:vortex-file-compressed 107651755 / 109234028 / -1.4% 146947921 / 151855486 / -3.2% 0.73 / 0.72 / +1.8%
tpcds_q65/duckdb:vortex-file-compressed 25183471 / 25805940 / -2.4% 48268669 / 49692570 / -2.9% 0.52 / 0.52 / +0.5%
tpcds_q66/duckdb:vortex-file-compressed 36725848 / 38859505 / -5.5% 68588632 / 64753609 / +5.9% 0.54 / 0.60 / -10.8%
tpcds_q67/duckdb:vortex-file-compressed 126890711 / 126745796 / +0.1% 172223946 / 151196537 / +13.9% 🔴 0.74 / 0.84 / -12.1%
tpcds_q68/duckdb:vortex-file-compressed 32770172 / 31791334 / +3.1% 59547199 / 56554054 / +5.3% 0.55 / 0.56 / -2.1%
tpcds_q69/duckdb:vortex-file-compressed 48710943 / 51891946 / -6.1% 84149862 / 89278947 / -5.7% 0.58 / 0.58 / -0.4%
tpcds_q70/duckdb:vortex-file-compressed 34541376 / 36683870 / -5.8% 65607502 / 62071718 / +5.7% 0.53 / 0.59 / -10.9%
tpcds_q71/duckdb:vortex-file-compressed 24507514 / 24267712 / +1.0% 55048333 / 54636195 / +0.8% 0.45 / 0.44 / +0.2%
tpcds_q72/duckdb:vortex-file-compressed 142542196 / 144709349 / -1.5% 187768300 / 190372246 / -1.4% 0.76 / 0.76 / -0.1%
tpcds_q73/duckdb:vortex-file-compressed 26961391 / 26931224 / +0.1% 47055577 / 44864194 / +4.9% 0.57 / 0.60 / -4.6%
tpcds_q74/duckdb:vortex-file-compressed 48753958 / 50140094 / -2.8% 73079601 / 77779516 / -6.0% 0.67 / 0.64 / +3.5%
tpcds_q75/duckdb:vortex-file-compressed 51089160 / 52788921 / -3.2% 87221214 / 84240815 / +3.5% 0.59 / 0.63 / -6.5%
tpcds_q76/duckdb:vortex-file-compressed 21484706 / 24498678 / -12.3% 🟢 54331532 / 54406673 / -0.1% 0.40 / 0.45 / -12.2%
tpcds_q77/duckdb:vortex-file-compressed 27290098 / 27303614 / -0.0% 54438610 / 52059995 / +4.6% 0.50 / 0.52 / -4.4%
tpcds_q78/duckdb:vortex-file-compressed 72731918 / 70346913 / +3.4% 101777489 / 104463996 / -2.6% 0.71 / 0.67 / +6.1%
tpcds_q79/duckdb:vortex-file-compressed 29161515 / 27484770 / +6.1% 53496486 / 54416254 / -1.7% 0.55 / 0.51 / +7.9%
tpcds_q80/duckdb:vortex-file-compressed 51260358 / 50374724 / +1.8% 85807445 / 82827076 / +3.6% 0.60 / 0.61 / -1.8%
tpcds_q81/duckdb:vortex-file-compressed 38968583 / 37552703 / +3.8% 56932159 / 57661690 / -1.3% 0.68 / 0.65 / +5.1%
tpcds_q82/duckdb:vortex-file-compressed 53176066 / 53144533 / +0.1% 80701390 / 86996903 / -7.2% 0.66 / 0.61 / +7.9%
tpcds_q83/duckdb:vortex-file-compressed 28781056 / 31141922 / -7.6% 44431662 / 44354205 / +0.2% 0.65 / 0.70 / -7.7%
tpcds_q84/duckdb:vortex-file-compressed 26168098 / 23645994 / +10.7% 🔴 41764058 / 39718965 / +5.1% 0.63 / 0.60 / +5.2%
tpcds_q85/duckdb:vortex-file-compressed 49338722 / 50125659 / -1.6% 76842643 / 73987908 / +3.9% 0.64 / 0.68 / -5.2%
tpcds_q86/duckdb:vortex-file-compressed 19454834 / 19192428 / +1.4% 35742647 / 36181557 / -1.2% 0.54 / 0.53 / +2.6%
tpcds_q87/duckdb:vortex-file-compressed 42287974 / 41653668 / +1.5% 63480580 / 63657687 / -0.3% 0.67 / 0.65 / +1.8%
tpcds_q88/duckdb:vortex-file-compressed 60061085 / 60880941 / -1.3% 121067311 / 119750876 / +1.1% 0.50 / 0.51 / -2.4%
tpcds_q89/duckdb:vortex-file-compressed 24511781 / 24424986 / +0.4% 53801004 / 48619727 / +10.7% 🔴 0.46 / 0.50 / -9.3%
tpcds_q90/duckdb:vortex-file-compressed 15365916 / 12819594 / +19.9% 🔴 31339747 / 26730242 / +17.2% 🔴 0.49 / 0.48 / +2.2%
tpcds_q91/duckdb:vortex-file-compressed 24343621 / 25839784 / -5.8% 42178912 / 42015669 / +0.4% 0.58 / 0.62 / -6.2%
tpcds_q92/duckdb:vortex-file-compressed 20433586 / 20768968 / -1.6% 38707887 / 38498224 / +0.5% 0.53 / 0.54 / -2.1%
tpcds_q93/duckdb:vortex-file-compressed 27815845 / 28719999 / -3.1% 49116953 / 53929924 / -8.9% 0.57 / 0.53 / +6.3%
tpcds_q94/duckdb:vortex-file-compressed 27510762 / 30154722 / -8.8% 46800437 / 47421182 / -1.3% 0.59 / 0.64 / -7.6%
tpcds_q95/duckdb:vortex-file-compressed 140311774 / 132080086 / +6.2% 159130067 / 157922774 / +0.8% 0.88 / 0.84 / +5.4%
tpcds_q96/duckdb:vortex-file-compressed 16183766 / 15241210 / +6.2% 39850305 / 32978788 / +20.8% 🔴 0.41 / 0.46 / -12.1%
tpcds_q97/duckdb:vortex-file-compressed 39613822 / 37469180 / +5.7% 60814358 / 64591772 / -5.8% 0.65 / 0.58 / +12.3%
tpcds_q98/duckdb:vortex-file-compressed 20877500 / 23096481 / -9.6% 47154471 / 47653852 / -1.0% 0.44 / 0.48 / -8.7%
tpcds_q99/duckdb:vortex-file-compressed 21905070 / 21425101 / +2.2% 40905574 / 39294322 / +4.1% 0.54 / 0.55 / -1.8%
duckdb / parquet / ns (0.999x ➖, 3↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 30920616 / 31765930 / -2.7% 46937646 / 46960491 / -0.0% 0.66 / 0.68 / -2.6%
tpcds_q02/duckdb:parquet 29800738 / 28473168 / +4.7% 39823035 / 32776159 / +21.5% 🔴 0.75 / 0.87 / -13.9%
tpcds_q03/duckdb:parquet 12287815 / 12373666 / -0.7% 23518159 / 22406949 / +5.0% 0.52 / 0.55 / -5.4%
tpcds_q04/duckdb:parquet 192760964 / 195399804 / -1.4% 203651662 / 207958751 / -2.1% 0.95 / 0.94 / +0.7%
tpcds_q05/duckdb:parquet 34976584 / 33149507 / +5.5% 42381505 / 42867972 / -1.1% 0.83 / 0.77 / +6.7%
tpcds_q06/duckdb:parquet 36001896 / 37137930 / -3.1% 58987115 / 59733932 / -1.3% 0.61 / 0.62 / -1.8%
tpcds_q07/duckdb:parquet 21325744 / 21696492 / -1.7% 35407432 / 34400764 / +2.9% 0.60 / 0.63 / -4.5%
tpcds_q08/duckdb:parquet 33105222 / 32955049 / +0.5% 46619289 / 47121776 / -1.1% 0.71 / 0.70 / +1.5%
tpcds_q09/duckdb:parquet 32164406 / 30222972 / +6.4% 38580245 / 37408142 / +3.1% 0.83 / 0.81 / +3.2%
tpcds_q10/duckdb:parquet 40178512 / 40755874 / -1.4% 60592149 / 59079300 / +2.6% 0.66 / 0.69 / -3.9%
tpcds_q11/duckdb:parquet 106903078 / 105222864 / +1.6% 117227913 / 118251288 / -0.9% 0.91 / 0.89 / +2.5%
tpcds_q12/duckdb:parquet 18035012 / 17468602 / +3.2% 28063304 / 27086312 / +3.6% 0.64 / 0.64 / -0.4%
tpcds_q13/duckdb:parquet 35997501 / 34098785 / +5.6% 49754852 / 50983344 / -2.4% 0.72 / 0.67 / +8.2%
tpcds_q14/duckdb:parquet 104365568 / 100260286 / +4.1% 111782043 / 115479343 / -3.2% 0.93 / 0.87 / +7.5%
tpcds_q15/duckdb:parquet 34664192 / 35270142 / -1.7% 47007371 / 46740560 / +0.6% 0.74 / 0.75 / -2.3%
tpcds_q16/duckdb:parquet 28220247 / 27633008 / +2.1% 42683902 / 42312686 / +0.9% 0.66 / 0.65 / +1.2%
tpcds_q17/duckdb:parquet 46379798 / 44648530 / +3.9% 57359829 / 59745915 / -4.0% 0.81 / 0.75 / +8.2%
tpcds_q18/duckdb:parquet 56475294 / 55314237 / +2.1% 78852826 / 76948207 / +2.5% 0.72 / 0.72 / -0.4%
tpcds_q19/duckdb:parquet 33724414 / 33852184 / -0.4% 46772035 / 47198153 / -0.9% 0.72 / 0.72 / +0.5%
tpcds_q20/duckdb:parquet 19046058 / 19369602 / -1.7% 29352715 / 29462052 / -0.4% 0.65 / 0.66 / -1.3%
tpcds_q21/duckdb:parquet 14240982 / 14060483 / +1.3% 24058885 / 28632098 / -16.0% 🟢 0.59 / 0.49 / +20.5%
tpcds_q22/duckdb:parquet 58106778 / 50654952 / +14.7% 🔴 78779450 / 81013904 / -2.8% 0.74 / 0.63 / +18.0%
tpcds_q23/duckdb:parquet 69506284 / 63555748 / +9.4% 85456173 / 86067232 / -0.7% 0.81 / 0.74 / +10.1%
tpcds_q24/duckdb:parquet 49546853 / 50878107 / -2.6% 68801375 / 70977486 / -3.1% 0.72 / 0.72 / +0.5%
tpcds_q25/duckdb:parquet 42554704 / 41875696 / +1.6% 61927529 / 57054920 / +8.5% 0.69 / 0.73 / -6.4%
tpcds_q26/duckdb:parquet 44337263 / 44804400 / -1.0% 57729644 / 63484852 / -9.1% 0.77 / 0.71 / +8.8%
tpcds_q27/duckdb:parquet 58706900 / 53983848 / +8.7% 74747942 / 77162604 / -3.1% 0.79 / 0.70 / +12.3%
tpcds_q28/duckdb:parquet 29349222 / 29054332 / +1.0% 40985765 / 36690512 / +11.7% 🔴 0.72 / 0.79 / -9.6%
tpcds_q29/duckdb:parquet 42924881 / 42970644 / -0.1% 58959702 / 56193882 / +4.9% 0.73 / 0.76 / -4.8%
tpcds_q30/duckdb:parquet 44800198 / 45196874 / -0.9% 59931104 / 61641283 / -2.8% 0.75 / 0.73 / +2.0%
tpcds_q31/duckdb:parquet 29844348 / 30594397 / -2.5% 42694625 / 42468632 / +0.5% 0.70 / 0.72 / -3.0%
tpcds_q32/duckdb:parquet 15193192 / 15268599 / -0.5% 27342408 / 27527810 / -0.7% 0.56 / 0.55 / +0.2%
tpcds_q33/duckdb:parquet 23809914 / 23597274 / +0.9% 38998678 / 38881361 / +0.3% 0.61 / 0.61 / +0.6%
tpcds_q34/duckdb:parquet 21961028 / 24653384 / -10.9% 🟢 35869899 / 37486038 / -4.3% 0.61 / 0.66 / -6.9%
tpcds_q35/duckdb:parquet 69498377 / 68373457 / +1.6% 89642800 / 87662636 / +2.3% 0.78 / 0.78 / -0.6%
tpcds_q36/duckdb:parquet 22706661 / 22090392 / +2.8% 39831191 / 41407198 / -3.8% 0.57 / 0.53 / +6.9%
tpcds_q37/duckdb:parquet 18435842 / 17693608 / +4.2% 30739307 / 30951240 / -0.7% 0.60 / 0.57 / +4.9%
tpcds_q38/duckdb:parquet 41146556 / 41310796 / -0.4% 52269330 / 53883086 / -3.0% 0.79 / 0.77 / +2.7%
tpcds_q39/duckdb:parquet 37839038 / 37281372 / +1.5% 47949613 / 50292166 / -4.7% 0.79 / 0.74 / +6.5%
tpcds_q40/duckdb:parquet 22918878 / 22620476 / +1.3% 31621307 / 30932433 / +2.2% 0.72 / 0.73 / -0.9%
tpcds_q41/duckdb:parquet 10534214 / 10887761 / -3.2% 20502812 / 23177975 / -11.5% 🟢 0.51 / 0.47 / +9.4%
tpcds_q42/duckdb:parquet 11772724 / 11692185 / +0.7% 22575146 / 22859452 / -1.2% 0.52 / 0.51 / +2.0%
tpcds_q43/duckdb:parquet 17340930 / 18254430 / -5.0% 29938059 / 31375428 / -4.6% 0.58 / 0.58 / -0.4%
tpcds_q44/duckdb:parquet 25596448 / 25949740 / -1.4% 39911698 / 36012768 / +10.8% 🔴 0.64 / 0.72 / -11.0%
tpcds_q45/duckdb:parquet 32373622 / 32818444 / -1.4% 43535204 / 45174208 / -3.6% 0.74 / 0.73 / +2.4%
tpcds_q46/duckdb:parquet 56220549 / 50129686 / +12.2% 🔴 65599133 / 65498148 / +0.2% 0.86 / 0.77 / +12.0%
tpcds_q47/duckdb:parquet 48510855 / 50135580 / -3.2% 62303843 / 63741724 / -2.3% 0.78 / 0.79 / -1.0%
tpcds_q48/duckdb:parquet 36193212 / 30195548 / +19.9% 🔴 44751747 / 42871286 / +4.4% 0.81 / 0.70 / +14.8%
tpcds_q49/duckdb:parquet 27965042 / 29835290 / -6.3% 45062967 / 45426557 / -0.8% 0.62 / 0.66 / -5.5%
tpcds_q50/duckdb:parquet 24852844 / 30380872 / -18.2% 🟢 37699897 / 40157510 / -6.1% 0.66 / 0.76 / -12.9%
tpcds_q51/duckdb:parquet 95473154 / 95450724 / +0.0% 145638840 / 116375306 / +25.1% 🔴 0.66 / 0.82 / -20.1%
tpcds_q52/duckdb:parquet 12262392 / 12896150 / -4.9% 22739945 / 22802329 / -0.3% 0.54 / 0.57 / -4.7%
tpcds_q53/duckdb:parquet 16530050 / 16146942 / +2.4% 31531458 / 28423567 / +10.9% 🔴 0.52 / 0.57 / -7.7%
tpcds_q54/duckdb:parquet 32676209 / 31133221 / +5.0% 46276819 / 46939886 / -1.4% 0.71 / 0.66 / +6.5%
tpcds_q55/duckdb:parquet 12019269 / 12315872 / -2.4% 22362130 / 23307651 / -4.1% 0.54 / 0.53 / +1.7%
tpcds_q56/duckdb:parquet 25000688 / 24474042 / +2.2% 41179978 / 39142216 / +5.2% 0.61 / 0.63 / -2.9%
tpcds_q57/duckdb:parquet 42910274 / 42758448 / +0.4% 55869990 / 56881271 / -1.8% 0.77 / 0.75 / +2.2%
tpcds_q58/duckdb:parquet 28354492 / 27175806 / +4.3% 44455229 / 40026261 / +11.1% 🔴 0.64 / 0.68 / -6.1%
tpcds_q59/duckdb:parquet 29459442 / 30259093 / -2.6% 41310039 / 42300216 / -2.3% 0.71 / 0.72 / -0.3%
tpcds_q60/duckdb:parquet 25173329 / 26797558 / -6.1% 39931094 / 40488512 / -1.4% 0.63 / 0.66 / -4.7%
tpcds_q61/duckdb:parquet 34596495 / 31217146 / +10.8% 🔴 44574542 / 44890836 / -0.7% 0.78 / 0.70 / +11.6%
tpcds_q62/duckdb:parquet 14693570 / 14705117 / -0.1% 22836752 / 22631412 / +0.9% 0.64 / 0.65 / -1.0%
tpcds_q63/duckdb:parquet 16693784 / 15446106 / +8.1% 29587622 / 28484660 / +3.9% 0.56 / 0.54 / +4.0%
tpcds_q64/duckdb:parquet 79282104 / 85143373 / -6.9% 101835966 / 103736696 / -1.8% 0.78 / 0.82 / -5.1%
tpcds_q65/duckdb:parquet 21854460 / 23287155 / -6.2% 37182676 / 35970284 / +3.4% 0.59 / 0.65 / -9.2%
tpcds_q66/duckdb:parquet 35706774 / 35062626 / +1.8% 48129894 / 47269596 / +1.8% 0.74 / 0.74 / +0.0%
tpcds_q67/duckdb:parquet 127685768 / 124486104 / +2.6% 135092189 / 152672896 / -11.5% 🟢 0.95 / 0.82 / +15.9%
tpcds_q68/duckdb:parquet 39520887 / 39477832 / +0.1% 58919832 / 61365811 / -4.0% 0.67 / 0.64 / +4.3%
tpcds_q69/duckdb:parquet 42298986 / 43530411 / -2.8% 60526166 / 60683824 / -0.3% 0.70 / 0.72 / -2.6%
tpcds_q70/duckdb:parquet 26629221 / 27280216 / -2.4% 43160527 / 43801233 / -1.5% 0.62 / 0.62 / -0.9%
tpcds_q71/duckdb:parquet 21377096 / 21508957 / -0.6% 36795485 / 34558119 / +6.5% 0.58 / 0.62 / -6.7%
tpcds_q72/duckdb:parquet 121876454 / 184128307 / -33.8% 🟢 133300284 / 133690020 / -0.3% 0.91 / 1.38 / -33.6%
tpcds_q73/duckdb:parquet 18589912 / 18655730 / -0.4% 30403933 / 30552968 / -0.5% 0.61 / 0.61 / +0.1%
tpcds_q74/duckdb:parquet 146353696 / 144500514 / +1.3% 160658794 / 161577734 / -0.6% 0.91 / 0.89 / +1.9%
tpcds_q75/duckdb:parquet 62125823 / 60788098 / +2.2% 80947855 / 80942096 / +0.0% 0.77 / 0.75 / +2.2%
tpcds_q76/duckdb:parquet 19852380 / 21289910 / -6.8% 32404947 / 35442148 / -8.6% 0.61 / 0.60 / +2.0%
tpcds_q77/duckdb:parquet 24659872 / 25901963 / -4.8% 39710041 / 38810979 / +2.3% 0.62 / 0.67 / -7.0%
tpcds_q78/duckdb:parquet 78225426 / 79676118 / -1.8% 92520081 / 92698034 / -0.2% 0.85 / 0.86 / -1.6%
tpcds_q79/duckdb:parquet 33101810 / 33233467 / -0.4% 42956190 / 44324990 / -3.1% 0.77 / 0.75 / +2.8%
tpcds_q80/duckdb:parquet 51954131 / 48876366 / +6.3% 62044849 / 59967078 / +3.5% 0.84 / 0.82 / +2.7%
tpcds_q81/duckdb:parquet 41759820 / 40862412 / +2.2% 58293412 / 57813199 / +0.8% 0.72 / 0.71 / +1.4%
tpcds_q82/duckdb:parquet 18932726 / 18932640 / +0.0% 33450229 / 31616627 / +5.8% 0.57 / 0.60 / -5.5%
tpcds_q83/duckdb:parquet 22291922 / 23001302 / -3.1% 31146966 / 31760658 / -1.9% 0.72 / 0.72 / -1.2%
tpcds_q84/duckdb:parquet 23615858 / 24174292 / -2.3% 33922910 / 34535848 / -1.8% 0.70 / 0.70 / -0.5%
tpcds_q85/duckdb:parquet 48840919 / 48121832 / +1.5% 66744650 / 64802714 / +3.0% 0.73 / 0.74 / -1.5%
tpcds_q86/duckdb:parquet 15285820 / 16333418 / -6.4% 25751710 / 28565209 / -9.8% 0.59 / 0.57 / +3.8%
tpcds_q87/duckdb:parquet 44072868 / 44474064 / -0.9% 53759884 / 55062269 / -2.4% 0.82 / 0.81 / +1.5%
tpcds_q88/duckdb:parquet 43168012 / 43567980 / -0.9% 51953606 / 50645202 / +2.6% 0.83 / 0.86 / -3.4%
tpcds_q89/duckdb:parquet 18572102 / 18293857 / +1.5% 35121611 / 31712209 / +10.8% 🔴 0.53 / 0.58 / -8.3%
tpcds_q90/duckdb:parquet 10283253 / 9736284 / +5.6% 21879858 / 20227617 / +8.2% 0.47 / 0.48 / -2.4%
tpcds_q91/duckdb:parquet 26976116 / 27116943 / -0.5% 41717497 / 42439106 / -1.7% 0.65 / 0.64 / +1.2%
tpcds_q92/duckdb:parquet 15730814 / 16060257 / -2.1% 28418245 / 30210975 / -5.9% 0.55 / 0.53 / +4.1%
tpcds_q93/duckdb:parquet 31121016 / 30923238 / +0.6% 47635406 / 47787999 / -0.3% 0.65 / 0.65 / +1.0%
tpcds_q94/duckdb:parquet 22630774 / 21810162 / +3.8% 35922140 / 35801465 / +0.3% 0.63 / 0.61 / +3.4%
tpcds_q95/duckdb:parquet 154024136 / 138320731 / +11.4% 🔴 148097778 / 147444706 / +0.4% 1.04 / 0.94 / +10.9%
tpcds_q96/duckdb:parquet 9896994 / 10708950 / -7.6% 16995593 / 17606724 / -3.5% 0.58 / 0.61 / -4.3%
tpcds_q97/duckdb:parquet 38607418 / 41114039 / -6.1% 48973779 / 49411468 / -0.9% 0.79 / 0.83 / -5.3%
tpcds_q98/duckdb:parquet 22590555 / 21703702 / +4.1% 34518478 / 33689181 / +2.5% 0.65 / 0.64 / +1.6%
tpcds_q99/duckdb:parquet 23670137 / 23905948 / -1.0% 32773432 / 33110394 / -1.0% 0.72 / 0.72 / +0.0%

File Size Changes (49 files changed, -45.6% overall, 11↑ 38↓)
File Scale Format Base HEAD Change %
income_band.vortex 1.0 vortex-file-compressed 5.52 KB 5.73 KB +216 B +3.8%
reason.vortex 1.0 vortex-file-compressed 7.66 KB 7.87 KB +216 B +2.8%
ship_mode.vortex 1.0 vortex-file-compressed 13.32 KB 13.53 KB +216 B +1.6%
household_demographics.vortex 1.0 vortex-file-compressed 16.16 KB 16.37 KB +216 B +1.3%
warehouse.vortex 1.0 vortex-file-compressed 23.83 KB 24.04 KB +216 B +0.9%
web_page.vortex 1.0 vortex-file-compressed 29.62 KB 29.83 KB +216 B +0.7%
store.vortex 1.0 vortex-file-compressed 48.17 KB 48.38 KB +216 B +0.4%
call_center.vortex 1.0 vortex-file-compressed 52.57 KB 52.79 KB +216 B +0.4%
web_site.vortex 1.0 vortex-file-compressed 53.90 KB 54.11 KB +216 B +0.4%
promotion.vortex 1.0 vortex-file-compressed 59.25 KB 59.46 KB +216 B +0.4%
time_dim.vortex 1.0 vortex-file-compressed 406.59 KB 406.80 KB +216 B +0.1%
catalog_page.vortex 1.0 vortex-file-compressed 567.95 KB 562.25 KB 5.70 KB -1.0%
customer_address.vortex 1.0 vortex-file-compressed 837.08 KB 827.21 KB 9.87 KB -1.2%
item.vortex 1.0 vortex-file-compressed 1.64 MB 1.61 MB 24.57 KB -1.5%
customer_demographics.vortex 1.0 vortex-file-compressed 1.48 MB 1.46 MB 23.86 KB -1.6%
store_sales.vortex 1.0 vortex-file-compressed 96.28 MB 94.71 MB 1.57 MB -1.6%
customer.vortex 1.0 vortex-file-compressed 4.20 MB 4.13 MB 76.05 KB -1.8%
catalog_returns.vortex 1.0 vortex-file-compressed 7.15 MB 6.96 MB 193.75 KB -2.6%
web_sales.vortex 1.0 vortex-file-compressed 34.17 MB 33.22 MB 971.16 KB -2.8%
catalog_sales.vortex 1.0 vortex-file-compressed 70.40 MB 68.19 MB 2.21 MB -3.1%
store_returns.vortex 1.0 vortex-file-compressed 10.96 MB 10.56 MB 411.98 KB -3.7%
web_returns.vortex 1.0 vortex-file-compressed 3.54 MB 3.41 MB 136.27 KB -3.8%
date_dim.vortex 1.0 vortex-file-compressed 1.02 MB 952.12 KB 88.83 KB -8.5%
inventory.vortex 1.0 vortex-file-compressed 36.61 MB 32.25 MB 4.36 MB -11.9%
call_center.vortex 1.0 vortex-compact 46.28 KB 0 B 46.28 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 361.51 KB 0 B 361.51 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.04 MB 0 B 6.04 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.45 MB 0 B 59.45 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 638.37 KB 0 B 638.37 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 422.35 KB 0 B 422.35 KB -100.0%
date_dim.vortex 1.0 vortex-compact 136.00 KB 0 B 136.00 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 9.90 KB 0 B 9.90 KB -100.0%
income_band.vortex 1.0 vortex-compact 5.31 KB 0 B 5.31 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.06 MB 0 B 16.06 MB -100.0%
item.vortex 1.0 vortex-compact 998.45 KB 0 B 998.45 KB -100.0%
promotion.vortex 1.0 vortex-compact 49.62 KB 0 B 49.62 KB -100.0%
reason.vortex 1.0 vortex-compact 5.96 KB 0 B 5.96 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 10.74 KB 0 B 10.74 KB -100.0%
store.vortex 1.0 vortex-compact 42.16 KB 0 B 42.16 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.36 MB 0 B 9.36 MB -100.0%
store_sales.vortex 1.0 vortex-compact 78.09 MB 0 B 78.09 MB -100.0%
time_dim.vortex 1.0 vortex-compact 95.41 KB 0 B 95.41 KB -100.0%
warehouse.vortex 1.0 vortex-compact 21.88 KB 0 B 21.88 KB -100.0%
web_page.vortex 1.0 vortex-compact 24.09 KB 0 B 24.09 KB -100.0%
web_returns.vortex 1.0 vortex-compact 2.99 MB 0 B 2.99 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.43 MB 0 B 29.43 MB -100.0%
web_site.vortex 1.0 vortex-compact 41.37 KB 0 B 41.37 KB -100.0%

Totals:

  • vortex-compact: 207.80 MB → 0 B (-100.0%)
  • vortex-file-compressed: 269.78 MB → 259.75 MB (-3.7%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 6a234562 vs base acd8bb47
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+2.7%, environment too noisy confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.002x ➖
Parquet (geomean): hot 0.993x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.7% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 339883747 / 345481421 / -1.6% 479090123 / 458883431 / +4.4% 0.71 / 0.75 / -5.8%
tpch_q02/datafusion:vortex-file-compressed 100794285 / 98828092 / +2.0% 177484498 / 175554126 / +1.1% 0.57 / 0.56 / +0.9%
tpch_q03/datafusion:vortex-file-compressed 147846912 / 151261417 / -2.3% 290226785 / 267854359 / +8.4% 0.51 / 0.56 / -9.8%
tpch_q04/datafusion:vortex-file-compressed 63811486 / 63557816 / +0.4% 130785521 / 127638823 / +2.5% 0.49 / 0.50 / -2.0%
tpch_q05/datafusion:vortex-file-compressed 261840417 / 265302676 / -1.3% 407867466 / 403308224 / +1.1% 0.64 / 0.66 / -2.4%
tpch_q06/datafusion:vortex-file-compressed 25636759 / 24441087 / +4.9% 142755489 / 130366429 / +9.5% 0.18 / 0.19 / -4.2%
tpch_q07/datafusion:vortex-file-compressed 344077753 / 347519488 / -1.0% 463133738 / 467695459 / -1.0% 0.74 / 0.74 / -0.0%
tpch_q08/datafusion:vortex-file-compressed 264513957 / 269483673 / -1.8% 432496793 / 407696908 / +6.1% 0.61 / 0.66 / -7.5%
tpch_q09/datafusion:vortex-file-compressed 452260342 / 465780048 / -2.9% 646778386 / 606660924 / +6.6% 0.70 / 0.77 / -8.9%
tpch_q10/datafusion:vortex-file-compressed 165879582 / 167538689 / -1.0% 297064268 / 312052765 / -4.8% 0.56 / 0.54 / +4.0%
tpch_q11/datafusion:vortex-file-compressed 71402437 / 72954540 / -2.1% 128282551 / 128948249 / -0.5% 0.56 / 0.57 / -1.6%
tpch_q12/datafusion:vortex-file-compressed 80083607 / 80060577 / +0.0% 165396387 / 166937592 / -0.9% 0.48 / 0.48 / +1.0%
tpch_q13/datafusion:vortex-file-compressed 114492467 / 115552537 / -0.9% 189284569 / 183460598 / +3.2% 0.60 / 0.63 / -4.0%
tpch_q14/datafusion:vortex-file-compressed 40746128 / 40211421 / +1.3% 167302165 / 172455539 / -3.0% 0.24 / 0.23 / +4.5%
tpch_q15/datafusion:vortex-file-compressed 71347366 / 69533204 / +2.6% 203434138 / 198089423 / +2.7% 0.35 / 0.35 / -0.1%
tpch_q16/datafusion:vortex-file-compressed 65011533 / 65648965 / -1.0% 132655090 / 130769917 / +1.4% 0.49 / 0.50 / -2.4%
tpch_q17/datafusion:vortex-file-compressed 418182067 / 408290715 / +2.4% 503494208 / 505399109 / -0.4% 0.83 / 0.81 / +2.8%
tpch_q18/datafusion:vortex-file-compressed 613185288 / 615077110 / -0.3% 790291865 / 769535806 / +2.7% 0.78 / 0.80 / -2.9%
tpch_q19/datafusion:vortex-file-compressed 55943551 / 53603195 / +4.4% 193968125 / 173765561 / +11.6% 🔴 0.29 / 0.31 / -6.5%
tpch_q20/datafusion:vortex-file-compressed 131280581 / 128019078 / +2.5% 261759658 / 270741819 / -3.3% 0.50 / 0.47 / +6.1%
tpch_q21/datafusion:vortex-file-compressed 447325937 / 454406850 / -1.6% 552814477 / 564503483 / -2.1% 0.81 / 0.80 / +0.5%
tpch_q22/datafusion:vortex-file-compressed 39144541 / 38804428 / +0.9% 99016433 / 94468710 / +4.8% 0.40 / 0.41 / -3.8%
datafusion / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 324141204 / 321242736 / +0.9% 419896962 / 418555652 / +0.3% 0.77 / 0.77 / +0.6%
tpch_q02/datafusion:parquet 212210351 / 217707437 / -2.5% 311063961 / 293435709 / +6.0% 0.68 / 0.74 / -8.0%
tpch_q03/datafusion:parquet 224193496 / 224094659 / +0.0% 363731594 / 359644902 / +1.1% 0.62 / 0.62 / -1.1%
tpch_q04/datafusion:parquet 95160946 / 96413080 / -1.3% 189678418 / 188191192 / +0.8% 0.50 / 0.51 / -2.1%
tpch_q05/datafusion:parquet 356325361 / 357219259 / -0.3% 521538738 / 527612304 / -1.2% 0.68 / 0.68 / +0.9%
tpch_q06/datafusion:parquet 64230946 / 63240203 / +1.6% 166857028 / 170882752 / -2.4% 0.38 / 0.37 / +4.0%
tpch_q07/datafusion:parquet 490111644 / 493888685 / -0.8% 676046982 / 659461913 / +2.5% 0.72 / 0.75 / -3.2%
tpch_q08/datafusion:parquet 397410985 / 395221373 / +0.6% 571988250 / 569220501 / +0.5% 0.69 / 0.69 / +0.1%
tpch_q09/datafusion:parquet 649202998 / 644590348 / +0.7% 834891881 / 852575934 / -2.1% 0.78 / 0.76 / +2.8%
tpch_q10/datafusion:parquet 517845469 / 512104119 / +1.1% 687292259 / 672730925 / +2.2% 0.75 / 0.76 / -1.0%
tpch_q11/datafusion:parquet 140677891 / 141367567 / -0.5% 220827043 / 214936537 / +2.7% 0.64 / 0.66 / -3.1%
tpch_q12/datafusion:parquet 142649385 / 142401111 / +0.2% 258594285 / 263363376 / -1.8% 0.55 / 0.54 / +2.0%
tpch_q13/datafusion:parquet 343490440 / 340342324 / +0.9% 428545548 / 394431328 / +8.6% 0.80 / 0.86 / -7.1%
tpch_q14/datafusion:parquet 116156416 / 114037902 / +1.9% 246076610 / 245433936 / +0.3% 0.47 / 0.46 / +1.6%
tpch_q15/datafusion:parquet 178039804 / 175156871 / +1.6% 287121994 / 292363217 / -1.8% 0.62 / 0.60 / +3.5%
tpch_q16/datafusion:parquet 130767182 / 129076295 / +1.3% 200442855 / 204162683 / -1.8% 0.65 / 0.63 / +3.2%
tpch_q17/datafusion:parquet 496332573 / 488905543 / +1.5% 632132050 / 613426651 / +3.0% 0.79 / 0.80 / -1.5%
tpch_q18/datafusion:parquet 698375371 / 671031212 / +4.1% 871707842 / 876624845 / -0.6% 0.80 / 0.77 / +4.7%
tpch_q19/datafusion:parquet 184017951 / 182948459 / +0.6% 343795861 / 322987733 / +6.4% 0.54 / 0.57 / -5.5%
tpch_q20/datafusion:parquet 289209674 / 283884252 / +1.9% 431136585 / 419926558 / +2.7% 0.67 / 0.68 / -0.8%
tpch_q21/datafusion:parquet 536546097 / 535564951 / +0.2% 686023525 / 682666844 / +0.5% 0.78 / 0.78 / -0.3%
tpch_q22/datafusion:parquet 238494990 / 243310349 / -2.0% 299864225 / 295646403 / +1.4% 0.80 / 0.82 / -3.4%
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 101179650 / 99867918 / +1.3% 201919760 / 231687589 / -12.8% 🟢 0.50 / 0.43 / +16.2%
tpch_q02/duckdb:vortex-file-compressed 68444576 / 65192968 / +5.0% 110395843 / 114535470 / -3.6% 0.62 / 0.57 / +8.9%
tpch_q03/duckdb:vortex-file-compressed 136560224 / 132615274 / +3.0% 257575845 / 247857205 / +3.9% 0.53 / 0.54 / -0.9%
tpch_q04/duckdb:vortex-file-compressed 171435108 / 171489729 / -0.0% 246997655 / 240869394 / +2.5% 0.69 / 0.71 / -2.5%
tpch_q05/duckdb:vortex-file-compressed 145652791 / 145928694 / -0.2% 249089519 / 264833231 / -5.9% 0.58 / 0.55 / +6.1%
tpch_q06/duckdb:vortex-file-compressed 38280610 / 37504951 / +2.1% 144307773 / 130443814 / +10.6% 🔴 0.27 / 0.29 / -7.7%
tpch_q07/duckdb:vortex-file-compressed 124820476 / 127188202 / -1.9% 290139692 / 253183647 / +14.6% 🔴 0.43 / 0.50 / -14.4%
tpch_q08/duckdb:vortex-file-compressed 178035986 / 178510033 / -0.3% 290611975 / 301021235 / -3.5% 0.61 / 0.59 / +3.3%
tpch_q09/duckdb:vortex-file-compressed 302158267 / 301497898 / +0.2% 425578965 / 437685354 / -2.8% 0.71 / 0.69 / +3.1%
tpch_q10/duckdb:vortex-file-compressed 222673148 / 215904491 / +3.1% 391560252 / 357018334 / +9.7% 0.57 / 0.60 / -6.0%
tpch_q11/duckdb:vortex-file-compressed 39226321 / 42030637 / -6.7% 100291336 / 99091486 / +1.2% 0.39 / 0.42 / -7.8%
tpch_q12/duckdb:vortex-file-compressed 115831479 / 113320730 / +2.2% 200836541 / 203985211 / -1.5% 0.58 / 0.56 / +3.8%
tpch_q13/duckdb:vortex-file-compressed 192712301 / 193497917 / -0.4% 286704266 / 311852271 / -8.1% 0.67 / 0.62 / +8.3%
tpch_q14/duckdb:vortex-file-compressed 59018577 / 55670977 / +6.0% 176115418 / 174761944 / +0.8% 0.34 / 0.32 / +5.2%
tpch_q15/duckdb:vortex-file-compressed 81929258 / 81948011 / -0.0% 179910258 / 199943529 / -10.0% 🟢 0.46 / 0.41 / +11.1%
tpch_q16/duckdb:vortex-file-compressed 87623356 / 85801422 / +2.1% 129668435 / 128943997 / +0.6% 0.68 / 0.67 / +1.6%
tpch_q17/duckdb:vortex-file-compressed 105303089 / 107309709 / -1.9% 219892009 / 278366813 / -21.0% 🟢 0.48 / 0.39 / +24.2%
tpch_q18/duckdb:vortex-file-compressed 269966897 / 263333259 / +2.5% 344341274 / 342330103 / +0.6% 0.78 / 0.77 / +1.9%
tpch_q19/duckdb:vortex-file-compressed 88914288 / 85731854 / +3.7% 210922759 / 216292202 / -2.5% 0.42 / 0.40 / +6.4%
tpch_q20/duckdb:vortex-file-compressed 140053064 / 142726748 / -1.9% 264743373 / 253368793 / +4.5% 0.53 / 0.56 / -6.1%
tpch_q21/duckdb:vortex-file-compressed 486996906 / 494893991 / -1.6% 575806485 / 575111399 / +0.1% 0.85 / 0.86 / -1.7%
tpch_q22/duckdb:vortex-file-compressed 72941504 / 72590169 / +0.5% 127717818 / 143232437 / -10.8% 🟢 0.57 / 0.51 / +12.7%
duckdb / parquet / ns (0.981x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 100018188 / 142025796 / -29.6% 🟢 144781527 / 197929410 / -26.9% 🟢 0.69 / 0.72 / -3.7%
tpch_q02/duckdb:parquet 101630570 / 100997552 / +0.6% 123934746 / 119376262 / +3.8% 0.82 / 0.85 / -3.1%
tpch_q03/duckdb:parquet 161156509 / 162355166 / -0.7% 226734481 / 224709154 / +0.9% 0.71 / 0.72 / -1.6%
tpch_q04/duckdb:parquet 117216395 / 118224634 / -0.9% 160631752 / 161788078 / -0.7% 0.73 / 0.73 / -0.1%
tpch_q05/duckdb:parquet 183328645 / 182777372 / +0.3% 261227798 / 252922676 / +3.3% 0.70 / 0.72 / -2.9%
tpch_q06/duckdb:parquet 56051642 / 59742661 / -6.2% 98794444 / 103620067 / -4.7% 0.57 / 0.58 / -1.6%
tpch_q07/duckdb:parquet 142254561 / 139995774 / +1.6% 224906900 / 236015728 / -4.7% 0.63 / 0.59 / +6.6%
tpch_q08/duckdb:parquet 213021504 / 215971825 / -1.4% 291709496 / 309865366 / -5.9% 0.73 / 0.70 / +4.8%
tpch_q09/duckdb:parquet 348305036 / 347142932 / +0.3% 433576211 / 447853288 / -3.2% 0.80 / 0.78 / +3.6%
tpch_q10/duckdb:parquet 657131851 / 649633386 / +1.2% 734859716 / 734709915 / +0.0% 0.89 / 0.88 / +1.1%
tpch_q11/duckdb:parquet 41501768 / 41375861 / +0.3% 54348577 / 53764158 / +1.1% 0.76 / 0.77 / -0.8%
tpch_q12/duckdb:parquet 117525026 / 121028757 / -2.9% 153306363 / 151957352 / +0.9% 0.77 / 0.80 / -3.7%
tpch_q13/duckdb:parquet 396643211 / 403230741 / -1.6% 435483738 / 430046736 / +1.3% 0.91 / 0.94 / -2.9%
tpch_q14/duckdb:parquet 152354697 / 152737550 / -0.3% 211897067 / 216717127 / -2.2% 0.72 / 0.70 / +2.0%
tpch_q15/duckdb:parquet 81351880 / 77995741 / +4.3% 127538003 / 124226414 / +2.7% 0.64 / 0.63 / +1.6%
tpch_q16/duckdb:parquet 154775562 / 155410931 / -0.4% 177959971 / 174021671 / +2.3% 0.87 / 0.89 / -2.6%
tpch_q17/duckdb:parquet 117251192 / 117489469 / -0.2% 195858693 / 200293956 / -2.2% 0.60 / 0.59 / +2.1%
tpch_q18/duckdb:parquet 293873799 / 289761489 / +1.4% 289770678 / 280489912 / +3.3% 1.01 / 1.03 / -1.8%
tpch_q19/duckdb:parquet 237751636 / 240805672 / -1.3% 303001661 / 316370524 / -4.2% 0.78 / 0.76 / +3.1%
tpch_q20/duckdb:parquet 198626992 / 197222470 / +0.7% 275816182 / 272799734 / +1.1% 0.72 / 0.72 / -0.4%
tpch_q21/duckdb:parquet 427718826 / 435063582 / -1.7% 469174188 / 478556357 / -2.0% 0.91 / 0.91 / +0.3%
tpch_q22/duckdb:parquet 337487878 / 337546560 / -0.0% 361224834 / 360730299 / +0.1% 0.93 / 0.94 / -0.2%

File Size Changes (17 files changed, -45.4% overall, 2↑ 15↓)
File Scale Format Base HEAD Change %
region.vortex 10.0 vortex-file-compressed 6.69 KB 6.90 KB +216 B +3.2%
nation.vortex 10.0 vortex-file-compressed 10.72 KB 10.93 KB +216 B +2.0%
partsupp.vortex 10.0 vortex-file-compressed 240.77 MB 239.41 MB 1.36 MB -0.6%
orders.vortex 10.0 vortex-file-compressed 436.68 MB 427.61 MB 9.07 MB -2.1%
supplier.vortex 10.0 vortex-file-compressed 5.69 MB 5.55 MB 135.51 KB -2.3%
customer.vortex 10.0 vortex-file-compressed 87.23 MB 85.16 MB 2.06 MB -2.4%
lineitem.vortex 10.0 vortex-file-compressed 1.65 GB 1.60 GB 49.95 MB -3.0%
part.vortex 10.0 vortex-file-compressed 53.62 MB 51.82 MB 1.79 MB -3.3%
customer.vortex 10.0 vortex-compact 74.00 MB 0 B 74.00 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 10.0 vortex-compact 1.28 GB 0 B 1.28 GB -100.0%
nation.vortex 10.0 vortex-compact 7.68 KB 0 B 7.68 KB -100.0%
orders.vortex 10.0 vortex-compact 344.29 MB 0 B 344.29 MB -100.0%
part.vortex 10.0 vortex-compact 35.89 MB 0 B 35.89 MB -100.0%
partsupp.vortex 10.0 vortex-compact 203.66 MB 0 B 203.66 MB -100.0%
region.vortex 10.0 vortex-compact 5.87 KB 0 B 5.87 KB -100.0%
supplier.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.92 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.45 GB → 2.39 GB (-2.6%)

@joseph-isaacs

Copy link
Copy Markdown
Contributor

please don't add them to the core edition yet

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 6a234562 vs base 68cdf004
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 0.987x ➖ · cold 0.940x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -0.4% · Median polish -5.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (0.987x ➖, 6↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 14875194 / 16897192 / -12.0% 🟢 26711025 / 26764139 / -0.2% 0.56 / 0.63 / -11.8%
statpopgen_q01/duckdb:vortex-file-compressed 14830518 / 17290955 / -14.2% 🟢 22458064 / 29671610 / -24.3% 🟢 0.66 / 0.58 / +13.3%
statpopgen_q02/duckdb:vortex-file-compressed 399066638 / 566787613 / -29.6% 🟢 490665764 / 669169871 / -26.7% 🟢 0.81 / 0.85 / -4.0%
statpopgen_q03/duckdb:vortex-file-compressed 1106911291 / 1269386264 / -12.8% 🟢 1071695231 / 1314642476 / -18.5% 🟢 1.03 / 0.97 / +7.0%
statpopgen_q04/duckdb:vortex-file-compressed 1339574834 / 1306133662 / +2.6% 1631981300 / 1764285033 / -7.5% 0.82 / 0.74 / +10.9%
statpopgen_q05/duckdb:vortex-file-compressed 465852521 / 524163595 / -11.1% 🟢 413645489 / 761170628 / -45.7% 🟢 1.13 / 0.69 / +63.5%
statpopgen_q06/duckdb:vortex-file-compressed 1610801033 / 1830538082 / -12.0% 🟢 1646991723 / 1927004681 / -14.5% 🟢 0.98 / 0.95 / +3.0%
statpopgen_q07/duckdb:vortex-file-compressed 321219580 / 236753298 / +35.7% 🔴 379290400 / 296351492 / +28.0% 🔴 0.85 / 0.80 / +6.0%
statpopgen_q08/duckdb:vortex-file-compressed 365970170 / 265803130 / +37.7% 🔴 474785305 / 319189261 / +48.7% 🔴 0.77 / 0.83 / -7.4%
statpopgen_q09/duckdb:vortex-file-compressed 1174671986 / 1244218918 / -5.6% 1157299324 / 1095781170 / +5.6% 1.02 / 1.14 / -10.6%
statpopgen_q10/duckdb:vortex-file-compressed 4146541062 / 3139279880 / +32.1% 🔴 4134238018 / 3199604192 / +29.2% 🔴 1.00 / 0.98 / +2.2%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 376835184 / 378671356 / -0.5% 381276415 / 378053895 / +0.9% 0.99 / 1.00 / -1.3%
statpopgen_q01/duckdb:parquet 461630104 / 466288855 / -1.0% 478633067 / 473754677 / +1.0% 0.96 / 0.98 / -2.0%
statpopgen_q02/duckdb:parquet 777868786 / 768704562 / +1.2% 818586646 / 804375220 / +1.8% 0.95 / 0.96 / -0.6%
statpopgen_q03/duckdb:parquet 1041763991 / 1057153026 / -1.5% 1087682055 / 1114142681 / -2.4% 0.96 / 0.95 / +0.9%
statpopgen_q04/duckdb:parquet 1052021763 / 1050370718 / +0.2% 1099586880 / 1103276671 / -0.3% 0.96 / 0.95 / +0.5%
statpopgen_q05/duckdb:parquet 764258988 / 768059200 / -0.5% 814935556 / 794350688 / +2.6% 0.94 / 0.97 / -3.0%
statpopgen_q06/duckdb:parquet 1020480902 / 1014153526 / +0.6% 1076531234 / 1060581538 / +1.5% 0.95 / 0.96 / -0.9%
statpopgen_q07/duckdb:parquet 942681580 / 939998580 / +0.3% 1139779056 / 1143510021 / -0.3% 0.83 / 0.82 / +0.6%
statpopgen_q08/duckdb:parquet 959349919 / 976933406 / -1.8% 1146800564 / 1137569908 / +0.8% 0.84 / 0.86 / -2.6%
statpopgen_q09/duckdb:parquet 996409432 / 1006984546 / -1.1% 1046344697 / 1062288865 / -1.5% 0.95 / 0.95 / +0.5%
statpopgen_q10/duckdb:parquet 1643473471 / 1656347536 / -0.8% 1685320913 / 1689612913 / -0.3% 0.98 / 0.98 / -0.5%

File Size Changes (3 files changed, -49.5% overall, 0↑ 3↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.47 GB 509.32 MB -25.3%
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.56 MB 0 B 960.56 MB -100.0%

Totals:

  • vortex-compact: 960.82 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.47 GB (-25.3%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 6a234562 vs base acd8bb47
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.1%
Engines: DataFusion No clear signal (-2.3%, environment too noisy confidence) · DuckDB No clear signal (-11.6%, environment too noisy confidence)
Vortex (geomean): hot 1.017x ➖ · cold 0.918x ➖
Parquet (geomean): hot 1.095x ➖ · cold 1.016x ➖
Shifts: Parquet (control) +9.5% · Median polish +1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.024x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 49429408 / 46178418 / +7.0% 117949849 / 139491968 / -15.4% 0.42 / 0.33 / +26.6%
fineweb_q01/datafusion:vortex-file-compressed 437953310 / 551158229 / -20.5% 916777304 / 1091917241 / -16.0% 0.48 / 0.50 / -5.4%
fineweb_q02/datafusion:vortex-file-compressed 528300119 / 562135802 / -6.0% 533395289 / 534810531 / -0.3% 0.99 / 1.05 / -5.8%
fineweb_q03/datafusion:vortex-file-compressed 798527371 / 602731444 / +32.5% 🔴 1008023615 / 745626393 / +35.2% 🔴 0.79 / 0.81 / -2.0%
fineweb_q04/datafusion:vortex-file-compressed 605031451 / 604655323 / +0.1% 612680582 / 652365528 / -6.1% 0.99 / 0.93 / +6.5%
fineweb_q05/datafusion:vortex-file-compressed 472547870 / 555554280 / -14.9% 445372472 / 908607972 / -51.0% 🟢 1.06 / 0.61 / +73.5%
fineweb_q06/datafusion:vortex-file-compressed 700903024 / 683139410 / +2.6% 731832771 / 925183314 / -20.9% 0.96 / 0.74 / +29.7%
fineweb_q07/datafusion:vortex-file-compressed 517128406 / 472070566 / +9.5% 591878999 / 425805244 / +39.0% 🔴 0.87 / 1.11 / -21.2%
fineweb_q08/datafusion:vortex-file-compressed 236185466 / 194017730 / +21.7% 206747703 / 301561578 / -31.4% 🟢 1.14 / 0.64 / +77.6%
datafusion / parquet / ns (1.048x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 625046352 / 718436896 / -13.0% 960179516 / 1118720611 / -14.2% 0.65 / 0.64 / +1.4%
fineweb_q01/datafusion:parquet 1082789699 / 1097551958 / -1.3% 1109268534 / 1018127379 / +9.0% 0.98 / 1.08 / -9.5%
fineweb_q02/datafusion:parquet 885427558 / 860166376 / +2.9% 1077335699 / 1012747185 / +6.4% 0.82 / 0.85 / -3.2%
fineweb_q03/datafusion:parquet 1115305912 / 913872320 / +22.0% 1019176602 / 851713667 / +19.7% 1.09 / 1.07 / +2.0%
fineweb_q04/datafusion:parquet 1210252202 / 1165466145 / +3.8% 1147460721 / 1433306611 / -19.9% 1.05 / 0.81 / +29.7%
fineweb_q05/datafusion:parquet 926097219 / 847086974 / +9.3% 1025122695 / 859038831 / +19.3% 0.90 / 0.99 / -8.4%
fineweb_q06/datafusion:parquet 920788360 / 844765958 / +9.0% 1078180467 / 1073414252 / +0.4% 0.85 / 0.79 / +8.5%
fineweb_q07/datafusion:parquet 1035037874 / 989512576 / +4.6% 1022305605 / 1047631724 / -2.4% 1.01 / 0.94 / +7.2%
fineweb_q08/datafusion:parquet 974233548 / 893451698 / +9.0% 1129578690 / 889396782 / +27.0% 0.86 / 1.00 / -14.1%
duckdb / vortex-file-compressed / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 87123410 / 73430528 / +18.6% 69082803 / 96823531 / -28.7% 1.26 / 0.76 / +66.3%
fineweb_q01/duckdb:vortex-file-compressed 560173503 / 560611562 / -0.1% 609954710 / 837086174 / -27.1% 0.92 / 0.67 / +37.1%
fineweb_q02/duckdb:vortex-file-compressed 673311131 / 712380685 / -5.5% 769860340 / 772354272 / -0.3% 0.87 / 0.92 / -5.2%
fineweb_q03/duckdb:vortex-file-compressed 1678830957 / 1709308650 / -1.8% 1754586972 / 1753537637 / +0.1% 0.96 / 0.97 / -1.8%
fineweb_q04/duckdb:vortex-file-compressed 1882327002 / 1869767060 / +0.7% 1908216405 / 1864431718 / +2.3% 0.99 / 1.00 / -1.6%
fineweb_q05/duckdb:vortex-file-compressed 1745835671 / 1730035860 / +0.9% 2221619954 / 1817280557 / +22.2% 0.79 / 0.95 / -17.5%
fineweb_q06/duckdb:vortex-file-compressed 1881646258 / 1863931058 / +1.0% 1867437860 / 1918973440 / -2.7% 1.01 / 0.97 / +3.7%
fineweb_q07/duckdb:vortex-file-compressed 1575817930 / 1548845076 / +1.7% 1594652227 / 1656599626 / -3.7% 0.99 / 0.93 / +5.7%
fineweb_q08/duckdb:vortex-file-compressed 712728530 / 742604189 / -4.0% 765637146 / 714380343 / +7.2% 0.93 / 1.04 / -10.4%
duckdb / parquet / ns (1.144x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 5260066550 / 5258714532 / +0.0% 574372313 / 560077781 / +2.6% 9.16 / 9.39 / -2.5%
fineweb_q01/duckdb:parquet 5316874479 / 5299845571 / +0.3% 648438018 / 697081790 / -7.0% 8.20 / 7.60 / +7.8%
fineweb_q02/duckdb:parquet 3048045622 / 5311494697 / -42.6% 🟢 599115603 / 645467926 / -7.2% 5.09 / 8.23 / -38.2%
fineweb_q03/duckdb:parquet 3291496312 / 5354033770 / -38.5% 🟢 1646185369 / 1382143829 / +19.1% 2.00 / 3.87 / -48.4%
fineweb_q04/duckdb:parquet 5314317742 / 5305419902 / +0.2% 918059749 / 845061096 / +8.6% 5.79 / 6.28 / -7.8%
fineweb_q05/duckdb:parquet 5282333178 / 5317271632 / -0.7% 832904676 / 1100493009 / -24.3% 6.34 / 4.83 / +31.3%
fineweb_q06/duckdb:parquet 5383355375 / 3431723088 / +56.9% 🔴 1569204113 / 1551145858 / +1.2% 3.43 / 2.21 / +55.1%
fineweb_q07/duckdb:parquet 5340151064 / 5327542261 / +0.2% 1238847223 / 942762061 / +31.4% 🔴 4.31 / 5.65 / -23.7%
fineweb_q08/duckdb:parquet 2863232296 / 472403982 / +506.1% 🔴 541351271 / 659135592 / -17.9% 5.29 / 0.72 / +638.0%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 6a234562 vs base acd8bb47
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.5%, environment too noisy confidence)
Vortex (geomean): hot 1.004x ➖ · cold 0.988x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.003x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1892686 / 1882317 / +0.6% 39447990 / 39643641 / -0.5% 0.05 / 0.05 / +1.0%
clickbench_q01/datafusion:vortex-file-compressed 10929296 / 10832345 / +0.9% 58111186 / 60130085 / -3.4% 0.19 / 0.18 / +4.4%
clickbench_q02/datafusion:vortex-file-compressed 21551004 / 22002410 / -2.1% 71037104 / 70956158 / +0.1% 0.30 / 0.31 / -2.2%
clickbench_q03/datafusion:vortex-file-compressed 25546774 / 24843084 / +2.8% 90992543 / 97156369 / -6.3% 0.28 / 0.26 / +9.8%
clickbench_q04/datafusion:vortex-file-compressed 156894482 / 155258373 / +1.1% 234155863 / 231746512 / +1.0% 0.67 / 0.67 / +0.0%
clickbench_q05/datafusion:vortex-file-compressed 212077276 / 216193188 / -1.9% 289989367 / 306500793 / -5.4% 0.73 / 0.71 / +3.7%
clickbench_q06/datafusion:vortex-file-compressed 1869325 / 1862544 / +0.4% 39143092 / 39540124 / -1.0% 0.05 / 0.05 / +1.4%
clickbench_q07/datafusion:vortex-file-compressed 14362812 / 14249024 / +0.8% 65095157 / 65807473 / -1.1% 0.22 / 0.22 / +1.9%
clickbench_q08/datafusion:vortex-file-compressed 212433784 / 207465804 / +2.4% 299322757 / 298676941 / +0.2% 0.71 / 0.69 / +2.2%
clickbench_q09/datafusion:vortex-file-compressed 340821164 / 337547803 / +1.0% 426792830 / 414223823 / +3.0% 0.80 / 0.81 / -2.0%
clickbench_q10/datafusion:vortex-file-compressed 49992824 / 47447028 / +5.4% 118501304 / 121621995 / -2.6% 0.42 / 0.39 / +8.1%
clickbench_q11/datafusion:vortex-file-compressed 55377406 / 55899988 / -0.9% 128414002 / 129189180 / -0.6% 0.43 / 0.43 / -0.3%
clickbench_q12/datafusion:vortex-file-compressed 186448372 / 188727920 / -1.2% 279412848 / 291602208 / -4.2% 0.67 / 0.65 / +3.1%
clickbench_q13/datafusion:vortex-file-compressed 335612864 / 327251203 / +2.6% 455983050 / 469474496 / -2.9% 0.74 / 0.70 / +5.6%
clickbench_q14/datafusion:vortex-file-compressed 184508754 / 192568492 / -4.2% 281725524 / 280938886 / +0.3% 0.65 / 0.69 / -4.5%
clickbench_q15/datafusion:vortex-file-compressed 182014554 / 178838832 / +1.8% 259614611 / 262305376 / -1.0% 0.70 / 0.68 / +2.8%
clickbench_q16/datafusion:vortex-file-compressed 468656994 / 467955413 / +0.1% 571989464 / 570815278 / +0.2% 0.82 / 0.82 / -0.1%
clickbench_q17/datafusion:vortex-file-compressed 455142661 / 462652838 / -1.6% 569040012 / 568613660 / +0.1% 0.80 / 0.81 / -1.7%
clickbench_q18/datafusion:vortex-file-compressed 895536084 / 913525399 / -2.0% 993722956 / 1016423176 / -2.2% 0.90 / 0.90 / +0.3%
clickbench_q19/datafusion:vortex-file-compressed 17819430 / 16348273 / +9.0% 83679774 / 87192141 / -4.0% 0.21 / 0.19 / +13.6%
clickbench_q20/datafusion:vortex-file-compressed 179025719 / 180403267 / -0.8% 383434933 / 383673934 / -0.1% 0.47 / 0.47 / -0.7%
clickbench_q21/datafusion:vortex-file-compressed 245523052 / 248761314 / -1.3% 480170378 / 471343586 / +1.9% 0.51 / 0.53 / -3.1%
clickbench_q22/datafusion:vortex-file-compressed 312023600 / 313516836 / -0.5% 599140401 / 608035090 / -1.5% 0.52 / 0.52 / +1.0%
clickbench_q23/datafusion:vortex-file-compressed 388496760 / 383791382 / +1.2% 676243030 / 830931942 / -18.6% 🟢 0.57 / 0.46 / +24.4%
clickbench_q24/datafusion:vortex-file-compressed 36735432 / 36627567 / +0.3% 118888480 / 116881495 / +1.7% 0.31 / 0.31 / -1.4%
clickbench_q25/datafusion:vortex-file-compressed 46192064 / 48613892 / -5.0% 116392551 / 119493241 / -2.6% 0.40 / 0.41 / -2.5%
clickbench_q26/datafusion:vortex-file-compressed 36408992 / 36299270 / +0.3% 114101788 / 112245392 / +1.7% 0.32 / 0.32 / -1.3%
clickbench_q27/datafusion:vortex-file-compressed 269525974 / 268093668 / +0.5% 450837900 / 471764703 / -4.4% 0.60 / 0.57 / +5.2%
clickbench_q28/datafusion:vortex-file-compressed 1456362556 / 1411526060 / +3.2% 1512626038 / 1518519881 / -0.4% 0.96 / 0.93 / +3.6%
clickbench_q29/datafusion:vortex-file-compressed 36542184 / 36672399 / -0.4% 87616970 / 89853764 / -2.5% 0.42 / 0.41 / +2.2%
clickbench_q30/datafusion:vortex-file-compressed 142976206 / 148885131 / -4.0% 233378597 / 232624222 / +0.3% 0.61 / 0.64 / -4.3%
clickbench_q31/datafusion:vortex-file-compressed 176206638 / 178998318 / -1.6% 325090994 / 321688096 / +1.1% 0.54 / 0.56 / -2.6%
clickbench_q32/datafusion:vortex-file-compressed 813715548 / 809928194 / +0.5% 942100310 / 935698979 / +0.7% 0.86 / 0.87 / -0.2%
clickbench_q33/datafusion:vortex-file-compressed 994185069 / 1017583190 / -2.3% 1168667637 / 1188842605 / -1.7% 0.85 / 0.86 / -0.6%
clickbench_q34/datafusion:vortex-file-compressed 1018575619 / 1011640627 / +0.7% 1179712936 / 1167786953 / +1.0% 0.86 / 0.87 / -0.3%
clickbench_q35/datafusion:vortex-file-compressed 149605551 / 150137157 / -0.4% 218836996 / 214557523 / +2.0% 0.68 / 0.70 / -2.3%
clickbench_q36/datafusion:vortex-file-compressed 56768008 / 56824621 / -0.1% 116358171 / 122419169 / -5.0% 0.49 / 0.46 / +5.1%
clickbench_q37/datafusion:vortex-file-compressed 28942683 / 29161875 / -0.8% 82798259 / 78343943 / +5.7% 0.35 / 0.37 / -6.1%
clickbench_q38/datafusion:vortex-file-compressed 15200594 / 15061445 / +0.9% 69023632 / 65933916 / +4.7% 0.22 / 0.23 / -3.6%
clickbench_q39/datafusion:vortex-file-compressed 111834773 / 111200794 / +0.6% 180526255 / 182096633 / -0.9% 0.62 / 0.61 / +1.4%
clickbench_q40/datafusion:vortex-file-compressed 13196625 / 12615950 / +4.6% 61680435 / 63851100 / -3.4% 0.21 / 0.20 / +8.3%
clickbench_q41/datafusion:vortex-file-compressed 12975494 / 12823807 / +1.2% 60978826 / 60810459 / +0.3% 0.21 / 0.21 / +0.9%
clickbench_q42/datafusion:vortex-file-compressed 13106962 / 14056535 / -6.8% 59631369 / 59560672 / +0.1% 0.22 / 0.24 / -6.9%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1881866 / 1934610 / -2.7% 87751520 / 90047801 / -2.6% 0.02 / 0.02 / -0.2%
clickbench_q01/datafusion:parquet 17555108 / 17815747 / -1.5% 125322749 / 124312976 / +0.8% 0.14 / 0.14 / -2.3%
clickbench_q02/datafusion:parquet 32669826 / 30892539 / +5.8% 149705274 / 148314812 / +0.9% 0.22 / 0.21 / +4.8%
clickbench_q03/datafusion:parquet 26238610 / 26869923 / -2.3% 146747157 / 140640708 / +4.3% 0.18 / 0.19 / -6.4%
clickbench_q04/datafusion:parquet 169821592 / 175410784 / -3.2% 311154690 / 315557798 / -1.4% 0.55 / 0.56 / -1.8%
clickbench_q05/datafusion:parquet 235118052 / 231129293 / +1.7% 385754101 / 372835047 / +3.5% 0.61 / 0.62 / -1.7%
clickbench_q06/datafusion:parquet 1899512 / 1887971 / +0.6% 87702534 / 86686277 / +1.2% 0.02 / 0.02 / -0.6%
clickbench_q07/datafusion:parquet 18238004 / 17720626 / +2.9% 131657545 / 127140391 / +3.6% 0.14 / 0.14 / -0.6%
clickbench_q08/datafusion:parquet 230598510 / 231091225 / -0.2% 390892313 / 389784746 / +0.3% 0.59 / 0.59 / -0.5%
clickbench_q09/datafusion:parquet 353478683 / 354628069 / -0.3% 512164831 / 513155051 / -0.2% 0.69 / 0.69 / -0.1%
clickbench_q10/datafusion:parquet 75801960 / 75443450 / +0.5% 203272938 / 200190862 / +1.5% 0.37 / 0.38 / -1.0%
clickbench_q11/datafusion:parquet 89284918 / 89233847 / +0.1% 222015117 / 221358017 / +0.3% 0.40 / 0.40 / -0.2%
clickbench_q12/datafusion:parquet 238159740 / 236359290 / +0.8% 382918692 / 381247894 / +0.4% 0.62 / 0.62 / +0.3%
clickbench_q13/datafusion:parquet 390981286 / 405868953 / -3.7% 571149658 / 549064947 / +4.0% 0.68 / 0.74 / -7.4%
clickbench_q14/datafusion:parquet 255725546 / 254533277 / +0.5% 409867837 / 409860088 / +0.0% 0.62 / 0.62 / +0.5%
clickbench_q15/datafusion:parquet 194589228 / 188682591 / +3.1% 338897556 / 338447638 / +0.1% 0.57 / 0.56 / +3.0%
clickbench_q16/datafusion:parquet 474954358 / 473920370 / +0.2% 653440076 / 640771970 / +2.0% 0.73 / 0.74 / -1.7%
clickbench_q17/datafusion:parquet 476847572 / 475411556 / +0.3% 653706611 / 646427026 / +1.1% 0.73 / 0.74 / -0.8%
clickbench_q18/datafusion:parquet 927621470 / 907136504 / +2.3% 1098054882 / 1147584017 / -4.3% 0.84 / 0.79 / +6.9%
clickbench_q19/datafusion:parquet 24351618 / 24219026 / +0.5% 140147753 / 137341114 / +2.0% 0.17 / 0.18 / -1.5%
clickbench_q20/datafusion:parquet 453187115 / 451534502 / +0.4% 605643899 / 614343239 / -1.4% 0.75 / 0.73 / +1.8%
clickbench_q21/datafusion:parquet 486245284 / 487825036 / -0.3% 670406590 / 672588592 / -0.3% 0.73 / 0.73 / +0.0%
clickbench_q22/datafusion:parquet 646819976 / 644024876 / +0.4% 876045817 / 877595504 / -0.2% 0.74 / 0.73 / +0.6%
clickbench_q23/datafusion:parquet 2828082943 / 2780068644 / +1.7% 3210325487 / 3422673270 / -6.2% 0.88 / 0.81 / +8.5%
clickbench_q24/datafusion:parquet 47526439 / 47838178 / -0.7% 160537197 / 162945077 / -1.5% 0.30 / 0.29 / +0.8%
clickbench_q25/datafusion:parquet 88445180 / 88630674 / -0.2% 213975868 / 211620104 / +1.1% 0.41 / 0.42 / -1.3%
clickbench_q26/datafusion:parquet 47431377 / 48291538 / -1.8% 161088711 / 162152479 / -0.7% 0.29 / 0.30 / -1.1%
clickbench_q27/datafusion:parquet 517712191 / 522280830 / -0.9% 697550548 / 706118403 / -1.2% 0.74 / 0.74 / +0.3%
clickbench_q28/datafusion:parquet 1527131888 / 1529716016 / -0.2% 1667267276 / 1656721207 / +0.6% 0.92 / 0.92 / -0.8%
clickbench_q29/datafusion:parquet 39442730 / 40595262 / -2.8% 159134153 / 158564633 / +0.4% 0.25 / 0.26 / -3.2%
clickbench_q30/datafusion:parquet 235171494 / 231592956 / +1.5% 406578455 / 393578121 / +3.3% 0.58 / 0.59 / -1.7%
clickbench_q31/datafusion:parquet 272642078 / 267573627 / +1.9% 456599008 / 461495393 / -1.1% 0.60 / 0.58 / +3.0%
clickbench_q32/datafusion:parquet 843986332 / 845210982 / -0.1% 1053357164 / 1039557135 / +1.3% 0.80 / 0.81 / -1.5%
clickbench_q33/datafusion:parquet 1093372886 / 1081198204 / +1.1% 1299122082 / 1331063253 / -2.4% 0.84 / 0.81 / +3.6%
clickbench_q34/datafusion:parquet 1096112900 / 1088284948 / +0.7% 1286509352 / 1315324438 / -2.2% 0.85 / 0.83 / +3.0%
clickbench_q35/datafusion:parquet 165929398 / 157702772 / +5.2% 298380820 / 298371430 / +0.0% 0.56 / 0.53 / +5.2%
clickbench_q36/datafusion:parquet 107091412 / 109130588 / -1.9% 229863321 / 233119058 / -1.4% 0.47 / 0.47 / -0.5%
clickbench_q37/datafusion:parquet 49074588 / 49675380 / -1.2% 155047100 / 158563492 / -2.2% 0.32 / 0.31 / +1.0%
clickbench_q38/datafusion:parquet 66740894 / 70820474 / -5.8% 182429578 / 178110428 / +2.4% 0.37 / 0.40 / -8.0%
clickbench_q39/datafusion:parquet 202868582 / 204185347 / -0.6% 334036967 / 332652020 / +0.4% 0.61 / 0.61 / -1.1%
clickbench_q40/datafusion:parquet 26611210 / 26451480 / +0.6% 137866020 / 135533450 / +1.7% 0.19 / 0.20 / -1.1%
clickbench_q41/datafusion:parquet 25559446 / 27146376 / -5.8% 132707735 / 137322046 / -3.4% 0.19 / 0.20 / -2.6%
clickbench_q42/datafusion:parquet 26887053 / 26320386 / +2.2% 126717913 / 130509008 / -2.9% 0.21 / 0.20 / +5.2%
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 15643605 / 13414076 / +16.6% 🔴 69519829 / 81542991 / -14.7% 🟢 0.23 / 0.16 / +36.8%
clickbench_q01/duckdb:vortex-file-compressed 18926000 / 17446494 / +8.5% 106031066 / 98912132 / +7.2% 0.18 / 0.18 / +1.2%
clickbench_q02/duckdb:vortex-file-compressed 20575284 / 22519832 / -8.6% 108192661 / 110338981 / -1.9% 0.19 / 0.20 / -6.8%
clickbench_q03/duckdb:vortex-file-compressed 34308797 / 33521587 / +2.3% 107522665 / 105511758 / +1.9% 0.32 / 0.32 / +0.4%
clickbench_q04/duckdb:vortex-file-compressed 135768540 / 132552767 / +2.4% 220237857 / 208730216 / +5.5% 0.62 / 0.64 / -2.9%
clickbench_q05/duckdb:vortex-file-compressed 155573916 / 157088006 / -1.0% 241202439 / 239546318 / +0.7% 0.64 / 0.66 / -1.6%
clickbench_q06/duckdb:vortex-file-compressed 21344642 / 20949859 / +1.9% 94401977 / 103365762 / -8.7% 0.23 / 0.20 / +11.6%
clickbench_q07/duckdb:vortex-file-compressed 21682394 / 21136845 / +2.6% 93457004 / 110604725 / -15.5% 🟢 0.23 / 0.19 / +21.4%
clickbench_q08/duckdb:vortex-file-compressed 169258307 / 172656520 / -2.0% 279238887 / 282680238 / -1.2% 0.61 / 0.61 / -0.8%
clickbench_q09/duckdb:vortex-file-compressed 209292377 / 209912838 / -0.3% 324468886 / 325296738 / -0.3% 0.65 / 0.65 / -0.0%
clickbench_q10/duckdb:vortex-file-compressed 66456666 / 62646226 / +6.1% 177941373 / 176493138 / +0.8% 0.37 / 0.35 / +5.2%
clickbench_q11/duckdb:vortex-file-compressed 69190802 / 69050792 / +0.2% 169570538 / 183915986 / -7.8% 0.41 / 0.38 / +8.7%
clickbench_q12/duckdb:vortex-file-compressed 172619914 / 180554338 / -4.4% 283078706 / 296358341 / -4.5% 0.61 / 0.61 / +0.1%
clickbench_q13/duckdb:vortex-file-compressed 323276820 / 325882638 / -0.8% 449543944 / 454065384 / -1.0% 0.72 / 0.72 / +0.2%
clickbench_q14/duckdb:vortex-file-compressed 188420030 / 193150651 / -2.4% 304159112 / 304144274 / +0.0% 0.62 / 0.64 / -2.5%
clickbench_q15/duckdb:vortex-file-compressed 189100072 / 187269125 / +1.0% 287066226 / 277587379 / +3.4% 0.66 / 0.67 / -2.4%
clickbench_q16/duckdb:vortex-file-compressed 379737068 / 376714442 / +0.8% 498866328 / 502490715 / -0.7% 0.76 / 0.75 / +1.5%
clickbench_q17/duckdb:vortex-file-compressed 372184936 / 366282936 / +1.6% 482470770 / 485069049 / -0.5% 0.77 / 0.76 / +2.2%
clickbench_q18/duckdb:vortex-file-compressed 739288682 / 723645348 / +2.2% 873893713 / 879808620 / -0.7% 0.85 / 0.82 / +2.9%
clickbench_q19/duckdb:vortex-file-compressed 28470370 / 26338345 / +8.1% 115234298 / 98426743 / +17.1% 🔴 0.25 / 0.27 / -7.7%
clickbench_q20/duckdb:vortex-file-compressed 241460918 / 240220752 / +0.5% 440288392 / 425421268 / +3.5% 0.55 / 0.56 / -2.9%
clickbench_q21/duckdb:vortex-file-compressed 355670634 / 362667766 / -1.9% 641459776 / 657389354 / -2.4% 0.55 / 0.55 / +0.5%
clickbench_q22/duckdb:vortex-file-compressed 531325113 / 541544782 / -1.9% 907058357 / 946903149 / -4.2% 0.59 / 0.57 / +2.4%
clickbench_q23/duckdb:vortex-file-compressed 104640965 / 105400589 / -0.7% 213313711 / 222945279 / -4.3% 0.49 / 0.47 / +3.8%
clickbench_q24/duckdb:vortex-file-compressed 40148870 / 35809352 / +12.1% 🔴 88305274 / 95168224 / -7.2% 0.45 / 0.38 / +20.8%
clickbench_q25/duckdb:vortex-file-compressed 55444536 / 58344799 / -5.0% 133125380 / 142280328 / -6.4% 0.42 / 0.41 / +1.6%
clickbench_q26/duckdb:vortex-file-compressed 33449750 / 33853227 / -1.2% 91664182 / 87083372 / +5.3% 0.36 / 0.39 / -6.1%
clickbench_q27/duckdb:vortex-file-compressed 235730141 / 243609019 / -3.2% 505376145 / 520573404 / -2.9% 0.47 / 0.47 / -0.3%
clickbench_q28/duckdb:vortex-file-compressed 1406723807 / 1404369156 / +0.2% 1558776268 / 1606364248 / -3.0% 0.90 / 0.87 / +3.2%
clickbench_q29/duckdb:vortex-file-compressed 30463964 / 29857904 / +2.0% 109151282 / 120893146 / -9.7% 0.28 / 0.25 / +13.0%
clickbench_q30/duckdb:vortex-file-compressed 137096437 / 140938715 / -2.7% 267320075 / 274493107 / -2.6% 0.51 / 0.51 / -0.1%
clickbench_q31/duckdb:vortex-file-compressed 294700338 / 302044828 / -2.4% 464928542 / 483197314 / -3.8% 0.63 / 0.63 / +1.4%
clickbench_q32/duckdb:vortex-file-compressed 922305643 / 924883750 / -0.3% 1040957398 / 1058092208 / -1.6% 0.89 / 0.87 / +1.4%
clickbench_q33/duckdb:vortex-file-compressed 1057380732 / 1040067440 / +1.7% 1308210718 / 1285783823 / +1.7% 0.81 / 0.81 / -0.1%
clickbench_q34/duckdb:vortex-file-compressed 1080390846 / 1102635470 / -2.0% 1334867572 / 1158848683 / +15.2% 🔴 0.81 / 0.95 / -14.9%
clickbench_q35/duckdb:vortex-file-compressed 209048364 / 208137891 / +0.4% 291941507 / 295692404 / -1.3% 0.72 / 0.70 / +1.7%
clickbench_q36/duckdb:vortex-file-compressed 27875371 / 28314200 / -1.5% 105666454 / 130253599 / -18.9% 🟢 0.26 / 0.22 / +21.4%
clickbench_q37/duckdb:vortex-file-compressed 18638450 / 18253855 / +2.1% 102048331 / 80992491 / +26.0% 🔴 0.18 / 0.23 / -19.0%
clickbench_q38/duckdb:vortex-file-compressed 21364002 / 22236799 / -3.9% 102359358 / 88665950 / +15.4% 🔴 0.21 / 0.25 / -16.8%
clickbench_q39/duckdb:vortex-file-compressed 43694908 / 43572281 / +0.3% 116594601 / 132052140 / -11.7% 🟢 0.37 / 0.33 / +13.6%
clickbench_q40/duckdb:vortex-file-compressed 15502825 / 17191419 / -9.8% 87042936 / 99702790 / -12.7% 🟢 0.18 / 0.17 / +3.3%
clickbench_q41/duckdb:vortex-file-compressed 19054338 / 16093712 / +18.4% 🔴 92132172 / 94240929 / -2.2% 0.21 / 0.17 / +21.1%
clickbench_q42/duckdb:vortex-file-compressed 18546910 / 18418928 / +0.7% 90935910 / 82448576 / +10.3% 🔴 0.20 / 0.22 / -8.7%
duckdb / parquet / ns (1.002x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 16382823 / 15239491 / +7.5% 45765064 / 38858643 / +17.8% 🔴 0.36 / 0.39 / -8.7%
clickbench_q01/duckdb:parquet 16431898 / 16229965 / +1.2% 41679125 / 38533178 / +8.2% 0.39 / 0.42 / -6.4%
clickbench_q02/duckdb:parquet 26813072 / 29367185 / -8.7% 57031201 / 57067423 / -0.1% 0.47 / 0.51 / -8.6%
clickbench_q03/duckdb:parquet 26851266 / 28940370 / -7.2% 85855320 / 87241946 / -1.6% 0.31 / 0.33 / -5.7%
clickbench_q04/duckdb:parquet 135037001 / 134575738 / +0.3% 195519720 / 181306318 / +7.8% 0.69 / 0.74 / -7.0%
clickbench_q05/duckdb:parquet 185204099 / 201630833 / -8.1% 257172388 / 244632671 / +5.1% 0.72 / 0.82 / -12.6%
clickbench_q06/duckdb:parquet 24112334 / 23584784 / +2.2% 46172492 / 48998401 / -5.8% 0.52 / 0.48 / +8.5%
clickbench_q07/duckdb:parquet 20961152 / 19020252 / +10.2% 🔴 40347224 / 36934695 / +9.2% 0.52 / 0.51 / +0.9%
clickbench_q08/duckdb:parquet 164244480 / 164091223 / +0.1% 254128468 / 250988822 / +1.3% 0.65 / 0.65 / -1.1%
clickbench_q09/duckdb:parquet 227866216 / 226973592 / +0.4% 323808421 / 323742708 / +0.0% 0.70 / 0.70 / +0.4%
clickbench_q10/duckdb:parquet 60701316 / 64309542 / -5.6% 116999275 / 114573318 / +2.1% 0.52 / 0.56 / -7.6%
clickbench_q11/duckdb:parquet 73184240 / 70040142 / +4.5% 131941512 / 132521662 / -0.4% 0.55 / 0.53 / +4.9%
clickbench_q12/duckdb:parquet 180164748 / 178776946 / +0.8% 279848127 / 262630124 / +6.6% 0.64 / 0.68 / -5.4%
clickbench_q13/duckdb:parquet 314613606 / 304450700 / +3.3% 429610652 / 431236882 / -0.4% 0.73 / 0.71 / +3.7%
clickbench_q14/duckdb:parquet 196842160 / 188767960 / +4.3% 289400085 / 290127846 / -0.3% 0.68 / 0.65 / +4.5%
clickbench_q15/duckdb:parquet 185089765 / 184092434 / +0.5% 230579955 / 235493569 / -2.1% 0.80 / 0.78 / +2.7%
clickbench_q16/duckdb:parquet 353444906 / 352592400 / +0.2% 470357181 / 481155305 / -2.2% 0.75 / 0.73 / +2.5%
clickbench_q17/duckdb:parquet 360852420 / 362978876 / -0.6% 486492740 / 468384111 / +3.9% 0.74 / 0.77 / -4.3%
clickbench_q18/duckdb:parquet 698312202 / 684473381 / +2.0% 864614367 / 891013415 / -3.0% 0.81 / 0.77 / +5.1%
clickbench_q19/duckdb:parquet 23501130 / 22508228 / +4.4% 65872026 / 66687333 / -1.2% 0.36 / 0.34 / +5.7%
clickbench_q20/duckdb:parquet 274329644 / 263218734 / +4.2% 458212124 / 452810491 / +1.2% 0.60 / 0.58 / +3.0%
clickbench_q21/duckdb:parquet 338782374 / 333853832 / +1.5% 603751313 / 638433857 / -5.4% 0.56 / 0.52 / +7.3%
clickbench_q22/duckdb:parquet 500800236 / 475128162 / +5.4% 774588586 / 773145638 / +0.2% 0.65 / 0.61 / +5.2%
clickbench_q23/duckdb:parquet 261336669 / 250282393 / +4.4% 324515215 / 306419072 / +5.9% 0.81 / 0.82 / -1.4%
clickbench_q24/duckdb:parquet 76868133 / 78438190 / -2.0% 122647980 / 123960926 / -1.1% 0.63 / 0.63 / -1.0%
clickbench_q25/duckdb:parquet 72689765 / 75344578 / -3.5% 182244345 / 183140109 / -0.5% 0.40 / 0.41 / -3.0%
clickbench_q26/duckdb:parquet 58153196 / 67111146 / -13.3% 🟢 100022973 / 109307660 / -8.5% 0.58 / 0.61 / -5.3%
clickbench_q27/duckdb:parquet 279455528 / 275638245 / +1.4% 507456843 / 516055074 / -1.7% 0.55 / 0.53 / +3.1%
clickbench_q28/duckdb:parquet 1699122314 / 1686286588 / +0.8% 2156357681 / 2173590832 / -0.8% 0.79 / 0.78 / +1.6%
clickbench_q29/duckdb:parquet 29421144 / 29666953 / -0.8% 61596950 / 63725457 / -3.3% 0.48 / 0.47 / +2.6%
clickbench_q30/duckdb:parquet 181235941 / 181925848 / -0.4% 337825164 / 331126219 / +2.0% 0.54 / 0.55 / -2.4%
clickbench_q31/duckdb:parquet 309912621 / 305637968 / +1.4% 538764996 / 539333734 / -0.1% 0.58 / 0.57 / +1.5%
clickbench_q32/duckdb:parquet 901818938 / 892995610 / +1.0% 1033548886 / 1004548050 / +2.9% 0.87 / 0.89 / -1.8%
clickbench_q33/duckdb:parquet 781117076 / 770815375 / +1.3% 957238791 / 979378714 / -2.3% 0.82 / 0.79 / +3.7%
clickbench_q34/duckdb:parquet 803471296 / 799617971 / +0.5% 988540794 / 1026598557 / -3.7% 0.81 / 0.78 / +4.4%
clickbench_q35/duckdb:parquet 209172896 / 213945266 / -2.2% 240703677 / 253322356 / -5.0% 0.87 / 0.84 / +2.9%
clickbench_q36/duckdb:parquet 51266788 / 53598430 / -4.4% 73838462 / 76473324 / -3.4% 0.69 / 0.70 / -0.9%
clickbench_q37/duckdb:parquet 38441438 / 38236164 / +0.5% 57918606 / 57913532 / +0.0% 0.66 / 0.66 / +0.5%
clickbench_q38/duckdb:parquet 38254166 / 37443052 / +2.2% 59362830 / 60734334 / -2.3% 0.64 / 0.62 / +4.5%
clickbench_q39/duckdb:parquet 87131988 / 99058422 / -12.0% 🟢 111911819 / 121095392 / -7.6% 0.78 / 0.82 / -4.8%
clickbench_q40/duckdb:parquet 21635399 / 20657909 / +4.7% 43841961 / 42037050 / +4.3% 0.49 / 0.49 / +0.4%
clickbench_q41/duckdb:parquet 21389938 / 20756372 / +3.1% 44501585 / 41789438 / +6.5% 0.48 / 0.50 / -3.2%
clickbench_q42/duckdb:parquet 25759142 / 23285693 / +10.6% 🔴 49654399 / 44334550 / +12.0% 🔴 0.52 / 0.53 / -1.2%

File Size Changes (201 files changed, -41.6% overall, 0↑ 201↓)
File Scale Format Base HEAD Change %
hits_51.vortex 1.0 vortex-file-compressed 280.27 MB 275.85 MB 4.42 MB -1.6%
hits_54.vortex 1.0 vortex-file-compressed 223.14 MB 219.39 MB 3.75 MB -1.7%
hits_43.vortex 1.0 vortex-file-compressed 227.67 MB 223.71 MB 3.95 MB -1.7%
hits_42.vortex 1.0 vortex-file-compressed 223.20 MB 219.28 MB 3.92 MB -1.8%
hits_41.vortex 1.0 vortex-file-compressed 224.33 MB 220.34 MB 3.98 MB -1.8%
hits_89.vortex 1.0 vortex-file-compressed 185.60 MB 181.55 MB 4.05 MB -2.2%
hits_2.vortex 1.0 vortex-file-compressed 187.02 MB 182.73 MB 4.29 MB -2.3%
hits_44.vortex 1.0 vortex-file-compressed 186.81 MB 182.49 MB 4.32 MB -2.3%
hits_78.vortex 1.0 vortex-file-compressed 165.46 MB 161.32 MB 4.13 MB -2.5%
hits_67.vortex 1.0 vortex-file-compressed 185.35 MB 180.69 MB 4.66 MB -2.5%
hits_55.vortex 1.0 vortex-file-compressed 170.12 MB 165.49 MB 4.62 MB -2.7%
hits_65.vortex 1.0 vortex-file-compressed 184.34 MB 179.29 MB 5.05 MB -2.7%
hits_27.vortex 1.0 vortex-file-compressed 123.24 MB 119.81 MB 3.42 MB -2.8%
hits_50.vortex 1.0 vortex-file-compressed 180.30 MB 175.20 MB 5.11 MB -2.8%
hits_28.vortex 1.0 vortex-file-compressed 120.47 MB 117.02 MB 3.45 MB -2.9%
hits_69.vortex 1.0 vortex-file-compressed 123.42 MB 119.86 MB 3.56 MB -2.9%
hits_77.vortex 1.0 vortex-file-compressed 168.92 MB 163.98 MB 4.94 MB -2.9%
hits_87.vortex 1.0 vortex-file-compressed 172.96 MB 167.89 MB 5.07 MB -2.9%
hits_26.vortex 1.0 vortex-file-compressed 109.73 MB 106.42 MB 3.32 MB -3.0%
hits_8.vortex 1.0 vortex-file-compressed 93.93 MB 91.06 MB 2.87 MB -3.1%
hits_6.vortex 1.0 vortex-file-compressed 94.02 MB 91.12 MB 2.89 MB -3.1%
hits_4.vortex 1.0 vortex-file-compressed 109.04 MB 105.65 MB 3.38 MB -3.1%
hits_7.vortex 1.0 vortex-file-compressed 94.67 MB 91.66 MB 3.00 MB -3.2%
hits_5.vortex 1.0 vortex-file-compressed 93.64 MB 90.67 MB 2.97 MB -3.2%
hits_47.vortex 1.0 vortex-file-compressed 41.19 MB 39.85 MB 1.34 MB -3.3%
hits_58.vortex 1.0 vortex-file-compressed 90.74 MB 87.73 MB 3.01 MB -3.3%
hits_68.vortex 1.0 vortex-file-compressed 123.44 MB 119.28 MB 4.16 MB -3.4%
hits_79.vortex 1.0 vortex-file-compressed 144.78 MB 139.86 MB 4.92 MB -3.4%
hits_62.vortex 1.0 vortex-file-compressed 117.72 MB 113.70 MB 4.03 MB -3.4%
hits_9.vortex 1.0 vortex-file-compressed 99.65 MB 96.19 MB 3.46 MB -3.5%
hits_92.vortex 1.0 vortex-file-compressed 147.44 MB 142.25 MB 5.19 MB -3.5%
hits_3.vortex 1.0 vortex-file-compressed 142.49 MB 137.46 MB 5.03 MB -3.5%
hits_57.vortex 1.0 vortex-file-compressed 128.61 MB 123.89 MB 4.71 MB -3.7%
hits_90.vortex 1.0 vortex-file-compressed 142.82 MB 137.52 MB 5.29 MB -3.7%
hits_56.vortex 1.0 vortex-file-compressed 123.96 MB 119.31 MB 4.64 MB -3.7%
hits_1.vortex 1.0 vortex-file-compressed 138.81 MB 133.47 MB 5.35 MB -3.9%
hits_10.vortex 1.0 vortex-file-compressed 69.52 MB 66.79 MB 2.73 MB -3.9%
hits_20.vortex 1.0 vortex-file-compressed 62.58 MB 60.11 MB 2.47 MB -3.9%
hits_53.vortex 1.0 vortex-file-compressed 85.77 MB 82.35 MB 3.42 MB -4.0%
hits_35.vortex 1.0 vortex-file-compressed 115.10 MB 110.42 MB 4.69 MB -4.1%
hits_96.vortex 1.0 vortex-file-compressed 136.10 MB 130.53 MB 5.57 MB -4.1%
hits_81.vortex 1.0 vortex-file-compressed 101.30 MB 97.14 MB 4.16 MB -4.1%
hits_0.vortex 1.0 vortex-file-compressed 89.92 MB 86.22 MB 3.69 MB -4.1%
hits_94.vortex 1.0 vortex-file-compressed 139.33 MB 133.59 MB 5.74 MB -4.1%
hits_88.vortex 1.0 vortex-file-compressed 111.14 MB 106.42 MB 4.72 MB -4.2%
hits_18.vortex 1.0 vortex-file-compressed 104.80 MB 100.34 MB 4.46 MB -4.3%
hits_71.vortex 1.0 vortex-file-compressed 102.09 MB 97.70 MB 4.39 MB -4.3%
hits_19.vortex 1.0 vortex-file-compressed 73.29 MB 70.13 MB 3.16 MB -4.3%
hits_37.vortex 1.0 vortex-file-compressed 85.60 MB 81.91 MB 3.70 MB -4.3%
hits_99.vortex 1.0 vortex-file-compressed 123.52 MB 118.18 MB 5.34 MB -4.3%
hits_11.vortex 1.0 vortex-file-compressed 79.93 MB 76.47 MB 3.46 MB -4.3%
hits_74.vortex 1.0 vortex-file-compressed 120.12 MB 114.92 MB 5.20 MB -4.3%
hits_14.vortex 1.0 vortex-file-compressed 111.56 MB 106.68 MB 4.88 MB -4.4%
hits_36.vortex 1.0 vortex-file-compressed 68.53 MB 65.53 MB 3.01 MB -4.4%
hits_70.vortex 1.0 vortex-file-compressed 93.87 MB 89.65 MB 4.21 MB -4.5%
hits_13.vortex 1.0 vortex-file-compressed 99.59 MB 95.10 MB 4.48 MB -4.5%
hits_98.vortex 1.0 vortex-file-compressed 118.83 MB 113.44 MB 5.40 MB -4.5%
hits_45.vortex 1.0 vortex-file-compressed 122.36 MB 116.73 MB 5.62 MB -4.6%
hits_12.vortex 1.0 vortex-file-compressed 101.26 MB 96.61 MB 4.66 MB -4.6%
hits_60.vortex 1.0 vortex-file-compressed 103.50 MB 98.74 MB 4.76 MB -4.6%
hits_38.vortex 1.0 vortex-file-compressed 99.30 MB 94.69 MB 4.61 MB -4.6%
hits_76.vortex 1.0 vortex-file-compressed 114.27 MB 108.95 MB 5.32 MB -4.7%
hits_33.vortex 1.0 vortex-file-compressed 57.11 MB 54.44 MB 2.67 MB -4.7%
hits_59.vortex 1.0 vortex-file-compressed 101.97 MB 97.18 MB 4.79 MB -4.7%
hits_75.vortex 1.0 vortex-file-compressed 63.43 MB 60.35 MB 3.07 MB -4.8%
hits_21.vortex 1.0 vortex-file-compressed 93.07 MB 88.48 MB 4.59 MB -4.9%
hits_32.vortex 1.0 vortex-file-compressed 66.76 MB 63.41 MB 3.35 MB -5.0%
hits_52.vortex 1.0 vortex-file-compressed 103.83 MB 98.56 MB 5.27 MB -5.1%
hits_86.vortex 1.0 vortex-file-compressed 69.35 MB 65.83 MB 3.52 MB -5.1%
hits_17.vortex 1.0 vortex-file-compressed 87.53 MB 83.04 MB 4.48 MB -5.1%
hits_85.vortex 1.0 vortex-file-compressed 91.74 MB 87.01 MB 4.72 MB -5.1%
hits_66.vortex 1.0 vortex-file-compressed 90.34 MB 85.67 MB 4.67 MB -5.2%
hits_40.vortex 1.0 vortex-file-compressed 118.02 MB 111.84 MB 6.18 MB -5.2%
hits_15.vortex 1.0 vortex-file-compressed 89.20 MB 84.53 MB 4.67 MB -5.2%
hits_82.vortex 1.0 vortex-file-compressed 99.93 MB 94.58 MB 5.34 MB -5.3%
hits_61.vortex 1.0 vortex-file-compressed 101.34 MB 95.84 MB 5.50 MB -5.4%
hits_29.vortex 1.0 vortex-file-compressed 59.47 MB 56.22 MB 3.24 MB -5.5%
hits_95.vortex 1.0 vortex-file-compressed 96.40 MB 91.14 MB 5.26 MB -5.5%
hits_25.vortex 1.0 vortex-file-compressed 113.73 MB 107.22 MB 6.51 MB -5.7%
hits_84.vortex 1.0 vortex-file-compressed 117.80 MB 111.03 MB 6.76 MB -5.7%
hits_83.vortex 1.0 vortex-file-compressed 89.35 MB 84.14 MB 5.20 MB -5.8%
hits_46.vortex 1.0 vortex-file-compressed 69.29 MB 65.23 MB 4.05 MB -5.8%
hits_48.vortex 1.0 vortex-file-compressed 27.97 MB 26.33 MB 1.64 MB -5.9%
hits_97.vortex 1.0 vortex-file-compressed 107.20 MB 100.89 MB 6.31 MB -5.9%
hits_34.vortex 1.0 vortex-file-compressed 97.79 MB 92.04 MB 5.76 MB -5.9%
hits_39.vortex 1.0 vortex-file-compressed 80.31 MB 75.57 MB 4.75 MB -5.9%
hits_91.vortex 1.0 vortex-file-compressed 97.29 MB 91.54 MB 5.75 MB -5.9%
hits_73.vortex 1.0 vortex-file-compressed 109.86 MB 103.36 MB 6.50 MB -5.9%
hits_72.vortex 1.0 vortex-file-compressed 84.61 MB 79.59 MB 5.02 MB -5.9%
hits_30.vortex 1.0 vortex-file-compressed 87.12 MB 81.88 MB 5.23 MB -6.0%
hits_24.vortex 1.0 vortex-file-compressed 75.94 MB 71.34 MB 4.60 MB -6.1%
hits_64.vortex 1.0 vortex-file-compressed 81.15 MB 76.18 MB 4.97 MB -6.1%
hits_23.vortex 1.0 vortex-file-compressed 76.44 MB 71.74 MB 4.70 MB -6.1%
hits_63.vortex 1.0 vortex-file-compressed 69.20 MB 64.91 MB 4.30 MB -6.2%
hits_80.vortex 1.0 vortex-file-compressed 105.41 MB 98.80 MB 6.61 MB -6.3%
hits_22.vortex 1.0 vortex-file-compressed 77.02 MB 72.14 MB 4.87 MB -6.3%
hits_31.vortex 1.0 vortex-file-compressed 90.25 MB 84.36 MB 5.88 MB -6.5%
hits_49.vortex 1.0 vortex-file-compressed 75.66 MB 70.55 MB 5.12 MB -6.8%
hits_93.vortex 1.0 vortex-file-compressed 90.61 MB 84.47 MB 6.14 MB -6.8%
hits_16.vortex 1.0 vortex-file-compressed 79.40 MB 73.35 MB 6.05 MB -7.6%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.85 MB 0 B 58.85 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.68 MB 0 B 90.68 MB -100.0%
hits_10.vortex 1.0 vortex-compact 49.45 MB 0 B 49.45 MB -100.0%
hits_11.vortex 1.0 vortex-compact 56.08 MB 0 B 56.08 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.83 MB 0 B 69.83 MB -100.0%
hits_13.vortex 1.0 vortex-compact 69.21 MB 0 B 69.21 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.85 MB 0 B 74.85 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.38 MB 0 B 48.38 MB -100.0%
hits_16.vortex 1.0 vortex-compact 49.53 MB 0 B 49.53 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.76 MB 0 B 58.76 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.85 MB 0 B 64.85 MB -100.0%
hits_19.vortex 1.0 vortex-compact 49.69 MB 0 B 49.69 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.13 MB 0 B 129.13 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.33 MB 0 B 38.33 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.96 MB 0 B 51.96 MB -100.0%
hits_22.vortex 1.0 vortex-compact 46.20 MB 0 B 46.20 MB -100.0%
hits_23.vortex 1.0 vortex-compact 46.11 MB 0 B 46.11 MB -100.0%
hits_24.vortex 1.0 vortex-compact 45.09 MB 0 B 45.09 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.50 MB 0 B 73.50 MB -100.0%
hits_26.vortex 1.0 vortex-compact 71.96 MB 0 B 71.96 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.84 MB 0 B 69.84 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.83 MB 0 B 70.83 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.65 MB 0 B 36.65 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.04 MB 0 B 95.04 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.55 MB 0 B 58.55 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.74 MB 0 B 55.74 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.58 MB 0 B 44.58 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.89 MB 0 B 35.89 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.21 MB 0 B 58.21 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.31 MB 0 B 75.31 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.18 MB 0 B 49.18 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.73 MB 0 B 54.73 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.35 MB 0 B 63.35 MB -100.0%
hits_39.vortex 1.0 vortex-compact 50.06 MB 0 B 50.06 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.92 MB 0 B 71.92 MB -100.0%
hits_40.vortex 1.0 vortex-compact 77.39 MB 0 B 77.39 MB -100.0%
hits_41.vortex 1.0 vortex-compact 166.03 MB 0 B 166.03 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.50 MB 0 B 164.50 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.18 MB 0 B 169.18 MB -100.0%
hits_44.vortex 1.0 vortex-compact 133.23 MB 0 B 133.23 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.77 MB 0 B 75.77 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.24 MB 0 B 42.24 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.19 MB 0 B 18.19 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.82 MB 0 B 17.82 MB -100.0%
hits_49.vortex 1.0 vortex-compact 50.97 MB 0 B 50.97 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.30 MB 0 B 63.30 MB -100.0%
hits_50.vortex 1.0 vortex-compact 114.17 MB 0 B 114.17 MB -100.0%
hits_51.vortex 1.0 vortex-compact 168.31 MB 0 B 168.31 MB -100.0%
hits_52.vortex 1.0 vortex-compact 65.05 MB 0 B 65.05 MB -100.0%
hits_53.vortex 1.0 vortex-compact 60.02 MB 0 B 60.02 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.55 MB 0 B 117.55 MB -100.0%
hits_55.vortex 1.0 vortex-compact 92.51 MB 0 B 92.51 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.57 MB 0 B 78.57 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.69 MB 0 B 83.69 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.21 MB 0 B 61.21 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.65 MB 0 B 66.65 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.55 MB 0 B 63.55 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.89 MB 0 B 64.89 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.70 MB 0 B 57.70 MB -100.0%
hits_62.vortex 1.0 vortex-compact 75.42 MB 0 B 75.42 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.41 MB 0 B 46.41 MB -100.0%
hits_64.vortex 1.0 vortex-compact 54.06 MB 0 B 54.06 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.38 MB 0 B 129.38 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.49 MB 0 B 53.49 MB -100.0%
hits_67.vortex 1.0 vortex-compact 114.42 MB 0 B 114.42 MB -100.0%
hits_68.vortex 1.0 vortex-compact 76.65 MB 0 B 76.65 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.97 MB 0 B 80.97 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.16 MB 0 B 64.16 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.81 MB 0 B 61.81 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.93 MB 0 B 69.93 MB -100.0%
hits_72.vortex 1.0 vortex-compact 52.70 MB 0 B 52.70 MB -100.0%
hits_73.vortex 1.0 vortex-compact 70.85 MB 0 B 70.85 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.84 MB 0 B 71.84 MB -100.0%
hits_75.vortex 1.0 vortex-compact 45.09 MB 0 B 45.09 MB -100.0%
hits_76.vortex 1.0 vortex-compact 77.07 MB 0 B 77.07 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.44 MB 0 B 118.44 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.82 MB 0 B 97.82 MB -100.0%
hits_79.vortex 1.0 vortex-compact 86.14 MB 0 B 86.14 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.37 MB 0 B 63.37 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.64 MB 0 B 68.64 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.92 MB 0 B 65.92 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.40 MB 0 B 67.40 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.58 MB 0 B 53.58 MB -100.0%
hits_84.vortex 1.0 vortex-compact 74.18 MB 0 B 74.18 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.83 MB 0 B 52.83 MB -100.0%
hits_86.vortex 1.0 vortex-compact 49.09 MB 0 B 49.09 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.83 MB 0 B 118.83 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.49 MB 0 B 73.49 MB -100.0%
hits_89.vortex 1.0 vortex-compact 114.07 MB 0 B 114.07 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.29 MB 0 B 66.29 MB -100.0%
hits_90.vortex 1.0 vortex-compact 82.06 MB 0 B 82.06 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.21 MB 0 B 61.21 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.37 MB 0 B 94.37 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.89 MB 0 B 59.89 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.87 MB 0 B 90.87 MB -100.0%
hits_95.vortex 1.0 vortex-compact 58.17 MB 0 B 58.17 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.72 MB 0 B 91.72 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.55 MB 0 B 69.55 MB -100.0%
hits_98.vortex 1.0 vortex-compact 73.12 MB 0 B 73.12 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.61 MB 0 B 77.61 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 0 B (-100.0%)
  • vortex-file-compressed: 11.03 GB → 10.59 GB (-4.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 6a234562 vs base acd8bb47
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.4%
Engines: DataFusion No clear signal (-8.6%, environment too noisy confidence) · DuckDB No clear signal (+4.2%, environment too noisy confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.994x ➖
Parquet (geomean): hot 1.026x ➖ · cold 1.046x ➖
Shifts: Parquet (control) +2.6% · Median polish +2.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.945x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 241444983 / 254329886 / -5.1% 708216754 / 764055549 / -7.3% 0.34 / 0.33 / +2.4%
tpch_q02/datafusion:vortex-file-compressed 511123751 / 457338660 / +11.8% 764366084 / 773059863 / -1.1% 0.67 / 0.59 / +13.0%
tpch_q03/datafusion:vortex-file-compressed 358366526 / 324324842 / +10.5% 1240000088 / 1036934739 / +19.6% 0.29 / 0.31 / -7.6%
tpch_q04/datafusion:vortex-file-compressed 175055267 / 166706380 / +5.0% 436120886 / 341251068 / +27.8% 0.40 / 0.49 / -17.8%
tpch_q05/datafusion:vortex-file-compressed 338099378 / 513845491 / -34.2% 🟢 568329349 / 544894440 / +4.3% 0.59 / 0.94 / -36.9%
tpch_q06/datafusion:vortex-file-compressed 260303304 / 241293829 / +7.9% 456842755 / 405868453 / +12.6% 0.57 / 0.59 / -4.2%
tpch_q07/datafusion:vortex-file-compressed 369189768 / 362041291 / +2.0% 541870042 / 638574243 / -15.1% 0.68 / 0.57 / +20.2%
tpch_q08/datafusion:vortex-file-compressed 453920703 / 519789727 / -12.7% 693106085 / 917403727 / -24.4% 0.65 / 0.57 / +15.6%
tpch_q09/datafusion:vortex-file-compressed 374023418 / 558331734 / -33.0% 🟢 605614283 / 717196408 / -15.6% 0.62 / 0.78 / -20.7%
tpch_q10/datafusion:vortex-file-compressed 347382663 / 359184427 / -3.3% 516918848 / 511726226 / +1.0% 0.67 / 0.70 / -4.3%
tpch_q11/datafusion:vortex-file-compressed 267023618 / 271874943 / -1.8% 473102380 / 463255232 / +2.1% 0.56 / 0.59 / -3.8%
tpch_q12/datafusion:vortex-file-compressed 345897618 / 350889017 / -1.4% 633698037 / 485388561 / +30.6% 🔴 0.55 / 0.72 / -24.5%
tpch_q13/datafusion:vortex-file-compressed 107660820 / 104711565 / +2.8% 402926830 / 363176397 / +10.9% 0.27 / 0.29 / -7.3%
tpch_q14/datafusion:vortex-file-compressed 180897455 / 174891319 / +3.4% 448949718 / 378441050 / +18.6% 0.40 / 0.46 / -12.8%
tpch_q15/datafusion:vortex-file-compressed 296199069 / 336231193 / -11.9% 541639547 / 516646625 / +4.8% 0.55 / 0.65 / -16.0%
tpch_q16/datafusion:vortex-file-compressed 222338265 / 198886795 / +11.8% 375069455 / 362245907 / +3.5% 0.59 / 0.55 / +8.0%
tpch_q17/datafusion:vortex-file-compressed 289359392 / 313950335 / -7.8% 648950114 / 461204740 / +40.7% 🔴 0.45 / 0.68 / -34.5%
tpch_q18/datafusion:vortex-file-compressed 262210457 / 699795793 / -62.5% 🟢 701905128 / 1006884905 / -30.3% 🟢 0.37 / 0.70 / -46.2%
tpch_q19/datafusion:vortex-file-compressed 393206634 / 318908650 / +23.3% 505624044 / 518885285 / -2.6% 0.78 / 0.61 / +26.5%
tpch_q20/datafusion:vortex-file-compressed 358556992 / 377627131 / -5.0% 544941619 / 630308319 / -13.5% 0.66 / 0.60 / +9.8%
tpch_q21/datafusion:vortex-file-compressed 564682528 / 484733500 / +16.5% 688394915 / 644014844 / +6.9% 0.82 / 0.75 / +9.0%
tpch_q22/datafusion:vortex-file-compressed 171467805 / 142935295 / +20.0% 445344845 / 365077746 / +22.0% 0.39 / 0.39 / -1.7%
datafusion / parquet / ns (1.034x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 259392331 / 218450764 / +18.7% 615193769 / 537069679 / +14.5% 0.42 / 0.41 / +3.7%
tpch_q02/datafusion:parquet 319426846 / 285327632 / +12.0% 637747969 / 677224563 / -5.8% 0.50 / 0.42 / +18.9%
tpch_q03/datafusion:parquet 289788699 / 299031986 / -3.1% 874572538 / 744859366 / +17.4% 0.33 / 0.40 / -17.5%
tpch_q04/datafusion:parquet 152962499 / 148214359 / +3.2% 370407546 / 411542023 / -10.0% 0.41 / 0.36 / +14.7%
tpch_q05/datafusion:parquet 372393089 / 354756829 / +5.0% 607775283 / 510558678 / +19.0% 0.61 / 0.69 / -11.8%
tpch_q06/datafusion:parquet 135044972 / 138778814 / -2.7% 293778607 / 280529053 / +4.7% 0.46 / 0.49 / -7.1%
tpch_q07/datafusion:parquet 455705047 / 375564574 / +21.3% 574657405 / 542089376 / +6.0% 0.79 / 0.69 / +14.5%
tpch_q08/datafusion:parquet 463218963 / 549085396 / -15.6% 664753515 / 593652054 / +12.0% 0.70 / 0.92 / -24.7%
tpch_q09/datafusion:parquet 535799206 / 466430004 / +14.9% 727798102 / 673739106 / +8.0% 0.74 / 0.69 / +6.3%
tpch_q10/datafusion:parquet 424662055 / 399652780 / +6.3% 667555384 / 567383940 / +17.7% 0.64 / 0.70 / -9.7%
tpch_q11/datafusion:parquet 274843191 / 272030592 / +1.0% 461891219 / 433721223 / +6.5% 0.60 / 0.63 / -5.1%
tpch_q12/datafusion:parquet 237558180 / 217350516 / +9.3% 585398570 / 439556027 / +33.2% 🔴 0.41 / 0.49 / -17.9%
tpch_q13/datafusion:parquet 450367718 / 452829048 / -0.5% 617958534 / 753934731 / -18.0% 0.73 / 0.60 / +21.3%
tpch_q14/datafusion:parquet 189349986 / 179803063 / +5.3% 357088444 / 342716481 / +4.2% 0.53 / 0.52 / +1.1%
tpch_q15/datafusion:parquet 287008022 / 282226313 / +1.7% 458991471 / 508134861 / -9.7% 0.63 / 0.56 / +12.6%
tpch_q16/datafusion:parquet 148326743 / 121159065 / +22.4% 328505959 / 319517718 / +2.8% 0.45 / 0.38 / +19.1%
tpch_q17/datafusion:parquet 360163381 / 346070206 / +4.1% 526747704 / 509857315 / +3.3% 0.68 / 0.68 / +0.7%
tpch_q18/datafusion:parquet 482466013 / 454263098 / +6.2% 692360872 / 573653782 / +20.7% 0.70 / 0.79 / -12.0%
tpch_q19/datafusion:parquet 182349427 / 212460730 / -14.2% 324968048 / 323354839 / +0.5% 0.56 / 0.66 / -14.6%
tpch_q20/datafusion:parquet 283442885 / 421908644 / -32.8% 🟢 512595134 / 504492011 / +1.6% 0.55 / 0.84 / -33.9%
tpch_q21/datafusion:parquet 510405809 / 469959299 / +8.6% 677228656 / 600839389 / +12.7% 0.75 / 0.78 / -3.6%
tpch_q22/datafusion:parquet 238168379 / 191591014 / +24.3% 468805602 / 411304386 / +14.0% 0.51 / 0.47 / +9.1%
duckdb / vortex-file-compressed / ns (1.061x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 229434494 / 205429287 / +11.7% 296137045 / 269901119 / +9.7% 0.77 / 0.76 / +1.8%
tpch_q02/duckdb:vortex-file-compressed 426087661 / 397951267 / +7.1% 517796101 / 457988304 / +13.1% 0.82 / 0.87 / -5.3%
tpch_q03/duckdb:vortex-file-compressed 419087602 / 406039426 / +3.2% 480845417 / 613077470 / -21.6% 0.87 / 0.66 / +31.6%
tpch_q04/duckdb:vortex-file-compressed 276158861 / 285159795 / -3.2% 369348627 / 321196203 / +15.0% 0.75 / 0.89 / -15.8%
tpch_q05/duckdb:vortex-file-compressed 431401053 / 432985122 / -0.4% 593630747 / 1024705049 / -42.1% 🟢 0.73 / 0.42 / +72.0%
tpch_q06/duckdb:vortex-file-compressed 284072518 / 274056719 / +3.7% 379228697 / 294215352 / +28.9% 0.75 / 0.93 / -19.6%
tpch_q07/duckdb:vortex-file-compressed 443172933 / 432920165 / +2.4% 487787623 / 510410468 / -4.4% 0.91 / 0.85 / +7.1%
tpch_q08/duckdb:vortex-file-compressed 597521828 / 545410920 / +9.6% 636812575 / 707844409 / -10.0% 0.94 / 0.77 / +21.8%
tpch_q09/duckdb:vortex-file-compressed 475837209 / 470518399 / +1.1% 525739135 / 478575841 / +9.9% 0.91 / 0.98 / -7.9%
tpch_q10/duckdb:vortex-file-compressed 418873442 / 432565589 / -3.2% 539041265 / 483483960 / +11.5% 0.78 / 0.89 / -13.1%
tpch_q11/duckdb:vortex-file-compressed 155077468 / 158122929 / -1.9% 169418895 / 175738704 / -3.6% 0.92 / 0.90 / +1.7%
tpch_q12/duckdb:vortex-file-compressed 622062936 / 386287344 / +61.0% 🔴 755755734 / 520150334 / +45.3% 🔴 0.82 / 0.74 / +10.8%
tpch_q13/duckdb:vortex-file-compressed 377748320 / 293171328 / +28.8% 358063492 / 433947496 / -17.5% 1.05 / 0.68 / +56.2%
tpch_q14/duckdb:vortex-file-compressed 266468721 / 233916997 / +13.9% 319639054 / 297167752 / +7.6% 0.83 / 0.79 / +5.9%
tpch_q15/duckdb:vortex-file-compressed 172108473 / 144081896 / +19.5% 231454505 / 203966252 / +13.5% 0.74 / 0.71 / +5.3%
tpch_q16/duckdb:vortex-file-compressed 213441291 / 209997963 / +1.6% 222668112 / 266332647 / -16.4% 0.96 / 0.79 / +21.6%
tpch_q17/duckdb:vortex-file-compressed 385226787 / 384780163 / +0.1% 438571243 / 473974584 / -7.5% 0.88 / 0.81 / +8.2%
tpch_q18/duckdb:vortex-file-compressed 309290957 / 319344632 / -3.1% 376347149 / 357404676 / +5.3% 0.82 / 0.89 / -8.0%
tpch_q19/duckdb:vortex-file-compressed 412419799 / 343234786 / +20.2% 428892388 / 453865400 / -5.5% 0.96 / 0.76 / +27.2%
tpch_q20/duckdb:vortex-file-compressed 442531794 / 378726718 / +16.8% 523895407 / 462507577 / +13.3% 0.84 / 0.82 / +3.2%
tpch_q21/duckdb:vortex-file-compressed 538881882 / 776777242 / -30.6% 🟢 689724004 / 716317951 / -3.7% 0.78 / 1.08 / -28.0%
tpch_q22/duckdb:vortex-file-compressed 116500443 / 113353638 / +2.8% 194713890 / 491491878 / -60.4% 🟢 0.60 / 0.23 / +159.4%
duckdb / parquet / ns (1.018x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 334578127 / 339875424 / -1.6% 361911752 / 345363744 / +4.8% 0.92 / 0.98 / -6.1%
tpch_q02/duckdb:parquet 716660250 / 681953350 / +5.1% 723025224 / 665505883 / +8.6% 0.99 / 1.02 / -3.3%
tpch_q03/duckdb:parquet 795109247 / 794903402 / +0.0% 908704026 / 868158427 / +4.7% 0.87 / 0.92 / -4.4%
tpch_q04/duckdb:parquet 512386130 / 518476035 / -1.2% 478553836 / 583660469 / -18.0% 1.07 / 0.89 / +20.5%
tpch_q05/duckdb:parquet 1019748507 / 979773928 / +4.1% 1232095609 / 950488930 / +29.6% 0.83 / 1.03 / -19.7%
tpch_q06/duckdb:parquet 321614298 / 301119771 / +6.8% 329787457 / 317536593 / +3.9% 0.98 / 0.95 / +2.8%
tpch_q07/duckdb:parquet 904403426 / 945444471 / -4.3% 919685882 / 1166986091 / -21.2% 0.98 / 0.81 / +21.4%
tpch_q08/duckdb:parquet 1182776030 / 1080677267 / +9.4% 1291036456 / 1230358617 / +4.9% 0.92 / 0.88 / +4.3%
tpch_q09/duckdb:parquet 1099406013 / 1081091175 / +1.7% 1152640445 / 1018636504 / +13.2% 0.95 / 1.06 / -10.1%
tpch_q10/duckdb:parquet 1030450994 / 1028183097 / +0.2% 1040569652 / 1024489022 / +1.6% 0.99 / 1.00 / -1.3%
tpch_q11/duckdb:parquet 449929823 / 470820123 / -4.4% 460829112 / 489414221 / -5.8% 0.98 / 0.96 / +1.5%
tpch_q12/duckdb:parquet 672087806 / 575291111 / +16.8% 694476034 / 629566532 / +10.3% 0.97 / 0.91 / +5.9%
tpch_q13/duckdb:parquet 877189098 / 864862022 / +1.4% 907804344 / 1127281266 / -19.5% 0.97 / 0.77 / +25.9%
tpch_q14/duckdb:parquet 523939090 / 547628385 / -4.3% 624114315 / 551798478 / +13.1% 0.84 / 0.99 / -15.4%
tpch_q15/duckdb:parquet 472215630 / 384865526 / +22.7% 515984324 / 385701668 / +33.8% 🔴 0.92 / 1.00 / -8.3%
tpch_q16/duckdb:parquet 527108345 / 535857467 / -1.6% 518582519 / 531429728 / -2.4% 1.02 / 1.01 / +0.8%
tpch_q17/duckdb:parquet 515998385 / 522288532 / -1.2% 548508992 / 538368836 / +1.9% 0.94 / 0.97 / -3.0%
tpch_q18/duckdb:parquet 724581779 / 727016644 / -0.3% 733484425 / 751463634 / -2.4% 0.99 / 0.97 / +2.1%
tpch_q19/duckdb:parquet 582086079 / 625229173 / -6.9% 647415486 / 707116428 / -8.4% 0.90 / 0.88 / +1.7%
tpch_q20/duckdb:parquet 921556458 / 934947971 / -1.4% 899125016 / 898319485 / +0.1% 1.02 / 1.04 / -1.5%
tpch_q21/duckdb:parquet 808404717 / 814765522 / -0.8% 925411109 / 795376706 / +16.3% 0.87 / 1.02 / -14.7%
tpch_q22/duckdb:parquet 474425124 / 454711399 / +4.3% 496381388 / 443669930 / +11.9% 0.96 / 1.02 / -6.7%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 6a234562 vs base acd8bb47
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: random-access No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 1.001x ➖
Parquet (geomean): hot 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 338213 / 327049 / +3.4%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 602955 / 595178 / +1.3%
random-access/feature-vectors/uniform/vortex-tokio-local-disk 2629066 / 2609463 / +0.8%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 3046521 / 3073935 / -0.9%
random-access/nested-lists/correlated/vortex-tokio-local-disk 289634 / 288940 / +0.2%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 372684 / 361563 / +3.1%
random-access/nested-lists/uniform/vortex-tokio-local-disk 1457634 / 1485128 / -1.9%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 1627121 / 1634863 / -0.5%
random-access/nested-structs/correlated/vortex-tokio-local-disk 317910 / 325681 / -2.4%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 467899 / 466905 / +0.2%
random-access/nested-structs/uniform/vortex-tokio-local-disk 1090975 / 1006508 / +8.4%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1214103 / 1181997 / +2.7%
random-access/taxi/correlated/vortex-tokio-local-disk 795563 / 883462 / -9.9%
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1311622 / 1359350 / -3.5%
random-access/taxi/uniform/vortex-tokio-local-disk 3939422 / 3951068 / -0.3%
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4616929 / 4739332 / -2.6%
random-access/vortex-tokio-local-disk 559054 / 557153 / +0.3%
random-access/vortex-tokio-local-disk-footer 939834 / 897967 / +4.7%
random-access / parquet / ns (1.003x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8958538186 / 8772425373 / +2.1%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 9072089377 / 9201936145 / -1.4%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8997418482 / 8989720624 / +0.1%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8940742779 / 8961950771 / -0.2%
random-access/nested-lists/correlated/parquet-tokio-local-disk 138206565 / 138246489 / -0.0%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 135788701 / 138738754 / -2.1%
random-access/nested-lists/uniform/parquet-tokio-local-disk 134363410 / 134862246 / -0.4%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 135407093 / 135518441 / -0.1%
random-access/nested-structs/correlated/parquet-tokio-local-disk 20246973 / 20078558 / +0.8%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 18982285 / 19001987 / -0.1%
random-access/nested-structs/uniform/parquet-tokio-local-disk 19359318 / 18797963 / +3.0%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 19338245 / 19070379 / +1.4%
random-access/parquet-tokio-local-disk 182962241 / 180390251 / +1.4%
random-access/parquet-tokio-local-disk-footer 181807568 / 180505618 / +0.7%
random-access/taxi/correlated/parquet-tokio-local-disk 274293250 / 274894528 / -0.2%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 272937218 / 270938387 / +0.7%
random-access/taxi/uniform/parquet-tokio-local-disk 288200181 / 285870972 / +0.8%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 288955762 / 289659422 / -0.2%
random-access / lance / ns (0.993x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 21508740 / 23512648 / -8.5%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1054520 / 1103381 / -4.4%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1097649 / 1074452 / +2.2%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1844513 / 1859553 / -0.8%
random-access/lance-tokio-local-disk 628445 / 628169 / +0.0%
random-access/lance-tokio-local-disk-footer 1356800 / 1366289 / -0.7%
random-access/nested-lists/correlated/lance-tokio-local-disk 187262 / 187272 / -0.0%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 580084 / 580094 / -0.0%
random-access/nested-lists/uniform/lance-tokio-local-disk 900552 / 913529 / -1.4%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1331549 / 1328122 / +0.3%
random-access/nested-structs/correlated/lance-tokio-local-disk 311029 / 313973 / -0.9%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 456570 / 457491 / -0.2%
random-access/nested-structs/uniform/lance-tokio-local-disk 2415076 / 2404517 / +0.4%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2570837 / 2546197 / +1.0%
random-access/taxi/correlated/lance-tokio-local-disk 956830 / 951005 / +0.6%
random-access/taxi/correlated/lance-tokio-local-disk-footer 1855741 / 1882889 / -1.4%
random-access/taxi/uniform/lance-tokio-local-disk 10004398 / 9936413 / +0.7%
random-access/taxi/uniform/lance-tokio-local-disk-footer 10599608 / 10497046 / +1.0%

@github-actions

github-actions Bot commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 6a234562 vs base 68cdf004


vortex / vortex-file-compressed / ns (0.942x ➖, 5↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 1159766662 / 1233068672 / -5.9%
compress time/Bimbo 4968184680 / 4868501566 / +2.0%
compress time/CMSprovider 3926755116 / 3982576204 / -1.4%
compress time/Euro2016 437220730 / 477063320 / -8.4%
compress time/Food 418146295 / 431326061 / -3.1%
compress time/HashTags 910269799 / 898764213 / +1.3%
compress time/TPC-H l_comment canonical 1115709174 / 1166288824 / -4.3%
compress time/TPC-H l_comment chunked 1131509406 / 1151875324 / -1.8%
compress time/glove-embeddings-100k 106896873 / — / no baseline
compress time/openai-c4-embeddings-50k 847961465 / — / no baseline
compress time/taxi 566710307 / 580971080 / -2.5%
compress time/wide table cols=100 chunks=1 rows=1000 8247840 / 8481836 / -2.8%
compress time/wide table cols=100 chunks=50 rows=1000 7888692 / 8462493 / -6.8%
compress time/wide table cols=1000 chunks=1 rows=1000 83599177 / 86096102 / -2.9%
compress time/wide table cols=1000 chunks=50 rows=1000 84180853 / 83111791 / +1.3%
compress time/wide table cols=10000 chunks=1 rows=1000 966277984 / 995204493 / -2.9%
compress time/wide table cols=10000 chunks=50 rows=1000 963980140 / 992665571 / -2.9%
decompress time/Arade 21151858 / 24549590 / -13.8% 🟢
decompress time/Bimbo 74664699 / 81512985 / -8.4%
decompress time/CMSprovider 70750428 / 76175396 / -7.1%
decompress time/Euro2016 14237891 / 14628277 / -2.7%
decompress time/Food 6270021 / 6673111 / -6.0%
decompress time/HashTags 77378006 / 101834001 / -24.0% 🟢
decompress time/TPC-H l_comment canonical 33491503 / 34816235 / -3.8%
decompress time/TPC-H l_comment chunked 33542844 / 34019346 / -1.4%
decompress time/glove-embeddings-100k 5158576 / — / no baseline
decompress time/openai-c4-embeddings-50k 25350073 / — / no baseline
decompress time/taxi 11924677 / 14723670 / -19.0% 🟢
decompress time/wide table cols=100 chunks=1 rows=1000 2308977 / 2377570 / -2.9%
decompress time/wide table cols=100 chunks=50 rows=1000 2306077 / 2376007 / -2.9%
decompress time/wide table cols=1000 chunks=1 rows=1000 22772550 / 23308148 / -2.3%
decompress time/wide table cols=1000 chunks=50 rows=1000 23555664 / 23144809 / +1.8%
decompress time/wide table cols=10000 chunks=1 rows=1000 261600168 / 309096342 / -15.4% 🟢
decompress time/wide table cols=10000 chunks=50 rows=1000 254567828 / 308717010 / -17.5% 🟢
vortex / vortex-file-compressed / bytes (0.954x ➖, 4↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 141456612 / 145313924 / -2.7%
vortex-file-compressed size/Bimbo 401472428 / 466894596 / -14.0% 🟢
vortex-file-compressed size/CMSprovider 375748796 / 417691700 / -10.0% 🟢
vortex-file-compressed size/Euro2016 158179684 / 162328492 / -2.6%
vortex-file-compressed size/Food 34857744 / 41963280 / -16.9% 🟢
vortex-file-compressed size/HashTags 180655780 / 186618268 / -3.2%
vortex-file-compressed size/TPC-H l_comment canonical 167334928 / 172613296 / -3.1%
vortex-file-compressed size/TPC-H l_comment chunked 167334928 / 172613296 / -3.1%
vortex-file-compressed size/glove-embeddings-100k 68833432 / — / no baseline
vortex-file-compressed size/openai-c4-embeddings-50k 326410152 / — / no baseline
vortex-file-compressed size/taxi 46155100 / 52250516 / -11.7% 🟢
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932872 / 932656 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932872 / 932656 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9310072 / 9309856 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9310072 / 9309856 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93118072 / 93117856 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93118072 / 93117856 / +0.0%
vortex / vortex-file-compressed / ratio (0.946x ➖, 9↑ 0↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.389666638 / 0.418317094 / -6.8%
vortex:parquet-zstd ratio compress time/Bimbo 0.349609498 / 0.338271256 / +3.4%
vortex:parquet-zstd ratio compress time/CMSprovider 0.500054046 / 0.508962749 / -1.8%
vortex:parquet-zstd ratio compress time/Euro2016 0.290321284 / 0.314818728 / -7.8%
vortex:parquet-zstd ratio compress time/Food 0.460675798 / 0.473873893 / -2.8%
vortex:parquet-zstd ratio compress time/HashTags 0.373203755 / 0.366201155 / +1.9%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.304141357 / 0.317340839 / -4.2%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.309609871 / 0.313108647 / -1.1%
vortex:parquet-zstd ratio compress time/glove-embeddings-100k 0.381086286 / — / no baseline
vortex:parquet-zstd ratio compress time/openai-c4-embeddings-50k 0.23547286 / — / no baseline
vortex:parquet-zstd ratio compress time/taxi 0.410743729 / 0.428772035 / -4.2%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.29649118 / 1.32807355 / -2.4%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.25949781 / 1.35760642 / -7.2%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.10191751 / 1.15272375 / -4.4%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.11721976 / 1.10817706 / +0.8%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.23299828 / 1.26062703 / -2.2%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.21509503 / 1.25046407 / -2.8%
vortex:parquet-zstd ratio decompress time/Arade 0.029706306 / 0.0342928733 / -13.4% 🟢
vortex:parquet-zstd ratio decompress time/Bimbo 0.0387507353 / 0.0421761605 / -8.1%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.036287527 / 0.03896842 / -6.9%
vortex:parquet-zstd ratio decompress time/Euro2016 0.0330543929 / 0.033468594 / -1.2%
vortex:parquet-zstd ratio decompress time/Food 0.0280722956 / 0.029823537 / -5.9%
vortex:parquet-zstd ratio decompress time/HashTags 0.108762825 / 0.143027011 / -24.0% 🟢
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.049682763 / 0.0517221402 / -3.9%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0501489035 / 0.0502332951 / -0.2%
vortex:parquet-zstd ratio decompress time/glove-embeddings-100k 0.0285902028 / — / no baseline
vortex:parquet-zstd ratio decompress time/openai-c4-embeddings-50k 0.0161574309 / — / no baseline
vortex:parquet-zstd ratio decompress time/taxi 0.0417435416 / 0.05196059 / -19.7% 🟢
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.93847921 / 0.955021134 / -1.7%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.974250811 / 0.994037466 / -2.0%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.818475374 / 0.864646863 / -5.3%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.861000308 / 0.846293387 / +1.7%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.879331234 / 1.0207369 / -13.9% 🟢
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.832628188 / 1.02424763 / -18.7% 🟢
vortex:parquet-zstd size/Arade 0.548251093 / 0.563201087 / -2.7%
vortex:parquet-zstd size/Bimbo 1.0440946 / 1.21423563 / -14.0% 🟢
vortex:parquet-zstd size/CMSprovider 0.996983835 / 1.10827201 / -10.0% 🟢
vortex:parquet-zstd size/Euro2016 1.28626991 / 1.32000678 / -2.6%
vortex:parquet-zstd size/Food 0.97642107 / 1.17545848 / -16.9% 🟢
vortex:parquet-zstd size/HashTags 1.3531159 / 1.39777507 / -3.2%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.05668597 / 1.09001779 / -3.1%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.05668597 / 1.09001779 / -3.1%
vortex:parquet-zstd size/glove-embeddings-100k 0.924444114 / — / no baseline
vortex:parquet-zstd size/openai-c4-embeddings-50k 0.926267301 / — / no baseline
vortex:parquet-zstd size/taxi 0.83487817 / 0.945135319 / -11.7% 🟢
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00050193 / 1.00027027 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00050193 / 1.00027027 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.998505792 / 0.998482626 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.998505792 / 0.998482626 / +0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.998692278 / 0.998689961 / +0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.998692278 / 0.998689961 / +0.0%
vortex / parquet / ns (0.999x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2976304738 / 2947688942 / +1.0%
parquet_rs-zstd compress time/Bimbo 14210668512 / 14392300496 / -1.3%
parquet_rs-zstd compress time/CMSprovider 7852661422 / 7824887399 / +0.4%
parquet_rs-zstd compress time/Euro2016 1505989242 / 1515358771 / -0.6%
parquet_rs-zstd compress time/Food 907680188 / 910212753 / -0.3%
parquet_rs-zstd compress time/HashTags 2439069243 / 2454291038 / -0.6%
parquet_rs-zstd compress time/TPC-H l_comment canonical 3668390196 / 3675192975 / -0.2%
parquet_rs-zstd compress time/TPC-H l_comment chunked 3654629618 / 3678835873 / -0.7%
parquet_rs-zstd compress time/glove-embeddings-100k 280505694 / — / no baseline
parquet_rs-zstd compress time/openai-c4-embeddings-50k 3601100628 / — / no baseline
parquet_rs-zstd compress time/taxi 1379717489 / 1354964953 / +1.8%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6361663 / 6386571 / -0.4%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6263363 / 6233392 / +0.5%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 75867001 / 74689276 / +1.6%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 75348518 / 74998657 / +0.5%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 783681537 / 789451970 / -0.7%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 793337240 / 793837741 / -0.1%
parquet_rs-zstd decompress time/Arade 712032589 / 715880230 / -0.5%
parquet_rs-zstd decompress time/Bimbo 1926794379 / 1932679124 / -0.3%
parquet_rs-zstd decompress time/CMSprovider 1949717546 / 1954798166 / -0.3%
parquet_rs-zstd decompress time/Euro2016 430741265 / 437074740 / -1.4%
parquet_rs-zstd decompress time/Food 223352628 / 223753172 / -0.2%
parquet_rs-zstd decompress time/HashTags 711437993 / 711991396 / -0.1%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 674107094 / 673139875 / +0.1%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 668864953 / 677227045 / -1.2%
parquet_rs-zstd decompress time/glove-embeddings-100k 180431599 / — / no baseline
parquet_rs-zstd decompress time/openai-c4-embeddings-50k 1568942069 / — / no baseline
parquet_rs-zstd decompress time/taxi 285665196 / 283362256 / +0.8%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2460339 / 2489547 / -1.2%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2367026 / 2390259 / -1.0%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 27823134 / 26956841 / +3.2%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 27358485 / 27348446 / +0.0%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 297499006 / 302816860 / -1.8%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 305740103 / 301408568 / +1.4%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376885545 / 376885545 / +0.0%
parquet size/Euro2016 122975499 / 122975499 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133510943 / 133510943 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/glove-embeddings-100k 74459268 / — / no baseline
parquet size/openai-c4-embeddings-50k 352393042 / — / no baseline
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%

Signed-off-by: Will Manning <will@willmanning.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants