Repository navigation

fix: bound spill batches by bytes and remove the halving re-spill from the spill merge - #25910

Draft

adriangb wants to merge 7 commits into

apache:mainfrom

adriangb:spill-max-batch-bytes

Draft

fix: bound spill batches by bytes and remove the halving re-spill from the spill merge#25910
adriangb wants to merge 7 commits into
apache:mainfrom
adriangb:spill-max-batch-bytes

Commits on Nov 10, 2026
- test: external sort over wide rows under a memory limit
  adriangb
  committed
  d2a226a
- bench: external sort that spills under a memory limit
  
  adriangb
  and
  claude
  committed
  fadebbb
- refactor: return the row count of the written spill batch
  
  adriangb
  and
  claude
  committed
  071e968
- fix: bound spill file batches by bytes so external sorts over wide rows can merge
  
  adriangb
  and
  claude
  committed
  7f525fc
- test: the oversized-batch sort fuzz test no longer needs a re-spill
  
  adriangb
  and
  claude
  committed
  b032fab
- fix: bound aggregate spill batches by the memory of the first spill
  
  adriangb
  and
  claude
  committed
  65d3c87
- refactor: delete the halving re-spill and the per-run limits of the spill merge
  
  committed
  4253f74