All pull requests

Pull requests

• perf: reuse LZ4 frame encoder state across shuffle blocks

  #7606·JonSnow1807 opened Nov 11, 2026·

  ·

• test: state each integral-digit limit case once and call the count in the bound test

  #7605·snmvaughan opened Nov 11, 2026Contributor·

  ·
  1

• feat: sign native Iceberg writes with an explicit S3A provider list and translate S3A encryption

  area:Icebergarea:writerenhancementrun-iceberg-tests
  #7604·comphead opened Nov 11, 2026Contributor·

  ·
  1

• feat: admit native Iceberg write settings that iceberg-java's writer ignores

  area:Icebergarea:writerenhancementrun-iceberg-tests
  #7603·comphead opened Nov 11, 2026Contributor·

  ·
  1

• fix: include the license for bundled protobuf-java

  bug
  #7602·manuzhang opened Nov 11, 2026Member·

  ·

• feat: add a native kernel for Delta's InterleaveBits

  #7600·dwsmith1983 opened Nov 11, 2026Contributor·

  ·
  1

• fix: wrap legacy scalar negation of signed integer minimum values

  #7599·1fanwang opened Nov 11, 2026Contributor·

  ·
  1

• feat: add native MIN/MAX Parquet reader filtering 1/n

  area:joinsenhancement
  #7598·pingzh opened Nov 10, 2026Contributor·

  ·
  14

• feat(delta): run Delta InterleaveBits natively

  #7597·ErikBPF opened Nov 10, 2026Contributor·

  ·
  5

• build(deps-dev): bump org.bouncycastle:bcprov-jdk18on from 1.78.1 to 1.85 in /spark

  dependenciesjava
  #7595·dependabot[bot] opened Nov 10, 2026Bot·

  ·
  2

• feat(delta): pair Spark 4.2 with Delta 4.4.1

  #7593·ErikBPF opened Nov 10, 2026Contributor·

  ·
  1

  1

• test: exercise folded UnsafeArrayData literals

  enhancementtest
  #7592·narutomanchester opened Nov 10, 2026·

  ·
  1

• fix: evaluate a NULL-guarded argument for every row when only shared parts of it can fail

  #7590·dwsmith1983 opened Nov 10, 2026Contributor·

  ·
  1

• fix: let a NULL-guarded argument skip a shared subexpression that cannot fail

  #7589·dwsmith1983 opened Nov 10, 2026Contributor·

  ·

• fix: send a skipped shared subexpression to Spark where Spark's sharing depends on the plan

  #7586·dwsmith1983 opened Nov 10, 2026Contributor·

  ·

• fix: report input and SQL metrics while a native shuffle write runs

  area:shufflebug
  #7584·comphead opened Nov 10, 2026Contributor·

  ·
  1

  3

• fix: leave wide integer truncate to Spark

  #7580·ErikBPF opened Nov 9, 2026Contributor·

  ·
  1

• fix: accept second-precision zone offsets in native timestamp casts

  #7579·ErikBPF opened Nov 9, 2026Contributor·

  ·
  1

  4

• feat: [DO NOT MERGE] native Iceberg reads of unshredded Variant columns

  area:Icebergarea:scanenhancementrun-iceberg-tests
  #7575·mbutrovich opened Nov 9, 2026Contributor·

  ·
  

• refactor: factor out map-entry hashing loops into hash_map_entries!

  #7569·jinjin1919 opened Nov 8, 2026·

  ·
  3

• feat: warn about unrecognized spark.comet configuration keys

  #7568·tlfua opened Nov 8, 2026·

  ·
  1

• fix: warn about the deprecated memoryPool.fraction when it is set on the session

  #7567·tlfua opened Nov 8, 2026·

  ·

• fix: share the grouping key type checks between doConvert and canAggregateBeConverted

  #7566·tlfua opened Nov 8, 2026·

  ·
  1

• fix: keep URL passwords and query strings out of rejected path reasons

  #7565·dwsmith1983 opened Nov 7, 2026Contributor·

  ·
  1

• fix: keep URL query strings and passwords out of native Delta errors

  area:Deltaarea:scanbug
  #7562·dwsmith1983 opened Nov 7, 2026Contributor·

  ·