Commits

History for

Commits on Jul 1, 2026

Validate executor local directories and block ids in the external shuffle service

huaxingao
and
peter-toth
committed
[SPARK-57774][CORE] DriverLogger should not propagate log4j internal exception to caller
pan3793
committed

Commits on Jun 30, 2026

[SPARK-57695][CORE] Make TestUtils.recursiveList null-safe by reusing Utils.recursiveList

LuciferYang
authored and
MaxGekk
committed
[SPARK-56505][SQL][TEST] Add SessionQueryTest to replace SharedSparkSession

authored and
cloud-fan
committed

Commits on Jun 27, 2026

[SPARK-54879][CORE] Add final status to Spark History Server for failed executions

robreeves
authored and
Mridul Muralidharan
committed
[SPARK-57723][CORE] Enable `spark.rdd.compress` by default like PySpark
dongjoon-hyun
committed
[SPARK-57337][SS][RTM][STREAMINGSHUFFLE][PART3.5] Add streaming shuffle shared transport and error plumbing

jerrypeng
authored and
viirya
committed

Commits on Jun 25, 2026

[SPARK-56642][SQL] Add pipelined JVM-Python UDF data transfer
viirya
committed

Commits on Jun 24, 2026

[SPARK-56743][SPARK-56773][SQL][CORE][TEST] Exercise writer-stage retries in DSv2 DML metric tests and fix injection-state cleanup under AQE

juliuszsompolski
authored and
cloud-fan
committed

Commits on Jun 23, 2026

Commits on Jun 20, 2026

[SPARK-57519][CORE] Fix NoSuchElementException in ErrorClassesJsonReader.isValidErrorClass for error classes without sub-classes
LuciferYang
committed

Commits on Jun 19, 2026

[SPARK-57504][CORE] Avoid a potential NPE in `IndexShuffleBlockResolver.getChecksums` when the checksum file cannot be opened
LuciferYang
committed

Commits on Jun 17, 2026

Commits on Jun 16, 2026

[SPARK-57482][CORE][TEST] Fix flaky SparkLauncherSuite.testInProcessLauncher under CI load
dbtsai
committed

Commits on Jun 15, 2026

Commits on Jun 14, 2026

Commits on Jun 12, 2026

[SPARK-57271][PYTHON] Add capability to print locals in traceback for Python UDF
gaogaotiantian
committed

Commits on Jun 11, 2026

[SPARK-57377][INFRA] Add CI check to prevent new entries in the config binding policy exceptions file
cloud-fan
committed

Commits on Jun 9, 2026

[SPARK-57351][K8S][CORE] Enable `spark.kubernetes.executor.useDriverPodIP` by default
dongjoon-hyun
committed

Commits on Jun 8, 2026

[SPARK-56661] Addressing review comments from PR #55768

sven-weber-db
authored and
hvanhovell
committed

Commits on Jun 7, 2026

[SPARK-57141][SS][RTM][STREAMINGSHUFFLE][PART3] Add StreamingShuffleManager and MultiShuffleManager

jerrypeng
authored and
HeartSaVioR
committed

Commits on Jun 6, 2026

[SPARK-56645][CORE] Fix History Server serving stale UI after app completes

cxzl25
authored and
Mridul Muralidharan
committed

Commits on May 28, 2026

[SPARK-57117][BUILD] Upgrade `zstd-jni` to 1.5.7-9
dongjoon-hyun
committed