You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by gu...@apache.org on 2024/04/24 00:47:47 UTC

(spark) branch master updated (390fb7429029 -> e8f529bb89a6)

This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


    from 390fb7429029 [SPARK-47941][SS][CONNECT] Propagate ForeachBatch worker initialization errors to users for PySpark
     add e8f529bb89a6 Revert "[SPARK-45302][PYTHON] Remove PID communication between Python workers when no demon is used"

No new revisions were added by this update.

Summary of changes:
 core/src/main/scala/org/apache/spark/SparkEnv.scala           |  4 ++--
 .../main/scala/org/apache/spark/api/python/PythonRunner.scala | 10 +++++-----
 .../org/apache/spark/api/python/PythonWorkerFactory.scala     | 11 ++++++-----
 python/pyspark/daemon.py                                      |  4 ++--
 .../sql/connect/streaming/worker/foreach_batch_worker.py      |  2 ++
 .../pyspark/sql/connect/streaming/worker/listener_worker.py   |  2 ++
 python/pyspark/sql/worker/analyze_udtf.py                     |  3 +++
 python/pyspark/worker.py                                      |  3 +++
 .../apache/spark/sql/execution/python/PythonArrowOutput.scala |  2 +-
 .../apache/spark/sql/execution/python/PythonUDFRunner.scala   |  2 +-
 10 files changed, 27 insertions(+), 16 deletions(-)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org