You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yicong Huang (Jira)" <ji...@apache.org> on 2025/09/02 20:10:00 UTC
[jira] [Created] (SPARK-53456) Python UDF traceback dump causes crashes
Yicong Huang created SPARK-53456:
------------------------------------
Summary: Python UDF traceback dump causes crashes
Key: SPARK-53456
URL: https://issues.apache.org/jira/browse/SPARK-53456
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 3.5.6, 4.1.0
Reporter: Yicong Huang
The traceback dump feature uses process signals to capture program state. However, CUDA and other libraries also rely on process signals for their own internal operations. This can lead to conflicts where signals intended for one purpose interfere with or disrupt the other, potentially causing unexpected behavior or errors in user code.
{{This module contains functions to dump Python tracebacks explicitly, on a fault, after a timeout, or on a user signal. Call faulthandler.enable() to install fault handlers for the SIGSEGV, SIGFPE, SIGABRT, SIGBUS, and SIGILL signals.}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org