You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yicong Huang (Jira)" <ji...@apache.org> on 2025/09/02 20:10:00 UTC

[jira] [Created] (SPARK-53456) Python UDF traceback dump causes crashes

Yicong Huang created SPARK-53456:
------------------------------------

             Summary: Python UDF traceback dump causes crashes
                 Key: SPARK-53456
                 URL: https://issues.apache.org/jira/browse/SPARK-53456
             Project: Spark
          Issue Type: Bug
          Components: PySpark
    Affects Versions: 3.5.6, 4.1.0
            Reporter: Yicong Huang


The traceback dump feature uses process signals to capture program state. However, CUDA and other libraries also rely on process signals for their own internal operations. This can lead to conflicts where signals intended for one purpose interfere with or disrupt the other, potentially causing unexpected behavior or errors in user code.

 

{{This module contains functions to dump Python tracebacks explicitly, on a fault, after a timeout, or on a user signal. Call faulthandler.enable() to install fault handlers for the SIGSEGV, SIGFPE, SIGABRT, SIGBUS, and SIGILL signals.}}

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org