You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/20 10:22:00 UTC

[jira] [Created] (SPARK-41597) Improve PySpark errors

Haejoon Lee created SPARK-41597:
-----------------------------------

             Summary: Improve PySpark errors
                 Key: SPARK-41597
                 URL: https://issues.apache.org/jira/browse/SPARK-41597
             Project: Spark
          Issue Type: Umbrella
          Components: PySpark
    Affects Versions: 3.4.0
            Reporter: Haejoon Lee


This ticket aims to introduce new PySpark framework to centralize the PySpark error message into single path and improve the error message more actionable and consistency.

This umbrella JIRA might includes:
 * Introduce new error framework for PySpark
 * Migrate existing errors generated by Python driver into error classes.
 * Migrate existing errors generated by Python worker into error classes.
 * Migrate existing errors generated by Py4J into error classes.
 * Introduce test utils for testing errors by its error class instead of error messages.
 * Improve the error messages.
 * Documentation for PySpark error framework.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org