You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/10/16 11:27:00 UTC

[jira] [Created] (SPARK-45551) Enchance PySpark testing utils

Haejoon Lee created SPARK-45551:
-----------------------------------

             Summary: Enchance PySpark testing utils
                 Key: SPARK-45551
                 URL: https://issues.apache.org/jira/browse/SPARK-45551
             Project: Spark
          Issue Type: Umbrella
          Components: PySpark
    Affects Versions: 4.0.0
            Reporter: Haejoon Lee


We have added several testing utils for PySpark testing: [https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.testing.assertDataFrameEqual.html.]

We might need to enhance the functionality of those functions to make testing easier for users. The existing testing utils could be enhanced by:
 * Adding new parameters to the existing utils
 * Returning a debuggable object for failed assertions

and any other suggestions are welcome.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org