You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Fanyue Xia (Jira)" <ji...@apache.org> on 2024/05/01 20:14:00 UTC

[jira] [Created] (SPARK-48075) Enforce type checking in from_avro and to_avro functions

Fanyue Xia created SPARK-48075:
----------------------------------

             Summary: Enforce type checking in from_avro and to_avro functions
                 Key: SPARK-48075
                 URL: https://issues.apache.org/jira/browse/SPARK-48075
             Project: Spark
          Issue Type: Improvement
          Components: Structured Streaming
    Affects Versions: 4.0.0
            Reporter: Fanyue Xia


Because types are not enforced in Python, users can pass in all sort of arguments for functions. This could lead to invoking wrong functions in spark connect.

If we perform type checking for arguments and output sensible errors when the type of arguments passed into the functions don’t match, we can give the user a better user experience



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org