You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "王俊博 (Jira)" <ji...@apache.org> on 2024/04/03 08:08:00 UTC

[jira] [Created] (SPARK-47707) Special handling of JSON type for MySQL connector

王俊博 created SPARK-47707:
---------------------------

             Summary: Special handling of JSON type for MySQL connector
                 Key: SPARK-47707
                 URL: https://issues.apache.org/jira/browse/SPARK-47707
             Project: Spark
          Issue Type: Sub-task
          Components: SQL
    Affects Versions: 3.4.0
         Environment: mysql-connector-java-5.1.49.jar

spark-3.5.0
            Reporter: 王俊博


MySQL JDBC drivers `mysql-connector-java-5.1.49.jar` converts JSON type into Types.CHAR with a precision of Int.Max.
When receiving CHAR with Int.Max precision, Spark executor will throw an error of {{java.lang.OutOfMemoryError: Requested array size exceeds VM limit }}.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org