You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Tianhan Hu (Jira)" <ji...@apache.org> on 2023/04/05 18:11:00 UTC

[jira] [Created] (SPARK-43040) Improve TimestampNTZ support in JDBC data source

Tianhan Hu created SPARK-43040:
----------------------------------

             Summary: Improve TimestampNTZ support in JDBC data source
                 Key: SPARK-43040
                 URL: https://issues.apache.org/jira/browse/SPARK-43040
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.3.3, 3.4.0
            Reporter: Tianhan Hu


[https://github.com/apache/spark/pull/36726] supports TimestampNTZ type in JDBC data source and [https://github.com/apache/spark/pull/37013] applies a fix to pass more test cases with H2.

The problem is that Java Timestamp is a poorly defined class and different JDBC drivers implement "getTimestamp" and "setTimestamp" with different expected behaviors in mind. The general conversion implementation would work with some JDBC dialects and their drivers but not others.

This issue is discovered when testing with PostgreSQL database.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org