You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Snoot.io (Jira)" <ji...@apache.org> on 2023/07/06 04:09:00 UTC
[jira] [Commented] (SPARK-44280) Add convertJavaTimestampToTimestamp in JDBCDialect API
[ https://issues.apache.org/jira/browse/SPARK-44280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740393#comment-17740393 ]
Snoot.io commented on SPARK-44280:
----------------------------------
User 'mingkangli-db' has created a pull request for this issue:
https://github.com/apache/spark/pull/41843
> Add convertJavaTimestampToTimestamp in JDBCDialect API
> ------------------------------------------------------
>
> Key: SPARK-44280
> URL: https://issues.apache.org/jira/browse/SPARK-44280
> Project: Spark
> Issue Type: New Feature
> Components: Spark Core
> Affects Versions: 3.5.0
> Reporter: Mingkang Li
> Priority: Major
>
> A new method, {{{}convertJavaTimestampToTimestamp{}}}, is introduced to the JDBCDialects API, providing the capability for JDBC dialects to override the default Java timestamp conversion behavior. This enhancement is particularly beneficial for databases such as PostgreSQL, which feature special values for timestamps representing positive and negative infinity.
> The pre-existing default behavior of timestamp conversion potentially triggers an overflow due to these special values (i.e. The executor would crash if you select a column that contains infinity timestamps in PostgreSQL.) By integrating this new function, we can mitigate such issues, enabling more versatile and robust timestamp value conversions across various JDBC-based connectors.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org