You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Maxim Gekk (Jira)" <ji...@apache.org> on 2020/05/23 05:38:00 UTC
[jira] [Updated] (SPARK-31802) Format Java date-time types in
Row.jsonValue directly
[ https://issues.apache.org/jira/browse/SPARK-31802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Maxim Gekk updated SPARK-31802:
-------------------------------
Description: Row.jsonValue has to convert incoming Java date/timestamps types to days/microseconds because DateFormatter/TimestampFormatter APIs didn't accept java.sql.Timestamp/java.util.Date and java.time.Instant/java.time.LocalDate before . Internally, the formatters perform conversions to Java types again. This badly impacts on the performance. The ticket aims to add new APIs to DateFormatter and TimestampFormatter that should accept Java types. (was: HiveResult.toHiveString has to convert incoming Java date/timestamps types to days/microseconds because existing API of DateFormatter/TimestampFormatter don't accept java.sql.Timestamp/java.util.Date and java.time.Instant/java.time.LocalDate. Internally, the formatters perform conversions to Java types again. This badly impacts on the performance. The ticket aims to add new APIs to DateFormatter and TimestampFormatter that should accept Java types.)
> Format Java date-time types in Row.jsonValue directly
> -----------------------------------------------------
>
> Key: SPARK-31802
> URL: https://issues.apache.org/jira/browse/SPARK-31802
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 3.0.0, 3.1.0
> Reporter: Maxim Gekk
> Assignee: Maxim Gekk
> Priority: Major
> Fix For: 3.0.0
>
>
> Row.jsonValue has to convert incoming Java date/timestamps types to days/microseconds because DateFormatter/TimestampFormatter APIs didn't accept java.sql.Timestamp/java.util.Date and java.time.Instant/java.time.LocalDate before . Internally, the formatters perform conversions to Java types again. This badly impacts on the performance. The ticket aims to add new APIs to DateFormatter and TimestampFormatter that should accept Java types.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org