You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Bill Schneider (Jira)" <ji...@apache.org> on 2019/09/03 02:10:00 UTC
[jira] [Created] (SPARK-28955) Support for LocalDateTime semantics
Bill Schneider created SPARK-28955:
--------------------------------------
Summary: Support for LocalDateTime semantics
Key: SPARK-28955
URL: https://issues.apache.org/jira/browse/SPARK-28955
Project: Spark
Issue Type: Wish
Components: SQL
Affects Versions: 2.3.0
Reporter: Bill Schneider
It would be great if Spark supported local times in DataFrames, rather than only instants.
The specific use case I have in mind is something like
* parse "2019-01-01 17:00" (no timezone) from CSV -> LocalDateTime in dataframe
* save to Parquet: LocalDateTime is stored with same integer value as 2019-01-01 17:00 UTC, but with isAdjustedToUTC=false. (Currently Spark saves either INT96 or TIME_MILLIS/TIME_MICROS which has isAdjustedToUTC=true)
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org