You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Cheng Lian (JIRA)" <ji...@apache.org> on 2015/08/11 08:55:45 UTC
[jira] [Comment Edited] (SPARK-8824) Support Parquet logical types
TIMESTAMP_MILLIS and TIMESTAMP_MICROS
[ https://issues.apache.org/jira/browse/SPARK-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681331#comment-14681331 ]
Cheng Lian edited comment on SPARK-8824 at 8/11/15 6:55 AM:
------------------------------------------------------------
Oh sorry, I meant to say {{TIMESTAMP_MICROS}} and I mistook your request for {{TIMESTAMP_MICROS}}. I'm afraid it's already too late for 1.5. Another thing is that, Spark SQL 1.5 now only has microsecond precision, so even if we support {{TIMESTAMP_MILLIS}} in 1.6, we'll probably only read Parquet {{TIMESTAMP_MILLIS}} values and convert them to microsecond timestamps.
was (Author: lian cheng):
Oh sorry, I mistook your request for {{TIMESTAMP_MICROS}}. I'm afraid it's already too late for 1.5. Another thing is that, Spark SQL 1.5 now only has microsecond precision, so even if we support {{TIMESTAMP_MILLIS}} in 1.6, we'll probably only read Parquet {{TIMESTAMP_MILLIS}} values and convert them to microsecond timestamps.
> Support Parquet logical types TIMESTAMP_MILLIS and TIMESTAMP_MICROS
> -------------------------------------------------------------------
>
> Key: SPARK-8824
> URL: https://issues.apache.org/jira/browse/SPARK-8824
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 1.5.0
> Reporter: Cheng Lian
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org