[jira] [Closed] (SPARK-11995) Partitioning Parquet by DateType

["Hyukjin Kwon (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon closed SPARK-11995.
--------------------------------
    Resolution: Duplicate

As SPARK-17388 has a PR, I will mark this as duplicate. Please reopen if you feel strongly this is not a duplicate.

> Partitioning Parquet by DateType
> --------------------------------
>
>                 Key: SPARK-11995
>                 URL: https://issues.apache.org/jira/browse/SPARK-11995
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 1.5.2
>            Reporter: Jack Arenas
>            Priority: Minor
>
> ... After writing to s3 and partitioning by a DateType column, reads on the parquet "table" (i.e. s3n://s3_bucket_url/table where date partitions break the table into date-based s3n://s3_bucket_url/table/date=2015-11-25 chunks) will show the partitioned date column as a StringType...
> https://github.com/databricks/spark-redshift/issues/122



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org