You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2016/09/03 06:44:20 UTC

[jira] [Created] (SPARK-17388) Support for inferring type date/timestamp for partition column

Hyukjin Kwon created SPARK-17388:
------------------------------------

             Summary: Support for inferring type date/timestamp for partition column
                 Key: SPARK-17388
                 URL: https://issues.apache.org/jira/browse/SPARK-17388
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.0.0
            Reporter: Hyukjin Kwon
            Priority: Minor


Currently, Spark only supports to infer {{IntegerType}}, {{LongType}}, {{DoubleType}} and {{StringType}}.

{{DecimalType}} is being tried but it seems it never infers type as {{DecimalType}} as {{DoubleType}} is being tried first.

Also, {{DateType}} and {{TimestampType}} can be inferred. It seems it is a pretty common to use both for a partition column.

It'd be great if they can be inferred as both rather than just {{StringType}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org