You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2016/09/03 06:44:20 UTC
[jira] [Created] (SPARK-17388) Support for inferring type
date/timestamp for partition column
Hyukjin Kwon created SPARK-17388:
------------------------------------
Summary: Support for inferring type date/timestamp for partition column
Key: SPARK-17388
URL: https://issues.apache.org/jira/browse/SPARK-17388
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.0.0
Reporter: Hyukjin Kwon
Priority: Minor
Currently, Spark only supports to infer {{IntegerType}}, {{LongType}}, {{DoubleType}} and {{StringType}}.
{{DecimalType}} is being tried but it seems it never infers type as {{DecimalType}} as {{DoubleType}} is being tried first.
Also, {{DateType}} and {{TimestampType}} can be inferred. It seems it is a pretty common to use both for a partition column.
It'd be great if they can be inferred as both rather than just {{StringType}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org