You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/20 08:16:00 UTC

[jira] [Created] (SPARK-25160) Remove sql configuration spark.sql.avro.outputTimestampType

Gengliang Wang created SPARK-25160:
--------------------------------------

             Summary: Remove sql configuration spark.sql.avro.outputTimestampType
                 Key: SPARK-25160
                 URL: https://issues.apache.org/jira/browse/SPARK-25160
             Project: Spark
          Issue Type: Sub-task
          Components: SQL
    Affects Versions: 2.4.0
            Reporter: Gengliang Wang


In the PR for supporting logical timestamp types [https://github.com/apache/spark/pull/21935,] a SQL configuration spark.sql.avro.outputTimestampType is added, so that user can specify the output timestamp precision they want.

With PR [https://github.com/apache/spark/pull/21847,]  the output file can be written with user specified types. 

So no need to have such configuration. Otherwise to make it consistent we need to add configuration for all the Catalyst types that can be converted into different Avro types. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org