You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Maxim Gekk (Jira)" <ji...@apache.org> on 2020/10/15 11:57:00 UTC

[jira] [Created] (SPARK-33160) Allow saving/loading INT96 in parquet w/o rebasing

Maxim Gekk created SPARK-33160:
----------------------------------

             Summary: Allow saving/loading INT96 in parquet w/o rebasing
                 Key: SPARK-33160
                 URL: https://issues.apache.org/jira/browse/SPARK-33160
             Project: Spark
          Issue Type: New Feature
          Components: SQL
    Affects Versions: 3.1.0
            Reporter: Maxim Gekk


Currently, Spark always performs rebasing of INT96 columns in Parquet datasource but this is not required by parquet spec. This tickets aims to allow users to turn off rebasing via SQL config.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org