You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Gengliang Wang (Jira)" <ji...@apache.org> on 2024/03/18 18:55:00 UTC

[jira] [Created] (SPARK-47447) Allow reading Parquet TimestampLTZ as TimestampNTZ

Gengliang Wang created SPARK-47447:
--------------------------------------

             Summary: Allow reading Parquet TimestampLTZ as TimestampNTZ
                 Key: SPARK-47447
                 URL: https://issues.apache.org/jira/browse/SPARK-47447
             Project: Spark
          Issue Type: Sub-task
          Components: SQL
    Affects Versions: 4.0.0
            Reporter: Gengliang Wang
            Assignee: Gengliang Wang


Currently, Parquet TimestampNTZ type columns can be read as TimestampLTZ, while reading TimestampLTZ as TimestampNTZ will cause errors. This makes it impossible to read parquet files containing both TimestampLTZ and TimestampNTZ as TimestampNTZ.

To make the data type system on Parquet simpler, we should allow reading TimestampLTZ as TimestampNTZ in the Parquet data source.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org