You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Mingliang Liu (Jira)" <ji...@apache.org> on 2022/12/22 08:23:00 UTC
[jira] [Updated] (FLINK-30483) Make Avro format support for TIMESTAMP_LTZ

     [ https://issues.apache.org/jira/browse/FLINK-30483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mingliang Liu updated FLINK-30483:
----------------------------------
    Description: 
Currently Avro format does not support TIMESTAMP_LTZ (short for TIMESTAMP_WITH_LOCAL_TIME_ZONE) type. Avro 1.10+ introduces local timestamp logic type (both milliseconds and microseconds), see [spec||https://avro.apache.org/docs/1.10.2/spec.html#Local+timestamp+%28millisecond+precision%29]. As TIMESTAMP currently only supports milliseconds, we can make TIMESTAMP_LTZ support milliseconds first.

A related work is to support microseconds, and there is already work-in-progress Jira FLINK-23589 for TIMESTAMP type. We can consolidate the effort or track that separately for TIMESTAMP_LTZ.

  was:
Currently Avro format does not support TIMESTAMP_LTZ (short for TIMESTAMP_WITH_LOCAL_TIME_ZONE) type. Avro 1.10+ introduces local timestamp logic type (both milliseconds and microseconds), see [spec||https://avro.apache.org/docs/1.10.2/spec.html#Local+timestamp+%28millisecond+precision%29]. As TIMESTAMP currently only supports milliseconds, we can make TIMESTAMP_LTZ support milliseconds first.

A related work is to support microseconds, and there is already work-in-progress Jira [[FLINK-23589]] for TIMESTAMP type. We can consolidate the effort or track that separately for TIMESTAMP_LTZ.


> Make Avro format support for TIMESTAMP_LTZ
> ------------------------------------------
>
>                 Key: FLINK-30483
>                 URL: https://issues.apache.org/jira/browse/FLINK-30483
>             Project: Flink
>          Issue Type: Improvement
>          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
>    Affects Versions: 1.16.0
>            Reporter: Mingliang Liu
>            Priority: Major
>
> Currently Avro format does not support TIMESTAMP_LTZ (short for TIMESTAMP_WITH_LOCAL_TIME_ZONE) type. Avro 1.10+ introduces local timestamp logic type (both milliseconds and microseconds), see [spec||https://avro.apache.org/docs/1.10.2/spec.html#Local+timestamp+%28millisecond+precision%29]. As TIMESTAMP currently only supports milliseconds, we can make TIMESTAMP_LTZ support milliseconds first.
> A related work is to support microseconds, and there is already work-in-progress Jira FLINK-23589 for TIMESTAMP type. We can consolidate the effort or track that separately for TIMESTAMP_LTZ.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)