You are viewing a plain text version of this content. The canonical link for it is here.
Posted to gitbox@hive.apache.org by GitBox <gi...@apache.org> on 2021/06/08 22:34:59 UTC

[GitHub] [hive] zabetak opened a new pull request #2370: HIVE-25219: Backward incompatible timestamp serialization in Avro for certain timezones

zabetak opened a new pull request #2370:
URL: https://github.com/apache/hive/pull/2370


   ### What changes were proposed in this pull request?
   1. Add new read/write config properties to control legacy zone conversions in Avro.
   2. Exploit file metadata and property to choose between new/old conversion rules.
   
   ### Why are the changes needed?
   Provide the end-users the possibility to write backward compatible timestamps in Parquet files so that files can be read correctly by older versions.
   
   ### Does this PR introduce _any_ user-facing change?
   No
   
   ### How was this patch tested?
   1. New qtests for writting Avro timestamps (`avro_write_legacy_timestamp.q`, `avro_write_new_timestamp.q`)
   2. Manual tests
   * Export Avro table with current Hive version setting `hive.avro.timestamp.write.legacy.conversion.enabled=true`
   * Read from external Parquet table with Hive 2 (commit 324f9fa)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org

[GitHub] [hive] aasha merged pull request #2370: HIVE-25219: Backward incompatible timestamp serialization in Avro for certain timezones

Posted by GitBox <gi...@apache.org>.
aasha merged pull request #2370:
URL: https://github.com/apache/hive/pull/2370


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org