[GitHub] [parquet-format] nevi-me edited a comment on pull request #165: PARQUET-675: Specify Interval LogicalType

[GitBox <gi...@apache.org>]

nevi-me edited a comment on pull request #165:
URL: https://github.com/apache/parquet-format/pull/165#issuecomment-767132481


   Thanks for the responses, I'll look at the interval vs duration support in more detail in the coming weeks, and rather put together a Google doc for discussion in the Parquet mailing list.
   
   > The existing interval type seems reasonable in parquet.
   
   It's reasonable for converted types, but has no equivalent logical type. While this is still fine as we have to write converted types in the metadata for backwards-compatibility, it still means that one has to write a 4-byte value into a 12-byte FLA in order for the converted type to make sense when being read by another application.
   
   The Arrow schema is binary, so in the long-run I wouldn't expect a non-Arrow reader to care about it. So, I was trying to approach adding INTERVAL to logical types, so that one could drop the INTERVAL converted type, as it wouldn't be correct to map Logical::INTERVAL to Converted::INTERVAL.
   
   I'll research this subject, read and write files with v2 of the writer, and come back with observations.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org