You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "pitrou (via GitHub)" <gi...@apache.org> on 2023/05/31 14:25:10 UTC

[GitHub] [parquet-format] pitrou commented on pull request #164: PARQUET-1950: Define core features

pitrou commented on PR #164:
URL: https://github.com/apache/parquet-format/pull/164#issuecomment-1570342348

   Wild idea: instead of defining core features, how about rephrasing this in terms of _presets_?
   
   We could have a growing number of calendar-versioned presets, example:
   * Preset 2023.06 : v2 data pages + delta encodings + ZSTD + Snappy + ZLib (+ logical types etc.)
   * Preset 2024.11 : the former + byte stream split encoding  + LZ4_RAW
   * ...
   
   I'm also skeptical that this needs to be advertised in the Thrift metadata. Presets would mostly serve as a guideline for implementations and as an API simplification for users.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@parquet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org