You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by Xinli shang <sh...@uber.com.INVALID> on 2020/06/23 21:09:03 UTC

Parquet sync meeting notes

Hi all,

Attendees: Gidon, Gabor, Julien, Xu, Xinli


Topics:


   1.

   Proposal for CompressionCodec Provider-aware Compression Codec (doc
   <https://docs.google.com/document/d/1ueSYq2FIzaom23cpHXppig93ylOxe8CU6EwS82dov2E/edit#heading=h.5b2qz2ba32wm>
   )
   1.

      Concern: open the door for compatibility issue
      2.

      Mitigation: We need to think about how to test it, fall back to
      standard implementation, provide enough information in metadata
like vendor
      name, version etc.


   1.

   Column Encryption
   1.

      782 <https://github.com/apache/parquet-mr/pull/782> is merged
      2.

      615 <https://github.com/apache/parquet-mr/pull/615> will be done soo
      2.

   Unifying Vectorization API


   1.

   Discussed 2-3 years ago. There will be a lot of work. But somebody can
   drive it, we still encourage it.


   1.

   Parquet 1.11.1 release.

a. Regression is found and the PR is 798
<https://github.com/apache/parquet-mr/pull/798>. We need people who are
familiar with avro to have a look.

-- 
Xinli Shang