Parquet sync meeting May 2021

[Xinli shang <sh...@uber.com.INVALID>]

5/25/2021

Attendees: Xinli Shang, Gábor Szádovszky, Gidon Gershinsky

   1.

   Parquet 1.12.0 post release issues:
   1.

      Release 1.12.1? Let's wait a bit since the testing and integration is
      still going on. Better to have more fixes for the release.
      2.

      Two integer overflow issues are being reviewed.
      2.

   INT96 issue (Parquet-2037) - fixed and merged
   3.

   1.13.0 planning ideas brainstorming
   1.

      ID resolution instead of name
      2.

      Iceberg filtering / V2 api
      3.

      Adopt Arrow as data model
      4.

      Vectorization API
      5.

      Unified file encryption
      6.

      Data masking(null)


-- 
Xinli Shang, Tech Lead Manager at Uber Data Infra

Re: Parquet sync meeting May 2021

[Micah Kornfield <em...@gmail.com>]

>
>  Iceberg filtering / V2 api
>       3.
>       Adopt Arrow as data model


Curious if more notes, or discussion around the two points above will
happen on the mailing list?  Or are there relevant JIRAs?

Thanks,
Micah



On Tue, May 25, 2021 at 9:45 AM Xinli shang <sh...@uber.com.invalid> wrote:

> 5/25/2021
>
> Attendees: Xinli Shang, Gábor Szádovszky, Gidon Gershinsky
>
>    1.
>
>    Parquet 1.12.0 post release issues:
>    1.
>
>       Release 1.12.1? Let's wait a bit since the testing and integration is
>       still going on. Better to have more fixes for the release.
>       2.
>
>       Two integer overflow issues are being reviewed.
>       2.
>
>    INT96 issue (Parquet-2037) - fixed and merged
>    3.
>
>    1.13.0 planning ideas brainstorming
>    1.
>
>       ID resolution instead of name
>       2.
>
>       Iceberg filtering / V2 api
>       3.
>
>       Adopt Arrow as data model
>       4.
>
>       Vectorization API
>       5.
>
>       Unified file encryption
>       6.
>
>       Data masking(null)
>
>
> --
> Xinli Shang, Tech Lead Manager at Uber Data Infra
>