You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by sh...@uber.com.INVALID on 2019/10/17 16:33:56 UTC
Parquet Sync - 10/17/2019 - Meeting Notes
10/17/2019
Attendee:
Gidon
Gabor
Ryan
Karfiol
Xinli
Topics:
Column Encryption
For C++ version, Gidon worked with Deepak to have reviews going on.
For Java, we are blocked on the Parquet-11 release. Gabor proposed to have
branch the Parquet-11 and then merge later. But we would need to be in
master as the final step.
Bloom Filter
Next step is to wait for the Parquet-11 release
Parquet-11 Validation
Ryan - the release can go ahead without me if there are enough PMCs
Gabor - I will try to push this effort in a couple of weeks
Ongoing Parquet Work
There is some work to create PR shortly to optimize Parquet usage of byte
buffer, ParallelIzation, S3 reading, etc.
Xinli Shang (Uber)
Title: Parquet Sync - Monthly(every 3rd thursday)
Hi all,This is an invitation for the next occasion of the regular sync
meeting of the Parquet community.Xinli Shang Join Zoom
Meetinghttps://uber.zoom.us/j/112318682One tap
mobile+16699006833,,112318682# US (San Jose)+16468769923,,112318682# US
(New York)Dial by your
location +1 669 900 6833 US
(San Jose) +1 646 876 9923
US (New York) 855 880 1246
US Toll-free 877 369 0926 US
Toll-freeMeeting ID: 112 318 682Find your local number:
https://zoom.us/u/aZKZunOZ9Join by SIP112318682@zoomcrc.comJoin by
H.323162.255.37.11 (US West)162.255.36.11 (US East)221.122.88.195
(China)115.114.131.7 (India)213.19.144.110 (EMEA)103.122.166.55
(Australia)209.9.211.110 (Hong Kong)64.211.144.160 (Brazil)69.174.57.160
(Canada)207.226.132.110 (Japan)Meeting ID: 112 318 682
When: Thu Oct 17, 2019 9am – 10am Pacific Time - Los Angeles
Where: https://uber.zoom.us/j/112318682, SEA | 1191 2nd Ave-8th-Whidbey (7)
[Zoom]
Who:
* shangx@uber.com - organizer
* shri.hariharasubrahmanian@oracle.com
* nongli@gmail.com
* robertk@palantir.com
* szonyi.anna@gmail.com
* szonyi@cloudera.com
* m.lacour@criteo.com
* csringhofer@cloudera.com
* rzamora@nvidia.com
* boroknagyz@cloudera.com
* bikramjeet.vig@cloudera.com
* dev@parquet.apache.org
* danielshir@gmail.com
* smanik.im@gmail.com
* nkollar@cloudera.com
* venkik@uber.com
* q.xu@criteo.com
* jimmyjchen@tencent.com
* vercegovac@cloudera.com
* Xu, Cheng A
* aniket486@gmail.com
* jbapple@cloudera.com
* Julien Le Dem
* aphadke@cloudera.com
* yaliangw@twitter.com
* marcelk@gmail.com
* mark.marsh@kognitio.com
* santlal.gupta@bitwiseglobal.com
* Daniel Weeks
* wesmckinn@gmail.com
* sunchao@apache.org
* j.coffey@criteo.com
* Reynold Xin
* Ryan Blue
* Lars Volker
* alexlevenson@twitter.com
* jacques@apache.org
* Sergio Pena
* gg5070@gmail.com
* fnothaft@berkeley.edu
* lukas.nalezenec@gmail.com
* m.liroz@criteo.com
* stakiar@cloudera.com
* smoy@yelp.com
* o.kaidannik@criteo.com
* altekrusejason@gmail.com
* brian.bowman@sas.com
* julien.ledem@gmail.com
* Mohammad Islam
* gabor.szadovszky@cloudera.com
* andy.grove@rms.com
* Wei Han
* yumwang@ebay.com
* baliga@uber.com
* ippokratis@gmail.com
* Pavi Subenderan
* Zoltan Ivanfi
* b.hanotte@criteo.com
* dam6923@gmail.com
* majeti.deepak@gmail.com
* Parth Chandra
* Mohit Sabharwal
* nilangekar.pooja@gmail.com
* xhochy@gmail.com
* goreckim@amazon.com
Re: Parquet Sync - 10/17/2019 - Meeting Notes
Posted by Julien Le Dem <ju...@wework.com.INVALID>.
Thanks for the notes. Sorry I missed the sync because of a conflict.
On Thu, Oct 17, 2019 at 10:00 AM Gidon Gershinsky <gg...@gmail.com> wrote:
> A slight correction re C++. I said the following
> C++ work is near completion/merge. Deepark has reviewed it and made
> additional changes / refactoring.
>
> On Thu, Oct 17, 2019 at 7:33 PM <sh...@uber.com> wrote:
>
>> 10/17/2019
>>
>> Attendee:
>> Gidon
>> Gabor
>> Ryan
>> Karfiol
>> Xinli
>>
>> Topics:
>>
>> Column Encryption
>> For C++ version, Gidon worked with Deepak to have reviews going on.
>> For Java, we are blocked on the Parquet-11 release. Gabor proposed to
>> have branch the Parquet-11 and then merge later. But we would need to be in
>> master as the final step.
>>
>> Bloom Filter
>> Next step is to wait for the Parquet-11 release
>>
>> Parquet-11 Validation
>> Ryan - the release can go ahead without me if there are enough PMCs
>> Gabor - I will try to push this effort in a couple of weeks
>>
>> Ongoing Parquet Work
>> There is some work to create PR shortly to optimize Parquet usage of byte
>> buffer, ParallelIzation, S3 reading, etc.
>>
>> Xinli Shang (Uber)
>>
>> Parquet Sync - Monthly(every 3rd thursday)
>> Hi all,
>>
>> This is an invitation for the next occasion of the regular sync meeting
>> of the Parquet community.
>>
>> Xinli Shang
>>
>> Join Zoom Meeting
>> https://uber.zoom.us/j/112318682
>> <https://www.google.com/url?q=https%3A%2F%2Fuber.zoom.us%2Fj%2F112318682&sa=D&ust=1571762036500000&usg=AFQjCNFLMC07ke-eJw4pjYYwN8FsCtnzMA>
>>
>> One tap mobile
>> +16699006833,,112318682# US (San Jose)
>> +16468769923,,112318682# US (New York)
>>
>> Dial by your location
>> +1 669 900 6833 US (San Jose)
>> +1 646 876 9923 US (New York)
>> 855 880 1246 US Toll-free
>> 877 369 0926 US Toll-free
>> Meeting ID: 112 318 682
>> Find your local number: https://zoom.us/u/aZKZunOZ9
>> <https://www.google.com/url?q=https%3A%2F%2Fzoom.us%2Fu%2FaZKZunOZ9&sa=D&ust=1571762036501000&usg=AFQjCNH-GaE-r1Fxk3iTw0cJgIRhbUP1JA>
>>
>> Join by SIP
>> 112318682@zoomcrc.com
>>
>> Join by H.323
>> 162.255.37.11 (US West)
>> 162.255.36.11 (US East)
>> 221.122.88.195 (China)
>> 115.114.131.7 (India)
>> 213.19.144.110 (EMEA)
>> 103.122.166.55 (Australia)
>> 209.9.211.110 (Hong Kong)
>> 64.211.144.160 (Brazil)
>> 69.174.57.160 (Canada)
>> 207.226.132.110 (Japan)
>> Meeting ID: 112 318 682
>> *When*
>> Thu Oct 17, 2019 9am – 10am Pacific Time - Los Angeles
>>
>> *Where*
>> https://uber.zoom.us/j/112318682, SEA | 1191 2nd Ave-8th-Whidbey (7)
>> [Zoom] (map
>> <https://www.google.com/maps/search/https:%2F%2Fuber.zoom.us%2Fj%2F112318682,+SEA+%7C+1191+2nd+Ave-8th-Whidbey+%287%29+%5BZoom%5D?hl=en>
>> )
>>
>> *Who*
>> •
>> shangx@uber.com - organizer
>> •
>> shri.hariharasubrahmanian@oracle.com
>> •
>> nongli@gmail.com
>> •
>> robertk@palantir.com
>> •
>> szonyi.anna@gmail.com
>> •
>> szonyi@cloudera.com
>> •
>> m.lacour@criteo.com
>> •
>> csringhofer@cloudera.com
>> •
>> rzamora@nvidia.com
>> •
>> boroknagyz@cloudera.com
>> •
>> bikramjeet.vig@cloudera.com
>> •
>> dev@parquet.apache.org
>> •
>> danielshir@gmail.com
>> •
>> smanik.im@gmail.com
>> •
>> nkollar@cloudera.com
>> •
>> venkik@uber.com
>> •
>> q.xu@criteo.com
>> •
>> jimmyjchen@tencent.com
>> •
>> vercegovac@cloudera.com
>> •
>> Xu, Cheng A
>> •
>> aniket486@gmail.com
>> •
>> jbapple@cloudera.com
>> •
>> Julien Le Dem
>> •
>> aphadke@cloudera.com
>> •
>> yaliangw@twitter.com
>> •
>> marcelk@gmail.com
>> •
>> mark.marsh@kognitio.com
>> •
>> santlal.gupta@bitwiseglobal.com
>> •
>> Daniel Weeks
>> •
>> wesmckinn@gmail.com
>> •
>> sunchao@apache.org
>> •
>> j.coffey@criteo.com
>> •
>> Reynold Xin
>> •
>> Ryan Blue
>> •
>> Lars Volker
>> •
>> alexlevenson@twitter.com
>> •
>> jacques@apache.org
>> •
>> Sergio Pena
>> •
>> gg5070@gmail.com
>> •
>> fnothaft@berkeley.edu
>> •
>> lukas.nalezenec@gmail.com
>> •
>> m.liroz@criteo.com
>> •
>> stakiar@cloudera.com
>> •
>> smoy@yelp.com
>> •
>> o.kaidannik@criteo.com
>> •
>> altekrusejason@gmail.com
>> •
>> brian.bowman@sas.com
>> •
>> julien.ledem@gmail.com
>> •
>> Mohammad Islam
>> •
>> gabor.szadovszky@cloudera.com
>> •
>> andy.grove@rms.com
>> •
>> Wei Han
>> •
>> yumwang@ebay.com
>> •
>> baliga@uber.com
>> •
>> ippokratis@gmail.com
>> •
>> Pavi Subenderan
>> •
>> Zoltan Ivanfi
>> •
>> b.hanotte@criteo.com
>> •
>> dam6923@gmail.com
>> •
>> majeti.deepak@gmail.com
>> •
>> Parth Chandra
>> •
>> Mohit Sabharwal
>> •
>> nilangekar.pooja@gmail.com
>> •
>> xhochy@gmail.com
>> •
>> goreckim@amazon.com
>>
>
Re: Parquet Sync - 10/17/2019 - Meeting Notes
Posted by Gidon Gershinsky <gg...@gmail.com>.
A slight correction re C++. I said the following
C++ work is near completion/merge. Deepark has reviewed it and made
additional changes / refactoring.
On Thu, Oct 17, 2019 at 7:33 PM <sh...@uber.com> wrote:
> 10/17/2019
>
> Attendee:
> Gidon
> Gabor
> Ryan
> Karfiol
> Xinli
>
> Topics:
>
> Column Encryption
> For C++ version, Gidon worked with Deepak to have reviews going on.
> For Java, we are blocked on the Parquet-11 release. Gabor proposed to have
> branch the Parquet-11 and then merge later. But we would need to be in
> master as the final step.
>
> Bloom Filter
> Next step is to wait for the Parquet-11 release
>
> Parquet-11 Validation
> Ryan - the release can go ahead without me if there are enough PMCs
> Gabor - I will try to push this effort in a couple of weeks
>
> Ongoing Parquet Work
> There is some work to create PR shortly to optimize Parquet usage of byte
> buffer, ParallelIzation, S3 reading, etc.
>
> Xinli Shang (Uber)
>
> Parquet Sync - Monthly(every 3rd thursday)
> Hi all,
>
> This is an invitation for the next occasion of the regular sync meeting of
> the Parquet community.
>
> Xinli Shang
>
> Join Zoom Meeting
> https://uber.zoom.us/j/112318682
> <https://www.google.com/url?q=https%3A%2F%2Fuber.zoom.us%2Fj%2F112318682&sa=D&ust=1571762036500000&usg=AFQjCNFLMC07ke-eJw4pjYYwN8FsCtnzMA>
>
> One tap mobile
> +16699006833,,112318682# US (San Jose)
> +16468769923,,112318682# US (New York)
>
> Dial by your location
> +1 669 900 6833 US (San Jose)
> +1 646 876 9923 US (New York)
> 855 880 1246 US Toll-free
> 877 369 0926 US Toll-free
> Meeting ID: 112 318 682
> Find your local number: https://zoom.us/u/aZKZunOZ9
> <https://www.google.com/url?q=https%3A%2F%2Fzoom.us%2Fu%2FaZKZunOZ9&sa=D&ust=1571762036501000&usg=AFQjCNH-GaE-r1Fxk3iTw0cJgIRhbUP1JA>
>
> Join by SIP
> 112318682@zoomcrc.com
>
> Join by H.323
> 162.255.37.11 (US West)
> 162.255.36.11 (US East)
> 221.122.88.195 (China)
> 115.114.131.7 (India)
> 213.19.144.110 (EMEA)
> 103.122.166.55 (Australia)
> 209.9.211.110 (Hong Kong)
> 64.211.144.160 (Brazil)
> 69.174.57.160 (Canada)
> 207.226.132.110 (Japan)
> Meeting ID: 112 318 682
> *When*
> Thu Oct 17, 2019 9am – 10am Pacific Time - Los Angeles
>
> *Where*
> https://uber.zoom.us/j/112318682, SEA | 1191 2nd Ave-8th-Whidbey (7)
> [Zoom] (map
> <https://www.google.com/maps/search/https:%2F%2Fuber.zoom.us%2Fj%2F112318682,+SEA+%7C+1191+2nd+Ave-8th-Whidbey+%287%29+%5BZoom%5D?hl=en>
> )
>
> *Who*
> •
> shangx@uber.com - organizer
> •
> shri.hariharasubrahmanian@oracle.com
> •
> nongli@gmail.com
> •
> robertk@palantir.com
> •
> szonyi.anna@gmail.com
> •
> szonyi@cloudera.com
> •
> m.lacour@criteo.com
> •
> csringhofer@cloudera.com
> •
> rzamora@nvidia.com
> •
> boroknagyz@cloudera.com
> •
> bikramjeet.vig@cloudera.com
> •
> dev@parquet.apache.org
> •
> danielshir@gmail.com
> •
> smanik.im@gmail.com
> •
> nkollar@cloudera.com
> •
> venkik@uber.com
> •
> q.xu@criteo.com
> •
> jimmyjchen@tencent.com
> •
> vercegovac@cloudera.com
> •
> Xu, Cheng A
> •
> aniket486@gmail.com
> •
> jbapple@cloudera.com
> •
> Julien Le Dem
> •
> aphadke@cloudera.com
> •
> yaliangw@twitter.com
> •
> marcelk@gmail.com
> •
> mark.marsh@kognitio.com
> •
> santlal.gupta@bitwiseglobal.com
> •
> Daniel Weeks
> •
> wesmckinn@gmail.com
> •
> sunchao@apache.org
> •
> j.coffey@criteo.com
> •
> Reynold Xin
> •
> Ryan Blue
> •
> Lars Volker
> •
> alexlevenson@twitter.com
> •
> jacques@apache.org
> •
> Sergio Pena
> •
> gg5070@gmail.com
> •
> fnothaft@berkeley.edu
> •
> lukas.nalezenec@gmail.com
> •
> m.liroz@criteo.com
> •
> stakiar@cloudera.com
> •
> smoy@yelp.com
> •
> o.kaidannik@criteo.com
> •
> altekrusejason@gmail.com
> •
> brian.bowman@sas.com
> •
> julien.ledem@gmail.com
> •
> Mohammad Islam
> •
> gabor.szadovszky@cloudera.com
> •
> andy.grove@rms.com
> •
> Wei Han
> •
> yumwang@ebay.com
> •
> baliga@uber.com
> •
> ippokratis@gmail.com
> •
> Pavi Subenderan
> •
> Zoltan Ivanfi
> •
> b.hanotte@criteo.com
> •
> dam6923@gmail.com
> •
> majeti.deepak@gmail.com
> •
> Parth Chandra
> •
> Mohit Sabharwal
> •
> nilangekar.pooja@gmail.com
> •
> xhochy@gmail.com
> •
> goreckim@amazon.com
>