You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by Ryan Blue <bl...@apache.org> on 2017/10/17 19:33:36 UTC

[VOTE] Release Apache Parquet Format 2.4.0 RC2

Hi everyone,

I propose the following RC to be released as official Apache Parquet Format
2.4.0 release.

The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06

This corresponds to the tag: apache-parquet-format-2.4.0

   - https://github.com/apache/parquet-format/tree/08eb0ce
   -
   https://git-wip-us.apache.org/repos/asf/projects/repo?p=parquet-format.git&a=commit&h=08eb0ce

The release tarball, signature, and checksums are here:

   -
   https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-format-2.4.0-rc2/

You can find the KEYS file here:

   - https://dist.apache.org/repos/dist/dev/parquet/KEYS

Binary artifacts are staged in Nexus here:

   -
   https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/2.4.0/
   - Maven repository URL:
   https://repository.apache.org/content/repositories/orgapacheparquet-1012

This release includes:

   - Min and max fields for correct column sort orders
   - Definitions for indexing columns
   - Support for new compression codecs: Brotli, Zstd, LZ4
   - New representation for logical types
   - Other bug fixes and improvements

Please download, verify, and test.

This vote will close on Saturday morning, 21 October.

[ ] +1 - Release this as Apache Parquet Format 2.4.0
[ ] +0
[ ] -1 - Do not release this because…
​
-- 
Ryan Blue

Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2

Posted by Lars Volker <lv...@cloudera.com>.
Oh, I'm sorry for my confusion, I wasn't aware that only the PMC's votes
are binding. Thank you Wes for pointing this out.

On Oct 17, 2017 16:42, "Wes McKinney" <we...@gmail.com> wrote:

+1 (binding)

* Verified checksum, signature
* Ran mvn test
* Confirmed parquet.thrift optically matches what I expect

Some notes

* The build fails with the Thrift 0.10.0 compiler installed. 0.9.3 is
pinned in the pom.xml. Since 0.10.0 is getting more widespread (and
more easily installed on Windows) it might be worth upgrading
* This project should be updated to follow the new guidance for SHA
checksums http://www.apache.org/dev/release-distribution#sigs-and-sums

I note that Lars's vote is non-binding because he is not a PMC member

- Wes

On Tue, Oct 17, 2017 at 6:54 PM, Lars Volker <lv...@cloudera.com> wrote:
> +1 (binding)
>
> * Verified checksum and signature
> * Ran "mvn test" and it passed. This included RAT.
> * Ran "make doc" to check that docs compile and look OK
> * Verified that the latest changes are included in parquet.thrift
>
> I noticed that PARQUET-1144 did not make it into the CHANGES.md file. Is
> that on purpose?
>
> Thank you Ryan for preparing the release!
>
> Cheers, Lars
>
> On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:
>
>> Hi everyone,
>>
>> I propose the following RC to be released as official Apache Parquet
Format
>> 2.4.0 release.
>>
>> The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
>>
>> This corresponds to the tag: apache-parquet-format-2.4.0
>>
>>    - https://github.com/apache/parquet-format/tree/08eb0ce
>>    -
>>    https://git-wip-us.apache.org/repos/asf/projects/repo?p=
>> parquet-format.git&a=commit&h=08eb0ce
>>
>> The release tarball, signature, and checksums are here:
>>
>>    -
>>    https://dist.apache.org/repos/dist/dev/parquet/apache-
>> parquet-format-2.4.0-rc2/
>>
>> You can find the KEYS file here:
>>
>>    - https://dist.apache.org/repos/dist/dev/parquet/KEYS
>>
>> Binary artifacts are staged in Nexus here:
>>
>>    -
>>    https://repository.apache.org/content/groups/staging/org/
>> apache/parquet/parquet-format/2.4.0/
>>    - Maven repository URL:
>>    https://repository.apache.org/content/repositories/
>> orgapacheparquet-1012
>>
>> This release includes:
>>
>>    - Min and max fields for correct column sort orders
>>    - Definitions for indexing columns
>>    - Support for new compression codecs: Brotli, Zstd, LZ4
>>    - New representation for logical types
>>    - Other bug fixes and improvements
>>
>> Please download, verify, and test.
>>
>> This vote will close on Saturday morning, 21 October.
>>
>> [ ] +1 - Release this as Apache Parquet Format 2.4.0
>> [ ] +0
>> [ ] -1 - Do not release this because…
>>
>> --
>> Ryan Blue
>>

Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2

Posted by Ryan Blue <rb...@netflix.com.INVALID>.
Thanks for the link about checksums. I completely forgot that came out.
I'll make sure we update for the next release, though I don't think we need
to cancel this one.

On Tue, Oct 17, 2017 at 4:41 PM, Wes McKinney <we...@gmail.com> wrote:

> +1 (binding)
>
> * Verified checksum, signature
> * Ran mvn test
> * Confirmed parquet.thrift optically matches what I expect
>
> Some notes
>
> * The build fails with the Thrift 0.10.0 compiler installed. 0.9.3 is
> pinned in the pom.xml. Since 0.10.0 is getting more widespread (and
> more easily installed on Windows) it might be worth upgrading
> * This project should be updated to follow the new guidance for SHA
> checksums http://www.apache.org/dev/release-distribution#sigs-and-sums
>
> I note that Lars's vote is non-binding because he is not a PMC member
>
> - Wes
>
> On Tue, Oct 17, 2017 at 6:54 PM, Lars Volker <lv...@cloudera.com> wrote:
> > +1 (binding)
> >
> > * Verified checksum and signature
> > * Ran "mvn test" and it passed. This included RAT.
> > * Ran "make doc" to check that docs compile and look OK
> > * Verified that the latest changes are included in parquet.thrift
> >
> > I noticed that PARQUET-1144 did not make it into the CHANGES.md file. Is
> > that on purpose?
> >
> > Thank you Ryan for preparing the release!
> >
> > Cheers, Lars
> >
> > On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:
> >
> >> Hi everyone,
> >>
> >> I propose the following RC to be released as official Apache Parquet
> Format
> >> 2.4.0 release.
> >>
> >> The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
> >>
> >> This corresponds to the tag: apache-parquet-format-2.4.0
> >>
> >>    - https://github.com/apache/parquet-format/tree/08eb0ce
> >>    -
> >>    https://git-wip-us.apache.org/repos/asf/projects/repo?p=
> >> parquet-format.git&a=commit&h=08eb0ce
> >>
> >> The release tarball, signature, and checksums are here:
> >>
> >>    -
> >>    https://dist.apache.org/repos/dist/dev/parquet/apache-
> >> parquet-format-2.4.0-rc2/
> >>
> >> You can find the KEYS file here:
> >>
> >>    - https://dist.apache.org/repos/dist/dev/parquet/KEYS
> >>
> >> Binary artifacts are staged in Nexus here:
> >>
> >>    -
> >>    https://repository.apache.org/content/groups/staging/org/
> >> apache/parquet/parquet-format/2.4.0/
> >>    - Maven repository URL:
> >>    https://repository.apache.org/content/repositories/
> >> orgapacheparquet-1012
> >>
> >> This release includes:
> >>
> >>    - Min and max fields for correct column sort orders
> >>    - Definitions for indexing columns
> >>    - Support for new compression codecs: Brotli, Zstd, LZ4
> >>    - New representation for logical types
> >>    - Other bug fixes and improvements
> >>
> >> Please download, verify, and test.
> >>
> >> This vote will close on Saturday morning, 21 October.
> >>
> >> [ ] +1 - Release this as Apache Parquet Format 2.4.0
> >> [ ] +0
> >> [ ] -1 - Do not release this because…
> >>
> >> --
> >> Ryan Blue
> >>
>



-- 
Ryan Blue
Software Engineer
Netflix

Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2

Posted by Wes McKinney <we...@gmail.com>.
+1 (binding)

* Verified checksum, signature
* Ran mvn test
* Confirmed parquet.thrift optically matches what I expect

Some notes

* The build fails with the Thrift 0.10.0 compiler installed. 0.9.3 is
pinned in the pom.xml. Since 0.10.0 is getting more widespread (and
more easily installed on Windows) it might be worth upgrading
* This project should be updated to follow the new guidance for SHA
checksums http://www.apache.org/dev/release-distribution#sigs-and-sums

I note that Lars's vote is non-binding because he is not a PMC member

- Wes

On Tue, Oct 17, 2017 at 6:54 PM, Lars Volker <lv...@cloudera.com> wrote:
> +1 (binding)
>
> * Verified checksum and signature
> * Ran "mvn test" and it passed. This included RAT.
> * Ran "make doc" to check that docs compile and look OK
> * Verified that the latest changes are included in parquet.thrift
>
> I noticed that PARQUET-1144 did not make it into the CHANGES.md file. Is
> that on purpose?
>
> Thank you Ryan for preparing the release!
>
> Cheers, Lars
>
> On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:
>
>> Hi everyone,
>>
>> I propose the following RC to be released as official Apache Parquet Format
>> 2.4.0 release.
>>
>> The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
>>
>> This corresponds to the tag: apache-parquet-format-2.4.0
>>
>>    - https://github.com/apache/parquet-format/tree/08eb0ce
>>    -
>>    https://git-wip-us.apache.org/repos/asf/projects/repo?p=
>> parquet-format.git&a=commit&h=08eb0ce
>>
>> The release tarball, signature, and checksums are here:
>>
>>    -
>>    https://dist.apache.org/repos/dist/dev/parquet/apache-
>> parquet-format-2.4.0-rc2/
>>
>> You can find the KEYS file here:
>>
>>    - https://dist.apache.org/repos/dist/dev/parquet/KEYS
>>
>> Binary artifacts are staged in Nexus here:
>>
>>    -
>>    https://repository.apache.org/content/groups/staging/org/
>> apache/parquet/parquet-format/2.4.0/
>>    - Maven repository URL:
>>    https://repository.apache.org/content/repositories/
>> orgapacheparquet-1012
>>
>> This release includes:
>>
>>    - Min and max fields for correct column sort orders
>>    - Definitions for indexing columns
>>    - Support for new compression codecs: Brotli, Zstd, LZ4
>>    - New representation for logical types
>>    - Other bug fixes and improvements
>>
>> Please download, verify, and test.
>>
>> This vote will close on Saturday morning, 21 October.
>>
>> [ ] +1 - Release this as Apache Parquet Format 2.4.0
>> [ ] +0
>> [ ] -1 - Do not release this because…
>>
>> --
>> Ryan Blue
>>

Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2

Posted by Lars Volker <lv...@cloudera.com>.
+1 (binding)

* Verified checksum and signature
* Ran "mvn test" and it passed. This included RAT.
* Ran "make doc" to check that docs compile and look OK
* Verified that the latest changes are included in parquet.thrift

I noticed that PARQUET-1144 did not make it into the CHANGES.md file. Is
that on purpose?

Thank you Ryan for preparing the release!

Cheers, Lars

On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:

> Hi everyone,
>
> I propose the following RC to be released as official Apache Parquet Format
> 2.4.0 release.
>
> The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
>
> This corresponds to the tag: apache-parquet-format-2.4.0
>
>    - https://github.com/apache/parquet-format/tree/08eb0ce
>    -
>    https://git-wip-us.apache.org/repos/asf/projects/repo?p=
> parquet-format.git&a=commit&h=08eb0ce
>
> The release tarball, signature, and checksums are here:
>
>    -
>    https://dist.apache.org/repos/dist/dev/parquet/apache-
> parquet-format-2.4.0-rc2/
>
> You can find the KEYS file here:
>
>    - https://dist.apache.org/repos/dist/dev/parquet/KEYS
>
> Binary artifacts are staged in Nexus here:
>
>    -
>    https://repository.apache.org/content/groups/staging/org/
> apache/parquet/parquet-format/2.4.0/
>    - Maven repository URL:
>    https://repository.apache.org/content/repositories/
> orgapacheparquet-1012
>
> This release includes:
>
>    - Min and max fields for correct column sort orders
>    - Definitions for indexing columns
>    - Support for new compression codecs: Brotli, Zstd, LZ4
>    - New representation for logical types
>    - Other bug fixes and improvements
>
> Please download, verify, and test.
>
> This vote will close on Saturday morning, 21 October.
>
> [ ] +1 - Release this as Apache Parquet Format 2.4.0
> [ ] +0
> [ ] -1 - Do not release this because…
> ​
> --
> Ryan Blue
>

Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2

Posted by Ryan Blue <bl...@apache.org>.
This vote passes, with 3 binding +1 and 1 non-binding +1. Thanks for
testing, everyone. I'll get the artifacts pushed and send an announcement.

rb

On Thu, Oct 19, 2017 at 5:23 PM, Daniel Weeks <dw...@netflix.com.invalid>
wrote:

> +1
>
> Verified checksum, signature, build
>
> On Wed, Oct 18, 2017 at 9:37 AM, Ryan Blue <bl...@apache.org> wrote:
>
> > +1
> >
> > Verified signature, checksums, tested. Also tested Parquet MR with PR
> #430
> > <https://github.com/apache/parquet-mr/pull/430> and everything is
> passing.
> >
> > On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:
> >
> > > Hi everyone,
> > >
> > > I propose the following RC to be released as official Apache Parquet
> > > Format 2.4.0 release.
> > >
> > > The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
> > >
> > > This corresponds to the tag: apache-parquet-format-2.4.0
> > >
> > >    - https://github.com/apache/parquet-format/tree/08eb0ce
> > >    - https://git-wip-us.apache.org/repos/asf/projects/repo?p=
> > >    parquet-format.git&a=commit&h=08eb0ce
> > >    <https://git-wip-us.apache.org/repos/asf/projects/repo?p=
> > parquet-format.git&a=commit&h=08eb0ce>
> > >
> > > The release tarball, signature, and checksums are here:
> > >
> > >    - https://dist.apache.org/repos/dist/dev/parquet/apache-
> > >    parquet-format-2.4.0-rc2/
> > >
> > > You can find the KEYS file here:
> > >
> > >    - https://dist.apache.org/repos/dist/dev/parquet/KEYS
> > >
> > > Binary artifacts are staged in Nexus here:
> > >
> > >    - https://repository.apache.org/content/groups/staging/org/
> > >    apache/parquet/parquet-format/2.4.0/
> > >    <https://repository.apache.org/content/groups/staging/
> > org/apache/parquet/parquet-format/2.4.0/>
> > >    - Maven repository URL: https://repository.apache.org/
> > >    content/repositories/orgapacheparquet-1012
> > >    <https://repository.apache.org/content/repositories/
> > orgapacheparquet-1012>
> > >
> > > This release includes:
> > >
> > >    - Min and max fields for correct column sort orders
> > >    - Definitions for indexing columns
> > >    - Support for new compression codecs: Brotli, Zstd, LZ4
> > >    - New representation for logical types
> > >    - Other bug fixes and improvements
> > >
> > > Please download, verify, and test.
> > >
> > > This vote will close on Saturday morning, 21 October.
> > >
> > > [ ] +1 - Release this as Apache Parquet Format 2.4.0
> > > [ ] +0
> > > [ ] -1 - Do not release this because…
> > > ​
> > > --
> > > Ryan Blue
> > >
> >
> >
> >
> > --
> > Ryan Blue
> >
>



-- 
Ryan Blue

Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2

Posted by Daniel Weeks <dw...@netflix.com.INVALID>.
+1

Verified checksum, signature, build

On Wed, Oct 18, 2017 at 9:37 AM, Ryan Blue <bl...@apache.org> wrote:

> +1
>
> Verified signature, checksums, tested. Also tested Parquet MR with PR #430
> <https://github.com/apache/parquet-mr/pull/430> and everything is passing.
>
> On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:
>
> > Hi everyone,
> >
> > I propose the following RC to be released as official Apache Parquet
> > Format 2.4.0 release.
> >
> > The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
> >
> > This corresponds to the tag: apache-parquet-format-2.4.0
> >
> >    - https://github.com/apache/parquet-format/tree/08eb0ce
> >    - https://git-wip-us.apache.org/repos/asf/projects/repo?p=
> >    parquet-format.git&a=commit&h=08eb0ce
> >    <https://git-wip-us.apache.org/repos/asf/projects/repo?p=
> parquet-format.git&a=commit&h=08eb0ce>
> >
> > The release tarball, signature, and checksums are here:
> >
> >    - https://dist.apache.org/repos/dist/dev/parquet/apache-
> >    parquet-format-2.4.0-rc2/
> >
> > You can find the KEYS file here:
> >
> >    - https://dist.apache.org/repos/dist/dev/parquet/KEYS
> >
> > Binary artifacts are staged in Nexus here:
> >
> >    - https://repository.apache.org/content/groups/staging/org/
> >    apache/parquet/parquet-format/2.4.0/
> >    <https://repository.apache.org/content/groups/staging/
> org/apache/parquet/parquet-format/2.4.0/>
> >    - Maven repository URL: https://repository.apache.org/
> >    content/repositories/orgapacheparquet-1012
> >    <https://repository.apache.org/content/repositories/
> orgapacheparquet-1012>
> >
> > This release includes:
> >
> >    - Min and max fields for correct column sort orders
> >    - Definitions for indexing columns
> >    - Support for new compression codecs: Brotli, Zstd, LZ4
> >    - New representation for logical types
> >    - Other bug fixes and improvements
> >
> > Please download, verify, and test.
> >
> > This vote will close on Saturday morning, 21 October.
> >
> > [ ] +1 - Release this as Apache Parquet Format 2.4.0
> > [ ] +0
> > [ ] -1 - Do not release this because…
> > ​
> > --
> > Ryan Blue
> >
>
>
>
> --
> Ryan Blue
>

Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2

Posted by Ryan Blue <bl...@apache.org>.
+1

Verified signature, checksums, tested. Also tested Parquet MR with PR #430
<https://github.com/apache/parquet-mr/pull/430> and everything is passing.

On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:

> Hi everyone,
>
> I propose the following RC to be released as official Apache Parquet
> Format 2.4.0 release.
>
> The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
>
> This corresponds to the tag: apache-parquet-format-2.4.0
>
>    - https://github.com/apache/parquet-format/tree/08eb0ce
>    - https://git-wip-us.apache.org/repos/asf/projects/repo?p=
>    parquet-format.git&a=commit&h=08eb0ce
>    <https://git-wip-us.apache.org/repos/asf/projects/repo?p=parquet-format.git&a=commit&h=08eb0ce>
>
> The release tarball, signature, and checksums are here:
>
>    - https://dist.apache.org/repos/dist/dev/parquet/apache-
>    parquet-format-2.4.0-rc2/
>
> You can find the KEYS file here:
>
>    - https://dist.apache.org/repos/dist/dev/parquet/KEYS
>
> Binary artifacts are staged in Nexus here:
>
>    - https://repository.apache.org/content/groups/staging/org/
>    apache/parquet/parquet-format/2.4.0/
>    <https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/2.4.0/>
>    - Maven repository URL: https://repository.apache.org/
>    content/repositories/orgapacheparquet-1012
>    <https://repository.apache.org/content/repositories/orgapacheparquet-1012>
>
> This release includes:
>
>    - Min and max fields for correct column sort orders
>    - Definitions for indexing columns
>    - Support for new compression codecs: Brotli, Zstd, LZ4
>    - New representation for logical types
>    - Other bug fixes and improvements
>
> Please download, verify, and test.
>
> This vote will close on Saturday morning, 21 October.
>
> [ ] +1 - Release this as Apache Parquet Format 2.4.0
> [ ] +0
> [ ] -1 - Do not release this because…
> ​
> --
> Ryan Blue
>



-- 
Ryan Blue