You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by Ryan Blue <bl...@apache.org> on 2017/10/17 19:33:36 UTC
[VOTE] Release Apache Parquet Format 2.4.0 RC2
Hi everyone,
I propose the following RC to be released as official Apache Parquet Format
2.4.0 release.
The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
This corresponds to the tag: apache-parquet-format-2.4.0
- https://github.com/apache/parquet-format/tree/08eb0ce
-
https://git-wip-us.apache.org/repos/asf/projects/repo?p=parquet-format.git&a=commit&h=08eb0ce
The release tarball, signature, and checksums are here:
-
https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-format-2.4.0-rc2/
You can find the KEYS file here:
- https://dist.apache.org/repos/dist/dev/parquet/KEYS
Binary artifacts are staged in Nexus here:
-
https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/2.4.0/
- Maven repository URL:
https://repository.apache.org/content/repositories/orgapacheparquet-1012
This release includes:
- Min and max fields for correct column sort orders
- Definitions for indexing columns
- Support for new compression codecs: Brotli, Zstd, LZ4
- New representation for logical types
- Other bug fixes and improvements
Please download, verify, and test.
This vote will close on Saturday morning, 21 October.
[ ] +1 - Release this as Apache Parquet Format 2.4.0
[ ] +0
[ ] -1 - Do not release this because…
--
Ryan Blue
Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2
Posted by Lars Volker <lv...@cloudera.com>.
Oh, I'm sorry for my confusion, I wasn't aware that only the PMC's votes
are binding. Thank you Wes for pointing this out.
On Oct 17, 2017 16:42, "Wes McKinney" <we...@gmail.com> wrote:
+1 (binding)
* Verified checksum, signature
* Ran mvn test
* Confirmed parquet.thrift optically matches what I expect
Some notes
* The build fails with the Thrift 0.10.0 compiler installed. 0.9.3 is
pinned in the pom.xml. Since 0.10.0 is getting more widespread (and
more easily installed on Windows) it might be worth upgrading
* This project should be updated to follow the new guidance for SHA
checksums http://www.apache.org/dev/release-distribution#sigs-and-sums
I note that Lars's vote is non-binding because he is not a PMC member
- Wes
On Tue, Oct 17, 2017 at 6:54 PM, Lars Volker <lv...@cloudera.com> wrote:
> +1 (binding)
>
> * Verified checksum and signature
> * Ran "mvn test" and it passed. This included RAT.
> * Ran "make doc" to check that docs compile and look OK
> * Verified that the latest changes are included in parquet.thrift
>
> I noticed that PARQUET-1144 did not make it into the CHANGES.md file. Is
> that on purpose?
>
> Thank you Ryan for preparing the release!
>
> Cheers, Lars
>
> On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:
>
>> Hi everyone,
>>
>> I propose the following RC to be released as official Apache Parquet
Format
>> 2.4.0 release.
>>
>> The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
>>
>> This corresponds to the tag: apache-parquet-format-2.4.0
>>
>> - https://github.com/apache/parquet-format/tree/08eb0ce
>> -
>> https://git-wip-us.apache.org/repos/asf/projects/repo?p=
>> parquet-format.git&a=commit&h=08eb0ce
>>
>> The release tarball, signature, and checksums are here:
>>
>> -
>> https://dist.apache.org/repos/dist/dev/parquet/apache-
>> parquet-format-2.4.0-rc2/
>>
>> You can find the KEYS file here:
>>
>> - https://dist.apache.org/repos/dist/dev/parquet/KEYS
>>
>> Binary artifacts are staged in Nexus here:
>>
>> -
>> https://repository.apache.org/content/groups/staging/org/
>> apache/parquet/parquet-format/2.4.0/
>> - Maven repository URL:
>> https://repository.apache.org/content/repositories/
>> orgapacheparquet-1012
>>
>> This release includes:
>>
>> - Min and max fields for correct column sort orders
>> - Definitions for indexing columns
>> - Support for new compression codecs: Brotli, Zstd, LZ4
>> - New representation for logical types
>> - Other bug fixes and improvements
>>
>> Please download, verify, and test.
>>
>> This vote will close on Saturday morning, 21 October.
>>
>> [ ] +1 - Release this as Apache Parquet Format 2.4.0
>> [ ] +0
>> [ ] -1 - Do not release this because…
>>
>> --
>> Ryan Blue
>>
Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2
Posted by Ryan Blue <rb...@netflix.com.INVALID>.
Thanks for the link about checksums. I completely forgot that came out.
I'll make sure we update for the next release, though I don't think we need
to cancel this one.
On Tue, Oct 17, 2017 at 4:41 PM, Wes McKinney <we...@gmail.com> wrote:
> +1 (binding)
>
> * Verified checksum, signature
> * Ran mvn test
> * Confirmed parquet.thrift optically matches what I expect
>
> Some notes
>
> * The build fails with the Thrift 0.10.0 compiler installed. 0.9.3 is
> pinned in the pom.xml. Since 0.10.0 is getting more widespread (and
> more easily installed on Windows) it might be worth upgrading
> * This project should be updated to follow the new guidance for SHA
> checksums http://www.apache.org/dev/release-distribution#sigs-and-sums
>
> I note that Lars's vote is non-binding because he is not a PMC member
>
> - Wes
>
> On Tue, Oct 17, 2017 at 6:54 PM, Lars Volker <lv...@cloudera.com> wrote:
> > +1 (binding)
> >
> > * Verified checksum and signature
> > * Ran "mvn test" and it passed. This included RAT.
> > * Ran "make doc" to check that docs compile and look OK
> > * Verified that the latest changes are included in parquet.thrift
> >
> > I noticed that PARQUET-1144 did not make it into the CHANGES.md file. Is
> > that on purpose?
> >
> > Thank you Ryan for preparing the release!
> >
> > Cheers, Lars
> >
> > On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:
> >
> >> Hi everyone,
> >>
> >> I propose the following RC to be released as official Apache Parquet
> Format
> >> 2.4.0 release.
> >>
> >> The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
> >>
> >> This corresponds to the tag: apache-parquet-format-2.4.0
> >>
> >> - https://github.com/apache/parquet-format/tree/08eb0ce
> >> -
> >> https://git-wip-us.apache.org/repos/asf/projects/repo?p=
> >> parquet-format.git&a=commit&h=08eb0ce
> >>
> >> The release tarball, signature, and checksums are here:
> >>
> >> -
> >> https://dist.apache.org/repos/dist/dev/parquet/apache-
> >> parquet-format-2.4.0-rc2/
> >>
> >> You can find the KEYS file here:
> >>
> >> - https://dist.apache.org/repos/dist/dev/parquet/KEYS
> >>
> >> Binary artifacts are staged in Nexus here:
> >>
> >> -
> >> https://repository.apache.org/content/groups/staging/org/
> >> apache/parquet/parquet-format/2.4.0/
> >> - Maven repository URL:
> >> https://repository.apache.org/content/repositories/
> >> orgapacheparquet-1012
> >>
> >> This release includes:
> >>
> >> - Min and max fields for correct column sort orders
> >> - Definitions for indexing columns
> >> - Support for new compression codecs: Brotli, Zstd, LZ4
> >> - New representation for logical types
> >> - Other bug fixes and improvements
> >>
> >> Please download, verify, and test.
> >>
> >> This vote will close on Saturday morning, 21 October.
> >>
> >> [ ] +1 - Release this as Apache Parquet Format 2.4.0
> >> [ ] +0
> >> [ ] -1 - Do not release this because…
> >>
> >> --
> >> Ryan Blue
> >>
>
--
Ryan Blue
Software Engineer
Netflix
Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2
Posted by Wes McKinney <we...@gmail.com>.
+1 (binding)
* Verified checksum, signature
* Ran mvn test
* Confirmed parquet.thrift optically matches what I expect
Some notes
* The build fails with the Thrift 0.10.0 compiler installed. 0.9.3 is
pinned in the pom.xml. Since 0.10.0 is getting more widespread (and
more easily installed on Windows) it might be worth upgrading
* This project should be updated to follow the new guidance for SHA
checksums http://www.apache.org/dev/release-distribution#sigs-and-sums
I note that Lars's vote is non-binding because he is not a PMC member
- Wes
On Tue, Oct 17, 2017 at 6:54 PM, Lars Volker <lv...@cloudera.com> wrote:
> +1 (binding)
>
> * Verified checksum and signature
> * Ran "mvn test" and it passed. This included RAT.
> * Ran "make doc" to check that docs compile and look OK
> * Verified that the latest changes are included in parquet.thrift
>
> I noticed that PARQUET-1144 did not make it into the CHANGES.md file. Is
> that on purpose?
>
> Thank you Ryan for preparing the release!
>
> Cheers, Lars
>
> On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:
>
>> Hi everyone,
>>
>> I propose the following RC to be released as official Apache Parquet Format
>> 2.4.0 release.
>>
>> The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
>>
>> This corresponds to the tag: apache-parquet-format-2.4.0
>>
>> - https://github.com/apache/parquet-format/tree/08eb0ce
>> -
>> https://git-wip-us.apache.org/repos/asf/projects/repo?p=
>> parquet-format.git&a=commit&h=08eb0ce
>>
>> The release tarball, signature, and checksums are here:
>>
>> -
>> https://dist.apache.org/repos/dist/dev/parquet/apache-
>> parquet-format-2.4.0-rc2/
>>
>> You can find the KEYS file here:
>>
>> - https://dist.apache.org/repos/dist/dev/parquet/KEYS
>>
>> Binary artifacts are staged in Nexus here:
>>
>> -
>> https://repository.apache.org/content/groups/staging/org/
>> apache/parquet/parquet-format/2.4.0/
>> - Maven repository URL:
>> https://repository.apache.org/content/repositories/
>> orgapacheparquet-1012
>>
>> This release includes:
>>
>> - Min and max fields for correct column sort orders
>> - Definitions for indexing columns
>> - Support for new compression codecs: Brotli, Zstd, LZ4
>> - New representation for logical types
>> - Other bug fixes and improvements
>>
>> Please download, verify, and test.
>>
>> This vote will close on Saturday morning, 21 October.
>>
>> [ ] +1 - Release this as Apache Parquet Format 2.4.0
>> [ ] +0
>> [ ] -1 - Do not release this because…
>>
>> --
>> Ryan Blue
>>
Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2
Posted by Lars Volker <lv...@cloudera.com>.
+1 (binding)
* Verified checksum and signature
* Ran "mvn test" and it passed. This included RAT.
* Ran "make doc" to check that docs compile and look OK
* Verified that the latest changes are included in parquet.thrift
I noticed that PARQUET-1144 did not make it into the CHANGES.md file. Is
that on purpose?
Thank you Ryan for preparing the release!
Cheers, Lars
On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:
> Hi everyone,
>
> I propose the following RC to be released as official Apache Parquet Format
> 2.4.0 release.
>
> The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
>
> This corresponds to the tag: apache-parquet-format-2.4.0
>
> - https://github.com/apache/parquet-format/tree/08eb0ce
> -
> https://git-wip-us.apache.org/repos/asf/projects/repo?p=
> parquet-format.git&a=commit&h=08eb0ce
>
> The release tarball, signature, and checksums are here:
>
> -
> https://dist.apache.org/repos/dist/dev/parquet/apache-
> parquet-format-2.4.0-rc2/
>
> You can find the KEYS file here:
>
> - https://dist.apache.org/repos/dist/dev/parquet/KEYS
>
> Binary artifacts are staged in Nexus here:
>
> -
> https://repository.apache.org/content/groups/staging/org/
> apache/parquet/parquet-format/2.4.0/
> - Maven repository URL:
> https://repository.apache.org/content/repositories/
> orgapacheparquet-1012
>
> This release includes:
>
> - Min and max fields for correct column sort orders
> - Definitions for indexing columns
> - Support for new compression codecs: Brotli, Zstd, LZ4
> - New representation for logical types
> - Other bug fixes and improvements
>
> Please download, verify, and test.
>
> This vote will close on Saturday morning, 21 October.
>
> [ ] +1 - Release this as Apache Parquet Format 2.4.0
> [ ] +0
> [ ] -1 - Do not release this because…
>
> --
> Ryan Blue
>
Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2
Posted by Ryan Blue <bl...@apache.org>.
This vote passes, with 3 binding +1 and 1 non-binding +1. Thanks for
testing, everyone. I'll get the artifacts pushed and send an announcement.
rb
On Thu, Oct 19, 2017 at 5:23 PM, Daniel Weeks <dw...@netflix.com.invalid>
wrote:
> +1
>
> Verified checksum, signature, build
>
> On Wed, Oct 18, 2017 at 9:37 AM, Ryan Blue <bl...@apache.org> wrote:
>
> > +1
> >
> > Verified signature, checksums, tested. Also tested Parquet MR with PR
> #430
> > <https://github.com/apache/parquet-mr/pull/430> and everything is
> passing.
> >
> > On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:
> >
> > > Hi everyone,
> > >
> > > I propose the following RC to be released as official Apache Parquet
> > > Format 2.4.0 release.
> > >
> > > The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
> > >
> > > This corresponds to the tag: apache-parquet-format-2.4.0
> > >
> > > - https://github.com/apache/parquet-format/tree/08eb0ce
> > > - https://git-wip-us.apache.org/repos/asf/projects/repo?p=
> > > parquet-format.git&a=commit&h=08eb0ce
> > > <https://git-wip-us.apache.org/repos/asf/projects/repo?p=
> > parquet-format.git&a=commit&h=08eb0ce>
> > >
> > > The release tarball, signature, and checksums are here:
> > >
> > > - https://dist.apache.org/repos/dist/dev/parquet/apache-
> > > parquet-format-2.4.0-rc2/
> > >
> > > You can find the KEYS file here:
> > >
> > > - https://dist.apache.org/repos/dist/dev/parquet/KEYS
> > >
> > > Binary artifacts are staged in Nexus here:
> > >
> > > - https://repository.apache.org/content/groups/staging/org/
> > > apache/parquet/parquet-format/2.4.0/
> > > <https://repository.apache.org/content/groups/staging/
> > org/apache/parquet/parquet-format/2.4.0/>
> > > - Maven repository URL: https://repository.apache.org/
> > > content/repositories/orgapacheparquet-1012
> > > <https://repository.apache.org/content/repositories/
> > orgapacheparquet-1012>
> > >
> > > This release includes:
> > >
> > > - Min and max fields for correct column sort orders
> > > - Definitions for indexing columns
> > > - Support for new compression codecs: Brotli, Zstd, LZ4
> > > - New representation for logical types
> > > - Other bug fixes and improvements
> > >
> > > Please download, verify, and test.
> > >
> > > This vote will close on Saturday morning, 21 October.
> > >
> > > [ ] +1 - Release this as Apache Parquet Format 2.4.0
> > > [ ] +0
> > > [ ] -1 - Do not release this because…
> > >
> > > --
> > > Ryan Blue
> > >
> >
> >
> >
> > --
> > Ryan Blue
> >
>
--
Ryan Blue
Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2
Posted by Daniel Weeks <dw...@netflix.com.INVALID>.
+1
Verified checksum, signature, build
On Wed, Oct 18, 2017 at 9:37 AM, Ryan Blue <bl...@apache.org> wrote:
> +1
>
> Verified signature, checksums, tested. Also tested Parquet MR with PR #430
> <https://github.com/apache/parquet-mr/pull/430> and everything is passing.
>
> On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:
>
> > Hi everyone,
> >
> > I propose the following RC to be released as official Apache Parquet
> > Format 2.4.0 release.
> >
> > The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
> >
> > This corresponds to the tag: apache-parquet-format-2.4.0
> >
> > - https://github.com/apache/parquet-format/tree/08eb0ce
> > - https://git-wip-us.apache.org/repos/asf/projects/repo?p=
> > parquet-format.git&a=commit&h=08eb0ce
> > <https://git-wip-us.apache.org/repos/asf/projects/repo?p=
> parquet-format.git&a=commit&h=08eb0ce>
> >
> > The release tarball, signature, and checksums are here:
> >
> > - https://dist.apache.org/repos/dist/dev/parquet/apache-
> > parquet-format-2.4.0-rc2/
> >
> > You can find the KEYS file here:
> >
> > - https://dist.apache.org/repos/dist/dev/parquet/KEYS
> >
> > Binary artifacts are staged in Nexus here:
> >
> > - https://repository.apache.org/content/groups/staging/org/
> > apache/parquet/parquet-format/2.4.0/
> > <https://repository.apache.org/content/groups/staging/
> org/apache/parquet/parquet-format/2.4.0/>
> > - Maven repository URL: https://repository.apache.org/
> > content/repositories/orgapacheparquet-1012
> > <https://repository.apache.org/content/repositories/
> orgapacheparquet-1012>
> >
> > This release includes:
> >
> > - Min and max fields for correct column sort orders
> > - Definitions for indexing columns
> > - Support for new compression codecs: Brotli, Zstd, LZ4
> > - New representation for logical types
> > - Other bug fixes and improvements
> >
> > Please download, verify, and test.
> >
> > This vote will close on Saturday morning, 21 October.
> >
> > [ ] +1 - Release this as Apache Parquet Format 2.4.0
> > [ ] +0
> > [ ] -1 - Do not release this because…
> >
> > --
> > Ryan Blue
> >
>
>
>
> --
> Ryan Blue
>
Re: [VOTE] Release Apache Parquet Format 2.4.0 RC2
Posted by Ryan Blue <bl...@apache.org>.
+1
Verified signature, checksums, tested. Also tested Parquet MR with PR #430
<https://github.com/apache/parquet-mr/pull/430> and everything is passing.
On Tue, Oct 17, 2017 at 12:33 PM, Ryan Blue <bl...@apache.org> wrote:
> Hi everyone,
>
> I propose the following RC to be released as official Apache Parquet
> Format 2.4.0 release.
>
> The commit id is 08eb0cee5b5fdb1bc88cd684448be123754b8c06
>
> This corresponds to the tag: apache-parquet-format-2.4.0
>
> - https://github.com/apache/parquet-format/tree/08eb0ce
> - https://git-wip-us.apache.org/repos/asf/projects/repo?p=
> parquet-format.git&a=commit&h=08eb0ce
> <https://git-wip-us.apache.org/repos/asf/projects/repo?p=parquet-format.git&a=commit&h=08eb0ce>
>
> The release tarball, signature, and checksums are here:
>
> - https://dist.apache.org/repos/dist/dev/parquet/apache-
> parquet-format-2.4.0-rc2/
>
> You can find the KEYS file here:
>
> - https://dist.apache.org/repos/dist/dev/parquet/KEYS
>
> Binary artifacts are staged in Nexus here:
>
> - https://repository.apache.org/content/groups/staging/org/
> apache/parquet/parquet-format/2.4.0/
> <https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/2.4.0/>
> - Maven repository URL: https://repository.apache.org/
> content/repositories/orgapacheparquet-1012
> <https://repository.apache.org/content/repositories/orgapacheparquet-1012>
>
> This release includes:
>
> - Min and max fields for correct column sort orders
> - Definitions for indexing columns
> - Support for new compression codecs: Brotli, Zstd, LZ4
> - New representation for logical types
> - Other bug fixes and improvements
>
> Please download, verify, and test.
>
> This vote will close on Saturday morning, 21 October.
>
> [ ] +1 - Release this as Apache Parquet Format 2.4.0
> [ ] +0
> [ ] -1 - Do not release this because…
>
> --
> Ryan Blue
>
--
Ryan Blue