You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by Nandor Kollar <nk...@cloudera.com.INVALID> on 2018/09/27 15:02:41 UTC

[VOTE] Release Apache Parquet format 2.6.0 RC0

Hi everyone,

I propose the following RC to be released as official Apache Parquet
Format 2.6.0 release.

The commit id is df6132b94f273521a418a74442085fdd5a0aa009
* This corresponds to the tag: apache-parquet-format-2.6.0
* https://github.com/apache/parquet-format/tree/df6132b94f273521a418a74442085fdd5a0aa009
* https://gitbox.apache.org/repos/asf?p=parquet-format.git;a=commit;h=df6132b94f273521a418a74442085fdd5a0aa009

The release tarball, signature, and checksums are here:
* https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-format-2.6.0-rc0

You can find the KEYS file here:
* https://dist.apache.org/repos/dist/dev/parquet/KEYS

Binary artifacts are staged in Nexus here:
* https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/2.6.0

This release includes following changes:

PARQUET-1266 - LogicalTypes union in parquet-format doesn't include UUID
PARQUET-1290 - Clarify maximum run lengths for RLE encoding
PARQUET-1387 - Nanosecond precision time and timestamp - parquet-format
PARQUET-1400 - Deprecate parquet-mr related code in parquet-format
PARQUET-1429 - Turn off DocLint on parquet-format

Please download, verify, and test.

The voting will be open at least for 72 hour from now.

[ ] +1 Release this as Apache Parquet Format 2.6.0
[ ] +0
[ ] -1 Do not release this because...

Thanks,
Nandor

Re: [VOTE] Release Apache Parquet format 2.6.0 RC0

Posted by Nandor Kollar <nk...@cloudera.com.INVALID>.
Hi All,

The vote for this parquet-format release have passed with
3   "+1" votes (and 1 non-binding)
0   "0" votes
0   "-1" votes

With 3 binding “+1” votes this vote PASSES. We’ll release the
artifacts and send an announcement soon.

Regards,
Nandor
On Sun, Sep 30, 2018 at 11:28 PM Ryan Blue <rb...@netflix.com.invalid> wrote:
>
> +1 (binding)
>
> On Sat, Sep 29, 2018 at 2:11 AM Wes McKinney <we...@gmail.com> wrote:
>
> > +1 (binding)
> >
> > * Checked checksums, signature
> > * Ran unit tests
> >
> > Note that `mvn test` fails if Apache Thrift 0.10.0 or higher is
> > installed. It looks like this is a problem with the Maven Thrift
> > plugin and not a problem with parquet-format, but definitely a rough
> > edge that will affect users
> >
> > [ERROR] thrift failed output:
> >
> > [WARNING:/home/wesm/Downloads/apache-parquet-format-2.6.0/src/main/thrift/parquet.thrift:295]
> > The "byte" type is a compatibility alias for "i8". Use "i8" to
> > emphasize the signedness of this type.
> >
> > [ERROR] thrift failed error: [FAILURE:generation:1] Error: unknown
> > option java:hashcode
> >
> > - Wes
> > On Fri, Sep 28, 2018 at 2:52 AM Gabor Szadovszky
> > <ga...@cloudera.com.invalid> wrote:
> > >
> > > +1 (non-binding)
> > >
> > > - Checked source tarball content
> > > - Checked checksums, signature
> > >
> > > Cheers,
> > > Gabor
> > >
> > > On Thu, Sep 27, 2018 at 5:10 PM Zoltan Ivanfi <zi...@cloudera.com.invalid>
> > > wrote:
> > >
> > > > +1 (binding)
> > > >
> > > > - contents look good
> > > > - units tests pass
> > > > - checksums match
> > > > - signature matches
> > > >
> > > > Thanks,
> > > >
> > > > Zoltan
> > > >
> > > > On Thu, Sep 27, 2018 at 5:02 PM Nandor Kollar
> > <nkollar@cloudera.com.invalid
> > > > >
> > > > wrote:
> > > >
> > > > > Hi everyone,
> > > > >
> > > > > I propose the following RC to be released as official Apache Parquet
> > > > > Format 2.6.0 release.
> > > > >
> > > > > The commit id is df6132b94f273521a418a74442085fdd5a0aa009
> > > > > * This corresponds to the tag: apache-parquet-format-2.6.0
> > > > > *
> > > > >
> > > >
> > https://github.com/apache/parquet-format/tree/df6132b94f273521a418a74442085fdd5a0aa009
> > > > > *
> > > > >
> > > >
> > https://gitbox.apache.org/repos/asf?p=parquet-format.git;a=commit;h=df6132b94f273521a418a74442085fdd5a0aa009
> > > > >
> > > > > The release tarball, signature, and checksums are here:
> > > > > *
> > > > >
> > > >
> > https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-format-2.6.0-rc0
> > > > >
> > > > > You can find the KEYS file here:
> > > > > * https://dist.apache.org/repos/dist/dev/parquet/KEYS
> > > > >
> > > > > Binary artifacts are staged in Nexus here:
> > > > > *
> > > > >
> > > >
> > https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/2.6.0
> > > > >
> > > > > This release includes following changes:
> > > > >
> > > > > PARQUET-1266 - LogicalTypes union in parquet-format doesn't include
> > UUID
> > > > > PARQUET-1290 - Clarify maximum run lengths for RLE encoding
> > > > > PARQUET-1387 - Nanosecond precision time and timestamp -
> > parquet-format
> > > > > PARQUET-1400 - Deprecate parquet-mr related code in parquet-format
> > > > > PARQUET-1429 - Turn off DocLint on parquet-format
> > > > >
> > > > > Please download, verify, and test.
> > > > >
> > > > > The voting will be open at least for 72 hour from now.
> > > > >
> > > > > [ ] +1 Release this as Apache Parquet Format 2.6.0
> > > > > [ ] +0
> > > > > [ ] -1 Do not release this because...
> > > > >
> > > > > Thanks,
> > > > > Nandor
> > > > >
> > > >
> >
>
>
> --
> Ryan Blue
> Software Engineer
> Netflix

Re: [VOTE] Release Apache Parquet format 2.6.0 RC0

Posted by Ryan Blue <rb...@netflix.com.INVALID>.
+1 (binding)

On Sat, Sep 29, 2018 at 2:11 AM Wes McKinney <we...@gmail.com> wrote:

> +1 (binding)
>
> * Checked checksums, signature
> * Ran unit tests
>
> Note that `mvn test` fails if Apache Thrift 0.10.0 or higher is
> installed. It looks like this is a problem with the Maven Thrift
> plugin and not a problem with parquet-format, but definitely a rough
> edge that will affect users
>
> [ERROR] thrift failed output:
>
> [WARNING:/home/wesm/Downloads/apache-parquet-format-2.6.0/src/main/thrift/parquet.thrift:295]
> The "byte" type is a compatibility alias for "i8". Use "i8" to
> emphasize the signedness of this type.
>
> [ERROR] thrift failed error: [FAILURE:generation:1] Error: unknown
> option java:hashcode
>
> - Wes
> On Fri, Sep 28, 2018 at 2:52 AM Gabor Szadovszky
> <ga...@cloudera.com.invalid> wrote:
> >
> > +1 (non-binding)
> >
> > - Checked source tarball content
> > - Checked checksums, signature
> >
> > Cheers,
> > Gabor
> >
> > On Thu, Sep 27, 2018 at 5:10 PM Zoltan Ivanfi <zi...@cloudera.com.invalid>
> > wrote:
> >
> > > +1 (binding)
> > >
> > > - contents look good
> > > - units tests pass
> > > - checksums match
> > > - signature matches
> > >
> > > Thanks,
> > >
> > > Zoltan
> > >
> > > On Thu, Sep 27, 2018 at 5:02 PM Nandor Kollar
> <nkollar@cloudera.com.invalid
> > > >
> > > wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > I propose the following RC to be released as official Apache Parquet
> > > > Format 2.6.0 release.
> > > >
> > > > The commit id is df6132b94f273521a418a74442085fdd5a0aa009
> > > > * This corresponds to the tag: apache-parquet-format-2.6.0
> > > > *
> > > >
> > >
> https://github.com/apache/parquet-format/tree/df6132b94f273521a418a74442085fdd5a0aa009
> > > > *
> > > >
> > >
> https://gitbox.apache.org/repos/asf?p=parquet-format.git;a=commit;h=df6132b94f273521a418a74442085fdd5a0aa009
> > > >
> > > > The release tarball, signature, and checksums are here:
> > > > *
> > > >
> > >
> https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-format-2.6.0-rc0
> > > >
> > > > You can find the KEYS file here:
> > > > * https://dist.apache.org/repos/dist/dev/parquet/KEYS
> > > >
> > > > Binary artifacts are staged in Nexus here:
> > > > *
> > > >
> > >
> https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/2.6.0
> > > >
> > > > This release includes following changes:
> > > >
> > > > PARQUET-1266 - LogicalTypes union in parquet-format doesn't include
> UUID
> > > > PARQUET-1290 - Clarify maximum run lengths for RLE encoding
> > > > PARQUET-1387 - Nanosecond precision time and timestamp -
> parquet-format
> > > > PARQUET-1400 - Deprecate parquet-mr related code in parquet-format
> > > > PARQUET-1429 - Turn off DocLint on parquet-format
> > > >
> > > > Please download, verify, and test.
> > > >
> > > > The voting will be open at least for 72 hour from now.
> > > >
> > > > [ ] +1 Release this as Apache Parquet Format 2.6.0
> > > > [ ] +0
> > > > [ ] -1 Do not release this because...
> > > >
> > > > Thanks,
> > > > Nandor
> > > >
> > >
>


-- 
Ryan Blue
Software Engineer
Netflix

Re: [VOTE] Release Apache Parquet format 2.6.0 RC0

Posted by Nandor Kollar <nk...@cloudera.com.INVALID>.
Wes, I created a Jira for the failure with Thrift 0.10.0 problem:
PARQUET-1433 We should address it in the upcoming format release
On Sat, Sep 29, 2018 at 11:11 AM Wes McKinney <we...@gmail.com> wrote:
>
> +1 (binding)
>
> * Checked checksums, signature
> * Ran unit tests
>
> Note that `mvn test` fails if Apache Thrift 0.10.0 or higher is
> installed. It looks like this is a problem with the Maven Thrift
> plugin and not a problem with parquet-format, but definitely a rough
> edge that will affect users
>
> [ERROR] thrift failed output:
> [WARNING:/home/wesm/Downloads/apache-parquet-format-2.6.0/src/main/thrift/parquet.thrift:295]
> The "byte" type is a compatibility alias for "i8". Use "i8" to
> emphasize the signedness of this type.
>
> [ERROR] thrift failed error: [FAILURE:generation:1] Error: unknown
> option java:hashcode
>
> - Wes
> On Fri, Sep 28, 2018 at 2:52 AM Gabor Szadovszky
> <ga...@cloudera.com.invalid> wrote:
> >
> > +1 (non-binding)
> >
> > - Checked source tarball content
> > - Checked checksums, signature
> >
> > Cheers,
> > Gabor
> >
> > On Thu, Sep 27, 2018 at 5:10 PM Zoltan Ivanfi <zi...@cloudera.com.invalid>
> > wrote:
> >
> > > +1 (binding)
> > >
> > > - contents look good
> > > - units tests pass
> > > - checksums match
> > > - signature matches
> > >
> > > Thanks,
> > >
> > > Zoltan
> > >
> > > On Thu, Sep 27, 2018 at 5:02 PM Nandor Kollar <nkollar@cloudera.com.invalid
> > > >
> > > wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > I propose the following RC to be released as official Apache Parquet
> > > > Format 2.6.0 release.
> > > >
> > > > The commit id is df6132b94f273521a418a74442085fdd5a0aa009
> > > > * This corresponds to the tag: apache-parquet-format-2.6.0
> > > > *
> > > >
> > > https://github.com/apache/parquet-format/tree/df6132b94f273521a418a74442085fdd5a0aa009
> > > > *
> > > >
> > > https://gitbox.apache.org/repos/asf?p=parquet-format.git;a=commit;h=df6132b94f273521a418a74442085fdd5a0aa009
> > > >
> > > > The release tarball, signature, and checksums are here:
> > > > *
> > > >
> > > https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-format-2.6.0-rc0
> > > >
> > > > You can find the KEYS file here:
> > > > * https://dist.apache.org/repos/dist/dev/parquet/KEYS
> > > >
> > > > Binary artifacts are staged in Nexus here:
> > > > *
> > > >
> > > https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/2.6.0
> > > >
> > > > This release includes following changes:
> > > >
> > > > PARQUET-1266 - LogicalTypes union in parquet-format doesn't include UUID
> > > > PARQUET-1290 - Clarify maximum run lengths for RLE encoding
> > > > PARQUET-1387 - Nanosecond precision time and timestamp - parquet-format
> > > > PARQUET-1400 - Deprecate parquet-mr related code in parquet-format
> > > > PARQUET-1429 - Turn off DocLint on parquet-format
> > > >
> > > > Please download, verify, and test.
> > > >
> > > > The voting will be open at least for 72 hour from now.
> > > >
> > > > [ ] +1 Release this as Apache Parquet Format 2.6.0
> > > > [ ] +0
> > > > [ ] -1 Do not release this because...
> > > >
> > > > Thanks,
> > > > Nandor
> > > >
> > >

Re: [VOTE] Release Apache Parquet format 2.6.0 RC0

Posted by Wes McKinney <we...@gmail.com>.
+1 (binding)

* Checked checksums, signature
* Ran unit tests

Note that `mvn test` fails if Apache Thrift 0.10.0 or higher is
installed. It looks like this is a problem with the Maven Thrift
plugin and not a problem with parquet-format, but definitely a rough
edge that will affect users

[ERROR] thrift failed output:
[WARNING:/home/wesm/Downloads/apache-parquet-format-2.6.0/src/main/thrift/parquet.thrift:295]
The "byte" type is a compatibility alias for "i8". Use "i8" to
emphasize the signedness of this type.

[ERROR] thrift failed error: [FAILURE:generation:1] Error: unknown
option java:hashcode

- Wes
On Fri, Sep 28, 2018 at 2:52 AM Gabor Szadovszky
<ga...@cloudera.com.invalid> wrote:
>
> +1 (non-binding)
>
> - Checked source tarball content
> - Checked checksums, signature
>
> Cheers,
> Gabor
>
> On Thu, Sep 27, 2018 at 5:10 PM Zoltan Ivanfi <zi...@cloudera.com.invalid>
> wrote:
>
> > +1 (binding)
> >
> > - contents look good
> > - units tests pass
> > - checksums match
> > - signature matches
> >
> > Thanks,
> >
> > Zoltan
> >
> > On Thu, Sep 27, 2018 at 5:02 PM Nandor Kollar <nkollar@cloudera.com.invalid
> > >
> > wrote:
> >
> > > Hi everyone,
> > >
> > > I propose the following RC to be released as official Apache Parquet
> > > Format 2.6.0 release.
> > >
> > > The commit id is df6132b94f273521a418a74442085fdd5a0aa009
> > > * This corresponds to the tag: apache-parquet-format-2.6.0
> > > *
> > >
> > https://github.com/apache/parquet-format/tree/df6132b94f273521a418a74442085fdd5a0aa009
> > > *
> > >
> > https://gitbox.apache.org/repos/asf?p=parquet-format.git;a=commit;h=df6132b94f273521a418a74442085fdd5a0aa009
> > >
> > > The release tarball, signature, and checksums are here:
> > > *
> > >
> > https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-format-2.6.0-rc0
> > >
> > > You can find the KEYS file here:
> > > * https://dist.apache.org/repos/dist/dev/parquet/KEYS
> > >
> > > Binary artifacts are staged in Nexus here:
> > > *
> > >
> > https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/2.6.0
> > >
> > > This release includes following changes:
> > >
> > > PARQUET-1266 - LogicalTypes union in parquet-format doesn't include UUID
> > > PARQUET-1290 - Clarify maximum run lengths for RLE encoding
> > > PARQUET-1387 - Nanosecond precision time and timestamp - parquet-format
> > > PARQUET-1400 - Deprecate parquet-mr related code in parquet-format
> > > PARQUET-1429 - Turn off DocLint on parquet-format
> > >
> > > Please download, verify, and test.
> > >
> > > The voting will be open at least for 72 hour from now.
> > >
> > > [ ] +1 Release this as Apache Parquet Format 2.6.0
> > > [ ] +0
> > > [ ] -1 Do not release this because...
> > >
> > > Thanks,
> > > Nandor
> > >
> >

Re: [VOTE] Release Apache Parquet format 2.6.0 RC0

Posted by Gabor Szadovszky <ga...@cloudera.com.INVALID>.
+1 (non-binding)

- Checked source tarball content
- Checked checksums, signature

Cheers,
Gabor

On Thu, Sep 27, 2018 at 5:10 PM Zoltan Ivanfi <zi...@cloudera.com.invalid>
wrote:

> +1 (binding)
>
> - contents look good
> - units tests pass
> - checksums match
> - signature matches
>
> Thanks,
>
> Zoltan
>
> On Thu, Sep 27, 2018 at 5:02 PM Nandor Kollar <nkollar@cloudera.com.invalid
> >
> wrote:
>
> > Hi everyone,
> >
> > I propose the following RC to be released as official Apache Parquet
> > Format 2.6.0 release.
> >
> > The commit id is df6132b94f273521a418a74442085fdd5a0aa009
> > * This corresponds to the tag: apache-parquet-format-2.6.0
> > *
> >
> https://github.com/apache/parquet-format/tree/df6132b94f273521a418a74442085fdd5a0aa009
> > *
> >
> https://gitbox.apache.org/repos/asf?p=parquet-format.git;a=commit;h=df6132b94f273521a418a74442085fdd5a0aa009
> >
> > The release tarball, signature, and checksums are here:
> > *
> >
> https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-format-2.6.0-rc0
> >
> > You can find the KEYS file here:
> > * https://dist.apache.org/repos/dist/dev/parquet/KEYS
> >
> > Binary artifacts are staged in Nexus here:
> > *
> >
> https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/2.6.0
> >
> > This release includes following changes:
> >
> > PARQUET-1266 - LogicalTypes union in parquet-format doesn't include UUID
> > PARQUET-1290 - Clarify maximum run lengths for RLE encoding
> > PARQUET-1387 - Nanosecond precision time and timestamp - parquet-format
> > PARQUET-1400 - Deprecate parquet-mr related code in parquet-format
> > PARQUET-1429 - Turn off DocLint on parquet-format
> >
> > Please download, verify, and test.
> >
> > The voting will be open at least for 72 hour from now.
> >
> > [ ] +1 Release this as Apache Parquet Format 2.6.0
> > [ ] +0
> > [ ] -1 Do not release this because...
> >
> > Thanks,
> > Nandor
> >
>

Re: [VOTE] Release Apache Parquet format 2.6.0 RC0

Posted by Zoltan Ivanfi <zi...@cloudera.com.INVALID>.
+1 (binding)

- contents look good
- units tests pass
- checksums match
- signature matches

Thanks,

Zoltan

On Thu, Sep 27, 2018 at 5:02 PM Nandor Kollar <nk...@cloudera.com.invalid>
wrote:

> Hi everyone,
>
> I propose the following RC to be released as official Apache Parquet
> Format 2.6.0 release.
>
> The commit id is df6132b94f273521a418a74442085fdd5a0aa009
> * This corresponds to the tag: apache-parquet-format-2.6.0
> *
> https://github.com/apache/parquet-format/tree/df6132b94f273521a418a74442085fdd5a0aa009
> *
> https://gitbox.apache.org/repos/asf?p=parquet-format.git;a=commit;h=df6132b94f273521a418a74442085fdd5a0aa009
>
> The release tarball, signature, and checksums are here:
> *
> https://dist.apache.org/repos/dist/dev/parquet/apache-parquet-format-2.6.0-rc0
>
> You can find the KEYS file here:
> * https://dist.apache.org/repos/dist/dev/parquet/KEYS
>
> Binary artifacts are staged in Nexus here:
> *
> https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/2.6.0
>
> This release includes following changes:
>
> PARQUET-1266 - LogicalTypes union in parquet-format doesn't include UUID
> PARQUET-1290 - Clarify maximum run lengths for RLE encoding
> PARQUET-1387 - Nanosecond precision time and timestamp - parquet-format
> PARQUET-1400 - Deprecate parquet-mr related code in parquet-format
> PARQUET-1429 - Turn off DocLint on parquet-format
>
> Please download, verify, and test.
>
> The voting will be open at least for 72 hour from now.
>
> [ ] +1 Release this as Apache Parquet Format 2.6.0
> [ ] +0
> [ ] -1 Do not release this because...
>
> Thanks,
> Nandor
>