You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by Ismaël Mejía <ie...@gmail.com> on 2020/06/09 15:27:29 UTC
[VOTE] Release Apache Avro 1.10.0 RC1
Hi everyone,
I'd like to propose the following RC1 to be released as the official Apache
Avro 1.10.0 release.
The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
* This corresponds to the tag: release-1.10.0-rc1
* https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
The release tarball, signature, and checksums are here (revision 37932):
* https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
You can find the KEYS file here:
* https://dist.apache.org/repos/dist/dev/avro/KEYS
Binary artifacts for Java are staged in Nexus here:
* https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
This release includes 187 Jira issues (Thanks Ryan Skraba for the highlights)
https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
* Some interesting highlights (Thanks Ryan Skraba for the list):
C#
- [AVRO-2389] Add Avro serialization for POCO (Reflection)
Java
- [AVRO-2723] Automatically find defaults on POJO when using reflection.
- [AVRO-2278] Now throws an exception when getting a non-existent
field from a record
- [AVRO-2335] Remove Joda Time library.
- [AVRO-2438] Better support for URI and URL types.
Perl
- [AVRO-1461] Distribute as a CPAN module.
PHP
- [AVRO-2527] Update to PHP 7.x
Python
- [AVRO-2656] avro-python package is now the preferred python3 library
and avro-python3 is prepared to be deprecated
- [AVRO-2387] type checking added to python
Ruby
- [AVRO-1740] Support fingerprinting.
- [AVRO-2535] Support enum defaults.
- [AVRO-2545] Support aliases.
* Upgrade dependencies to latest versions, including CVE fixes.
* Multiple fixes and more...
Please download, verify, and test. This vote will remain open for at least
72 hours. Given sufficient votes, I would like to close after noon UTC
Friday, June 12th, 2020
[ ] +1 Release this as Apache Avro 1.10.0
[ ] +0
[ ] -1 Do not release this because...
Best regards,
Ismaël Mejía
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by Tim Perkins <tj...@cantab.net>.
Downloaded the Ruby gem and tested with several other Ruby libraries that
depend on Avro: avro-builder, avromatic, avro_turf,
avro-resolution_canonical_form
[x] +1 Release this as Apache Avro 1.10.0
[ ] +0
[ ] -1 Do not release this because...
On Thu, Jun 11, 2020 at 4:54 AM Ismaël Mejía <ie...@gmail.com> wrote:
> Kind reminder two days have passed, please check and vote!
>
> On Thu, Jun 11, 2020 at 2:29 AM Andy Le <an...@gmail.com> wrote:
> >
> > Hey Ryan,
> >
> > Thank you for your clear explanation.
> >
> > +1 for me :D
> >
> > Thank you.
> >
> >
> > On 2020/06/10 14:39:10, Ryan Skraba <ry...@skraba.com> wrote:
> > > Hey Anh, a release requires 3 PMC votes, but "unofficial" opinions are
> > > welcome and taken into account. My opinion is unofficial too!
> > >
> > > Just reply with a +1 if you think the artifacts are good to go or -1
> > > if you've found a bug, regression, security issue, or something that
> > > should block these artifacts from being the 1.10.0 release.
> > >
> > > For example, at my company, we have a lot of internal code and
> > > libraries that work with Avro 1.9.2, especially the generic Java APIs,
> > > so I'm going to compile with 1.10.0 and see if all the unit tests
> > > pass.
> > >
> > > If you're familiar with building any open source projects that use
> > > Avro, try bumping there and reporting back. You can go through the
> > > open JIRA and open PR and make recommendations if we missed something
> > > important.
> > >
> > > For example, I've gone through a lot of the JIRA and it looks like
> > > AVRO-2799 (a protobuf bug) is blocking a user. I'm looking to see if
> > > this is a regression or if it's an easy fix before I vote.
> > >
> > > I've verified the signatures and SHA512 of the artifacts, so that's
> good!
> > >
> > > All my best, Ryan
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Wed, Jun 10, 2020 at 8:53 AM Anh Le <an...@gmail.com> wrote:
> > > >
> > > > Hi,
> > > >
> > > > How can I make a vote on this?
> > > >
> > > > Best Regards.
> > > >
> > > > On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com> wrote:
> > > >
> > > > > Hi everyone,
> > > > >
> > > > > I'd like to propose the following RC1 to be released as the
> official Apache
> > > > > Avro 1.10.0 release.
> > > > >
> > > > > The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
> > > > >
> > > > > * This corresponds to the tag: release-1.10.0-rc1
> > > > > * https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
> > > > >
> > > > > The release tarball, signature, and checksums are here (revision
> 37932):
> > > > > * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
> > > > >
> > > > > You can find the KEYS file here:
> > > > > * https://dist.apache.org/repos/dist/dev/avro/KEYS
> > > > >
> > > > > Binary artifacts for Java are staged in Nexus here:
> > > > > *
> > > > >
> https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
> > > > >
> > > > > This release includes 187 Jira issues (Thanks Ryan Skraba for the
> > > > > highlights)
> > > > >
> > > > >
> https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
> > > > >
> > > > > * Some interesting highlights (Thanks Ryan Skraba for the list):
> > > > >
> > > > > C#
> > > > > - [AVRO-2389] Add Avro serialization for POCO (Reflection)
> > > > >
> > > > > Java
> > > > > - [AVRO-2723] Automatically find defaults on POJO when using
> reflection.
> > > > > - [AVRO-2278] Now throws an exception when getting a non-existent
> > > > > field from a record
> > > > > - [AVRO-2335] Remove Joda Time library.
> > > > > - [AVRO-2438] Better support for URI and URL types.
> > > > >
> > > > > Perl
> > > > > - [AVRO-1461] Distribute as a CPAN module.
> > > > >
> > > > > PHP
> > > > > - [AVRO-2527] Update to PHP 7.x
> > > > >
> > > > > Python
> > > > > - [AVRO-2656] avro-python package is now the preferred python3
> library
> > > > > and avro-python3 is prepared to be deprecated
> > > > > - [AVRO-2387] type checking added to python
> > > > >
> > > > > Ruby
> > > > > - [AVRO-1740] Support fingerprinting.
> > > > > - [AVRO-2535] Support enum defaults.
> > > > > - [AVRO-2545] Support aliases.
> > > > >
> > > > > * Upgrade dependencies to latest versions, including CVE fixes.
> > > > > * Multiple fixes and more...
> > > > >
> > > > > Please download, verify, and test. This vote will remain open for
> at least
> > > > > 72 hours. Given sufficient votes, I would like to close after noon
> UTC
> > > > > Friday, June 12th, 2020
> > > > >
> > > > > [ ] +1 Release this as Apache Avro 1.10.0
> > > > > [ ] +0
> > > > > [ ] -1 Do not release this because...
> > > > >
> > > > > Best regards,
> > > > > Ismaël Mejía
> > > > >
> > >
>
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by Ismaël Mejía <ie...@gmail.com>.
-1 for the CVE reported in AVRO-2865. It is not a severe CVE but
better to include the fix since many projects depend on maven-plugin.
I will prepare a new RC and publish it here beginning of next week.
In the meantime please help us test and report any extra issues you may see.
Regards,
Ismaël
On Tue, Jun 16, 2020 at 6:29 PM Ismaël Mejía <ie...@gmail.com> wrote:
>
> Kind reminder, We have so far 2 PMCs +1
>
> Please vote, help us with testing and validation in particular in less
> maintained languages.
>
>
>
> On Mon, Jun 15, 2020 at 9:50 AM Ryan Skraba <ry...@skraba.com> wrote:
> >
> > There's an issue to track the C# build issue:
> > https://issues.apache.org/jira/browse/AVRO-2847 Relaunching the job
> > will usually end up fixing it.
> >
> > I couldn't reproduce it on a local Window VM so it might be only
> > happening on travis. It should be unrelated to the release 1.10.x
> >
> > Best regards, Ryan
> >
> > On Sun, Jun 14, 2020 at 10:32 AM RumeshKrishnan Mohan
> > <ru...@gmail.com> wrote:
> > >
> > > Hi Team,
> > >
> > > Is someone aware of the build issue ? Looks like all the build failures for
> > > the last couple of days.
> > >
> > > + dotnet build --configuration Release Avro.sln
> > > > 90 Restore completed in 2.89 sec for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\codegen\Avro.codegen.csproj.
> > > > 91 Restore completed in 2.95 sec for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\main\Avro.main.csproj.
> > > > 92 Restore completed in 973.79 ms for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\msbuild\Avro.msbuild.csproj.
> > > > 93C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1603: Apache.Avro depends on Newtonsoft.Json (>= 10.0.3) but Newtonsoft.Json 10.0.3 was not found. An approximate best match of Newtonsoft.Json 11.0.2 was resolved. [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > > > 94C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package nunit. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > > > 95C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package nunit3testadapter. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > > > 96C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package NUnit.ConsoleRunner. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > > > 97C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package Microsoft.NET.Test.Sdk. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > > > 98C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package System.CodeDom. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > > > 99 Restore failed in 75.03 ms for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj.
> > > > 100 Restore completed in 1.16 sec for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\perf\Avro.perf.csproj.
> > > > 101
> > > > 102Build FAILED.
> > > >
> > > >
> > >
> > >
> > >
> > > Thanks and Regards
> > > *Rumeshkrishnan Mohan*
> > >
> > >
> > > On Sun, Jun 14, 2020 at 8:53 AM Driesprong, Fokko <fo...@driesprong.frl>
> > > wrote:
> > >
> > > > Thanks Ismaël for running the release. I've just tested an all looks good.
> > > >
> > > > +1 (binding)
> > > >
> > > > Cheers, Fokko
> > > >
> > > > Op za 13 jun. 2020 om 13:23 schreef Ryan Skraba <ry...@skraba.com>:
> > > >
> > > > > The only change necessary to compile Parquet with the 1.10.0 RC1
> > > > > artifacts was to add `<fieldVisibility>public</fieldVisibility>` to
> > > > > the parquet-avro pom.xml so that field members are generated with
> > > > > public access (the default is now private). Or we could rewrite the
> > > > > test classes to use getters!
> > > > >
> > > > > (Just for info, if you want to reproduce my build, I also changed the
> > > > > repositories and pluginRepositories to temporarily include the
> > > > > https://repository.apache.org/content/groups/staging for these release
> > > > > candidates. Something in my settings makes protoc-jar-maven-plugin
> > > > > unhappy with this setup, and the workaround is to build to a brand new
> > > > > local m2: `-Dmaven.repo.local=/tmp/m2` )
> > > > >
> > > > > I'm interested in your Parquet/Avro/Spark experience! I've gotten
> > > > > them to work together using Apache Beam on Spark and extensive shading
> > > > > :/ Ismael has done some excellent (and tricky!) work trying to get
> > > > > the communities to move forward together!
> > > > >
> > > > > All my best, Ryan
> > > > >
> > > > > On Fri, Jun 12, 2020 at 7:23 PM Michael Heuer <he...@gmail.com> wrote:
> > > > > >
> > > > > > Hello Ryan,
> > > > > >
> > > > > > If you don't mind me asking, what were the changes you found necessary
> > > > > for Parquet to work with Avro 1.10?
> > > > > >
> > > > > > The only reason I lurk on this mailing list is in the vain hope that
> > > > > Parquet and Avro and Spark will work together nicely at some point.
> > > > > >
> > > > > > michael
> > > > > >
> > > > > >
> > > > > > > On Jun 12, 2020, at 3:44 AM, Ryan Skraba <ry...@skraba.com> wrote:
> > > > > > >
> > > > > > > Hello!
> > > > > > >
> > > > > > > I checked the signature and SHA512 sums of the artifacts.
> > > > > > >
> > > > > > > Internally we have a large library of internal code that uses Avro
> > > > > > > 1.9, and it all recompiled and tests succeeded without modification.
> > > > > > >
> > > > > > > We have some other code that definitely breaks with 1.10 because of
> > > > > > > AVRO-2278 (getting an unknown field throws an exception). In
> > > > > > > practice, it's not going to impact us in the short term, since it's
> > > > > > > all run on a cluster where the avro version is provided (and usually
> > > > > > > 1.8.x). Our code will need to be rewritten to handle these
> > > > exceptions
> > > > > > > gracefully for Avro 1.10+
> > > > > > >
> > > > > > > Parquet needed some minor massaging because of the change to the
> > > > > > > avro-maven-plugin (now generates private field members). This should
> > > > > > > definitely be in the release notes:
> > > > > > >
> > > > > > > AVRO-2581: Maven plugin generates specific records with private
> > > > fields.
> > > > > > >
> > > > > > > The arrow Avro adapter builds and tests with the 1.10.0 RC
> > > > artifacts.
> > > > > > >
> > > > > > > I did some minor tests with a toy python project (both py and py3).
> > > > > > >
> > > > > > > +1 for me (mostly Java, some python).
> > > > > > >
> > > > > > > If there is a blocker or another release candidate, AVRO-2849 (spec
> > > > > > > clarification) would be nice to include.
> > > > > > >
> > > > > > > All my best and thanks for the work, Ismael!
> > > > > > >
> > > > > > > Ryan
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Jun 11, 2020 at 2:25 PM Daniel Kulp <dk...@apache.org>
> > > > wrote:
> > > > > > >>
> > > > > > >> +1
> > > > > > >>
> > > > > > >> Been playing around with it a bit and it looks OK.
> > > > > > >>
> > > > > > >> Dan
> > > > > > >>
> > > > > > >>
> > > > > > >>> On Jun 11, 2020, at 4:53 AM, Ismaël Mejía <ie...@gmail.com>
> > > > wrote:
> > > > > > >>>
> > > > > > >>> Kind reminder two days have passed, please check and vote!
> > > > > > >>>
> > > > > > >>> On Thu, Jun 11, 2020 at 2:29 AM Andy Le <an...@gmail.com> wrote:
> > > > > > >>>>
> > > > > > >>>> Hey Ryan,
> > > > > > >>>>
> > > > > > >>>> Thank you for your clear explanation.
> > > > > > >>>>
> > > > > > >>>> +1 for me :D
> > > > > > >>>>
> > > > > > >>>> Thank you.
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> On 2020/06/10 14:39:10, Ryan Skraba <ry...@skraba.com> wrote:
> > > > > > >>>>> Hey Anh, a release requires 3 PMC votes, but "unofficial"
> > > > opinions
> > > > > are
> > > > > > >>>>> welcome and taken into account. My opinion is unofficial too!
> > > > > > >>>>>
> > > > > > >>>>> Just reply with a +1 if you think the artifacts are good to go or
> > > > > -1
> > > > > > >>>>> if you've found a bug, regression, security issue, or something
> > > > > that
> > > > > > >>>>> should block these artifacts from being the 1.10.0 release.
> > > > > > >>>>>
> > > > > > >>>>> For example, at my company, we have a lot of internal code and
> > > > > > >>>>> libraries that work with Avro 1.9.2, especially the generic Java
> > > > > APIs,
> > > > > > >>>>> so I'm going to compile with 1.10.0 and see if all the unit tests
> > > > > > >>>>> pass.
> > > > > > >>>>>
> > > > > > >>>>> If you're familiar with building any open source projects that
> > > > use
> > > > > > >>>>> Avro, try bumping there and reporting back. You can go through
> > > > the
> > > > > > >>>>> open JIRA and open PR and make recommendations if we missed
> > > > > something
> > > > > > >>>>> important.
> > > > > > >>>>>
> > > > > > >>>>> For example, I've gone through a lot of the JIRA and it looks
> > > > like
> > > > > > >>>>> AVRO-2799 (a protobuf bug) is blocking a user. I'm looking to
> > > > see
> > > > > if
> > > > > > >>>>> this is a regression or if it's an easy fix before I vote.
> > > > > > >>>>>
> > > > > > >>>>> I've verified the signatures and SHA512 of the artifacts, so
> > > > > that's good!
> > > > > > >>>>>
> > > > > > >>>>> All my best, Ryan
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> On Wed, Jun 10, 2020 at 8:53 AM Anh Le <an...@gmail.com>
> > > > wrote:
> > > > > > >>>>>>
> > > > > > >>>>>> Hi,
> > > > > > >>>>>>
> > > > > > >>>>>> How can I make a vote on this?
> > > > > > >>>>>>
> > > > > > >>>>>> Best Regards.
> > > > > > >>>>>>
> > > > > > >>>>>> On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com>
> > > > > wrote:
> > > > > > >>>>>>
> > > > > > >>>>>>> Hi everyone,
> > > > > > >>>>>>>
> > > > > > >>>>>>> I'd like to propose the following RC1 to be released as the
> > > > > official Apache
> > > > > > >>>>>>> Avro 1.10.0 release.
> > > > > > >>>>>>>
> > > > > > >>>>>>> The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
> > > > > > >>>>>>>
> > > > > > >>>>>>> * This corresponds to the tag: release-1.10.0-rc1
> > > > > > >>>>>>> *
> > > > https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
> > > > > > >>>>>>>
> > > > > > >>>>>>> The release tarball, signature, and checksums are here
> > > > (revision
> > > > > 37932):
> > > > > > >>>>>>> * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
> > > > > > >>>>>>>
> > > > > > >>>>>>> You can find the KEYS file here:
> > > > > > >>>>>>> * https://dist.apache.org/repos/dist/dev/avro/KEYS
> > > > > > >>>>>>>
> > > > > > >>>>>>> Binary artifacts for Java are staged in Nexus here:
> > > > > > >>>>>>> *
> > > > > > >>>>>>>
> > > > >
> > > > https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
> > > > > > >>>>>>>
> > > > > > >>>>>>> This release includes 187 Jira issues (Thanks Ryan Skraba for
> > > > the
> > > > > > >>>>>>> highlights)
> > > > > > >>>>>>>
> > > > > > >>>>>>>
> > > > >
> > > > https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
> > > > > > >>>>>>>
> > > > > > >>>>>>> * Some interesting highlights (Thanks Ryan Skraba for the
> > > > list):
> > > > > > >>>>>>>
> > > > > > >>>>>>> C#
> > > > > > >>>>>>> - [AVRO-2389] Add Avro serialization for POCO (Reflection)
> > > > > > >>>>>>>
> > > > > > >>>>>>> Java
> > > > > > >>>>>>> - [AVRO-2723] Automatically find defaults on POJO when using
> > > > > reflection.
> > > > > > >>>>>>> - [AVRO-2278] Now throws an exception when getting a
> > > > non-existent
> > > > > > >>>>>>> field from a record
> > > > > > >>>>>>> - [AVRO-2335] Remove Joda Time library.
> > > > > > >>>>>>> - [AVRO-2438] Better support for URI and URL types.
> > > > > > >>>>>>>
> > > > > > >>>>>>> Perl
> > > > > > >>>>>>> - [AVRO-1461] Distribute as a CPAN module.
> > > > > > >>>>>>>
> > > > > > >>>>>>> PHP
> > > > > > >>>>>>> - [AVRO-2527] Update to PHP 7.x
> > > > > > >>>>>>>
> > > > > > >>>>>>> Python
> > > > > > >>>>>>> - [AVRO-2656] avro-python package is now the preferred python3
> > > > > library
> > > > > > >>>>>>> and avro-python3 is prepared to be deprecated
> > > > > > >>>>>>> - [AVRO-2387] type checking added to python
> > > > > > >>>>>>>
> > > > > > >>>>>>> Ruby
> > > > > > >>>>>>> - [AVRO-1740] Support fingerprinting.
> > > > > > >>>>>>> - [AVRO-2535] Support enum defaults.
> > > > > > >>>>>>> - [AVRO-2545] Support aliases.
> > > > > > >>>>>>>
> > > > > > >>>>>>> * Upgrade dependencies to latest versions, including CVE fixes.
> > > > > > >>>>>>> * Multiple fixes and more...
> > > > > > >>>>>>>
> > > > > > >>>>>>> Please download, verify, and test. This vote will remain open
> > > > > for at least
> > > > > > >>>>>>> 72 hours. Given sufficient votes, I would like to close after
> > > > > noon UTC
> > > > > > >>>>>>> Friday, June 12th, 2020
> > > > > > >>>>>>>
> > > > > > >>>>>>> [ ] +1 Release this as Apache Avro 1.10.0
> > > > > > >>>>>>> [ ] +0
> > > > > > >>>>>>> [ ] -1 Do not release this because...
> > > > > > >>>>>>>
> > > > > > >>>>>>> Best regards,
> > > > > > >>>>>>> Ismaël Mejía
> > > > > > >>>>>>>
> > > > > > >>>>>
> > > > > > >>
> > > > > > >> --
> > > > > > >> Daniel Kulp
> > > > > > >> dkulp@apache.org <ma...@apache.org> -
> > > > http://dankulp.com/blog
> > > > > <http://dankulp.com/blog>
> > > > > > >> Talend Community Coder - http://talend.com <
> > > > http://coders.talend.com/
> > > > > >
> > > > > >
> > > > >
> > > >
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by Ismaël Mejía <ie...@gmail.com>.
Kind reminder, We have so far 2 PMCs +1
Please vote, help us with testing and validation in particular in less
maintained languages.
On Mon, Jun 15, 2020 at 9:50 AM Ryan Skraba <ry...@skraba.com> wrote:
>
> There's an issue to track the C# build issue:
> https://issues.apache.org/jira/browse/AVRO-2847 Relaunching the job
> will usually end up fixing it.
>
> I couldn't reproduce it on a local Window VM so it might be only
> happening on travis. It should be unrelated to the release 1.10.x
>
> Best regards, Ryan
>
> On Sun, Jun 14, 2020 at 10:32 AM RumeshKrishnan Mohan
> <ru...@gmail.com> wrote:
> >
> > Hi Team,
> >
> > Is someone aware of the build issue ? Looks like all the build failures for
> > the last couple of days.
> >
> > + dotnet build --configuration Release Avro.sln
> > > 90 Restore completed in 2.89 sec for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\codegen\Avro.codegen.csproj.
> > > 91 Restore completed in 2.95 sec for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\main\Avro.main.csproj.
> > > 92 Restore completed in 973.79 ms for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\msbuild\Avro.msbuild.csproj.
> > > 93C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1603: Apache.Avro depends on Newtonsoft.Json (>= 10.0.3) but Newtonsoft.Json 10.0.3 was not found. An approximate best match of Newtonsoft.Json 11.0.2 was resolved. [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > > 94C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package nunit. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > > 95C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package nunit3testadapter. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > > 96C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package NUnit.ConsoleRunner. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > > 97C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package Microsoft.NET.Test.Sdk. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > > 98C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package System.CodeDom. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > > 99 Restore failed in 75.03 ms for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj.
> > > 100 Restore completed in 1.16 sec for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\perf\Avro.perf.csproj.
> > > 101
> > > 102Build FAILED.
> > >
> > >
> >
> >
> >
> > Thanks and Regards
> > *Rumeshkrishnan Mohan*
> >
> >
> > On Sun, Jun 14, 2020 at 8:53 AM Driesprong, Fokko <fo...@driesprong.frl>
> > wrote:
> >
> > > Thanks Ismaël for running the release. I've just tested an all looks good.
> > >
> > > +1 (binding)
> > >
> > > Cheers, Fokko
> > >
> > > Op za 13 jun. 2020 om 13:23 schreef Ryan Skraba <ry...@skraba.com>:
> > >
> > > > The only change necessary to compile Parquet with the 1.10.0 RC1
> > > > artifacts was to add `<fieldVisibility>public</fieldVisibility>` to
> > > > the parquet-avro pom.xml so that field members are generated with
> > > > public access (the default is now private). Or we could rewrite the
> > > > test classes to use getters!
> > > >
> > > > (Just for info, if you want to reproduce my build, I also changed the
> > > > repositories and pluginRepositories to temporarily include the
> > > > https://repository.apache.org/content/groups/staging for these release
> > > > candidates. Something in my settings makes protoc-jar-maven-plugin
> > > > unhappy with this setup, and the workaround is to build to a brand new
> > > > local m2: `-Dmaven.repo.local=/tmp/m2` )
> > > >
> > > > I'm interested in your Parquet/Avro/Spark experience! I've gotten
> > > > them to work together using Apache Beam on Spark and extensive shading
> > > > :/ Ismael has done some excellent (and tricky!) work trying to get
> > > > the communities to move forward together!
> > > >
> > > > All my best, Ryan
> > > >
> > > > On Fri, Jun 12, 2020 at 7:23 PM Michael Heuer <he...@gmail.com> wrote:
> > > > >
> > > > > Hello Ryan,
> > > > >
> > > > > If you don't mind me asking, what were the changes you found necessary
> > > > for Parquet to work with Avro 1.10?
> > > > >
> > > > > The only reason I lurk on this mailing list is in the vain hope that
> > > > Parquet and Avro and Spark will work together nicely at some point.
> > > > >
> > > > > michael
> > > > >
> > > > >
> > > > > > On Jun 12, 2020, at 3:44 AM, Ryan Skraba <ry...@skraba.com> wrote:
> > > > > >
> > > > > > Hello!
> > > > > >
> > > > > > I checked the signature and SHA512 sums of the artifacts.
> > > > > >
> > > > > > Internally we have a large library of internal code that uses Avro
> > > > > > 1.9, and it all recompiled and tests succeeded without modification.
> > > > > >
> > > > > > We have some other code that definitely breaks with 1.10 because of
> > > > > > AVRO-2278 (getting an unknown field throws an exception). In
> > > > > > practice, it's not going to impact us in the short term, since it's
> > > > > > all run on a cluster where the avro version is provided (and usually
> > > > > > 1.8.x). Our code will need to be rewritten to handle these
> > > exceptions
> > > > > > gracefully for Avro 1.10+
> > > > > >
> > > > > > Parquet needed some minor massaging because of the change to the
> > > > > > avro-maven-plugin (now generates private field members). This should
> > > > > > definitely be in the release notes:
> > > > > >
> > > > > > AVRO-2581: Maven plugin generates specific records with private
> > > fields.
> > > > > >
> > > > > > The arrow Avro adapter builds and tests with the 1.10.0 RC
> > > artifacts.
> > > > > >
> > > > > > I did some minor tests with a toy python project (both py and py3).
> > > > > >
> > > > > > +1 for me (mostly Java, some python).
> > > > > >
> > > > > > If there is a blocker or another release candidate, AVRO-2849 (spec
> > > > > > clarification) would be nice to include.
> > > > > >
> > > > > > All my best and thanks for the work, Ismael!
> > > > > >
> > > > > > Ryan
> > > > > >
> > > > > >
> > > > > > On Thu, Jun 11, 2020 at 2:25 PM Daniel Kulp <dk...@apache.org>
> > > wrote:
> > > > > >>
> > > > > >> +1
> > > > > >>
> > > > > >> Been playing around with it a bit and it looks OK.
> > > > > >>
> > > > > >> Dan
> > > > > >>
> > > > > >>
> > > > > >>> On Jun 11, 2020, at 4:53 AM, Ismaël Mejía <ie...@gmail.com>
> > > wrote:
> > > > > >>>
> > > > > >>> Kind reminder two days have passed, please check and vote!
> > > > > >>>
> > > > > >>> On Thu, Jun 11, 2020 at 2:29 AM Andy Le <an...@gmail.com> wrote:
> > > > > >>>>
> > > > > >>>> Hey Ryan,
> > > > > >>>>
> > > > > >>>> Thank you for your clear explanation.
> > > > > >>>>
> > > > > >>>> +1 for me :D
> > > > > >>>>
> > > > > >>>> Thank you.
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> On 2020/06/10 14:39:10, Ryan Skraba <ry...@skraba.com> wrote:
> > > > > >>>>> Hey Anh, a release requires 3 PMC votes, but "unofficial"
> > > opinions
> > > > are
> > > > > >>>>> welcome and taken into account. My opinion is unofficial too!
> > > > > >>>>>
> > > > > >>>>> Just reply with a +1 if you think the artifacts are good to go or
> > > > -1
> > > > > >>>>> if you've found a bug, regression, security issue, or something
> > > > that
> > > > > >>>>> should block these artifacts from being the 1.10.0 release.
> > > > > >>>>>
> > > > > >>>>> For example, at my company, we have a lot of internal code and
> > > > > >>>>> libraries that work with Avro 1.9.2, especially the generic Java
> > > > APIs,
> > > > > >>>>> so I'm going to compile with 1.10.0 and see if all the unit tests
> > > > > >>>>> pass.
> > > > > >>>>>
> > > > > >>>>> If you're familiar with building any open source projects that
> > > use
> > > > > >>>>> Avro, try bumping there and reporting back. You can go through
> > > the
> > > > > >>>>> open JIRA and open PR and make recommendations if we missed
> > > > something
> > > > > >>>>> important.
> > > > > >>>>>
> > > > > >>>>> For example, I've gone through a lot of the JIRA and it looks
> > > like
> > > > > >>>>> AVRO-2799 (a protobuf bug) is blocking a user. I'm looking to
> > > see
> > > > if
> > > > > >>>>> this is a regression or if it's an easy fix before I vote.
> > > > > >>>>>
> > > > > >>>>> I've verified the signatures and SHA512 of the artifacts, so
> > > > that's good!
> > > > > >>>>>
> > > > > >>>>> All my best, Ryan
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> On Wed, Jun 10, 2020 at 8:53 AM Anh Le <an...@gmail.com>
> > > wrote:
> > > > > >>>>>>
> > > > > >>>>>> Hi,
> > > > > >>>>>>
> > > > > >>>>>> How can I make a vote on this?
> > > > > >>>>>>
> > > > > >>>>>> Best Regards.
> > > > > >>>>>>
> > > > > >>>>>> On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com>
> > > > wrote:
> > > > > >>>>>>
> > > > > >>>>>>> Hi everyone,
> > > > > >>>>>>>
> > > > > >>>>>>> I'd like to propose the following RC1 to be released as the
> > > > official Apache
> > > > > >>>>>>> Avro 1.10.0 release.
> > > > > >>>>>>>
> > > > > >>>>>>> The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
> > > > > >>>>>>>
> > > > > >>>>>>> * This corresponds to the tag: release-1.10.0-rc1
> > > > > >>>>>>> *
> > > https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
> > > > > >>>>>>>
> > > > > >>>>>>> The release tarball, signature, and checksums are here
> > > (revision
> > > > 37932):
> > > > > >>>>>>> * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
> > > > > >>>>>>>
> > > > > >>>>>>> You can find the KEYS file here:
> > > > > >>>>>>> * https://dist.apache.org/repos/dist/dev/avro/KEYS
> > > > > >>>>>>>
> > > > > >>>>>>> Binary artifacts for Java are staged in Nexus here:
> > > > > >>>>>>> *
> > > > > >>>>>>>
> > > >
> > > https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
> > > > > >>>>>>>
> > > > > >>>>>>> This release includes 187 Jira issues (Thanks Ryan Skraba for
> > > the
> > > > > >>>>>>> highlights)
> > > > > >>>>>>>
> > > > > >>>>>>>
> > > >
> > > https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
> > > > > >>>>>>>
> > > > > >>>>>>> * Some interesting highlights (Thanks Ryan Skraba for the
> > > list):
> > > > > >>>>>>>
> > > > > >>>>>>> C#
> > > > > >>>>>>> - [AVRO-2389] Add Avro serialization for POCO (Reflection)
> > > > > >>>>>>>
> > > > > >>>>>>> Java
> > > > > >>>>>>> - [AVRO-2723] Automatically find defaults on POJO when using
> > > > reflection.
> > > > > >>>>>>> - [AVRO-2278] Now throws an exception when getting a
> > > non-existent
> > > > > >>>>>>> field from a record
> > > > > >>>>>>> - [AVRO-2335] Remove Joda Time library.
> > > > > >>>>>>> - [AVRO-2438] Better support for URI and URL types.
> > > > > >>>>>>>
> > > > > >>>>>>> Perl
> > > > > >>>>>>> - [AVRO-1461] Distribute as a CPAN module.
> > > > > >>>>>>>
> > > > > >>>>>>> PHP
> > > > > >>>>>>> - [AVRO-2527] Update to PHP 7.x
> > > > > >>>>>>>
> > > > > >>>>>>> Python
> > > > > >>>>>>> - [AVRO-2656] avro-python package is now the preferred python3
> > > > library
> > > > > >>>>>>> and avro-python3 is prepared to be deprecated
> > > > > >>>>>>> - [AVRO-2387] type checking added to python
> > > > > >>>>>>>
> > > > > >>>>>>> Ruby
> > > > > >>>>>>> - [AVRO-1740] Support fingerprinting.
> > > > > >>>>>>> - [AVRO-2535] Support enum defaults.
> > > > > >>>>>>> - [AVRO-2545] Support aliases.
> > > > > >>>>>>>
> > > > > >>>>>>> * Upgrade dependencies to latest versions, including CVE fixes.
> > > > > >>>>>>> * Multiple fixes and more...
> > > > > >>>>>>>
> > > > > >>>>>>> Please download, verify, and test. This vote will remain open
> > > > for at least
> > > > > >>>>>>> 72 hours. Given sufficient votes, I would like to close after
> > > > noon UTC
> > > > > >>>>>>> Friday, June 12th, 2020
> > > > > >>>>>>>
> > > > > >>>>>>> [ ] +1 Release this as Apache Avro 1.10.0
> > > > > >>>>>>> [ ] +0
> > > > > >>>>>>> [ ] -1 Do not release this because...
> > > > > >>>>>>>
> > > > > >>>>>>> Best regards,
> > > > > >>>>>>> Ismaël Mejía
> > > > > >>>>>>>
> > > > > >>>>>
> > > > > >>
> > > > > >> --
> > > > > >> Daniel Kulp
> > > > > >> dkulp@apache.org <ma...@apache.org> -
> > > http://dankulp.com/blog
> > > > <http://dankulp.com/blog>
> > > > > >> Talend Community Coder - http://talend.com <
> > > http://coders.talend.com/
> > > > >
> > > > >
> > > >
> > >
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by Ryan Skraba <ry...@skraba.com>.
There's an issue to track the C# build issue:
https://issues.apache.org/jira/browse/AVRO-2847 Relaunching the job
will usually end up fixing it.
I couldn't reproduce it on a local Window VM so it might be only
happening on travis. It should be unrelated to the release 1.10.x
Best regards, Ryan
On Sun, Jun 14, 2020 at 10:32 AM RumeshKrishnan Mohan
<ru...@gmail.com> wrote:
>
> Hi Team,
>
> Is someone aware of the build issue ? Looks like all the build failures for
> the last couple of days.
>
> + dotnet build --configuration Release Avro.sln
> > 90 Restore completed in 2.89 sec for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\codegen\Avro.codegen.csproj.
> > 91 Restore completed in 2.95 sec for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\main\Avro.main.csproj.
> > 92 Restore completed in 973.79 ms for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\msbuild\Avro.msbuild.csproj.
> > 93C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1603: Apache.Avro depends on Newtonsoft.Json (>= 10.0.3) but Newtonsoft.Json 10.0.3 was not found. An approximate best match of Newtonsoft.Json 11.0.2 was resolved. [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > 94C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package nunit. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > 95C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package nunit3testadapter. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > 96C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package NUnit.ConsoleRunner. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > 97C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package Microsoft.NET.Test.Sdk. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > 98C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package System.CodeDom. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> > 99 Restore failed in 75.03 ms for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj.
> > 100 Restore completed in 1.16 sec for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\perf\Avro.perf.csproj.
> > 101
> > 102Build FAILED.
> >
> >
>
>
>
> Thanks and Regards
> *Rumeshkrishnan Mohan*
>
>
> On Sun, Jun 14, 2020 at 8:53 AM Driesprong, Fokko <fo...@driesprong.frl>
> wrote:
>
> > Thanks Ismaël for running the release. I've just tested an all looks good.
> >
> > +1 (binding)
> >
> > Cheers, Fokko
> >
> > Op za 13 jun. 2020 om 13:23 schreef Ryan Skraba <ry...@skraba.com>:
> >
> > > The only change necessary to compile Parquet with the 1.10.0 RC1
> > > artifacts was to add `<fieldVisibility>public</fieldVisibility>` to
> > > the parquet-avro pom.xml so that field members are generated with
> > > public access (the default is now private). Or we could rewrite the
> > > test classes to use getters!
> > >
> > > (Just for info, if you want to reproduce my build, I also changed the
> > > repositories and pluginRepositories to temporarily include the
> > > https://repository.apache.org/content/groups/staging for these release
> > > candidates. Something in my settings makes protoc-jar-maven-plugin
> > > unhappy with this setup, and the workaround is to build to a brand new
> > > local m2: `-Dmaven.repo.local=/tmp/m2` )
> > >
> > > I'm interested in your Parquet/Avro/Spark experience! I've gotten
> > > them to work together using Apache Beam on Spark and extensive shading
> > > :/ Ismael has done some excellent (and tricky!) work trying to get
> > > the communities to move forward together!
> > >
> > > All my best, Ryan
> > >
> > > On Fri, Jun 12, 2020 at 7:23 PM Michael Heuer <he...@gmail.com> wrote:
> > > >
> > > > Hello Ryan,
> > > >
> > > > If you don't mind me asking, what were the changes you found necessary
> > > for Parquet to work with Avro 1.10?
> > > >
> > > > The only reason I lurk on this mailing list is in the vain hope that
> > > Parquet and Avro and Spark will work together nicely at some point.
> > > >
> > > > michael
> > > >
> > > >
> > > > > On Jun 12, 2020, at 3:44 AM, Ryan Skraba <ry...@skraba.com> wrote:
> > > > >
> > > > > Hello!
> > > > >
> > > > > I checked the signature and SHA512 sums of the artifacts.
> > > > >
> > > > > Internally we have a large library of internal code that uses Avro
> > > > > 1.9, and it all recompiled and tests succeeded without modification.
> > > > >
> > > > > We have some other code that definitely breaks with 1.10 because of
> > > > > AVRO-2278 (getting an unknown field throws an exception). In
> > > > > practice, it's not going to impact us in the short term, since it's
> > > > > all run on a cluster where the avro version is provided (and usually
> > > > > 1.8.x). Our code will need to be rewritten to handle these
> > exceptions
> > > > > gracefully for Avro 1.10+
> > > > >
> > > > > Parquet needed some minor massaging because of the change to the
> > > > > avro-maven-plugin (now generates private field members). This should
> > > > > definitely be in the release notes:
> > > > >
> > > > > AVRO-2581: Maven plugin generates specific records with private
> > fields.
> > > > >
> > > > > The arrow Avro adapter builds and tests with the 1.10.0 RC
> > artifacts.
> > > > >
> > > > > I did some minor tests with a toy python project (both py and py3).
> > > > >
> > > > > +1 for me (mostly Java, some python).
> > > > >
> > > > > If there is a blocker or another release candidate, AVRO-2849 (spec
> > > > > clarification) would be nice to include.
> > > > >
> > > > > All my best and thanks for the work, Ismael!
> > > > >
> > > > > Ryan
> > > > >
> > > > >
> > > > > On Thu, Jun 11, 2020 at 2:25 PM Daniel Kulp <dk...@apache.org>
> > wrote:
> > > > >>
> > > > >> +1
> > > > >>
> > > > >> Been playing around with it a bit and it looks OK.
> > > > >>
> > > > >> Dan
> > > > >>
> > > > >>
> > > > >>> On Jun 11, 2020, at 4:53 AM, Ismaël Mejía <ie...@gmail.com>
> > wrote:
> > > > >>>
> > > > >>> Kind reminder two days have passed, please check and vote!
> > > > >>>
> > > > >>> On Thu, Jun 11, 2020 at 2:29 AM Andy Le <an...@gmail.com> wrote:
> > > > >>>>
> > > > >>>> Hey Ryan,
> > > > >>>>
> > > > >>>> Thank you for your clear explanation.
> > > > >>>>
> > > > >>>> +1 for me :D
> > > > >>>>
> > > > >>>> Thank you.
> > > > >>>>
> > > > >>>>
> > > > >>>> On 2020/06/10 14:39:10, Ryan Skraba <ry...@skraba.com> wrote:
> > > > >>>>> Hey Anh, a release requires 3 PMC votes, but "unofficial"
> > opinions
> > > are
> > > > >>>>> welcome and taken into account. My opinion is unofficial too!
> > > > >>>>>
> > > > >>>>> Just reply with a +1 if you think the artifacts are good to go or
> > > -1
> > > > >>>>> if you've found a bug, regression, security issue, or something
> > > that
> > > > >>>>> should block these artifacts from being the 1.10.0 release.
> > > > >>>>>
> > > > >>>>> For example, at my company, we have a lot of internal code and
> > > > >>>>> libraries that work with Avro 1.9.2, especially the generic Java
> > > APIs,
> > > > >>>>> so I'm going to compile with 1.10.0 and see if all the unit tests
> > > > >>>>> pass.
> > > > >>>>>
> > > > >>>>> If you're familiar with building any open source projects that
> > use
> > > > >>>>> Avro, try bumping there and reporting back. You can go through
> > the
> > > > >>>>> open JIRA and open PR and make recommendations if we missed
> > > something
> > > > >>>>> important.
> > > > >>>>>
> > > > >>>>> For example, I've gone through a lot of the JIRA and it looks
> > like
> > > > >>>>> AVRO-2799 (a protobuf bug) is blocking a user. I'm looking to
> > see
> > > if
> > > > >>>>> this is a regression or if it's an easy fix before I vote.
> > > > >>>>>
> > > > >>>>> I've verified the signatures and SHA512 of the artifacts, so
> > > that's good!
> > > > >>>>>
> > > > >>>>> All my best, Ryan
> > > > >>>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> On Wed, Jun 10, 2020 at 8:53 AM Anh Le <an...@gmail.com>
> > wrote:
> > > > >>>>>>
> > > > >>>>>> Hi,
> > > > >>>>>>
> > > > >>>>>> How can I make a vote on this?
> > > > >>>>>>
> > > > >>>>>> Best Regards.
> > > > >>>>>>
> > > > >>>>>> On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com>
> > > wrote:
> > > > >>>>>>
> > > > >>>>>>> Hi everyone,
> > > > >>>>>>>
> > > > >>>>>>> I'd like to propose the following RC1 to be released as the
> > > official Apache
> > > > >>>>>>> Avro 1.10.0 release.
> > > > >>>>>>>
> > > > >>>>>>> The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
> > > > >>>>>>>
> > > > >>>>>>> * This corresponds to the tag: release-1.10.0-rc1
> > > > >>>>>>> *
> > https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
> > > > >>>>>>>
> > > > >>>>>>> The release tarball, signature, and checksums are here
> > (revision
> > > 37932):
> > > > >>>>>>> * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
> > > > >>>>>>>
> > > > >>>>>>> You can find the KEYS file here:
> > > > >>>>>>> * https://dist.apache.org/repos/dist/dev/avro/KEYS
> > > > >>>>>>>
> > > > >>>>>>> Binary artifacts for Java are staged in Nexus here:
> > > > >>>>>>> *
> > > > >>>>>>>
> > >
> > https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
> > > > >>>>>>>
> > > > >>>>>>> This release includes 187 Jira issues (Thanks Ryan Skraba for
> > the
> > > > >>>>>>> highlights)
> > > > >>>>>>>
> > > > >>>>>>>
> > >
> > https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
> > > > >>>>>>>
> > > > >>>>>>> * Some interesting highlights (Thanks Ryan Skraba for the
> > list):
> > > > >>>>>>>
> > > > >>>>>>> C#
> > > > >>>>>>> - [AVRO-2389] Add Avro serialization for POCO (Reflection)
> > > > >>>>>>>
> > > > >>>>>>> Java
> > > > >>>>>>> - [AVRO-2723] Automatically find defaults on POJO when using
> > > reflection.
> > > > >>>>>>> - [AVRO-2278] Now throws an exception when getting a
> > non-existent
> > > > >>>>>>> field from a record
> > > > >>>>>>> - [AVRO-2335] Remove Joda Time library.
> > > > >>>>>>> - [AVRO-2438] Better support for URI and URL types.
> > > > >>>>>>>
> > > > >>>>>>> Perl
> > > > >>>>>>> - [AVRO-1461] Distribute as a CPAN module.
> > > > >>>>>>>
> > > > >>>>>>> PHP
> > > > >>>>>>> - [AVRO-2527] Update to PHP 7.x
> > > > >>>>>>>
> > > > >>>>>>> Python
> > > > >>>>>>> - [AVRO-2656] avro-python package is now the preferred python3
> > > library
> > > > >>>>>>> and avro-python3 is prepared to be deprecated
> > > > >>>>>>> - [AVRO-2387] type checking added to python
> > > > >>>>>>>
> > > > >>>>>>> Ruby
> > > > >>>>>>> - [AVRO-1740] Support fingerprinting.
> > > > >>>>>>> - [AVRO-2535] Support enum defaults.
> > > > >>>>>>> - [AVRO-2545] Support aliases.
> > > > >>>>>>>
> > > > >>>>>>> * Upgrade dependencies to latest versions, including CVE fixes.
> > > > >>>>>>> * Multiple fixes and more...
> > > > >>>>>>>
> > > > >>>>>>> Please download, verify, and test. This vote will remain open
> > > for at least
> > > > >>>>>>> 72 hours. Given sufficient votes, I would like to close after
> > > noon UTC
> > > > >>>>>>> Friday, June 12th, 2020
> > > > >>>>>>>
> > > > >>>>>>> [ ] +1 Release this as Apache Avro 1.10.0
> > > > >>>>>>> [ ] +0
> > > > >>>>>>> [ ] -1 Do not release this because...
> > > > >>>>>>>
> > > > >>>>>>> Best regards,
> > > > >>>>>>> Ismaël Mejía
> > > > >>>>>>>
> > > > >>>>>
> > > > >>
> > > > >> --
> > > > >> Daniel Kulp
> > > > >> dkulp@apache.org <ma...@apache.org> -
> > http://dankulp.com/blog
> > > <http://dankulp.com/blog>
> > > > >> Talend Community Coder - http://talend.com <
> > http://coders.talend.com/
> > > >
> > > >
> > >
> >
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by RumeshKrishnan Mohan <ru...@gmail.com>.
Hi Team,
Is someone aware of the build issue ? Looks like all the build failures for
the last couple of days.
+ dotnet build --configuration Release Avro.sln
> 90 Restore completed in 2.89 sec for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\codegen\Avro.codegen.csproj.
> 91 Restore completed in 2.95 sec for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\main\Avro.main.csproj.
> 92 Restore completed in 973.79 ms for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\msbuild\Avro.msbuild.csproj.
> 93C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1603: Apache.Avro depends on Newtonsoft.Json (>= 10.0.3) but Newtonsoft.Json 10.0.3 was not found. An approximate best match of Newtonsoft.Json 11.0.2 was resolved. [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> 94C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package nunit. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> 95C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package nunit3testadapter. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> 96C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package NUnit.ConsoleRunner. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> 97C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package Microsoft.NET.Test.Sdk. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> 98C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj : error NU1101: Unable to find package System.CodeDom. No packages exist with this id in source(s): Microsoft Visual Studio Offline Packages [C:\Users\travis\build\apache\avro\lang\csharp\Avro.sln]
> 99 Restore failed in 75.03 ms for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\test\Avro.test.csproj.
> 100 Restore completed in 1.16 sec for C:\Users\travis\build\apache\avro\lang\csharp\src\apache\perf\Avro.perf.csproj.
> 101
> 102Build FAILED.
>
>
Thanks and Regards
*Rumeshkrishnan Mohan*
On Sun, Jun 14, 2020 at 8:53 AM Driesprong, Fokko <fo...@driesprong.frl>
wrote:
> Thanks Ismaël for running the release. I've just tested an all looks good.
>
> +1 (binding)
>
> Cheers, Fokko
>
> Op za 13 jun. 2020 om 13:23 schreef Ryan Skraba <ry...@skraba.com>:
>
> > The only change necessary to compile Parquet with the 1.10.0 RC1
> > artifacts was to add `<fieldVisibility>public</fieldVisibility>` to
> > the parquet-avro pom.xml so that field members are generated with
> > public access (the default is now private). Or we could rewrite the
> > test classes to use getters!
> >
> > (Just for info, if you want to reproduce my build, I also changed the
> > repositories and pluginRepositories to temporarily include the
> > https://repository.apache.org/content/groups/staging for these release
> > candidates. Something in my settings makes protoc-jar-maven-plugin
> > unhappy with this setup, and the workaround is to build to a brand new
> > local m2: `-Dmaven.repo.local=/tmp/m2` )
> >
> > I'm interested in your Parquet/Avro/Spark experience! I've gotten
> > them to work together using Apache Beam on Spark and extensive shading
> > :/ Ismael has done some excellent (and tricky!) work trying to get
> > the communities to move forward together!
> >
> > All my best, Ryan
> >
> > On Fri, Jun 12, 2020 at 7:23 PM Michael Heuer <he...@gmail.com> wrote:
> > >
> > > Hello Ryan,
> > >
> > > If you don't mind me asking, what were the changes you found necessary
> > for Parquet to work with Avro 1.10?
> > >
> > > The only reason I lurk on this mailing list is in the vain hope that
> > Parquet and Avro and Spark will work together nicely at some point.
> > >
> > > michael
> > >
> > >
> > > > On Jun 12, 2020, at 3:44 AM, Ryan Skraba <ry...@skraba.com> wrote:
> > > >
> > > > Hello!
> > > >
> > > > I checked the signature and SHA512 sums of the artifacts.
> > > >
> > > > Internally we have a large library of internal code that uses Avro
> > > > 1.9, and it all recompiled and tests succeeded without modification.
> > > >
> > > > We have some other code that definitely breaks with 1.10 because of
> > > > AVRO-2278 (getting an unknown field throws an exception). In
> > > > practice, it's not going to impact us in the short term, since it's
> > > > all run on a cluster where the avro version is provided (and usually
> > > > 1.8.x). Our code will need to be rewritten to handle these
> exceptions
> > > > gracefully for Avro 1.10+
> > > >
> > > > Parquet needed some minor massaging because of the change to the
> > > > avro-maven-plugin (now generates private field members). This should
> > > > definitely be in the release notes:
> > > >
> > > > AVRO-2581: Maven plugin generates specific records with private
> fields.
> > > >
> > > > The arrow Avro adapter builds and tests with the 1.10.0 RC
> artifacts.
> > > >
> > > > I did some minor tests with a toy python project (both py and py3).
> > > >
> > > > +1 for me (mostly Java, some python).
> > > >
> > > > If there is a blocker or another release candidate, AVRO-2849 (spec
> > > > clarification) would be nice to include.
> > > >
> > > > All my best and thanks for the work, Ismael!
> > > >
> > > > Ryan
> > > >
> > > >
> > > > On Thu, Jun 11, 2020 at 2:25 PM Daniel Kulp <dk...@apache.org>
> wrote:
> > > >>
> > > >> +1
> > > >>
> > > >> Been playing around with it a bit and it looks OK.
> > > >>
> > > >> Dan
> > > >>
> > > >>
> > > >>> On Jun 11, 2020, at 4:53 AM, Ismaël Mejía <ie...@gmail.com>
> wrote:
> > > >>>
> > > >>> Kind reminder two days have passed, please check and vote!
> > > >>>
> > > >>> On Thu, Jun 11, 2020 at 2:29 AM Andy Le <an...@gmail.com> wrote:
> > > >>>>
> > > >>>> Hey Ryan,
> > > >>>>
> > > >>>> Thank you for your clear explanation.
> > > >>>>
> > > >>>> +1 for me :D
> > > >>>>
> > > >>>> Thank you.
> > > >>>>
> > > >>>>
> > > >>>> On 2020/06/10 14:39:10, Ryan Skraba <ry...@skraba.com> wrote:
> > > >>>>> Hey Anh, a release requires 3 PMC votes, but "unofficial"
> opinions
> > are
> > > >>>>> welcome and taken into account. My opinion is unofficial too!
> > > >>>>>
> > > >>>>> Just reply with a +1 if you think the artifacts are good to go or
> > -1
> > > >>>>> if you've found a bug, regression, security issue, or something
> > that
> > > >>>>> should block these artifacts from being the 1.10.0 release.
> > > >>>>>
> > > >>>>> For example, at my company, we have a lot of internal code and
> > > >>>>> libraries that work with Avro 1.9.2, especially the generic Java
> > APIs,
> > > >>>>> so I'm going to compile with 1.10.0 and see if all the unit tests
> > > >>>>> pass.
> > > >>>>>
> > > >>>>> If you're familiar with building any open source projects that
> use
> > > >>>>> Avro, try bumping there and reporting back. You can go through
> the
> > > >>>>> open JIRA and open PR and make recommendations if we missed
> > something
> > > >>>>> important.
> > > >>>>>
> > > >>>>> For example, I've gone through a lot of the JIRA and it looks
> like
> > > >>>>> AVRO-2799 (a protobuf bug) is blocking a user. I'm looking to
> see
> > if
> > > >>>>> this is a regression or if it's an easy fix before I vote.
> > > >>>>>
> > > >>>>> I've verified the signatures and SHA512 of the artifacts, so
> > that's good!
> > > >>>>>
> > > >>>>> All my best, Ryan
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> On Wed, Jun 10, 2020 at 8:53 AM Anh Le <an...@gmail.com>
> wrote:
> > > >>>>>>
> > > >>>>>> Hi,
> > > >>>>>>
> > > >>>>>> How can I make a vote on this?
> > > >>>>>>
> > > >>>>>> Best Regards.
> > > >>>>>>
> > > >>>>>> On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com>
> > wrote:
> > > >>>>>>
> > > >>>>>>> Hi everyone,
> > > >>>>>>>
> > > >>>>>>> I'd like to propose the following RC1 to be released as the
> > official Apache
> > > >>>>>>> Avro 1.10.0 release.
> > > >>>>>>>
> > > >>>>>>> The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
> > > >>>>>>>
> > > >>>>>>> * This corresponds to the tag: release-1.10.0-rc1
> > > >>>>>>> *
> https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
> > > >>>>>>>
> > > >>>>>>> The release tarball, signature, and checksums are here
> (revision
> > 37932):
> > > >>>>>>> * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
> > > >>>>>>>
> > > >>>>>>> You can find the KEYS file here:
> > > >>>>>>> * https://dist.apache.org/repos/dist/dev/avro/KEYS
> > > >>>>>>>
> > > >>>>>>> Binary artifacts for Java are staged in Nexus here:
> > > >>>>>>> *
> > > >>>>>>>
> >
> https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
> > > >>>>>>>
> > > >>>>>>> This release includes 187 Jira issues (Thanks Ryan Skraba for
> the
> > > >>>>>>> highlights)
> > > >>>>>>>
> > > >>>>>>>
> >
> https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
> > > >>>>>>>
> > > >>>>>>> * Some interesting highlights (Thanks Ryan Skraba for the
> list):
> > > >>>>>>>
> > > >>>>>>> C#
> > > >>>>>>> - [AVRO-2389] Add Avro serialization for POCO (Reflection)
> > > >>>>>>>
> > > >>>>>>> Java
> > > >>>>>>> - [AVRO-2723] Automatically find defaults on POJO when using
> > reflection.
> > > >>>>>>> - [AVRO-2278] Now throws an exception when getting a
> non-existent
> > > >>>>>>> field from a record
> > > >>>>>>> - [AVRO-2335] Remove Joda Time library.
> > > >>>>>>> - [AVRO-2438] Better support for URI and URL types.
> > > >>>>>>>
> > > >>>>>>> Perl
> > > >>>>>>> - [AVRO-1461] Distribute as a CPAN module.
> > > >>>>>>>
> > > >>>>>>> PHP
> > > >>>>>>> - [AVRO-2527] Update to PHP 7.x
> > > >>>>>>>
> > > >>>>>>> Python
> > > >>>>>>> - [AVRO-2656] avro-python package is now the preferred python3
> > library
> > > >>>>>>> and avro-python3 is prepared to be deprecated
> > > >>>>>>> - [AVRO-2387] type checking added to python
> > > >>>>>>>
> > > >>>>>>> Ruby
> > > >>>>>>> - [AVRO-1740] Support fingerprinting.
> > > >>>>>>> - [AVRO-2535] Support enum defaults.
> > > >>>>>>> - [AVRO-2545] Support aliases.
> > > >>>>>>>
> > > >>>>>>> * Upgrade dependencies to latest versions, including CVE fixes.
> > > >>>>>>> * Multiple fixes and more...
> > > >>>>>>>
> > > >>>>>>> Please download, verify, and test. This vote will remain open
> > for at least
> > > >>>>>>> 72 hours. Given sufficient votes, I would like to close after
> > noon UTC
> > > >>>>>>> Friday, June 12th, 2020
> > > >>>>>>>
> > > >>>>>>> [ ] +1 Release this as Apache Avro 1.10.0
> > > >>>>>>> [ ] +0
> > > >>>>>>> [ ] -1 Do not release this because...
> > > >>>>>>>
> > > >>>>>>> Best regards,
> > > >>>>>>> Ismaël Mejía
> > > >>>>>>>
> > > >>>>>
> > > >>
> > > >> --
> > > >> Daniel Kulp
> > > >> dkulp@apache.org <ma...@apache.org> -
> http://dankulp.com/blog
> > <http://dankulp.com/blog>
> > > >> Talend Community Coder - http://talend.com <
> http://coders.talend.com/
> > >
> > >
> >
>
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by "Driesprong, Fokko" <fo...@driesprong.frl>.
Thanks Ismaël for running the release. I've just tested an all looks good.
+1 (binding)
Cheers, Fokko
Op za 13 jun. 2020 om 13:23 schreef Ryan Skraba <ry...@skraba.com>:
> The only change necessary to compile Parquet with the 1.10.0 RC1
> artifacts was to add `<fieldVisibility>public</fieldVisibility>` to
> the parquet-avro pom.xml so that field members are generated with
> public access (the default is now private). Or we could rewrite the
> test classes to use getters!
>
> (Just for info, if you want to reproduce my build, I also changed the
> repositories and pluginRepositories to temporarily include the
> https://repository.apache.org/content/groups/staging for these release
> candidates. Something in my settings makes protoc-jar-maven-plugin
> unhappy with this setup, and the workaround is to build to a brand new
> local m2: `-Dmaven.repo.local=/tmp/m2` )
>
> I'm interested in your Parquet/Avro/Spark experience! I've gotten
> them to work together using Apache Beam on Spark and extensive shading
> :/ Ismael has done some excellent (and tricky!) work trying to get
> the communities to move forward together!
>
> All my best, Ryan
>
> On Fri, Jun 12, 2020 at 7:23 PM Michael Heuer <he...@gmail.com> wrote:
> >
> > Hello Ryan,
> >
> > If you don't mind me asking, what were the changes you found necessary
> for Parquet to work with Avro 1.10?
> >
> > The only reason I lurk on this mailing list is in the vain hope that
> Parquet and Avro and Spark will work together nicely at some point.
> >
> > michael
> >
> >
> > > On Jun 12, 2020, at 3:44 AM, Ryan Skraba <ry...@skraba.com> wrote:
> > >
> > > Hello!
> > >
> > > I checked the signature and SHA512 sums of the artifacts.
> > >
> > > Internally we have a large library of internal code that uses Avro
> > > 1.9, and it all recompiled and tests succeeded without modification.
> > >
> > > We have some other code that definitely breaks with 1.10 because of
> > > AVRO-2278 (getting an unknown field throws an exception). In
> > > practice, it's not going to impact us in the short term, since it's
> > > all run on a cluster where the avro version is provided (and usually
> > > 1.8.x). Our code will need to be rewritten to handle these exceptions
> > > gracefully for Avro 1.10+
> > >
> > > Parquet needed some minor massaging because of the change to the
> > > avro-maven-plugin (now generates private field members). This should
> > > definitely be in the release notes:
> > >
> > > AVRO-2581: Maven plugin generates specific records with private fields.
> > >
> > > The arrow Avro adapter builds and tests with the 1.10.0 RC artifacts.
> > >
> > > I did some minor tests with a toy python project (both py and py3).
> > >
> > > +1 for me (mostly Java, some python).
> > >
> > > If there is a blocker or another release candidate, AVRO-2849 (spec
> > > clarification) would be nice to include.
> > >
> > > All my best and thanks for the work, Ismael!
> > >
> > > Ryan
> > >
> > >
> > > On Thu, Jun 11, 2020 at 2:25 PM Daniel Kulp <dk...@apache.org> wrote:
> > >>
> > >> +1
> > >>
> > >> Been playing around with it a bit and it looks OK.
> > >>
> > >> Dan
> > >>
> > >>
> > >>> On Jun 11, 2020, at 4:53 AM, Ismaël Mejía <ie...@gmail.com> wrote:
> > >>>
> > >>> Kind reminder two days have passed, please check and vote!
> > >>>
> > >>> On Thu, Jun 11, 2020 at 2:29 AM Andy Le <an...@gmail.com> wrote:
> > >>>>
> > >>>> Hey Ryan,
> > >>>>
> > >>>> Thank you for your clear explanation.
> > >>>>
> > >>>> +1 for me :D
> > >>>>
> > >>>> Thank you.
> > >>>>
> > >>>>
> > >>>> On 2020/06/10 14:39:10, Ryan Skraba <ry...@skraba.com> wrote:
> > >>>>> Hey Anh, a release requires 3 PMC votes, but "unofficial" opinions
> are
> > >>>>> welcome and taken into account. My opinion is unofficial too!
> > >>>>>
> > >>>>> Just reply with a +1 if you think the artifacts are good to go or
> -1
> > >>>>> if you've found a bug, regression, security issue, or something
> that
> > >>>>> should block these artifacts from being the 1.10.0 release.
> > >>>>>
> > >>>>> For example, at my company, we have a lot of internal code and
> > >>>>> libraries that work with Avro 1.9.2, especially the generic Java
> APIs,
> > >>>>> so I'm going to compile with 1.10.0 and see if all the unit tests
> > >>>>> pass.
> > >>>>>
> > >>>>> If you're familiar with building any open source projects that use
> > >>>>> Avro, try bumping there and reporting back. You can go through the
> > >>>>> open JIRA and open PR and make recommendations if we missed
> something
> > >>>>> important.
> > >>>>>
> > >>>>> For example, I've gone through a lot of the JIRA and it looks like
> > >>>>> AVRO-2799 (a protobuf bug) is blocking a user. I'm looking to see
> if
> > >>>>> this is a regression or if it's an easy fix before I vote.
> > >>>>>
> > >>>>> I've verified the signatures and SHA512 of the artifacts, so
> that's good!
> > >>>>>
> > >>>>> All my best, Ryan
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> On Wed, Jun 10, 2020 at 8:53 AM Anh Le <an...@gmail.com> wrote:
> > >>>>>>
> > >>>>>> Hi,
> > >>>>>>
> > >>>>>> How can I make a vote on this?
> > >>>>>>
> > >>>>>> Best Regards.
> > >>>>>>
> > >>>>>> On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com>
> wrote:
> > >>>>>>
> > >>>>>>> Hi everyone,
> > >>>>>>>
> > >>>>>>> I'd like to propose the following RC1 to be released as the
> official Apache
> > >>>>>>> Avro 1.10.0 release.
> > >>>>>>>
> > >>>>>>> The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
> > >>>>>>>
> > >>>>>>> * This corresponds to the tag: release-1.10.0-rc1
> > >>>>>>> * https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
> > >>>>>>>
> > >>>>>>> The release tarball, signature, and checksums are here (revision
> 37932):
> > >>>>>>> * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
> > >>>>>>>
> > >>>>>>> You can find the KEYS file here:
> > >>>>>>> * https://dist.apache.org/repos/dist/dev/avro/KEYS
> > >>>>>>>
> > >>>>>>> Binary artifacts for Java are staged in Nexus here:
> > >>>>>>> *
> > >>>>>>>
> https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
> > >>>>>>>
> > >>>>>>> This release includes 187 Jira issues (Thanks Ryan Skraba for the
> > >>>>>>> highlights)
> > >>>>>>>
> > >>>>>>>
> https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
> > >>>>>>>
> > >>>>>>> * Some interesting highlights (Thanks Ryan Skraba for the list):
> > >>>>>>>
> > >>>>>>> C#
> > >>>>>>> - [AVRO-2389] Add Avro serialization for POCO (Reflection)
> > >>>>>>>
> > >>>>>>> Java
> > >>>>>>> - [AVRO-2723] Automatically find defaults on POJO when using
> reflection.
> > >>>>>>> - [AVRO-2278] Now throws an exception when getting a non-existent
> > >>>>>>> field from a record
> > >>>>>>> - [AVRO-2335] Remove Joda Time library.
> > >>>>>>> - [AVRO-2438] Better support for URI and URL types.
> > >>>>>>>
> > >>>>>>> Perl
> > >>>>>>> - [AVRO-1461] Distribute as a CPAN module.
> > >>>>>>>
> > >>>>>>> PHP
> > >>>>>>> - [AVRO-2527] Update to PHP 7.x
> > >>>>>>>
> > >>>>>>> Python
> > >>>>>>> - [AVRO-2656] avro-python package is now the preferred python3
> library
> > >>>>>>> and avro-python3 is prepared to be deprecated
> > >>>>>>> - [AVRO-2387] type checking added to python
> > >>>>>>>
> > >>>>>>> Ruby
> > >>>>>>> - [AVRO-1740] Support fingerprinting.
> > >>>>>>> - [AVRO-2535] Support enum defaults.
> > >>>>>>> - [AVRO-2545] Support aliases.
> > >>>>>>>
> > >>>>>>> * Upgrade dependencies to latest versions, including CVE fixes.
> > >>>>>>> * Multiple fixes and more...
> > >>>>>>>
> > >>>>>>> Please download, verify, and test. This vote will remain open
> for at least
> > >>>>>>> 72 hours. Given sufficient votes, I would like to close after
> noon UTC
> > >>>>>>> Friday, June 12th, 2020
> > >>>>>>>
> > >>>>>>> [ ] +1 Release this as Apache Avro 1.10.0
> > >>>>>>> [ ] +0
> > >>>>>>> [ ] -1 Do not release this because...
> > >>>>>>>
> > >>>>>>> Best regards,
> > >>>>>>> Ismaël Mejía
> > >>>>>>>
> > >>>>>
> > >>
> > >> --
> > >> Daniel Kulp
> > >> dkulp@apache.org <ma...@apache.org> - http://dankulp.com/blog
> <http://dankulp.com/blog>
> > >> Talend Community Coder - http://talend.com <http://coders.talend.com/
> >
> >
>
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by Ryan Skraba <ry...@skraba.com>.
The only change necessary to compile Parquet with the 1.10.0 RC1
artifacts was to add `<fieldVisibility>public</fieldVisibility>` to
the parquet-avro pom.xml so that field members are generated with
public access (the default is now private). Or we could rewrite the
test classes to use getters!
(Just for info, if you want to reproduce my build, I also changed the
repositories and pluginRepositories to temporarily include the
https://repository.apache.org/content/groups/staging for these release
candidates. Something in my settings makes protoc-jar-maven-plugin
unhappy with this setup, and the workaround is to build to a brand new
local m2: `-Dmaven.repo.local=/tmp/m2` )
I'm interested in your Parquet/Avro/Spark experience! I've gotten
them to work together using Apache Beam on Spark and extensive shading
:/ Ismael has done some excellent (and tricky!) work trying to get
the communities to move forward together!
All my best, Ryan
On Fri, Jun 12, 2020 at 7:23 PM Michael Heuer <he...@gmail.com> wrote:
>
> Hello Ryan,
>
> If you don't mind me asking, what were the changes you found necessary for Parquet to work with Avro 1.10?
>
> The only reason I lurk on this mailing list is in the vain hope that Parquet and Avro and Spark will work together nicely at some point.
>
> michael
>
>
> > On Jun 12, 2020, at 3:44 AM, Ryan Skraba <ry...@skraba.com> wrote:
> >
> > Hello!
> >
> > I checked the signature and SHA512 sums of the artifacts.
> >
> > Internally we have a large library of internal code that uses Avro
> > 1.9, and it all recompiled and tests succeeded without modification.
> >
> > We have some other code that definitely breaks with 1.10 because of
> > AVRO-2278 (getting an unknown field throws an exception). In
> > practice, it's not going to impact us in the short term, since it's
> > all run on a cluster where the avro version is provided (and usually
> > 1.8.x). Our code will need to be rewritten to handle these exceptions
> > gracefully for Avro 1.10+
> >
> > Parquet needed some minor massaging because of the change to the
> > avro-maven-plugin (now generates private field members). This should
> > definitely be in the release notes:
> >
> > AVRO-2581: Maven plugin generates specific records with private fields.
> >
> > The arrow Avro adapter builds and tests with the 1.10.0 RC artifacts.
> >
> > I did some minor tests with a toy python project (both py and py3).
> >
> > +1 for me (mostly Java, some python).
> >
> > If there is a blocker or another release candidate, AVRO-2849 (spec
> > clarification) would be nice to include.
> >
> > All my best and thanks for the work, Ismael!
> >
> > Ryan
> >
> >
> > On Thu, Jun 11, 2020 at 2:25 PM Daniel Kulp <dk...@apache.org> wrote:
> >>
> >> +1
> >>
> >> Been playing around with it a bit and it looks OK.
> >>
> >> Dan
> >>
> >>
> >>> On Jun 11, 2020, at 4:53 AM, Ismaël Mejía <ie...@gmail.com> wrote:
> >>>
> >>> Kind reminder two days have passed, please check and vote!
> >>>
> >>> On Thu, Jun 11, 2020 at 2:29 AM Andy Le <an...@gmail.com> wrote:
> >>>>
> >>>> Hey Ryan,
> >>>>
> >>>> Thank you for your clear explanation.
> >>>>
> >>>> +1 for me :D
> >>>>
> >>>> Thank you.
> >>>>
> >>>>
> >>>> On 2020/06/10 14:39:10, Ryan Skraba <ry...@skraba.com> wrote:
> >>>>> Hey Anh, a release requires 3 PMC votes, but "unofficial" opinions are
> >>>>> welcome and taken into account. My opinion is unofficial too!
> >>>>>
> >>>>> Just reply with a +1 if you think the artifacts are good to go or -1
> >>>>> if you've found a bug, regression, security issue, or something that
> >>>>> should block these artifacts from being the 1.10.0 release.
> >>>>>
> >>>>> For example, at my company, we have a lot of internal code and
> >>>>> libraries that work with Avro 1.9.2, especially the generic Java APIs,
> >>>>> so I'm going to compile with 1.10.0 and see if all the unit tests
> >>>>> pass.
> >>>>>
> >>>>> If you're familiar with building any open source projects that use
> >>>>> Avro, try bumping there and reporting back. You can go through the
> >>>>> open JIRA and open PR and make recommendations if we missed something
> >>>>> important.
> >>>>>
> >>>>> For example, I've gone through a lot of the JIRA and it looks like
> >>>>> AVRO-2799 (a protobuf bug) is blocking a user. I'm looking to see if
> >>>>> this is a regression or if it's an easy fix before I vote.
> >>>>>
> >>>>> I've verified the signatures and SHA512 of the artifacts, so that's good!
> >>>>>
> >>>>> All my best, Ryan
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> On Wed, Jun 10, 2020 at 8:53 AM Anh Le <an...@gmail.com> wrote:
> >>>>>>
> >>>>>> Hi,
> >>>>>>
> >>>>>> How can I make a vote on this?
> >>>>>>
> >>>>>> Best Regards.
> >>>>>>
> >>>>>> On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com> wrote:
> >>>>>>
> >>>>>>> Hi everyone,
> >>>>>>>
> >>>>>>> I'd like to propose the following RC1 to be released as the official Apache
> >>>>>>> Avro 1.10.0 release.
> >>>>>>>
> >>>>>>> The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
> >>>>>>>
> >>>>>>> * This corresponds to the tag: release-1.10.0-rc1
> >>>>>>> * https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
> >>>>>>>
> >>>>>>> The release tarball, signature, and checksums are here (revision 37932):
> >>>>>>> * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
> >>>>>>>
> >>>>>>> You can find the KEYS file here:
> >>>>>>> * https://dist.apache.org/repos/dist/dev/avro/KEYS
> >>>>>>>
> >>>>>>> Binary artifacts for Java are staged in Nexus here:
> >>>>>>> *
> >>>>>>> https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
> >>>>>>>
> >>>>>>> This release includes 187 Jira issues (Thanks Ryan Skraba for the
> >>>>>>> highlights)
> >>>>>>>
> >>>>>>> https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
> >>>>>>>
> >>>>>>> * Some interesting highlights (Thanks Ryan Skraba for the list):
> >>>>>>>
> >>>>>>> C#
> >>>>>>> - [AVRO-2389] Add Avro serialization for POCO (Reflection)
> >>>>>>>
> >>>>>>> Java
> >>>>>>> - [AVRO-2723] Automatically find defaults on POJO when using reflection.
> >>>>>>> - [AVRO-2278] Now throws an exception when getting a non-existent
> >>>>>>> field from a record
> >>>>>>> - [AVRO-2335] Remove Joda Time library.
> >>>>>>> - [AVRO-2438] Better support for URI and URL types.
> >>>>>>>
> >>>>>>> Perl
> >>>>>>> - [AVRO-1461] Distribute as a CPAN module.
> >>>>>>>
> >>>>>>> PHP
> >>>>>>> - [AVRO-2527] Update to PHP 7.x
> >>>>>>>
> >>>>>>> Python
> >>>>>>> - [AVRO-2656] avro-python package is now the preferred python3 library
> >>>>>>> and avro-python3 is prepared to be deprecated
> >>>>>>> - [AVRO-2387] type checking added to python
> >>>>>>>
> >>>>>>> Ruby
> >>>>>>> - [AVRO-1740] Support fingerprinting.
> >>>>>>> - [AVRO-2535] Support enum defaults.
> >>>>>>> - [AVRO-2545] Support aliases.
> >>>>>>>
> >>>>>>> * Upgrade dependencies to latest versions, including CVE fixes.
> >>>>>>> * Multiple fixes and more...
> >>>>>>>
> >>>>>>> Please download, verify, and test. This vote will remain open for at least
> >>>>>>> 72 hours. Given sufficient votes, I would like to close after noon UTC
> >>>>>>> Friday, June 12th, 2020
> >>>>>>>
> >>>>>>> [ ] +1 Release this as Apache Avro 1.10.0
> >>>>>>> [ ] +0
> >>>>>>> [ ] -1 Do not release this because...
> >>>>>>>
> >>>>>>> Best regards,
> >>>>>>> Ismaël Mejía
> >>>>>>>
> >>>>>
> >>
> >> --
> >> Daniel Kulp
> >> dkulp@apache.org <ma...@apache.org> - http://dankulp.com/blog <http://dankulp.com/blog>
> >> Talend Community Coder - http://talend.com <http://coders.talend.com/>
>
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by Michael Heuer <he...@gmail.com>.
Hello Ryan,
If you don't mind me asking, what were the changes you found necessary for Parquet to work with Avro 1.10?
The only reason I lurk on this mailing list is in the vain hope that Parquet and Avro and Spark will work together nicely at some point.
michael
> On Jun 12, 2020, at 3:44 AM, Ryan Skraba <ry...@skraba.com> wrote:
>
> Hello!
>
> I checked the signature and SHA512 sums of the artifacts.
>
> Internally we have a large library of internal code that uses Avro
> 1.9, and it all recompiled and tests succeeded without modification.
>
> We have some other code that definitely breaks with 1.10 because of
> AVRO-2278 (getting an unknown field throws an exception). In
> practice, it's not going to impact us in the short term, since it's
> all run on a cluster where the avro version is provided (and usually
> 1.8.x). Our code will need to be rewritten to handle these exceptions
> gracefully for Avro 1.10+
>
> Parquet needed some minor massaging because of the change to the
> avro-maven-plugin (now generates private field members). This should
> definitely be in the release notes:
>
> AVRO-2581: Maven plugin generates specific records with private fields.
>
> The arrow Avro adapter builds and tests with the 1.10.0 RC artifacts.
>
> I did some minor tests with a toy python project (both py and py3).
>
> +1 for me (mostly Java, some python).
>
> If there is a blocker or another release candidate, AVRO-2849 (spec
> clarification) would be nice to include.
>
> All my best and thanks for the work, Ismael!
>
> Ryan
>
>
> On Thu, Jun 11, 2020 at 2:25 PM Daniel Kulp <dk...@apache.org> wrote:
>>
>> +1
>>
>> Been playing around with it a bit and it looks OK.
>>
>> Dan
>>
>>
>>> On Jun 11, 2020, at 4:53 AM, Ismaël Mejía <ie...@gmail.com> wrote:
>>>
>>> Kind reminder two days have passed, please check and vote!
>>>
>>> On Thu, Jun 11, 2020 at 2:29 AM Andy Le <an...@gmail.com> wrote:
>>>>
>>>> Hey Ryan,
>>>>
>>>> Thank you for your clear explanation.
>>>>
>>>> +1 for me :D
>>>>
>>>> Thank you.
>>>>
>>>>
>>>> On 2020/06/10 14:39:10, Ryan Skraba <ry...@skraba.com> wrote:
>>>>> Hey Anh, a release requires 3 PMC votes, but "unofficial" opinions are
>>>>> welcome and taken into account. My opinion is unofficial too!
>>>>>
>>>>> Just reply with a +1 if you think the artifacts are good to go or -1
>>>>> if you've found a bug, regression, security issue, or something that
>>>>> should block these artifacts from being the 1.10.0 release.
>>>>>
>>>>> For example, at my company, we have a lot of internal code and
>>>>> libraries that work with Avro 1.9.2, especially the generic Java APIs,
>>>>> so I'm going to compile with 1.10.0 and see if all the unit tests
>>>>> pass.
>>>>>
>>>>> If you're familiar with building any open source projects that use
>>>>> Avro, try bumping there and reporting back. You can go through the
>>>>> open JIRA and open PR and make recommendations if we missed something
>>>>> important.
>>>>>
>>>>> For example, I've gone through a lot of the JIRA and it looks like
>>>>> AVRO-2799 (a protobuf bug) is blocking a user. I'm looking to see if
>>>>> this is a regression or if it's an easy fix before I vote.
>>>>>
>>>>> I've verified the signatures and SHA512 of the artifacts, so that's good!
>>>>>
>>>>> All my best, Ryan
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Wed, Jun 10, 2020 at 8:53 AM Anh Le <an...@gmail.com> wrote:
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> How can I make a vote on this?
>>>>>>
>>>>>> Best Regards.
>>>>>>
>>>>>> On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com> wrote:
>>>>>>
>>>>>>> Hi everyone,
>>>>>>>
>>>>>>> I'd like to propose the following RC1 to be released as the official Apache
>>>>>>> Avro 1.10.0 release.
>>>>>>>
>>>>>>> The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
>>>>>>>
>>>>>>> * This corresponds to the tag: release-1.10.0-rc1
>>>>>>> * https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
>>>>>>>
>>>>>>> The release tarball, signature, and checksums are here (revision 37932):
>>>>>>> * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
>>>>>>>
>>>>>>> You can find the KEYS file here:
>>>>>>> * https://dist.apache.org/repos/dist/dev/avro/KEYS
>>>>>>>
>>>>>>> Binary artifacts for Java are staged in Nexus here:
>>>>>>> *
>>>>>>> https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
>>>>>>>
>>>>>>> This release includes 187 Jira issues (Thanks Ryan Skraba for the
>>>>>>> highlights)
>>>>>>>
>>>>>>> https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
>>>>>>>
>>>>>>> * Some interesting highlights (Thanks Ryan Skraba for the list):
>>>>>>>
>>>>>>> C#
>>>>>>> - [AVRO-2389] Add Avro serialization for POCO (Reflection)
>>>>>>>
>>>>>>> Java
>>>>>>> - [AVRO-2723] Automatically find defaults on POJO when using reflection.
>>>>>>> - [AVRO-2278] Now throws an exception when getting a non-existent
>>>>>>> field from a record
>>>>>>> - [AVRO-2335] Remove Joda Time library.
>>>>>>> - [AVRO-2438] Better support for URI and URL types.
>>>>>>>
>>>>>>> Perl
>>>>>>> - [AVRO-1461] Distribute as a CPAN module.
>>>>>>>
>>>>>>> PHP
>>>>>>> - [AVRO-2527] Update to PHP 7.x
>>>>>>>
>>>>>>> Python
>>>>>>> - [AVRO-2656] avro-python package is now the preferred python3 library
>>>>>>> and avro-python3 is prepared to be deprecated
>>>>>>> - [AVRO-2387] type checking added to python
>>>>>>>
>>>>>>> Ruby
>>>>>>> - [AVRO-1740] Support fingerprinting.
>>>>>>> - [AVRO-2535] Support enum defaults.
>>>>>>> - [AVRO-2545] Support aliases.
>>>>>>>
>>>>>>> * Upgrade dependencies to latest versions, including CVE fixes.
>>>>>>> * Multiple fixes and more...
>>>>>>>
>>>>>>> Please download, verify, and test. This vote will remain open for at least
>>>>>>> 72 hours. Given sufficient votes, I would like to close after noon UTC
>>>>>>> Friday, June 12th, 2020
>>>>>>>
>>>>>>> [ ] +1 Release this as Apache Avro 1.10.0
>>>>>>> [ ] +0
>>>>>>> [ ] -1 Do not release this because...
>>>>>>>
>>>>>>> Best regards,
>>>>>>> Ismaël Mejía
>>>>>>>
>>>>>
>>
>> --
>> Daniel Kulp
>> dkulp@apache.org <ma...@apache.org> - http://dankulp.com/blog <http://dankulp.com/blog>
>> Talend Community Coder - http://talend.com <http://coders.talend.com/>
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by Ryan Skraba <ry...@skraba.com>.
Hello!
I checked the signature and SHA512 sums of the artifacts.
Internally we have a large library of internal code that uses Avro
1.9, and it all recompiled and tests succeeded without modification.
We have some other code that definitely breaks with 1.10 because of
AVRO-2278 (getting an unknown field throws an exception). In
practice, it's not going to impact us in the short term, since it's
all run on a cluster where the avro version is provided (and usually
1.8.x). Our code will need to be rewritten to handle these exceptions
gracefully for Avro 1.10+
Parquet needed some minor massaging because of the change to the
avro-maven-plugin (now generates private field members). This should
definitely be in the release notes:
AVRO-2581: Maven plugin generates specific records with private fields.
The arrow Avro adapter builds and tests with the 1.10.0 RC artifacts.
I did some minor tests with a toy python project (both py and py3).
+1 for me (mostly Java, some python).
If there is a blocker or another release candidate, AVRO-2849 (spec
clarification) would be nice to include.
All my best and thanks for the work, Ismael!
Ryan
On Thu, Jun 11, 2020 at 2:25 PM Daniel Kulp <dk...@apache.org> wrote:
>
> +1
>
> Been playing around with it a bit and it looks OK.
>
> Dan
>
>
> > On Jun 11, 2020, at 4:53 AM, Ismaël Mejía <ie...@gmail.com> wrote:
> >
> > Kind reminder two days have passed, please check and vote!
> >
> > On Thu, Jun 11, 2020 at 2:29 AM Andy Le <an...@gmail.com> wrote:
> >>
> >> Hey Ryan,
> >>
> >> Thank you for your clear explanation.
> >>
> >> +1 for me :D
> >>
> >> Thank you.
> >>
> >>
> >> On 2020/06/10 14:39:10, Ryan Skraba <ry...@skraba.com> wrote:
> >>> Hey Anh, a release requires 3 PMC votes, but "unofficial" opinions are
> >>> welcome and taken into account. My opinion is unofficial too!
> >>>
> >>> Just reply with a +1 if you think the artifacts are good to go or -1
> >>> if you've found a bug, regression, security issue, or something that
> >>> should block these artifacts from being the 1.10.0 release.
> >>>
> >>> For example, at my company, we have a lot of internal code and
> >>> libraries that work with Avro 1.9.2, especially the generic Java APIs,
> >>> so I'm going to compile with 1.10.0 and see if all the unit tests
> >>> pass.
> >>>
> >>> If you're familiar with building any open source projects that use
> >>> Avro, try bumping there and reporting back. You can go through the
> >>> open JIRA and open PR and make recommendations if we missed something
> >>> important.
> >>>
> >>> For example, I've gone through a lot of the JIRA and it looks like
> >>> AVRO-2799 (a protobuf bug) is blocking a user. I'm looking to see if
> >>> this is a regression or if it's an easy fix before I vote.
> >>>
> >>> I've verified the signatures and SHA512 of the artifacts, so that's good!
> >>>
> >>> All my best, Ryan
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> On Wed, Jun 10, 2020 at 8:53 AM Anh Le <an...@gmail.com> wrote:
> >>>>
> >>>> Hi,
> >>>>
> >>>> How can I make a vote on this?
> >>>>
> >>>> Best Regards.
> >>>>
> >>>> On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com> wrote:
> >>>>
> >>>>> Hi everyone,
> >>>>>
> >>>>> I'd like to propose the following RC1 to be released as the official Apache
> >>>>> Avro 1.10.0 release.
> >>>>>
> >>>>> The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
> >>>>>
> >>>>> * This corresponds to the tag: release-1.10.0-rc1
> >>>>> * https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
> >>>>>
> >>>>> The release tarball, signature, and checksums are here (revision 37932):
> >>>>> * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
> >>>>>
> >>>>> You can find the KEYS file here:
> >>>>> * https://dist.apache.org/repos/dist/dev/avro/KEYS
> >>>>>
> >>>>> Binary artifacts for Java are staged in Nexus here:
> >>>>> *
> >>>>> https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
> >>>>>
> >>>>> This release includes 187 Jira issues (Thanks Ryan Skraba for the
> >>>>> highlights)
> >>>>>
> >>>>> https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
> >>>>>
> >>>>> * Some interesting highlights (Thanks Ryan Skraba for the list):
> >>>>>
> >>>>> C#
> >>>>> - [AVRO-2389] Add Avro serialization for POCO (Reflection)
> >>>>>
> >>>>> Java
> >>>>> - [AVRO-2723] Automatically find defaults on POJO when using reflection.
> >>>>> - [AVRO-2278] Now throws an exception when getting a non-existent
> >>>>> field from a record
> >>>>> - [AVRO-2335] Remove Joda Time library.
> >>>>> - [AVRO-2438] Better support for URI and URL types.
> >>>>>
> >>>>> Perl
> >>>>> - [AVRO-1461] Distribute as a CPAN module.
> >>>>>
> >>>>> PHP
> >>>>> - [AVRO-2527] Update to PHP 7.x
> >>>>>
> >>>>> Python
> >>>>> - [AVRO-2656] avro-python package is now the preferred python3 library
> >>>>> and avro-python3 is prepared to be deprecated
> >>>>> - [AVRO-2387] type checking added to python
> >>>>>
> >>>>> Ruby
> >>>>> - [AVRO-1740] Support fingerprinting.
> >>>>> - [AVRO-2535] Support enum defaults.
> >>>>> - [AVRO-2545] Support aliases.
> >>>>>
> >>>>> * Upgrade dependencies to latest versions, including CVE fixes.
> >>>>> * Multiple fixes and more...
> >>>>>
> >>>>> Please download, verify, and test. This vote will remain open for at least
> >>>>> 72 hours. Given sufficient votes, I would like to close after noon UTC
> >>>>> Friday, June 12th, 2020
> >>>>>
> >>>>> [ ] +1 Release this as Apache Avro 1.10.0
> >>>>> [ ] +0
> >>>>> [ ] -1 Do not release this because...
> >>>>>
> >>>>> Best regards,
> >>>>> Ismaël Mejía
> >>>>>
> >>>
>
> --
> Daniel Kulp
> dkulp@apache.org <ma...@apache.org> - http://dankulp.com/blog <http://dankulp.com/blog>
> Talend Community Coder - http://talend.com <http://coders.talend.com/>
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by Daniel Kulp <dk...@apache.org>.
+1
Been playing around with it a bit and it looks OK.
Dan
> On Jun 11, 2020, at 4:53 AM, Ismaël Mejía <ie...@gmail.com> wrote:
>
> Kind reminder two days have passed, please check and vote!
>
> On Thu, Jun 11, 2020 at 2:29 AM Andy Le <an...@gmail.com> wrote:
>>
>> Hey Ryan,
>>
>> Thank you for your clear explanation.
>>
>> +1 for me :D
>>
>> Thank you.
>>
>>
>> On 2020/06/10 14:39:10, Ryan Skraba <ry...@skraba.com> wrote:
>>> Hey Anh, a release requires 3 PMC votes, but "unofficial" opinions are
>>> welcome and taken into account. My opinion is unofficial too!
>>>
>>> Just reply with a +1 if you think the artifacts are good to go or -1
>>> if you've found a bug, regression, security issue, or something that
>>> should block these artifacts from being the 1.10.0 release.
>>>
>>> For example, at my company, we have a lot of internal code and
>>> libraries that work with Avro 1.9.2, especially the generic Java APIs,
>>> so I'm going to compile with 1.10.0 and see if all the unit tests
>>> pass.
>>>
>>> If you're familiar with building any open source projects that use
>>> Avro, try bumping there and reporting back. You can go through the
>>> open JIRA and open PR and make recommendations if we missed something
>>> important.
>>>
>>> For example, I've gone through a lot of the JIRA and it looks like
>>> AVRO-2799 (a protobuf bug) is blocking a user. I'm looking to see if
>>> this is a regression or if it's an easy fix before I vote.
>>>
>>> I've verified the signatures and SHA512 of the artifacts, so that's good!
>>>
>>> All my best, Ryan
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Wed, Jun 10, 2020 at 8:53 AM Anh Le <an...@gmail.com> wrote:
>>>>
>>>> Hi,
>>>>
>>>> How can I make a vote on this?
>>>>
>>>> Best Regards.
>>>>
>>>> On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com> wrote:
>>>>
>>>>> Hi everyone,
>>>>>
>>>>> I'd like to propose the following RC1 to be released as the official Apache
>>>>> Avro 1.10.0 release.
>>>>>
>>>>> The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
>>>>>
>>>>> * This corresponds to the tag: release-1.10.0-rc1
>>>>> * https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
>>>>>
>>>>> The release tarball, signature, and checksums are here (revision 37932):
>>>>> * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
>>>>>
>>>>> You can find the KEYS file here:
>>>>> * https://dist.apache.org/repos/dist/dev/avro/KEYS
>>>>>
>>>>> Binary artifacts for Java are staged in Nexus here:
>>>>> *
>>>>> https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
>>>>>
>>>>> This release includes 187 Jira issues (Thanks Ryan Skraba for the
>>>>> highlights)
>>>>>
>>>>> https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
>>>>>
>>>>> * Some interesting highlights (Thanks Ryan Skraba for the list):
>>>>>
>>>>> C#
>>>>> - [AVRO-2389] Add Avro serialization for POCO (Reflection)
>>>>>
>>>>> Java
>>>>> - [AVRO-2723] Automatically find defaults on POJO when using reflection.
>>>>> - [AVRO-2278] Now throws an exception when getting a non-existent
>>>>> field from a record
>>>>> - [AVRO-2335] Remove Joda Time library.
>>>>> - [AVRO-2438] Better support for URI and URL types.
>>>>>
>>>>> Perl
>>>>> - [AVRO-1461] Distribute as a CPAN module.
>>>>>
>>>>> PHP
>>>>> - [AVRO-2527] Update to PHP 7.x
>>>>>
>>>>> Python
>>>>> - [AVRO-2656] avro-python package is now the preferred python3 library
>>>>> and avro-python3 is prepared to be deprecated
>>>>> - [AVRO-2387] type checking added to python
>>>>>
>>>>> Ruby
>>>>> - [AVRO-1740] Support fingerprinting.
>>>>> - [AVRO-2535] Support enum defaults.
>>>>> - [AVRO-2545] Support aliases.
>>>>>
>>>>> * Upgrade dependencies to latest versions, including CVE fixes.
>>>>> * Multiple fixes and more...
>>>>>
>>>>> Please download, verify, and test. This vote will remain open for at least
>>>>> 72 hours. Given sufficient votes, I would like to close after noon UTC
>>>>> Friday, June 12th, 2020
>>>>>
>>>>> [ ] +1 Release this as Apache Avro 1.10.0
>>>>> [ ] +0
>>>>> [ ] -1 Do not release this because...
>>>>>
>>>>> Best regards,
>>>>> Ismaël Mejía
>>>>>
>>>
--
Daniel Kulp
dkulp@apache.org <ma...@apache.org> - http://dankulp.com/blog <http://dankulp.com/blog>
Talend Community Coder - http://talend.com <http://coders.talend.com/>
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by Ismaël Mejía <ie...@gmail.com>.
Kind reminder two days have passed, please check and vote!
On Thu, Jun 11, 2020 at 2:29 AM Andy Le <an...@gmail.com> wrote:
>
> Hey Ryan,
>
> Thank you for your clear explanation.
>
> +1 for me :D
>
> Thank you.
>
>
> On 2020/06/10 14:39:10, Ryan Skraba <ry...@skraba.com> wrote:
> > Hey Anh, a release requires 3 PMC votes, but "unofficial" opinions are
> > welcome and taken into account. My opinion is unofficial too!
> >
> > Just reply with a +1 if you think the artifacts are good to go or -1
> > if you've found a bug, regression, security issue, or something that
> > should block these artifacts from being the 1.10.0 release.
> >
> > For example, at my company, we have a lot of internal code and
> > libraries that work with Avro 1.9.2, especially the generic Java APIs,
> > so I'm going to compile with 1.10.0 and see if all the unit tests
> > pass.
> >
> > If you're familiar with building any open source projects that use
> > Avro, try bumping there and reporting back. You can go through the
> > open JIRA and open PR and make recommendations if we missed something
> > important.
> >
> > For example, I've gone through a lot of the JIRA and it looks like
> > AVRO-2799 (a protobuf bug) is blocking a user. I'm looking to see if
> > this is a regression or if it's an easy fix before I vote.
> >
> > I've verified the signatures and SHA512 of the artifacts, so that's good!
> >
> > All my best, Ryan
> >
> >
> >
> >
> >
> >
> > On Wed, Jun 10, 2020 at 8:53 AM Anh Le <an...@gmail.com> wrote:
> > >
> > > Hi,
> > >
> > > How can I make a vote on this?
> > >
> > > Best Regards.
> > >
> > > On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com> wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > I'd like to propose the following RC1 to be released as the official Apache
> > > > Avro 1.10.0 release.
> > > >
> > > > The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
> > > >
> > > > * This corresponds to the tag: release-1.10.0-rc1
> > > > * https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
> > > >
> > > > The release tarball, signature, and checksums are here (revision 37932):
> > > > * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
> > > >
> > > > You can find the KEYS file here:
> > > > * https://dist.apache.org/repos/dist/dev/avro/KEYS
> > > >
> > > > Binary artifacts for Java are staged in Nexus here:
> > > > *
> > > > https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
> > > >
> > > > This release includes 187 Jira issues (Thanks Ryan Skraba for the
> > > > highlights)
> > > >
> > > > https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
> > > >
> > > > * Some interesting highlights (Thanks Ryan Skraba for the list):
> > > >
> > > > C#
> > > > - [AVRO-2389] Add Avro serialization for POCO (Reflection)
> > > >
> > > > Java
> > > > - [AVRO-2723] Automatically find defaults on POJO when using reflection.
> > > > - [AVRO-2278] Now throws an exception when getting a non-existent
> > > > field from a record
> > > > - [AVRO-2335] Remove Joda Time library.
> > > > - [AVRO-2438] Better support for URI and URL types.
> > > >
> > > > Perl
> > > > - [AVRO-1461] Distribute as a CPAN module.
> > > >
> > > > PHP
> > > > - [AVRO-2527] Update to PHP 7.x
> > > >
> > > > Python
> > > > - [AVRO-2656] avro-python package is now the preferred python3 library
> > > > and avro-python3 is prepared to be deprecated
> > > > - [AVRO-2387] type checking added to python
> > > >
> > > > Ruby
> > > > - [AVRO-1740] Support fingerprinting.
> > > > - [AVRO-2535] Support enum defaults.
> > > > - [AVRO-2545] Support aliases.
> > > >
> > > > * Upgrade dependencies to latest versions, including CVE fixes.
> > > > * Multiple fixes and more...
> > > >
> > > > Please download, verify, and test. This vote will remain open for at least
> > > > 72 hours. Given sufficient votes, I would like to close after noon UTC
> > > > Friday, June 12th, 2020
> > > >
> > > > [ ] +1 Release this as Apache Avro 1.10.0
> > > > [ ] +0
> > > > [ ] -1 Do not release this because...
> > > >
> > > > Best regards,
> > > > Ismaël Mejía
> > > >
> >
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by Andy Le <an...@gmail.com>.
Hey Ryan,
Thank you for your clear explanation.
+1 for me :D
Thank you.
On 2020/06/10 14:39:10, Ryan Skraba <ry...@skraba.com> wrote:
> Hey Anh, a release requires 3 PMC votes, but "unofficial" opinions are
> welcome and taken into account. My opinion is unofficial too!
>
> Just reply with a +1 if you think the artifacts are good to go or -1
> if you've found a bug, regression, security issue, or something that
> should block these artifacts from being the 1.10.0 release.
>
> For example, at my company, we have a lot of internal code and
> libraries that work with Avro 1.9.2, especially the generic Java APIs,
> so I'm going to compile with 1.10.0 and see if all the unit tests
> pass.
>
> If you're familiar with building any open source projects that use
> Avro, try bumping there and reporting back. You can go through the
> open JIRA and open PR and make recommendations if we missed something
> important.
>
> For example, I've gone through a lot of the JIRA and it looks like
> AVRO-2799 (a protobuf bug) is blocking a user. I'm looking to see if
> this is a regression or if it's an easy fix before I vote.
>
> I've verified the signatures and SHA512 of the artifacts, so that's good!
>
> All my best, Ryan
>
>
>
>
>
>
> On Wed, Jun 10, 2020 at 8:53 AM Anh Le <an...@gmail.com> wrote:
> >
> > Hi,
> >
> > How can I make a vote on this?
> >
> > Best Regards.
> >
> > On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com> wrote:
> >
> > > Hi everyone,
> > >
> > > I'd like to propose the following RC1 to be released as the official Apache
> > > Avro 1.10.0 release.
> > >
> > > The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
> > >
> > > * This corresponds to the tag: release-1.10.0-rc1
> > > * https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
> > >
> > > The release tarball, signature, and checksums are here (revision 37932):
> > > * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
> > >
> > > You can find the KEYS file here:
> > > * https://dist.apache.org/repos/dist/dev/avro/KEYS
> > >
> > > Binary artifacts for Java are staged in Nexus here:
> > > *
> > > https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
> > >
> > > This release includes 187 Jira issues (Thanks Ryan Skraba for the
> > > highlights)
> > >
> > > https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
> > >
> > > * Some interesting highlights (Thanks Ryan Skraba for the list):
> > >
> > > C#
> > > - [AVRO-2389] Add Avro serialization for POCO (Reflection)
> > >
> > > Java
> > > - [AVRO-2723] Automatically find defaults on POJO when using reflection.
> > > - [AVRO-2278] Now throws an exception when getting a non-existent
> > > field from a record
> > > - [AVRO-2335] Remove Joda Time library.
> > > - [AVRO-2438] Better support for URI and URL types.
> > >
> > > Perl
> > > - [AVRO-1461] Distribute as a CPAN module.
> > >
> > > PHP
> > > - [AVRO-2527] Update to PHP 7.x
> > >
> > > Python
> > > - [AVRO-2656] avro-python package is now the preferred python3 library
> > > and avro-python3 is prepared to be deprecated
> > > - [AVRO-2387] type checking added to python
> > >
> > > Ruby
> > > - [AVRO-1740] Support fingerprinting.
> > > - [AVRO-2535] Support enum defaults.
> > > - [AVRO-2545] Support aliases.
> > >
> > > * Upgrade dependencies to latest versions, including CVE fixes.
> > > * Multiple fixes and more...
> > >
> > > Please download, verify, and test. This vote will remain open for at least
> > > 72 hours. Given sufficient votes, I would like to close after noon UTC
> > > Friday, June 12th, 2020
> > >
> > > [ ] +1 Release this as Apache Avro 1.10.0
> > > [ ] +0
> > > [ ] -1 Do not release this because...
> > >
> > > Best regards,
> > > Ismaël Mejía
> > >
>
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by Ryan Skraba <ry...@skraba.com>.
Hey Anh, a release requires 3 PMC votes, but "unofficial" opinions are
welcome and taken into account. My opinion is unofficial too!
Just reply with a +1 if you think the artifacts are good to go or -1
if you've found a bug, regression, security issue, or something that
should block these artifacts from being the 1.10.0 release.
For example, at my company, we have a lot of internal code and
libraries that work with Avro 1.9.2, especially the generic Java APIs,
so I'm going to compile with 1.10.0 and see if all the unit tests
pass.
If you're familiar with building any open source projects that use
Avro, try bumping there and reporting back. You can go through the
open JIRA and open PR and make recommendations if we missed something
important.
For example, I've gone through a lot of the JIRA and it looks like
AVRO-2799 (a protobuf bug) is blocking a user. I'm looking to see if
this is a regression or if it's an easy fix before I vote.
I've verified the signatures and SHA512 of the artifacts, so that's good!
All my best, Ryan
On Wed, Jun 10, 2020 at 8:53 AM Anh Le <an...@gmail.com> wrote:
>
> Hi,
>
> How can I make a vote on this?
>
> Best Regards.
>
> On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com> wrote:
>
> > Hi everyone,
> >
> > I'd like to propose the following RC1 to be released as the official Apache
> > Avro 1.10.0 release.
> >
> > The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
> >
> > * This corresponds to the tag: release-1.10.0-rc1
> > * https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
> >
> > The release tarball, signature, and checksums are here (revision 37932):
> > * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
> >
> > You can find the KEYS file here:
> > * https://dist.apache.org/repos/dist/dev/avro/KEYS
> >
> > Binary artifacts for Java are staged in Nexus here:
> > *
> > https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
> >
> > This release includes 187 Jira issues (Thanks Ryan Skraba for the
> > highlights)
> >
> > https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
> >
> > * Some interesting highlights (Thanks Ryan Skraba for the list):
> >
> > C#
> > - [AVRO-2389] Add Avro serialization for POCO (Reflection)
> >
> > Java
> > - [AVRO-2723] Automatically find defaults on POJO when using reflection.
> > - [AVRO-2278] Now throws an exception when getting a non-existent
> > field from a record
> > - [AVRO-2335] Remove Joda Time library.
> > - [AVRO-2438] Better support for URI and URL types.
> >
> > Perl
> > - [AVRO-1461] Distribute as a CPAN module.
> >
> > PHP
> > - [AVRO-2527] Update to PHP 7.x
> >
> > Python
> > - [AVRO-2656] avro-python package is now the preferred python3 library
> > and avro-python3 is prepared to be deprecated
> > - [AVRO-2387] type checking added to python
> >
> > Ruby
> > - [AVRO-1740] Support fingerprinting.
> > - [AVRO-2535] Support enum defaults.
> > - [AVRO-2545] Support aliases.
> >
> > * Upgrade dependencies to latest versions, including CVE fixes.
> > * Multiple fixes and more...
> >
> > Please download, verify, and test. This vote will remain open for at least
> > 72 hours. Given sufficient votes, I would like to close after noon UTC
> > Friday, June 12th, 2020
> >
> > [ ] +1 Release this as Apache Avro 1.10.0
> > [ ] +0
> > [ ] -1 Do not release this because...
> >
> > Best regards,
> > Ismaël Mejía
> >
Re: [VOTE] Release Apache Avro 1.10.0 RC1
Posted by Anh Le <an...@gmail.com>.
Hi,
How can I make a vote on this?
Best Regards.
On Tue, 9 Jun 2020, 22:28 Ismaël Mejía, <ie...@gmail.com> wrote:
> Hi everyone,
>
> I'd like to propose the following RC1 to be released as the official Apache
> Avro 1.10.0 release.
>
> The commit id is 1301a045396cf0e6ca7f12c9e4053b4f81237887
>
> * This corresponds to the tag: release-1.10.0-rc1
> * https://github.com/apache/avro/releases/tag/release-1.10.0-rc1
>
> The release tarball, signature, and checksums are here (revision 37932):
> * https://dist.apache.org/repos/dist/dev/avro/avro-1.10.0-rc1/
>
> You can find the KEYS file here:
> * https://dist.apache.org/repos/dist/dev/avro/KEYS
>
> Binary artifacts for Java are staged in Nexus here:
> *
> https://repository.apache.org/content/groups/staging/org/apache/avro/avro/1.10.0/
>
> This release includes 187 Jira issues (Thanks Ryan Skraba for the
> highlights)
>
> https://jira.apache.org/jira/issues/?jql=project%20%3D%20AVRO%20AND%20fixVersion%20%3D%201.10.0
>
> * Some interesting highlights (Thanks Ryan Skraba for the list):
>
> C#
> - [AVRO-2389] Add Avro serialization for POCO (Reflection)
>
> Java
> - [AVRO-2723] Automatically find defaults on POJO when using reflection.
> - [AVRO-2278] Now throws an exception when getting a non-existent
> field from a record
> - [AVRO-2335] Remove Joda Time library.
> - [AVRO-2438] Better support for URI and URL types.
>
> Perl
> - [AVRO-1461] Distribute as a CPAN module.
>
> PHP
> - [AVRO-2527] Update to PHP 7.x
>
> Python
> - [AVRO-2656] avro-python package is now the preferred python3 library
> and avro-python3 is prepared to be deprecated
> - [AVRO-2387] type checking added to python
>
> Ruby
> - [AVRO-1740] Support fingerprinting.
> - [AVRO-2535] Support enum defaults.
> - [AVRO-2545] Support aliases.
>
> * Upgrade dependencies to latest versions, including CVE fixes.
> * Multiple fixes and more...
>
> Please download, verify, and test. This vote will remain open for at least
> 72 hours. Given sufficient votes, I would like to close after noon UTC
> Friday, June 12th, 2020
>
> [ ] +1 Release this as Apache Avro 1.10.0
> [ ] +0
> [ ] -1 Do not release this because...
>
> Best regards,
> Ismaël Mejía
>