You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Krisztián Szűcs <sz...@gmail.com> on 2019/01/12 19:56:28 UTC
[VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Hi,
I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
The previous RCs were not voted, because:
- RC0: the source archive didn't include required files to build
gandiva-glib
documents, also causing failed binary build for Debian Stretch [6].
- RC1: compatibility issues with the just released pandas version 0.24.rc1
[8]
This release candidate is based on commit:
0bbaef451ae9d59799e693df9b2383808516a326 [2]
The source release rc2 is hosted at [3].
The binary artifacts are hosted at [4].
The changelog is located at [5].
Please download, verify checksums and signatures, run the unit tests,
and vote on the release. See [7] for how to validate a release candidate.
The vote will be open for at least 72 hours.
[ ] +1 Release this as Apache Arrow 0.12.0
[ ] +0
[ ] -1 Do not release this as Apache Arrow 0.12.0 because...
Special thanks to @kou for helping with the uprising issues!
- Krisztian
[1]:
https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
[2]:
https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
<https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
[3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
[4]: https://bintray.com/beta/#/apache/arrow?tab=packages
[5]:
https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
[6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
[7]:
https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
[8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Kouhei Sutou <ko...@clear-code.com>.
Hi,
I've created a pull request for verifying binaries on Bintray:
https://github.com/apache/arrow/pull/3397
Thanks,
--
kou
In <0a...@python.org>
"Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Mon, 14 Jan 2019 09:34:06 +0100,
Antoine Pitrou <an...@python.org> wrote:
>
> Apparently the binaries verification script attempts to download from
> dist.apache.org?
>
> $ dev/release/verify-release-candidate.sh binaries 0.12.0 rc2
> [...]
> + wget -P apache-arrow-0.12.0-rcrc2 --quiet --no-host-directories
> --cut-dirs=5 --no-parent --reject 'index.html*' --recursive
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rcrc2/binaries/
>
>
>
> Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
>> Hi,
>>
>> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
>> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
>> The previous RCs were not voted, because:
>> - RC0: the source archive didn't include required files to build
>> gandiva-glib
>> documents, also causing failed binary build for Debian Stretch [6].
>> - RC1: compatibility issues with the just released pandas version 0.24.rc1
>> [8]
>>
>> This release candidate is based on commit:
>> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
>>
>> The source release rc2 is hosted at [3].
>> The binary artifacts are hosted at [4].
>> The changelog is located at [5].
>>
>> Please download, verify checksums and signatures, run the unit tests,
>> and vote on the release. See [7] for how to validate a release candidate.
>>
>> The vote will be open for at least 72 hours.
>>
>> [ ] +1 Release this as Apache Arrow 0.12.0
>> [ ] +0
>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
>>
>> Special thanks to @kou for helping with the uprising issues!
>>
>> - Krisztian
>>
>> [1]:
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
>> [2]:
>> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
>> <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
>> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
>> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
>> [5]:
>> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
>> [7]:
>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
>>
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Antoine Pitrou <an...@python.org>.
Apparently the binaries verification script attempts to download from
dist.apache.org?
$ dev/release/verify-release-candidate.sh binaries 0.12.0 rc2
[...]
+ wget -P apache-arrow-0.12.0-rcrc2 --quiet --no-host-directories
--cut-dirs=5 --no-parent --reject 'index.html*' --recursive
https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rcrc2/binaries/
Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> Hi,
>
> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> The previous RCs were not voted, because:
> - RC0: the source archive didn't include required files to build
> gandiva-glib
> documents, also causing failed binary build for Debian Stretch [6].
> - RC1: compatibility issues with the just released pandas version 0.24.rc1
> [8]
>
> This release candidate is based on commit:
> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
>
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4].
> The changelog is located at [5].
>
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [7] for how to validate a release candidate.
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Release this as Apache Arrow 0.12.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
>
> Special thanks to @kou for helping with the uprising issues!
>
> - Krisztian
>
> [1]:
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> [2]:
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> [5]:
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> [7]:
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
>
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Philipp Moritz <pc...@gmail.com>.
+1 (non-binding)
I didn't do very exhaustive tests, but the full Ray test suite passes based
on that commit.
On Sun, Jan 13, 2019 at 8:59 PM Wes McKinney <we...@gmail.com> wrote:
> +1 (binding)
>
> Ran release verification scripts (for source release) on Ubuntu 14.04
> (with ARROW_HAVE_CUDA=yes) and Windows / Visual Studio 2015 with some
> caveats
>
> * ARROW-4250: Gandiva test failing due to exact floating point
> comparison on Ubuntu 14.04
> * ARROW-4253: GLib cannot use a non-system Boost
> * ARROW-4254: Ubuntu 14.04 Boost from apt has compilation errors in
> Gandiva unit tests
> * ARROW-4256: Windows verification script fix (patch up)
> * ARROW-4257: Update release verification script now that the staged
> binaries are on Bintray
>
> None of these issues are very significant. I hope we can work toward a
> more smooth 0.13 release
>
> On Sun, Jan 13, 2019 at 10:14 AM Andy Grove <an...@gmail.com> wrote:
> >
> > Speaking for the Rust implementation only ...
> >
> > - The code compiles and tests pass
> > - The version number of both crates (arrow and parquet) is correctly set
> to
> > 0.12.0
> > - The parquet crate still depends on the arrow crate using a local path
> > (../arrow) rather than depending on the published 0.12.0 (which doesn't
> > exist yet) so technically cannot be published as is (but we can manually
> > change that dependency when publishing, so I don't see it as a big deal
> at
> > all)
> >
> > So it's a +1 from me.
> >
> > Andy.
> >
> > On Sat, Jan 12, 2019 at 12:56 PM Krisztián Szűcs <
> szucs.krisztian@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > I'd like to propose the 1st release candidate (RC2) of Apache Arrow
> version
> > > 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > > The previous RCs were not voted, because:
> > > - RC0: the source archive didn't include required files to build
> > > gandiva-glib
> > > documents, also causing failed binary build for Debian Stretch [6].
> > > - RC1: compatibility issues with the just released pandas version
> 0.24.rc1
> > > [8]
> > >
> > > This release candidate is based on commit:
> > > 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> > >
> > > The source release rc2 is hosted at [3].
> > > The binary artifacts are hosted at [4].
> > > The changelog is located at [5].
> > >
> > > Please download, verify checksums and signatures, run the unit tests,
> > > and vote on the release. See [7] for how to validate a release
> candidate.
> > >
> > > The vote will be open for at least 72 hours.
> > >
> > > [ ] +1 Release this as Apache Arrow 0.12.0
> > > [ ] +0
> > > [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> > >
> > > Special thanks to @kou for helping with the uprising issues!
> > >
> > > - Krisztian
> > >
> > > [1]:
> > >
> > >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > > [2]:
> > >
> > >
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > > <
> > >
> https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359
> > > >
> > > [3]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > > [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > > [5]:
> > >
> > >
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > > [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > > [7]:
> > >
> > >
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > > [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> > >
>
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Wes McKinney <we...@gmail.com>.
+1 (binding)
Ran release verification scripts (for source release) on Ubuntu 14.04
(with ARROW_HAVE_CUDA=yes) and Windows / Visual Studio 2015 with some
caveats
* ARROW-4250: Gandiva test failing due to exact floating point
comparison on Ubuntu 14.04
* ARROW-4253: GLib cannot use a non-system Boost
* ARROW-4254: Ubuntu 14.04 Boost from apt has compilation errors in
Gandiva unit tests
* ARROW-4256: Windows verification script fix (patch up)
* ARROW-4257: Update release verification script now that the staged
binaries are on Bintray
None of these issues are very significant. I hope we can work toward a
more smooth 0.13 release
On Sun, Jan 13, 2019 at 10:14 AM Andy Grove <an...@gmail.com> wrote:
>
> Speaking for the Rust implementation only ...
>
> - The code compiles and tests pass
> - The version number of both crates (arrow and parquet) is correctly set to
> 0.12.0
> - The parquet crate still depends on the arrow crate using a local path
> (../arrow) rather than depending on the published 0.12.0 (which doesn't
> exist yet) so technically cannot be published as is (but we can manually
> change that dependency when publishing, so I don't see it as a big deal at
> all)
>
> So it's a +1 from me.
>
> Andy.
>
> On Sat, Jan 12, 2019 at 12:56 PM Krisztián Szűcs <sz...@gmail.com>
> wrote:
>
> > Hi,
> >
> > I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> > 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > The previous RCs were not voted, because:
> > - RC0: the source archive didn't include required files to build
> > gandiva-glib
> > documents, also causing failed binary build for Debian Stretch [6].
> > - RC1: compatibility issues with the just released pandas version 0.24.rc1
> > [8]
> >
> > This release candidate is based on commit:
> > 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> >
> > The source release rc2 is hosted at [3].
> > The binary artifacts are hosted at [4].
> > The changelog is located at [5].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [7] for how to validate a release candidate.
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow 0.12.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> >
> > Special thanks to @kou for helping with the uprising issues!
> >
> > - Krisztian
> >
> > [1]:
> >
> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > [2]:
> >
> > https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > <
> > https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359
> > >
> > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > [5]:
> >
> > https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > [7]:
> >
> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> >
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Andy Grove <an...@gmail.com>.
Speaking for the Rust implementation only ...
- The code compiles and tests pass
- The version number of both crates (arrow and parquet) is correctly set to
0.12.0
- The parquet crate still depends on the arrow crate using a local path
(../arrow) rather than depending on the published 0.12.0 (which doesn't
exist yet) so technically cannot be published as is (but we can manually
change that dependency when publishing, so I don't see it as a big deal at
all)
So it's a +1 from me.
Andy.
On Sat, Jan 12, 2019 at 12:56 PM Krisztián Szűcs <sz...@gmail.com>
wrote:
> Hi,
>
> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> The previous RCs were not voted, because:
> - RC0: the source archive didn't include required files to build
> gandiva-glib
> documents, also causing failed binary build for Debian Stretch [6].
> - RC1: compatibility issues with the just released pandas version 0.24.rc1
> [8]
>
> This release candidate is based on commit:
> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
>
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4].
> The changelog is located at [5].
>
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [7] for how to validate a release candidate.
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Release this as Apache Arrow 0.12.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
>
> Special thanks to @kou for helping with the uprising issues!
>
> - Krisztian
>
> [1]:
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> [2]:
>
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> <
> https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359
> >
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> [5]:
>
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> [7]:
>
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
>
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Wes McKinney <we...@gmail.com>.
Does anything need to change in the verification scripts to run the
JavaScript parts of the integration tests? The build was passing when
I merged the refactor. We aren't pushing any npm artifacts from this
release so as long as the tests run it is OK
I would be OK with merging the patch for ARROW-4258 and then
immediately cutting another RC (so long as the verification script
isn't broken -- modulo the known issues reported in this thread
already)
On Mon, Jan 14, 2019 at 2:55 PM Krisztián Szűcs
<sz...@gmail.com> wrote:
>
> I'm fine with cutting an RC3. ARROW-4258 seems pretty bad.
> If We decide to create a new RC how should We deal with the
> recent JS refactoring [1]?
>
> On OSX the verification worked well though, except a plasma issue.
> Uwe, if You have time please verify it on OSX too.
>
> [1]
> https://github.com/apache/arrow/commit/5598d2f42573ed19e7db4aae7adb02af2cd4ccd0
>
> On Mon, Jan 14, 2019 at 8:01 PM Antoine Pitrou <an...@python.org> wrote:
>
> >
> > Ok, it worked, except that I got the classical test_plasma_list() failure.
> >
> > Regards
> >
> > Antoine.
> >
> >
> > Le 14/01/2019 à 17:50, Wes McKinney a écrit :
> > > How about using the conda-forge package?
> > >
> > > conda create -y -p $HOME/release-0.12-toolchain brotli -c conda-forge
> > > export BROTLI_HOME=$HOME/release-0.12-toolchain
> > >
> > >
> > > On Mon, Jan 14, 2019 at 10:46 AM Antoine Pitrou <an...@python.org>
> > wrote:
> > >>
> > >>
> > >> Unfortunately, Ubuntu only provides shared library versions of
> > >> Brotli but we're looking for a statically-linked brotli:
> > >>
> > >> make[2]: *** No rule to make target
> > '/usr/lib/x86_64-linux-gnu/libbrotlidec.a', needed by
> > 'release/libarrow.so.12.0.0'. Stop.
> > >> CMakeFiles/Makefile2:2013: recipe for target
> > 'src/arrow/CMakeFiles/arrow_shared.dir/all' failed
> > >>
> > >>
> > >>
> > >>
> > >> Le 14/01/2019 à 16:46, Wes McKinney a écrit :
> > >>> Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
> > >>> packages for Ubuntu Bionic it's an annoyance for source-builders but
> > >>> not a deal breaker (IMHO) for the RC
> > >>>
> > >>> On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou <an...@python.org>
> > wrote:
> > >>>>
> > >>>>
> > >>>> Unfortunately I cannot validate the source release on Ubuntu 18.04,
> > >>>> as brotli fails compiling with a internal compiler error
> > >>>> (this is gcc 7.3.0):
> > >>>>
> > >>>>
> > /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:
> > In function ‘BrotliCompressFragmentFastImpl13’:
> > >>>>
> > /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1:
> > internal compiler error: Erreur de segmentation
> > >>>> FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
> > >>>> ^~~~~~~~~~~~~~~
> > >>>> Please submit a full bug report,
> > >>>> with preprocessed source if appropriate.
> > >>>> See <file:///usr/share/doc/gcc-7/README.Bugs> for instructions.
> > >>>> make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o]
> > Error 1
> > >>>> make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
> > >>>> make[3]: *** [all] Error 2
> > >>>>
> > >>>>
> > >>>> Regards
> > >>>>
> > >>>> Antoine.
> > >>>>
> > >>>>
> > >>>> Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> > >>>>> Hi,
> > >>>>>
> > >>>>> I'd like to propose the 1st release candidate (RC2) of Apache Arrow
> > version
> > >>>>> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > >>>>> The previous RCs were not voted, because:
> > >>>>> - RC0: the source archive didn't include required files to build
> > >>>>> gandiva-glib
> > >>>>> documents, also causing failed binary build for Debian Stretch [6].
> > >>>>> - RC1: compatibility issues with the just released pandas version
> > 0.24.rc1
> > >>>>> [8]
> > >>>>>
> > >>>>> This release candidate is based on commit:
> > >>>>> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> > >>>>>
> > >>>>> The source release rc2 is hosted at [3].
> > >>>>> The binary artifacts are hosted at [4].
> > >>>>> The changelog is located at [5].
> > >>>>>
> > >>>>> Please download, verify checksums and signatures, run the unit tests,
> > >>>>> and vote on the release. See [7] for how to validate a release
> > candidate.
> > >>>>>
> > >>>>> The vote will be open for at least 72 hours.
> > >>>>>
> > >>>>> [ ] +1 Release this as Apache Arrow 0.12.0
> > >>>>> [ ] +0
> > >>>>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> > >>>>>
> > >>>>> Special thanks to @kou for helping with the uprising issues!
> > >>>>>
> > >>>>> - Krisztian
> > >>>>>
> > >>>>> [1]:
> > >>>>>
> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > >>>>> [2]:
> > >>>>>
> > https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > >>>>> <
> > https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359
> > >
> > >>>>> [3]:
> > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > >>>>> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > >>>>> [5]:
> > >>>>>
> > https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > >>>>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > >>>>> [7]:
> > >>>>>
> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > >>>>> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> > >>>>>
> >
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Krisztián Szűcs <sz...@gmail.com>.
I'm fine with cutting an RC3. ARROW-4258 seems pretty bad.
If We decide to create a new RC how should We deal with the
recent JS refactoring [1]?
On OSX the verification worked well though, except a plasma issue.
Uwe, if You have time please verify it on OSX too.
[1]
https://github.com/apache/arrow/commit/5598d2f42573ed19e7db4aae7adb02af2cd4ccd0
On Mon, Jan 14, 2019 at 8:01 PM Antoine Pitrou <an...@python.org> wrote:
>
> Ok, it worked, except that I got the classical test_plasma_list() failure.
>
> Regards
>
> Antoine.
>
>
> Le 14/01/2019 à 17:50, Wes McKinney a écrit :
> > How about using the conda-forge package?
> >
> > conda create -y -p $HOME/release-0.12-toolchain brotli -c conda-forge
> > export BROTLI_HOME=$HOME/release-0.12-toolchain
> >
> >
> > On Mon, Jan 14, 2019 at 10:46 AM Antoine Pitrou <an...@python.org>
> wrote:
> >>
> >>
> >> Unfortunately, Ubuntu only provides shared library versions of
> >> Brotli but we're looking for a statically-linked brotli:
> >>
> >> make[2]: *** No rule to make target
> '/usr/lib/x86_64-linux-gnu/libbrotlidec.a', needed by
> 'release/libarrow.so.12.0.0'. Stop.
> >> CMakeFiles/Makefile2:2013: recipe for target
> 'src/arrow/CMakeFiles/arrow_shared.dir/all' failed
> >>
> >>
> >>
> >>
> >> Le 14/01/2019 à 16:46, Wes McKinney a écrit :
> >>> Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
> >>> packages for Ubuntu Bionic it's an annoyance for source-builders but
> >>> not a deal breaker (IMHO) for the RC
> >>>
> >>> On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou <an...@python.org>
> wrote:
> >>>>
> >>>>
> >>>> Unfortunately I cannot validate the source release on Ubuntu 18.04,
> >>>> as brotli fails compiling with a internal compiler error
> >>>> (this is gcc 7.3.0):
> >>>>
> >>>>
> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:
> In function ‘BrotliCompressFragmentFastImpl13’:
> >>>>
> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1:
> internal compiler error: Erreur de segmentation
> >>>> FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
> >>>> ^~~~~~~~~~~~~~~
> >>>> Please submit a full bug report,
> >>>> with preprocessed source if appropriate.
> >>>> See <file:///usr/share/doc/gcc-7/README.Bugs> for instructions.
> >>>> make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o]
> Error 1
> >>>> make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
> >>>> make[3]: *** [all] Error 2
> >>>>
> >>>>
> >>>> Regards
> >>>>
> >>>> Antoine.
> >>>>
> >>>>
> >>>> Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> >>>>> Hi,
> >>>>>
> >>>>> I'd like to propose the 1st release candidate (RC2) of Apache Arrow
> version
> >>>>> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> >>>>> The previous RCs were not voted, because:
> >>>>> - RC0: the source archive didn't include required files to build
> >>>>> gandiva-glib
> >>>>> documents, also causing failed binary build for Debian Stretch [6].
> >>>>> - RC1: compatibility issues with the just released pandas version
> 0.24.rc1
> >>>>> [8]
> >>>>>
> >>>>> This release candidate is based on commit:
> >>>>> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> >>>>>
> >>>>> The source release rc2 is hosted at [3].
> >>>>> The binary artifacts are hosted at [4].
> >>>>> The changelog is located at [5].
> >>>>>
> >>>>> Please download, verify checksums and signatures, run the unit tests,
> >>>>> and vote on the release. See [7] for how to validate a release
> candidate.
> >>>>>
> >>>>> The vote will be open for at least 72 hours.
> >>>>>
> >>>>> [ ] +1 Release this as Apache Arrow 0.12.0
> >>>>> [ ] +0
> >>>>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> >>>>>
> >>>>> Special thanks to @kou for helping with the uprising issues!
> >>>>>
> >>>>> - Krisztian
> >>>>>
> >>>>> [1]:
> >>>>>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> >>>>> [2]:
> >>>>>
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> >>>>> <
> https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359
> >
> >>>>> [3]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> >>>>> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> >>>>> [5]:
> >>>>>
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> >>>>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> >>>>> [7]:
> >>>>>
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >>>>> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> >>>>>
>
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Antoine Pitrou <an...@python.org>.
Ok, it worked, except that I got the classical test_plasma_list() failure.
Regards
Antoine.
Le 14/01/2019 à 17:50, Wes McKinney a écrit :
> How about using the conda-forge package?
>
> conda create -y -p $HOME/release-0.12-toolchain brotli -c conda-forge
> export BROTLI_HOME=$HOME/release-0.12-toolchain
>
>
> On Mon, Jan 14, 2019 at 10:46 AM Antoine Pitrou <an...@python.org> wrote:
>>
>>
>> Unfortunately, Ubuntu only provides shared library versions of
>> Brotli but we're looking for a statically-linked brotli:
>>
>> make[2]: *** No rule to make target '/usr/lib/x86_64-linux-gnu/libbrotlidec.a', needed by 'release/libarrow.so.12.0.0'. Stop.
>> CMakeFiles/Makefile2:2013: recipe for target 'src/arrow/CMakeFiles/arrow_shared.dir/all' failed
>>
>>
>>
>>
>> Le 14/01/2019 à 16:46, Wes McKinney a écrit :
>>> Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
>>> packages for Ubuntu Bionic it's an annoyance for source-builders but
>>> not a deal breaker (IMHO) for the RC
>>>
>>> On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou <an...@python.org> wrote:
>>>>
>>>>
>>>> Unfortunately I cannot validate the source release on Ubuntu 18.04,
>>>> as brotli fails compiling with a internal compiler error
>>>> (this is gcc 7.3.0):
>>>>
>>>> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c: In function ‘BrotliCompressFragmentFastImpl13’:
>>>> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1: internal compiler error: Erreur de segmentation
>>>> FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
>>>> ^~~~~~~~~~~~~~~
>>>> Please submit a full bug report,
>>>> with preprocessed source if appropriate.
>>>> See <file:///usr/share/doc/gcc-7/README.Bugs> for instructions.
>>>> make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
>>>> make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
>>>> make[3]: *** [all] Error 2
>>>>
>>>>
>>>> Regards
>>>>
>>>> Antoine.
>>>>
>>>>
>>>> Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
>>>>> Hi,
>>>>>
>>>>> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
>>>>> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
>>>>> The previous RCs were not voted, because:
>>>>> - RC0: the source archive didn't include required files to build
>>>>> gandiva-glib
>>>>> documents, also causing failed binary build for Debian Stretch [6].
>>>>> - RC1: compatibility issues with the just released pandas version 0.24.rc1
>>>>> [8]
>>>>>
>>>>> This release candidate is based on commit:
>>>>> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
>>>>>
>>>>> The source release rc2 is hosted at [3].
>>>>> The binary artifacts are hosted at [4].
>>>>> The changelog is located at [5].
>>>>>
>>>>> Please download, verify checksums and signatures, run the unit tests,
>>>>> and vote on the release. See [7] for how to validate a release candidate.
>>>>>
>>>>> The vote will be open for at least 72 hours.
>>>>>
>>>>> [ ] +1 Release this as Apache Arrow 0.12.0
>>>>> [ ] +0
>>>>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
>>>>>
>>>>> Special thanks to @kou for helping with the uprising issues!
>>>>>
>>>>> - Krisztian
>>>>>
>>>>> [1]:
>>>>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
>>>>> [2]:
>>>>> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
>>>>> <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
>>>>> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
>>>>> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
>>>>> [5]:
>>>>> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
>>>>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
>>>>> [7]:
>>>>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>>>>> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
>>>>>
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Wes McKinney <we...@gmail.com>.
In light of the severity of ARROW-4258
(https://github.com/apache/arrow/pull/3395) and some of the other
rough edges in this RC, I would suggest making some fixes today and
cutting an RC3. I'm revising my vote to -0
@Krisztian -- you are the RM, so it is up to you whether you want to
cancel the release vote
On Mon, Jan 14, 2019 at 10:50 AM Wes McKinney <we...@gmail.com> wrote:
>
> How about using the conda-forge package?
>
> conda create -y -p $HOME/release-0.12-toolchain brotli -c conda-forge
> export BROTLI_HOME=$HOME/release-0.12-toolchain
>
>
> On Mon, Jan 14, 2019 at 10:46 AM Antoine Pitrou <an...@python.org> wrote:
> >
> >
> > Unfortunately, Ubuntu only provides shared library versions of
> > Brotli but we're looking for a statically-linked brotli:
> >
> > make[2]: *** No rule to make target '/usr/lib/x86_64-linux-gnu/libbrotlidec.a', needed by 'release/libarrow.so.12.0.0'. Stop.
> > CMakeFiles/Makefile2:2013: recipe for target 'src/arrow/CMakeFiles/arrow_shared.dir/all' failed
> >
> >
> >
> >
> > Le 14/01/2019 à 16:46, Wes McKinney a écrit :
> > > Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
> > > packages for Ubuntu Bionic it's an annoyance for source-builders but
> > > not a deal breaker (IMHO) for the RC
> > >
> > > On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou <an...@python.org> wrote:
> > >>
> > >>
> > >> Unfortunately I cannot validate the source release on Ubuntu 18.04,
> > >> as brotli fails compiling with a internal compiler error
> > >> (this is gcc 7.3.0):
> > >>
> > >> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c: In function ‘BrotliCompressFragmentFastImpl13’:
> > >> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1: internal compiler error: Erreur de segmentation
> > >> FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
> > >> ^~~~~~~~~~~~~~~
> > >> Please submit a full bug report,
> > >> with preprocessed source if appropriate.
> > >> See <file:///usr/share/doc/gcc-7/README.Bugs> for instructions.
> > >> make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
> > >> make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
> > >> make[3]: *** [all] Error 2
> > >>
> > >>
> > >> Regards
> > >>
> > >> Antoine.
> > >>
> > >>
> > >> Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> > >>> Hi,
> > >>>
> > >>> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> > >>> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > >>> The previous RCs were not voted, because:
> > >>> - RC0: the source archive didn't include required files to build
> > >>> gandiva-glib
> > >>> documents, also causing failed binary build for Debian Stretch [6].
> > >>> - RC1: compatibility issues with the just released pandas version 0.24.rc1
> > >>> [8]
> > >>>
> > >>> This release candidate is based on commit:
> > >>> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> > >>>
> > >>> The source release rc2 is hosted at [3].
> > >>> The binary artifacts are hosted at [4].
> > >>> The changelog is located at [5].
> > >>>
> > >>> Please download, verify checksums and signatures, run the unit tests,
> > >>> and vote on the release. See [7] for how to validate a release candidate.
> > >>>
> > >>> The vote will be open for at least 72 hours.
> > >>>
> > >>> [ ] +1 Release this as Apache Arrow 0.12.0
> > >>> [ ] +0
> > >>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> > >>>
> > >>> Special thanks to @kou for helping with the uprising issues!
> > >>>
> > >>> - Krisztian
> > >>>
> > >>> [1]:
> > >>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > >>> [2]:
> > >>> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > >>> <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
> > >>> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > >>> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > >>> [5]:
> > >>> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > >>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > >>> [7]:
> > >>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > >>> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> > >>>
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Wes McKinney <we...@gmail.com>.
How about using the conda-forge package?
conda create -y -p $HOME/release-0.12-toolchain brotli -c conda-forge
export BROTLI_HOME=$HOME/release-0.12-toolchain
On Mon, Jan 14, 2019 at 10:46 AM Antoine Pitrou <an...@python.org> wrote:
>
>
> Unfortunately, Ubuntu only provides shared library versions of
> Brotli but we're looking for a statically-linked brotli:
>
> make[2]: *** No rule to make target '/usr/lib/x86_64-linux-gnu/libbrotlidec.a', needed by 'release/libarrow.so.12.0.0'. Stop.
> CMakeFiles/Makefile2:2013: recipe for target 'src/arrow/CMakeFiles/arrow_shared.dir/all' failed
>
>
>
>
> Le 14/01/2019 à 16:46, Wes McKinney a écrit :
> > Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
> > packages for Ubuntu Bionic it's an annoyance for source-builders but
> > not a deal breaker (IMHO) for the RC
> >
> > On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou <an...@python.org> wrote:
> >>
> >>
> >> Unfortunately I cannot validate the source release on Ubuntu 18.04,
> >> as brotli fails compiling with a internal compiler error
> >> (this is gcc 7.3.0):
> >>
> >> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c: In function ‘BrotliCompressFragmentFastImpl13’:
> >> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1: internal compiler error: Erreur de segmentation
> >> FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
> >> ^~~~~~~~~~~~~~~
> >> Please submit a full bug report,
> >> with preprocessed source if appropriate.
> >> See <file:///usr/share/doc/gcc-7/README.Bugs> for instructions.
> >> make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
> >> make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
> >> make[3]: *** [all] Error 2
> >>
> >>
> >> Regards
> >>
> >> Antoine.
> >>
> >>
> >> Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> >>> Hi,
> >>>
> >>> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> >>> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> >>> The previous RCs were not voted, because:
> >>> - RC0: the source archive didn't include required files to build
> >>> gandiva-glib
> >>> documents, also causing failed binary build for Debian Stretch [6].
> >>> - RC1: compatibility issues with the just released pandas version 0.24.rc1
> >>> [8]
> >>>
> >>> This release candidate is based on commit:
> >>> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> >>>
> >>> The source release rc2 is hosted at [3].
> >>> The binary artifacts are hosted at [4].
> >>> The changelog is located at [5].
> >>>
> >>> Please download, verify checksums and signatures, run the unit tests,
> >>> and vote on the release. See [7] for how to validate a release candidate.
> >>>
> >>> The vote will be open for at least 72 hours.
> >>>
> >>> [ ] +1 Release this as Apache Arrow 0.12.0
> >>> [ ] +0
> >>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> >>>
> >>> Special thanks to @kou for helping with the uprising issues!
> >>>
> >>> - Krisztian
> >>>
> >>> [1]:
> >>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> >>> [2]:
> >>> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> >>> <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
> >>> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> >>> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> >>> [5]:
> >>> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> >>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> >>> [7]:
> >>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >>> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> >>>
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Antoine Pitrou <an...@python.org>.
Unfortunately, Ubuntu only provides shared library versions of
Brotli but we're looking for a statically-linked brotli:
make[2]: *** No rule to make target '/usr/lib/x86_64-linux-gnu/libbrotlidec.a', needed by 'release/libarrow.so.12.0.0'. Stop.
CMakeFiles/Makefile2:2013: recipe for target 'src/arrow/CMakeFiles/arrow_shared.dir/all' failed
Le 14/01/2019 à 16:46, Wes McKinney a écrit :
> Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
> packages for Ubuntu Bionic it's an annoyance for source-builders but
> not a deal breaker (IMHO) for the RC
>
> On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou <an...@python.org> wrote:
>>
>>
>> Unfortunately I cannot validate the source release on Ubuntu 18.04,
>> as brotli fails compiling with a internal compiler error
>> (this is gcc 7.3.0):
>>
>> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c: In function ‘BrotliCompressFragmentFastImpl13’:
>> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1: internal compiler error: Erreur de segmentation
>> FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
>> ^~~~~~~~~~~~~~~
>> Please submit a full bug report,
>> with preprocessed source if appropriate.
>> See <file:///usr/share/doc/gcc-7/README.Bugs> for instructions.
>> make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
>> make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
>> make[3]: *** [all] Error 2
>>
>>
>> Regards
>>
>> Antoine.
>>
>>
>> Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
>>> Hi,
>>>
>>> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
>>> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
>>> The previous RCs were not voted, because:
>>> - RC0: the source archive didn't include required files to build
>>> gandiva-glib
>>> documents, also causing failed binary build for Debian Stretch [6].
>>> - RC1: compatibility issues with the just released pandas version 0.24.rc1
>>> [8]
>>>
>>> This release candidate is based on commit:
>>> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
>>>
>>> The source release rc2 is hosted at [3].
>>> The binary artifacts are hosted at [4].
>>> The changelog is located at [5].
>>>
>>> Please download, verify checksums and signatures, run the unit tests,
>>> and vote on the release. See [7] for how to validate a release candidate.
>>>
>>> The vote will be open for at least 72 hours.
>>>
>>> [ ] +1 Release this as Apache Arrow 0.12.0
>>> [ ] +0
>>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
>>>
>>> Special thanks to @kou for helping with the uprising issues!
>>>
>>> - Krisztian
>>>
>>> [1]:
>>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
>>> [2]:
>>> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
>>> <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
>>> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
>>> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
>>> [5]:
>>> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
>>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
>>> [7]:
>>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>>> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
>>>
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Wes McKinney <we...@gmail.com>.
I forgot to add that I also hit known issue
https://issues.apache.org/jira/browse/ARROW-3344 on Ubuntu 14.04
On Mon, Jan 14, 2019 at 9:46 AM Wes McKinney <we...@gmail.com> wrote:
>
> Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
> packages for Ubuntu Bionic it's an annoyance for source-builders but
> not a deal breaker (IMHO) for the RC
>
> On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou <an...@python.org> wrote:
> >
> >
> > Unfortunately I cannot validate the source release on Ubuntu 18.04,
> > as brotli fails compiling with a internal compiler error
> > (this is gcc 7.3.0):
> >
> > /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c: In function ‘BrotliCompressFragmentFastImpl13’:
> > /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1: internal compiler error: Erreur de segmentation
> > FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
> > ^~~~~~~~~~~~~~~
> > Please submit a full bug report,
> > with preprocessed source if appropriate.
> > See <file:///usr/share/doc/gcc-7/README.Bugs> for instructions.
> > make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
> > make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
> > make[3]: *** [all] Error 2
> >
> >
> > Regards
> >
> > Antoine.
> >
> >
> > Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> > > Hi,
> > >
> > > I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> > > 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > > The previous RCs were not voted, because:
> > > - RC0: the source archive didn't include required files to build
> > > gandiva-glib
> > > documents, also causing failed binary build for Debian Stretch [6].
> > > - RC1: compatibility issues with the just released pandas version 0.24.rc1
> > > [8]
> > >
> > > This release candidate is based on commit:
> > > 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> > >
> > > The source release rc2 is hosted at [3].
> > > The binary artifacts are hosted at [4].
> > > The changelog is located at [5].
> > >
> > > Please download, verify checksums and signatures, run the unit tests,
> > > and vote on the release. See [7] for how to validate a release candidate.
> > >
> > > The vote will be open for at least 72 hours.
> > >
> > > [ ] +1 Release this as Apache Arrow 0.12.0
> > > [ ] +0
> > > [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> > >
> > > Special thanks to @kou for helping with the uprising issues!
> > >
> > > - Krisztian
> > >
> > > [1]:
> > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > > [2]:
> > > https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > > <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
> > > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > > [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > > [5]:
> > > https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > > [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > > [7]:
> > > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > > [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> > >
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Wes McKinney <we...@gmail.com>.
Can you set $BROTLI_HOME to unblock yourself? Since we have .deb
packages for Ubuntu Bionic it's an annoyance for source-builders but
not a deal breaker (IMHO) for the RC
On Mon, Jan 14, 2019 at 3:24 AM Antoine Pitrou <an...@python.org> wrote:
>
>
> Unfortunately I cannot validate the source release on Ubuntu 18.04,
> as brotli fails compiling with a internal compiler error
> (this is gcc 7.3.0):
>
> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c: In function ‘BrotliCompressFragmentFastImpl13’:
> /tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1: internal compiler error: Erreur de segmentation
> FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
> ^~~~~~~~~~~~~~~
> Please submit a full bug report,
> with preprocessed source if appropriate.
> See <file:///usr/share/doc/gcc-7/README.Bugs> for instructions.
> make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
> make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
> make[3]: *** [all] Error 2
>
>
> Regards
>
> Antoine.
>
>
> Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> > Hi,
> >
> > I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> > 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > The previous RCs were not voted, because:
> > - RC0: the source archive didn't include required files to build
> > gandiva-glib
> > documents, also causing failed binary build for Debian Stretch [6].
> > - RC1: compatibility issues with the just released pandas version 0.24.rc1
> > [8]
> >
> > This release candidate is based on commit:
> > 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> >
> > The source release rc2 is hosted at [3].
> > The binary artifacts are hosted at [4].
> > The changelog is located at [5].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [7] for how to validate a release candidate.
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow 0.12.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> >
> > Special thanks to @kou for helping with the uprising issues!
> >
> > - Krisztian
> >
> > [1]:
> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > [2]:
> > https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
> > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > [5]:
> > https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > [7]:
> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
> >
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Antoine Pitrou <an...@python.org>.
Unfortunately I cannot validate the source release on Ubuntu 18.04,
as brotli fails compiling with a internal compiler error
(this is gcc 7.3.0):
/tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c: In function ‘BrotliCompressFragmentFastImpl13’:
/tmp/arrow-0.12.0.BZuZO/apache-arrow-0.12.0/cpp/build/brotli_ep-prefix/src/brotli_ep/enc/compress_fragment.c:743:1: internal compiler error: Erreur de segmentation
FOR_TABLE_BITS_(BAKE_METHOD_PARAM_)
^~~~~~~~~~~~~~~
Please submit a full bug report,
with preprocessed source if appropriate.
See <file:///usr/share/doc/gcc-7/README.Bugs> for instructions.
make[5]: *** [CMakeFiles/brotlienc.dir/enc/compress_fragment.c.o] Error 1
make[4]: *** [CMakeFiles/brotlienc.dir/all] Error 2
make[3]: *** [all] Error 2
Regards
Antoine.
Le 12/01/2019 à 20:56, Krisztián Szűcs a écrit :
> Hi,
>
> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> The previous RCs were not voted, because:
> - RC0: the source archive didn't include required files to build
> gandiva-glib
> documents, also causing failed binary build for Debian Stretch [6].
> - RC1: compatibility issues with the just released pandas version 0.24.rc1
> [8]
>
> This release candidate is based on commit:
> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
>
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4].
> The changelog is located at [5].
>
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [7] for how to validate a release candidate.
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Release this as Apache Arrow 0.12.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
>
> Special thanks to @kou for helping with the uprising issues!
>
> - Krisztian
>
> [1]:
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> [2]:
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> [5]:
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> [7]:
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
>
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Krisztián Szűcs <sz...@gmail.com>.
On Sun, Jan 13, 2019 at 4:43 AM Kouhei Sutou <ko...@clear-code.com> wrote:
> +1 (binding) with a trivial fix.
>
> The following checksum files use absolute paths:
>
>
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/apache-arrow-0.12.0.tar.gz.sha256
>
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/apache-arrow-0.12.0.tar.gz.sha512
Updated.
>
> We need to update verify script for changes between 0.11.1
> and 0.12.0:
>
> https://github.com/apache/arrow/pull/3389
Merged.
Thanks Kou!
>
>
> I ran the followings on Debian GNU/Linux sid:
>
> * ARROW_HAVE_CUDA=no CC=gcc-7 CXX=g++-7
> dev/release/verify-release-candidate.sh binaries 0.12.0 2
> * ARROW_HAVE_CUDA=yes CC=gcc-7 CXX=g++-7
> dev/release/verify-release-candidate.sh binaries 0.12.0 2
>
> with:
>
> * gcc-7 (Debian 7.4.0-2) 7.4.0
> * openjdk version "1.8.0_191"
> * ruby 2.7.0dev (2019-01-05 trunk 66719) [x86_64-linux]
> * Node.js v10.15.0
>
>
> There is a problem in Plasma + Python + CUDA:
>
> https://issues.apache.org/jira/browse/ARROW-4246
>
> I don't think that this is a blocker.
>
> Other modules work well with ARROW_HAVE_GPU=yes.
>
>
> There is a problem with GCC 8:
>
> https://issues.apache.org/jira/browse/ARROW-4242
>
> I don't think that this is a blocker.
>
>
> Thanks,
> --
> kou
>
> In <CA...@mail.gmail.com>
> "[VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Sat, 12 Jan 2019
> 20:56:28 +0100,
> Krisztián Szűcs <sz...@gmail.com> wrote:
>
> > Hi,
> >
> > I'd like to propose the 1st release candidate (RC2) of Apache Arrow
> version
> > 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> > The previous RCs were not voted, because:
> > - RC0: the source archive didn't include required files to build
> > gandiva-glib
> > documents, also causing failed binary build for Debian Stretch [6].
> > - RC1: compatibility issues with the just released pandas version
> 0.24.rc1
> > [8]
> >
> > This release candidate is based on commit:
> > 0bbaef451ae9d59799e693df9b2383808516a326 [2]
> >
> > The source release rc2 is hosted at [3].
> > The binary artifacts are hosted at [4].
> > The changelog is located at [5].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [7] for how to validate a release candidate.
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow 0.12.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
> >
> > Special thanks to @kou for helping with the uprising issues!
> >
> > - Krisztian
> >
> > [1]:
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> > [2]:
> >
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> > <
> https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359
> >
> > [3]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> > [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> > [5]:
> >
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> > [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> > [7]:
> >
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
>
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Andrew Palumbo <ap...@outlook.com>.
SGTM. Happy to.
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Kouhei Sutou <ko...@clear-code.com>.
Hi,
> I was verifying RC2. Seems that commit was not included in RC2.
>
> ~/arrow$ git log | grep be663c14637b2bdfef935946b6e91b6317219332
> ~/arrow$
>
> So maybe this is the culprit?
Yes. The commit was pushed after RC2.
Thanks for verifying RC2. We'll release RC3. I hope that
you verify RC3 too.
--
kou
In <CY...@CY4PR06MB2773.namprd06.prod.outlook.com>
"Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Tue, 15 Jan 2019 17:42:57 +0000,
Andrew Palumbo <ap...@outlook.com> wrote:
> Wes,
> /tmp doesnt seem to be the issue. it seems this machine has ~295 G. (I'll try to eye-verify that there is not some massive memory leak a bit later, seems unlikely though).
>
> ~$ df -Th /tmp
> Filesystem Type Size Used Avail Use% Mounted on
> /dev/xvda1 ext4 291G 4.6G 287G 2% /
>
>
>
>
> Kouhei,
> I was verifying RC2. Seems that commit was not included in RC2.
>
> ~/arrow$ git log | grep be663c14637b2bdfef935946b6e91b6317219332
> ~/arrow$
>
>
> So maybe this is the culprit?
>
>
>
>
> I see that this commit is in master (from my local after a `git pull origin master`):
>
> $ git log | grep -A20 be663c14637b2bdfef935946b6e91b6317219332
> commit be663c14637b2bdfef935946b6e91b6317219332
> Author: Kouhei Sutou <ko...@clear-code.com>
> Date: Sun Jan 13 11:14:51 2019 +0100
>
> ARROW-4247: [Release] Update verify script for 0.12.0
>
> * C++: -DARROW_GPU -> -DARROW_CUDA
> * C++: Enable Gandiva
> * C++: default: -DARROW_BUILD_TESTS=ON -> OFF
> * Ruby: red-plasma, red-gandiva and red-parquet are added
> * Rust: The top-level Cargo.toml is a virtual manifest
>
> Author: Kouhei Sutou <ko...@clear-code.com>
>
> Closes #3389 from kou/release-update-verify-script and squashes the following commits:
>
> f019a3fc <Kouhei Sutou> Update verify script for 0.12.0
>
>
> Thanks Very Much,
>
> Andy
>
> ________________________________
> From: Wes McKinney <we...@gmail.com>
> Sent: Tuesday, January 15, 2019 12:47 AM
> To: dev@arrow.apache.org
> Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
>
> I'm working on getting ARROW-4258 merged right now. ARROW-4260 also
> should be fixed before another RC is cut
>
> https://issues.apache.org/jira/browse/ARROW-4260
>
> On Mon, Jan 14, 2019 at 11:36 PM Kouhei Sutou <ko...@clear-code.com> wrote:
>>
>> Hi,
>>
>> Does your verify-release-candidate.sh include
>> https://github.com/apache/arrow/commit/be663c14637b2bdfef935946b6e91b6317219332
>> ?
>>
>> arrow-json-integration-test needs -DARROW_BUILD_TESTS=ON.
>>
>>
>> Thanks,
>> --
>> kou
>>
>> In <CY...@CY4PR06MB2773.namprd06.prod.outlook.com>
>> "Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Tue, 15 Jan 2019 02:30:13 +0000,
>> Andrew Palumbo <ap...@outlook.com> wrote:
>>
>> > After following all setup and install steps from: https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> >
>> >
>> > apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ verify-release-candidate.sh source 0.12.0 2
>> >
>> >
>> >
>> > fails with this stack trace:
>> >
>> >
>> >
>> >
>> > #########################################################
>> > C++ producing, C++ consuming
>> > ##########################################################
>> > ==========================================================
>> > Testing file /tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
>> > ==========================================================
>> > -- Creating binary inputs
>> > Traceback (most recent call last):
>> > File "integration_test.py", line 1216, in <module>
>> > run_all_tests(debug=args.debug, tempdir=args.tempdir)
>> > File "integration_test.py", line 1179, in run_all_tests
>> > runner.run()
>> > File "integration_test.py", line 937, in run
>> > self._compare_implementations(producer, consumer)
>> > File "integration_test.py", line 959, in _compare_implementations
>> > producer.json_to_file(json_path, producer_file_path)
>> > File "integration_test.py", line 1086, in json_to_file
>> > return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
>> > File "integration_test.py", line 1080, in _run
>> > run_cmd(cmd)
>> > File "integration_test.py", line 87, in run_cmd
>> > output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
>> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 336, in chec
>> > k_output
>> > **kwargs).stdout
>> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 403, in run
>> > with Popen(*popenargs, **kwargs) as process:
>> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 709, in __in
>> > it__
>> > restore_signals, start_new_session)
>> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 1344, in _ex
>> > ecute_child
>> > raise child_exception_type(errno_num, err_msg, err_filename)
>> > FileNotFoundError: [Errno 2] No such file or directory: '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-
>> > integration-test': '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-integration-test'
>> > + cleanup
>> > + rm -fr /tmp/arrow-0.12.0.5xTVS
>> >
>> >
>> >
>> >
>> > Jira or is this something obvious that i missed?
>> >
>> > Thank you.
>> >
>> > --Andy
>> >
>> > ________________________________
>> > From: Andrew Palumbo <an...@msn.com>
>> > Sent: Monday, January 14, 2019 9:23 PM
>> > To: dev@arrow.apache.org
>> > Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
>> >
>> > Hello, I've just run the verify scipt on the 0.12.0 tag after configuring an Ubuntu machine per the instructions. I'm crashing at "c++ producing, c++ consuming". With a no such file or directory... Arrow-json-integration-test.
>> >
>> > When I was trying to build straight from that submodule there was a
>> >
>> > git submodule update --init command that I had to run.
>> >
>> > Just taking a wild guess that it could be the cause.
>> >
>> > I have to let this message go through to show the stack trace, because I hadn't confirmed my dev@a.a.o acct.
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Andrew Palumbo <ap...@outlook.com>.
Apologies for spamming this [VOTE] Thread with my build results. After pulling the newest master, upgrading to LLVM 6.0 and clang 6.0 I am able to get a complete build with all tests passing:
~/arrow/dev/release$ ./verify-release-candidate.sh source 0.12.0 2
{snip}
Doc-tests parquet
test result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out
+ popd
/tmp/arrow-0.12.0.WgsaB/apache-arrow-0.12.0
+ echo 'Release candidate looks good!'
Release candidate looks good!
+ exit 0
+ cleanup
+ rm -fr /tmp/arrow-0.12.0.WgsaB
Thanks,
Andy
________________________________
From: Andrew Palumbo <ap...@outlook.com>
Sent: Tuesday, January 15, 2019 12:42 PM
To: dev@arrow.apache.org
Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Wes,
/tmp doesnt seem to be the issue. it seems this machine has ~295 G. (I'll try to eye-verify that there is not some massive memory leak a bit later, seems unlikely though).
~$ df -Th /tmp
Filesystem Type Size Used Avail Use% Mounted on
/dev/xvda1 ext4 291G 4.6G 287G 2% /
Kouhei,
I was verifying RC2. Seems that commit was not included in RC2.
~/arrow$ git log | grep be663c14637b2bdfef935946b6e91b6317219332
~/arrow$
So maybe this is the culprit?
I see that this commit is in master (from my local after a `git pull origin master`):
$ git log | grep -A20 be663c14637b2bdfef935946b6e91b6317219332
commit be663c14637b2bdfef935946b6e91b6317219332
Author: Kouhei Sutou <ko...@clear-code.com>
Date: Sun Jan 13 11:14:51 2019 +0100
ARROW-4247: [Release] Update verify script for 0.12.0
* C++: -DARROW_GPU -> -DARROW_CUDA
* C++: Enable Gandiva
* C++: default: -DARROW_BUILD_TESTS=ON -> OFF
* Ruby: red-plasma, red-gandiva and red-parquet are added
* Rust: The top-level Cargo.toml is a virtual manifest
Author: Kouhei Sutou <ko...@clear-code.com>
Closes #3389 from kou/release-update-verify-script and squashes the following commits:
f019a3fc <Kouhei Sutou> Update verify script for 0.12.0
Thanks Very Much,
Andy
________________________________
From: Wes McKinney <we...@gmail.com>
Sent: Tuesday, January 15, 2019 12:47 AM
To: dev@arrow.apache.org
Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
I'm working on getting ARROW-4258 merged right now. ARROW-4260 also
should be fixed before another RC is cut
https://issues.apache.org/jira/browse/ARROW-4260
On Mon, Jan 14, 2019 at 11:36 PM Kouhei Sutou <ko...@clear-code.com> wrote:
>
> Hi,
>
> Does your verify-release-candidate.sh include
> https://github.com/apache/arrow/commit/be663c14637b2bdfef935946b6e91b6317219332
> ?
>
> arrow-json-integration-test needs -DARROW_BUILD_TESTS=ON.
>
>
> Thanks,
> --
> kou
>
> In <CY...@CY4PR06MB2773.namprd06.prod.outlook.com>
> "Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Tue, 15 Jan 2019 02:30:13 +0000,
> Andrew Palumbo <ap...@outlook.com> wrote:
>
> > After following all setup and install steps from: https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >
> >
> > apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ verify-release-candidate.sh source 0.12.0 2
> >
> >
> >
> > fails with this stack trace:
> >
> >
> >
> >
> > #########################################################
> > C++ producing, C++ consuming
> > ##########################################################
> > ==========================================================
> > Testing file /tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
> > ==========================================================
> > -- Creating binary inputs
> > Traceback (most recent call last):
> > File "integration_test.py", line 1216, in <module>
> > run_all_tests(debug=args.debug, tempdir=args.tempdir)
> > File "integration_test.py", line 1179, in run_all_tests
> > runner.run()
> > File "integration_test.py", line 937, in run
> > self._compare_implementations(producer, consumer)
> > File "integration_test.py", line 959, in _compare_implementations
> > producer.json_to_file(json_path, producer_file_path)
> > File "integration_test.py", line 1086, in json_to_file
> > return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
> > File "integration_test.py", line 1080, in _run
> > run_cmd(cmd)
> > File "integration_test.py", line 87, in run_cmd
> > output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 336, in chec
> > k_output
> > **kwargs).stdout
> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 403, in run
> > with Popen(*popenargs, **kwargs) as process:
> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 709, in __in
> > it__
> > restore_signals, start_new_session)
> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 1344, in _ex
> > ecute_child
> > raise child_exception_type(errno_num, err_msg, err_filename)
> > FileNotFoundError: [Errno 2] No such file or directory: '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-
> > integration-test': '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-integration-test'
> > + cleanup
> > + rm -fr /tmp/arrow-0.12.0.5xTVS
> >
> >
> >
> >
> > Jira or is this something obvious that i missed?
> >
> > Thank you.
> >
> > --Andy
> >
> > ________________________________
> > From: Andrew Palumbo <an...@msn.com>
> > Sent: Monday, January 14, 2019 9:23 PM
> > To: dev@arrow.apache.org
> > Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
> >
> > Hello, I've just run the verify scipt on the 0.12.0 tag after configuring an Ubuntu machine per the instructions. I'm crashing at "c++ producing, c++ consuming". With a no such file or directory... Arrow-json-integration-test.
> >
> > When I was trying to build straight from that submodule there was a
> >
> > git submodule update --init command that I had to run.
> >
> > Just taking a wild guess that it could be the cause.
> >
> > I have to let this message go through to show the stack trace, because I hadn't confirmed my dev@a.a.o acct.
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Andrew Palumbo <ap...@outlook.com>.
Wes,
/tmp doesnt seem to be the issue. it seems this machine has ~295 G. (I'll try to eye-verify that there is not some massive memory leak a bit later, seems unlikely though).
~$ df -Th /tmp
Filesystem Type Size Used Avail Use% Mounted on
/dev/xvda1 ext4 291G 4.6G 287G 2% /
Kouhei,
I was verifying RC2. Seems that commit was not included in RC2.
~/arrow$ git log | grep be663c14637b2bdfef935946b6e91b6317219332
~/arrow$
So maybe this is the culprit?
I see that this commit is in master (from my local after a `git pull origin master`):
$ git log | grep -A20 be663c14637b2bdfef935946b6e91b6317219332
commit be663c14637b2bdfef935946b6e91b6317219332
Author: Kouhei Sutou <ko...@clear-code.com>
Date: Sun Jan 13 11:14:51 2019 +0100
ARROW-4247: [Release] Update verify script for 0.12.0
* C++: -DARROW_GPU -> -DARROW_CUDA
* C++: Enable Gandiva
* C++: default: -DARROW_BUILD_TESTS=ON -> OFF
* Ruby: red-plasma, red-gandiva and red-parquet are added
* Rust: The top-level Cargo.toml is a virtual manifest
Author: Kouhei Sutou <ko...@clear-code.com>
Closes #3389 from kou/release-update-verify-script and squashes the following commits:
f019a3fc <Kouhei Sutou> Update verify script for 0.12.0
Thanks Very Much,
Andy
________________________________
From: Wes McKinney <we...@gmail.com>
Sent: Tuesday, January 15, 2019 12:47 AM
To: dev@arrow.apache.org
Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
I'm working on getting ARROW-4258 merged right now. ARROW-4260 also
should be fixed before another RC is cut
https://issues.apache.org/jira/browse/ARROW-4260
On Mon, Jan 14, 2019 at 11:36 PM Kouhei Sutou <ko...@clear-code.com> wrote:
>
> Hi,
>
> Does your verify-release-candidate.sh include
> https://github.com/apache/arrow/commit/be663c14637b2bdfef935946b6e91b6317219332
> ?
>
> arrow-json-integration-test needs -DARROW_BUILD_TESTS=ON.
>
>
> Thanks,
> --
> kou
>
> In <CY...@CY4PR06MB2773.namprd06.prod.outlook.com>
> "Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Tue, 15 Jan 2019 02:30:13 +0000,
> Andrew Palumbo <ap...@outlook.com> wrote:
>
> > After following all setup and install steps from: https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >
> >
> > apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ verify-release-candidate.sh source 0.12.0 2
> >
> >
> >
> > fails with this stack trace:
> >
> >
> >
> >
> > #########################################################
> > C++ producing, C++ consuming
> > ##########################################################
> > ==========================================================
> > Testing file /tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
> > ==========================================================
> > -- Creating binary inputs
> > Traceback (most recent call last):
> > File "integration_test.py", line 1216, in <module>
> > run_all_tests(debug=args.debug, tempdir=args.tempdir)
> > File "integration_test.py", line 1179, in run_all_tests
> > runner.run()
> > File "integration_test.py", line 937, in run
> > self._compare_implementations(producer, consumer)
> > File "integration_test.py", line 959, in _compare_implementations
> > producer.json_to_file(json_path, producer_file_path)
> > File "integration_test.py", line 1086, in json_to_file
> > return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
> > File "integration_test.py", line 1080, in _run
> > run_cmd(cmd)
> > File "integration_test.py", line 87, in run_cmd
> > output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 336, in chec
> > k_output
> > **kwargs).stdout
> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 403, in run
> > with Popen(*popenargs, **kwargs) as process:
> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 709, in __in
> > it__
> > restore_signals, start_new_session)
> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 1344, in _ex
> > ecute_child
> > raise child_exception_type(errno_num, err_msg, err_filename)
> > FileNotFoundError: [Errno 2] No such file or directory: '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-
> > integration-test': '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-integration-test'
> > + cleanup
> > + rm -fr /tmp/arrow-0.12.0.5xTVS
> >
> >
> >
> >
> > Jira or is this something obvious that i missed?
> >
> > Thank you.
> >
> > --Andy
> >
> > ________________________________
> > From: Andrew Palumbo <an...@msn.com>
> > Sent: Monday, January 14, 2019 9:23 PM
> > To: dev@arrow.apache.org
> > Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
> >
> > Hello, I've just run the verify scipt on the 0.12.0 tag after configuring an Ubuntu machine per the instructions. I'm crashing at "c++ producing, c++ consuming". With a no such file or directory... Arrow-json-integration-test.
> >
> > When I was trying to build straight from that submodule there was a
> >
> > git submodule update --init command that I had to run.
> >
> > Just taking a wild guess that it could be the cause.
> >
> > I have to let this message go through to show the stack trace, because I hadn't confirmed my dev@a.a.o acct.
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Wes McKinney <we...@gmail.com>.
I'm working on getting ARROW-4258 merged right now. ARROW-4260 also
should be fixed before another RC is cut
https://issues.apache.org/jira/browse/ARROW-4260
On Mon, Jan 14, 2019 at 11:36 PM Kouhei Sutou <ko...@clear-code.com> wrote:
>
> Hi,
>
> Does your verify-release-candidate.sh include
> https://github.com/apache/arrow/commit/be663c14637b2bdfef935946b6e91b6317219332
> ?
>
> arrow-json-integration-test needs -DARROW_BUILD_TESTS=ON.
>
>
> Thanks,
> --
> kou
>
> In <CY...@CY4PR06MB2773.namprd06.prod.outlook.com>
> "Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Tue, 15 Jan 2019 02:30:13 +0000,
> Andrew Palumbo <ap...@outlook.com> wrote:
>
> > After following all setup and install steps from: https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >
> >
> > apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ verify-release-candidate.sh source 0.12.0 2
> >
> >
> >
> > fails with this stack trace:
> >
> >
> >
> >
> > #########################################################
> > C++ producing, C++ consuming
> > ##########################################################
> > ==========================================================
> > Testing file /tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
> > ==========================================================
> > -- Creating binary inputs
> > Traceback (most recent call last):
> > File "integration_test.py", line 1216, in <module>
> > run_all_tests(debug=args.debug, tempdir=args.tempdir)
> > File "integration_test.py", line 1179, in run_all_tests
> > runner.run()
> > File "integration_test.py", line 937, in run
> > self._compare_implementations(producer, consumer)
> > File "integration_test.py", line 959, in _compare_implementations
> > producer.json_to_file(json_path, producer_file_path)
> > File "integration_test.py", line 1086, in json_to_file
> > return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
> > File "integration_test.py", line 1080, in _run
> > run_cmd(cmd)
> > File "integration_test.py", line 87, in run_cmd
> > output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 336, in chec
> > k_output
> > **kwargs).stdout
> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 403, in run
> > with Popen(*popenargs, **kwargs) as process:
> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 709, in __in
> > it__
> > restore_signals, start_new_session)
> > File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 1344, in _ex
> > ecute_child
> > raise child_exception_type(errno_num, err_msg, err_filename)
> > FileNotFoundError: [Errno 2] No such file or directory: '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-
> > integration-test': '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-integration-test'
> > + cleanup
> > + rm -fr /tmp/arrow-0.12.0.5xTVS
> >
> >
> >
> >
> > Jira or is this something obvious that i missed?
> >
> > Thank you.
> >
> > --Andy
> >
> > ________________________________
> > From: Andrew Palumbo <an...@msn.com>
> > Sent: Monday, January 14, 2019 9:23 PM
> > To: dev@arrow.apache.org
> > Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
> >
> > Hello, I've just run the verify scipt on the 0.12.0 tag after configuring an Ubuntu machine per the instructions. I'm crashing at "c++ producing, c++ consuming". With a no such file or directory... Arrow-json-integration-test.
> >
> > When I was trying to build straight from that submodule there was a
> >
> > git submodule update --init command that I had to run.
> >
> > Just taking a wild guess that it could be the cause.
> >
> > I have to let this message go through to show the stack trace, because I hadn't confirmed my dev@a.a.o acct.
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Kouhei Sutou <ko...@clear-code.com>.
Hi,
Does your verify-release-candidate.sh include
https://github.com/apache/arrow/commit/be663c14637b2bdfef935946b6e91b6317219332
?
arrow-json-integration-test needs -DARROW_BUILD_TESTS=ON.
Thanks,
--
kou
In <CY...@CY4PR06MB2773.namprd06.prod.outlook.com>
"Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Tue, 15 Jan 2019 02:30:13 +0000,
Andrew Palumbo <ap...@outlook.com> wrote:
> After following all setup and install steps from: https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>
>
> apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ verify-release-candidate.sh source 0.12.0 2
>
>
>
> fails with this stack trace:
>
>
>
>
> #########################################################
> C++ producing, C++ consuming
> ##########################################################
> ==========================================================
> Testing file /tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
> ==========================================================
> -- Creating binary inputs
> Traceback (most recent call last):
> File "integration_test.py", line 1216, in <module>
> run_all_tests(debug=args.debug, tempdir=args.tempdir)
> File "integration_test.py", line 1179, in run_all_tests
> runner.run()
> File "integration_test.py", line 937, in run
> self._compare_implementations(producer, consumer)
> File "integration_test.py", line 959, in _compare_implementations
> producer.json_to_file(json_path, producer_file_path)
> File "integration_test.py", line 1086, in json_to_file
> return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
> File "integration_test.py", line 1080, in _run
> run_cmd(cmd)
> File "integration_test.py", line 87, in run_cmd
> output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
> File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 336, in chec
> k_output
> **kwargs).stdout
> File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 403, in run
> with Popen(*popenargs, **kwargs) as process:
> File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 709, in __in
> it__
> restore_signals, start_new_session)
> File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 1344, in _ex
> ecute_child
> raise child_exception_type(errno_num, err_msg, err_filename)
> FileNotFoundError: [Errno 2] No such file or directory: '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-
> integration-test': '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-integration-test'
> + cleanup
> + rm -fr /tmp/arrow-0.12.0.5xTVS
>
>
>
>
> Jira or is this something obvious that i missed?
>
> Thank you.
>
> --Andy
>
> ________________________________
> From: Andrew Palumbo <an...@msn.com>
> Sent: Monday, January 14, 2019 9:23 PM
> To: dev@arrow.apache.org
> Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
>
> Hello, I've just run the verify scipt on the 0.12.0 tag after configuring an Ubuntu machine per the instructions. I'm crashing at "c++ producing, c++ consuming". With a no such file or directory... Arrow-json-integration-test.
>
> When I was trying to build straight from that submodule there was a
>
> git submodule update --init command that I had to run.
>
> Just taking a wild guess that it could be the cause.
>
> I have to let this message go through to show the stack trace, because I hadn't confirmed my dev@a.a.o acct.
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Wes McKinney <we...@gmail.com>.
hi Andy,
We'd need to see a more complete log of the verification script run to
see what's going on.
If I had to venture a guess if you are working on EC2 you might be
running out of /tmp space. The build produces well over a gigabyte of
artifacts. If this is the case, we might add an environment variable
option to configure where to run the build (something instead of /tmp)
- Wes
On Mon, Jan 14, 2019 at 8:30 PM Andrew Palumbo <ap...@outlook.com> wrote:
>
> After following all setup and install steps from: https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>
>
> apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ verify-release-candidate.sh source 0.12.0 2
>
>
>
> fails with this stack trace:
>
>
>
>
> #########################################################
> C++ producing, C++ consuming
> ##########################################################
> ==========================================================
> Testing file /tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
> ==========================================================
> -- Creating binary inputs
> Traceback (most recent call last):
> File "integration_test.py", line 1216, in <module>
> run_all_tests(debug=args.debug, tempdir=args.tempdir)
> File "integration_test.py", line 1179, in run_all_tests
> runner.run()
> File "integration_test.py", line 937, in run
> self._compare_implementations(producer, consumer)
> File "integration_test.py", line 959, in _compare_implementations
> producer.json_to_file(json_path, producer_file_path)
> File "integration_test.py", line 1086, in json_to_file
> return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
> File "integration_test.py", line 1080, in _run
> run_cmd(cmd)
> File "integration_test.py", line 87, in run_cmd
> output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
> File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 336, in chec
> k_output
> **kwargs).stdout
> File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 403, in run
> with Popen(*popenargs, **kwargs) as process:
> File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 709, in __in
> it__
> restore_signals, start_new_session)
> File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 1344, in _ex
> ecute_child
> raise child_exception_type(errno_num, err_msg, err_filename)
> FileNotFoundError: [Errno 2] No such file or directory: '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-
> integration-test': '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-integration-test'
> + cleanup
> + rm -fr /tmp/arrow-0.12.0.5xTVS
>
>
>
>
> Jira or is this something obvious that i missed?
>
> Thank you.
>
> --Andy
>
> ________________________________
> From: Andrew Palumbo <an...@msn.com>
> Sent: Monday, January 14, 2019 9:23 PM
> To: dev@arrow.apache.org
> Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
>
> Hello, I've just run the verify scipt on the 0.12.0 tag after configuring an Ubuntu machine per the instructions. I'm crashing at "c++ producing, c++ consuming". With a no such file or directory... Arrow-json-integration-test.
>
> When I was trying to build straight from that submodule there was a
>
> git submodule update --init command that I had to run.
>
> Just taking a wild guess that it could be the cause.
>
> I have to let this message go through to show the stack trace, because I hadn't confirmed my dev@a.a.o acct.
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Andrew Palumbo <ap...@outlook.com>.
After following all setup and install steps from: https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
apalumbo@ip-xxx-xxx-xxx-xxx:~/arrow/dev/release$ verify-release-candidate.sh source 0.12.0 2
fails with this stack trace:
#########################################################
C++ producing, C++ consuming
##########################################################
==========================================================
Testing file /tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/integration/data/simple.json
==========================================================
-- Creating binary inputs
Traceback (most recent call last):
File "integration_test.py", line 1216, in <module>
run_all_tests(debug=args.debug, tempdir=args.tempdir)
File "integration_test.py", line 1179, in run_all_tests
runner.run()
File "integration_test.py", line 937, in run
self._compare_implementations(producer, consumer)
File "integration_test.py", line 959, in _compare_implementations
producer.json_to_file(json_path, producer_file_path)
File "integration_test.py", line 1086, in json_to_file
return self._run(arrow_path, json_path, 'JSON_TO_ARROW')
File "integration_test.py", line 1080, in _run
run_cmd(cmd)
File "integration_test.py", line 87, in run_cmd
output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 336, in chec
k_output
**kwargs).stdout
File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 403, in run
with Popen(*popenargs, **kwargs) as process:
File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 709, in __in
it__
restore_signals, start_new_session)
File "/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/test-miniconda/envs/arrow-test/lib/python3.6/subprocess.py", line 1344, in _ex
ecute_child
raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-
integration-test': '/tmp/arrow-0.12.0.5xTVS/apache-arrow-0.12.0/cpp/build/release/arrow-json-integration-test'
+ cleanup
+ rm -fr /tmp/arrow-0.12.0.5xTVS
Jira or is this something obvious that i missed?
Thank you.
--Andy
________________________________
From: Andrew Palumbo <an...@msn.com>
Sent: Monday, January 14, 2019 9:23 PM
To: dev@arrow.apache.org
Subject: Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Hello, I've just run the verify scipt on the 0.12.0 tag after configuring an Ubuntu machine per the instructions. I'm crashing at "c++ producing, c++ consuming". With a no such file or directory... Arrow-json-integration-test.
When I was trying to build straight from that submodule there was a
git submodule update --init command that I had to run.
Just taking a wild guess that it could be the cause.
I have to let this message go through to show the stack trace, because I hadn't confirmed my dev@a.a.o acct.
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Andrew Palumbo <an...@msn.com>.
Hello, I've just run the verify scipt on the 0.12.0 tag after configuring an Ubuntu machine per the instructions. I'm crashing at "c++ producing, c++ consuming". With a no such file or directory... Arrow-json-integration-test.
When I was trying to build straight from that submodule there was a
git submodule update --init command that I had to run.
Just taking a wild guess that it could be the cause.
I have to let this message go through to show the stack trace, because I hadn't confirmed my dev@a.a.o acct.
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Kouhei Sutou <ko...@clear-code.com>.
Hi,
> There is a problem in Plasma + Python + CUDA:
>
> https://issues.apache.org/jira/browse/ARROW-4246
I've created a pull request for this:
https://github.com/apache/arrow/pull/3398
Thanks,
--
kou
In <20...@clear-code.com>
"Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Sun, 13 Jan 2019 12:43:29 +0900 (JST),
Kouhei Sutou <ko...@clear-code.com> wrote:
> +1 (binding) with a trivial fix.
>
> The following checksum files use absolute paths:
>
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/apache-arrow-0.12.0.tar.gz.sha256
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/apache-arrow-0.12.0.tar.gz.sha512
>
> I think that we need to replace the files with basename only
> path.
>
> I verified checksums with the following change:
>
> ----
> diff --git a/dev/release/verify-release-candidate.sh b/dev/release/verify-release-candidate.sh
> index c8b9c54c..d992c43c 100755
> --- a/dev/release/verify-release-candidate.sh
> +++ b/dev/release/verify-release-candidate.sh
> @@ -83,8 +83,8 @@ fetch_archive() {
> download_rc_file ${dist_name}.tar.gz.sha256
> download_rc_file ${dist_name}.tar.gz.sha512
> gpg --verify ${dist_name}.tar.gz.asc ${dist_name}.tar.gz
> - shasum -a 256 -c ${dist_name}.tar.gz.sha256
> - shasum -a 512 -c ${dist_name}.tar.gz.sha512
> + sed -E -e 's,/+.+/,,g' ${dist_name}.tar.gz.sha256 | shasum -a 256 -c
> + sed -E -e 's,/+.+/,,g' ${dist_name}.tar.gz.sha512 | shasum -a 512 -c
> }
>
> verify_binary_artifacts() {
> ----
>
> We need to update verify script for changes between 0.11.1
> and 0.12.0:
>
> https://github.com/apache/arrow/pull/3389
>
> I ran the followings on Debian GNU/Linux sid:
>
> * ARROW_HAVE_CUDA=no CC=gcc-7 CXX=g++-7 dev/release/verify-release-candidate.sh binaries 0.12.0 2
> * ARROW_HAVE_CUDA=yes CC=gcc-7 CXX=g++-7 dev/release/verify-release-candidate.sh binaries 0.12.0 2
>
> with:
>
> * gcc-7 (Debian 7.4.0-2) 7.4.0
> * openjdk version "1.8.0_191"
> * ruby 2.7.0dev (2019-01-05 trunk 66719) [x86_64-linux]
> * Node.js v10.15.0
>
>
> There is a problem in Plasma + Python + CUDA:
>
> https://issues.apache.org/jira/browse/ARROW-4246
>
> I don't think that this is a blocker.
>
> Other modules work well with ARROW_HAVE_GPU=yes.
>
>
> There is a problem with GCC 8:
>
> https://issues.apache.org/jira/browse/ARROW-4242
>
> I don't think that this is a blocker.
>
>
> Thanks,
> --
> kou
>
> In <CA...@mail.gmail.com>
> "[VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Sat, 12 Jan 2019 20:56:28 +0100,
> Krisztián Szűcs <sz...@gmail.com> wrote:
>
>> Hi,
>>
>> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
>> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
>> The previous RCs were not voted, because:
>> - RC0: the source archive didn't include required files to build
>> gandiva-glib
>> documents, also causing failed binary build for Debian Stretch [6].
>> - RC1: compatibility issues with the just released pandas version 0.24.rc1
>> [8]
>>
>> This release candidate is based on commit:
>> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
>>
>> The source release rc2 is hosted at [3].
>> The binary artifacts are hosted at [4].
>> The changelog is located at [5].
>>
>> Please download, verify checksums and signatures, run the unit tests,
>> and vote on the release. See [7] for how to validate a release candidate.
>>
>> The vote will be open for at least 72 hours.
>>
>> [ ] +1 Release this as Apache Arrow 0.12.0
>> [ ] +0
>> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
>>
>> Special thanks to @kou for helping with the uprising issues!
>>
>> - Krisztian
>>
>> [1]:
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
>> [2]:
>> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
>> <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
>> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
>> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
>> [5]:
>> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
>> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
>> [7]:
>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640
Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW
Posted by Kouhei Sutou <ko...@clear-code.com>.
+1 (binding) with a trivial fix.
The following checksum files use absolute paths:
https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/apache-arrow-0.12.0.tar.gz.sha256
https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/apache-arrow-0.12.0.tar.gz.sha512
I think that we need to replace the files with basename only
path.
I verified checksums with the following change:
----
diff --git a/dev/release/verify-release-candidate.sh b/dev/release/verify-release-candidate.sh
index c8b9c54c..d992c43c 100755
--- a/dev/release/verify-release-candidate.sh
+++ b/dev/release/verify-release-candidate.sh
@@ -83,8 +83,8 @@ fetch_archive() {
download_rc_file ${dist_name}.tar.gz.sha256
download_rc_file ${dist_name}.tar.gz.sha512
gpg --verify ${dist_name}.tar.gz.asc ${dist_name}.tar.gz
- shasum -a 256 -c ${dist_name}.tar.gz.sha256
- shasum -a 512 -c ${dist_name}.tar.gz.sha512
+ sed -E -e 's,/+.+/,,g' ${dist_name}.tar.gz.sha256 | shasum -a 256 -c
+ sed -E -e 's,/+.+/,,g' ${dist_name}.tar.gz.sha512 | shasum -a 512 -c
}
verify_binary_artifacts() {
----
We need to update verify script for changes between 0.11.1
and 0.12.0:
https://github.com/apache/arrow/pull/3389
I ran the followings on Debian GNU/Linux sid:
* ARROW_HAVE_CUDA=no CC=gcc-7 CXX=g++-7 dev/release/verify-release-candidate.sh binaries 0.12.0 2
* ARROW_HAVE_CUDA=yes CC=gcc-7 CXX=g++-7 dev/release/verify-release-candidate.sh binaries 0.12.0 2
with:
* gcc-7 (Debian 7.4.0-2) 7.4.0
* openjdk version "1.8.0_191"
* ruby 2.7.0dev (2019-01-05 trunk 66719) [x86_64-linux]
* Node.js v10.15.0
There is a problem in Plasma + Python + CUDA:
https://issues.apache.org/jira/browse/ARROW-4246
I don't think that this is a blocker.
Other modules work well with ARROW_HAVE_GPU=yes.
There is a problem with GCC 8:
https://issues.apache.org/jira/browse/ARROW-4242
I don't think that this is a blocker.
Thanks,
--
kou
In <CA...@mail.gmail.com>
"[VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW" on Sat, 12 Jan 2019 20:56:28 +0100,
Krisztián Szűcs <sz...@gmail.com> wrote:
> Hi,
>
> I'd like to propose the 1st release candidate (RC2) of Apache Arrow version
> 0.12.0. This is a major release consisting of 600 resolved JIRAs [1].
> The previous RCs were not voted, because:
> - RC0: the source archive didn't include required files to build
> gandiva-glib
> documents, also causing failed binary build for Debian Stretch [6].
> - RC1: compatibility issues with the just released pandas version 0.24.rc1
> [8]
>
> This release candidate is based on commit:
> 0bbaef451ae9d59799e693df9b2383808516a326 [2]
>
> The source release rc2 is hosted at [3].
> The binary artifacts are hosted at [4].
> The changelog is located at [5].
>
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. See [7] for how to validate a release candidate.
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Release this as Apache Arrow 0.12.0
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow 0.12.0 because...
>
> Special thanks to @kou for helping with the uprising issues!
>
> - Krisztian
>
> [1]:
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.12.0
> [2]:
> https://github.com/apache/arrow/commit/0bbaef451ae9d59799e693df9b2383808516a326
> <https://github.com/apache/arrow/tree/5ac58233936fcd2213c23adce72a79911c3f1359>
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.12.0-rc2/
> [4]: https://bintray.com/beta/#/apache/arrow?tab=packages
> [5]:
> https://github.com/apache/arrow/blob/0bbaef451ae9d59799e693df9b2383808516a326/CHANGELOG.md
> [6]: https://travis-ci.org/kszucs/crossbow/builds/478393330
> [7]:
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> [8]: https://travis-ci.org/kszucs/crossbow/builds/478558640