You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Micah Kornfield <em...@gmail.com> on 2019/09/27 08:18:05 UTC

Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Hi,


I would like to propose the following release candidate (RC1) of Apache

Arrow version 0.15.0. This is a release consisting of 672

resolved JIRA issues[1]. (RC0 was aborted due to release script issues).


This release candidate is based on commit:

77f091888dbe5a4e023a66b986a2dd474696061a [2]


The source release rc1 is hosted at [3].

The binary artifacts are hosted at [4][5][6][7].

The changelog is located at [8].


Please download, verify checksums and signatures, run the unit tests,

and vote on the release. See [9] for how to validate a release candidate.


The vote will be open for at least 72 hours.


[ ] +1 Release this as Apache Arrow 0.15.0

[ ] +0

[ ] -1 Do not release this as Apache Arrow 0.15.0 because...


[1]:
https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0

[2]:
https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a

[3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1

[4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1

[5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1

[6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1

[7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1

[8]:
https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md

[9]:
https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Sutou Kouhei <ko...@clear-code.com>.
Thanks.

We can ignore the warning. If your key is signed by another
trusted key, the warning will be suppressed.
(You can trust your key ultimately by "gpg --edit-key
E47C810A90FE21FF448DA938755E743692EA1D85 trust".)

In <CA...@mail.gmail.com>
  "Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Sat, 28 Sep 2019 21:45:25 -0600,
  Micah Kornfield <em...@gmail.com> wrote:

>>
>> Could you show the real warning message as-is?
> 
> 
> gpg: Good signature from "Micah Kornfield (Apache Arrow Code Signing Key) <
> emkornfield@gmail.com>" [unknown]
> gpg: WARNING: This key is not certified with a trusted signature!
> 
> gpg:          There is no indication that the signature belongs to the
> owner.
> Primary key fingerprint: E47C 810A 90FE 21FF 448D  A938 755E 7436 92EA
> 1D85
> 
> On Sat, Sep 28, 2019 at 6:28 PM Sutou Kouhei <ko...@clear-code.com> wrote:
> 
>> Hi,
>>
>> > Yes I re-ran the command.
>>
>> I got it.
>>
>> It seems that
>>
>> https://bintray.com/apache/arrow/download_file?file_path=centos-rc%2F6%2FSource%2Frepodata%2Frepomd.xml.asc
>> is broken.
>>
>> % LANG=C gpg --verify ./centos-rc/6/Source/repodata/repomd.xml.asc
>> ./centos-rc/6/Source/repodata/repomd.xml
>> gpg: Signature made Fri Sep 27 17:12:05 2019 JST
>> gpg:                using RSA key E47C810A90FE21FF448DA938755E743692EA1D85
>> gpg: BAD signature from "Micah Kornfield (Apache Arrow Code Signing Key) <
>> emkornfield@gmail.com>" [unknown]
>>
>> Umm... It's strange...
>>
>>
>> I noticed that I forgot to add support for arm64 APT
>> repository and aarch64 Yum repository. We should not have
>> /dists/buster-arm64, /7-aarch64 and so on. We've added
>> support for arm64 deb and aarch64 RPM packages but users
>> can't install them by apt/yum.
>>
>> Note that this is not a blocker of 0.15.0.
>>
>>
>> > There is still the question about the warnings, displayed about my
>> identity.
>>
>> Could you show the real warning message as-is?
>>
>>
>> Thanks,
>> --
>> kou
>>
>> In <CA...@mail.gmail.com>
>>   "Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Sat, 28 Sep
>> 2019 17:05:01 -0700,
>>   Micah Kornfield <em...@gmail.com> wrote:
>>
>> > Yes I re-ran the command.  The re-upload fixed issues I had with APT but
>> I
>> > hit an issue on YUM, I can try to rerun to see if I am still seeing the
>> > issue.
>> >
>> > There is still the question about the warnings, displayed about my
>> identity.
>> >
>> > On Sat, Sep 28, 2019 at 3:37 PM Sutou Kouhei <ko...@clear-code.com> wrote:
>> >
>> >> Hi,
>> >>
>> >> I'm verifying the RC. There is no problem for APT and Yum
>> >> repositories. Did you already re-upload the following files?
>> >>
>> >>   *
>> >>
>> https://bintray.com/apache/arrow/download_file?file_path=debian-rc%2Fapache-arrow-keyring.gpg
>> >>   *
>> >>
>> https://bintray.com/apache/arrow/download_file?file_path=ubuntu-rc%2Fapache-arrow-keyring.gpg
>> >>   *
>> >>
>> https://bintray.com/apache/arrow/download_file?file_path=centos-rc%2FRPM-GPG-KEY-apache-arrow
>> >>
>> >> FYI: We can re-upload only them by the following command line:
>> >>
>> >>   UPLOAD_DEFAULT=0 \
>> >>     UPLOAD_DEBIAN_APT=1 \
>> >>     UPLOAD_UBUNTU_APT=1 \
>> >>     UPLOAD_CENTOS_YUM=1 \
>> >>       dev/release/03-binary.sh 0.15.0 1 ...
>> >>
>> >>
>> >> Thanks,
>> >> --
>> >> kou
>> >>
>> >> In <CA...@mail.gmail.com>
>> >>   "Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep
>> >> 2019 18:45:47 -0600,
>> >>   Micah Kornfield <em...@gmail.com> wrote:
>> >>
>> >> > I'm seeing issues with a bad signature on Centos binaries (I had to
>> >> > regenerate some files here because my signature was initially missing
>> >> from
>> >> > the dev KEYS file).  Can anyone else confirm?
>> >> >
>> >> > Also, for Debian and Ubuntu I'm seeing warnings about not being able
>> to
>> >> > verify the identify of my signature (I assume because I am not in the
>> web
>> >> > of trust).  Not sure if we care about the optics on this.
>> >> >
>> >> > Thanks,
>> >> > Micah
>> >> >
>> >> > On Fri, Sep 27, 2019 at 12:01 PM Wes McKinney <we...@gmail.com>
>> >> wrote:
>> >> >
>> >> >> @David -- the macOS conda-based build is a bit finicky due to the
>> >> >> SDK-related issues. In any case since we can successfully produce
>> >> >> macOS binaries for Homebrew and wheel/conda, that's the most
>> important
>> >> >> thing, though we should aim for a more refined out-of-the-box
>> >> >> development experience
>> >> >>
>> >> >> Not sure if
>> >> >>
>> >>
>> https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst
>> >> >> contains any helpful environment configuration related information
>> >> >>
>> >> >> On Fri, Sep 27, 2019 at 9:56 AM Micah Kornfield <
>> emkornfield@gmail.com>
>> >> >> wrote:
>> >> >> >
>> >> >> > >
>> >> >> > > I checked in the key to
>> >> >> https://dist.apache.org/repos/dist/release/arrow/.
>> >> >> > > Is there something else I need to do to make it available for
>> >> >> verification?
>> >> >> >
>> >> >> > To answer my own question I think I missed adding them to the the
>> dev
>> >> >> > branch (I just did this so hopefully they will propagate soon).
>> >> >> >
>> >> >> > On Fri, Sep 27, 2019 at 8:46 AM Micah Kornfield <
>> >> emkornfield@gmail.com>
>> >> >> > wrote:
>> >> >> >
>> >> >> > > I found that Micah's GPG key did not seem to be in KEYS and had
>> to
>> >> >> > >> import it manually.
>> >> >> > >
>> >> >> > >
>> >> >> > > I checked in the key to
>> >> >> https://dist.apache.org/repos/dist/release/arrow/.
>> >> >> > > Is there something else I need to do to make it available for
>> >> >> verification?
>> >> >> > >
>> >> >> > > On Fri, Sep 27, 2019 at 7:45 AM Andy Grove <
>> andygrove73@gmail.com>
>> >> >> wrote:
>> >> >> > >
>> >> >> > >> +1 for Rust implementation. Tests run fine out the box. Version
>> >> >> numbers
>> >> >> > >> are correct.
>> >> >> > >>
>> >> >> > >> On Fri, Sep 27, 2019 at 7:26 AM David Li <li.davidm96@gmail.com
>> >
>> >> >> wrote:
>> >> >> > >>
>> >> >> > >>> I ran the source verification script on MacOS 10.12 (Sierra).
>> >> >> > >>>
>> >> >> > >>> I found that Micah's GPG key did not seem to be in KEYS and
>> had to
>> >> >> > >>> import it manually.
>> >> >> > >>>
>> >> >> > >>> Python failed in pyarrow/tests/test_cython.py::test_cython_api
>> >> when
>> >> >> > >>> invoking gcc. Is this the MacOS conda toolchain issue? It works
>> >> if I
>> >> >> > >>> add `-stdlib=libc++` to the compiler options
>> >> >> > >>> (https://stackoverflow.com/questions/40301619)
>> >> >> > >>>
>> >> >> > >>> Compiling pyarrow_cython_example.pyx because it changed.
>> >> >> > >>> [1/1] Cythonizing pyarrow_cython_example.pyx
>> >> >> > >>> Extension module:
>> >> >> > >>> <distutils.extension.Extension('pyarrow_cython_example') at
>> >> >> > >>> 0x112c40390>
>> >> >> > >>>
>> >> >>
>> >>
>> ['/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include',
>> >> >> > >>>
>> >> >> > >>>
>> >> >>
>> >>
>> '/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include']
>> >> >> > >>> ['arrow', 'arrow_python']
>> >> >> > >>>
>> >> >> > >>>
>> >> >>
>> >>
>> ['/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow',
>> >> >> > >>>
>> >> >> > >>>
>> >> >>
>> >>
>> '/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/install/lib']
>> >> >> > >>> running build_ext
>> >> >> > >>> building 'pyarrow_cython_example' extension
>> >> >> > >>> creating build
>> >> >> > >>> creating build/temp.macosx-10.7-x86_64-3.6
>> >> >> > >>> gcc -Wno-unused-result -Wsign-compare -Wunreachable-code
>> -DNDEBUG
>> >> -g
>> >> >> > >>> -fwrapv -O3 -Wall -Wstrict-prototypes
>> >> >> > >>>
>> >> >> > >>>
>> >> >>
>> >>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
>> >> >> > >>> -arch x86_64
>> >> >> > >>>
>> >> >>
>> >>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
>> >> >> > >>> -arch x86_64
>> >> >> > >>>
>> >> >>
>> >>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include
>> >> >> > >>>
>> >> >> > >>>
>> >> >>
>> >>
>> -I/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include
>> >> >> > >>>
>> >> >> > >>>
>> >> >>
>> >>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include/python3.6m
>> >> >> > >>> -c pyarrow_cython_example.cpp -o
>> >> >> > >>> build/temp.macosx-10.7-x86_64-3.6/pyarrow_cython_example.o
>> >> -std=c++11
>> >> >> > >>>
>> >> >> > >>> pyarrow_cython_example.cpp:634:10: fatal error: 'unordered_map'
>> >> file
>> >> >> not
>> >> >> > >>> found
>> >> >> > >>> #include <unordered_map>
>> >> >> > >>>          ^~~~~~~~~~~~~~~
>> >> >> > >>> 1 error generated.
>> >> >> > >>> error: command 'gcc' failed with exit status 1
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>> It also failed in all the tests in
>> >> >> > >>> pyarrow/tests/test_plasma.py::TestPlasmaClient:
>> >> >> > >>>
>> >> >> > >>> WARNING: Logging before InitGoogleLogging() is written to
>> STDERR
>> >> >> > >>> I0927 08:54:13.048408 2902139840 store.cc:1149] Allowing the
>> >> Plasma
>> >> >> > >>> store to use up to 0.1GB of memory.
>> >> >> > >>> I0927 08:54:13.049072 2902139840 store.cc:1176] Starting object
>> >> store
>> >> >> > >>> with directory /tmp and huge page support disabled
>> >> >> > >>> E0927 08:54:13.049446 2902139840 io.cc:137] Socket pathname is
>> too
>> >> >> long.
>> >> >> > >>> F0927 08:54:13.049515 2902139840 store.cc:1074]  Check failed:
>> >> >> socket >=
>> >> >> > >>> 0
>> >> >> > >>> *** Check failure stack trace: ***
>> >> >> > >>> *** Aborted at 1569588853 (unix time) try "date -d
>> @1569588853" if
>> >> >> you
>> >> >> > >>> are using GNU date ***
>> >> >> > >>> PC: @                0x0 (unknown)
>> >> >> > >>> *** SIGABRT (@0x7fffa41c7d42) received by PID 61396 (TID
>> >> >> > >>> 0x7fffacfb23c0) stack trace: ***
>> >> >> > >>>     @     0x7fffa42a8b3a _sigtramp
>> >> >> > >>>
>> >> >> > >>> For this latter issue, I believe we ran into this with Flight
>> last
>> >> >> > >>> release. MacOS generates very long temporary directory paths,
>> and
>> >> >> this
>> >> >> > >>> usually exceeds the limit on domain socket path lengths. (I
>> also
>> >> >> can't
>> >> >> > >>> get mktemp to respect TMPDIR.)
>> >> >> > >>>
>> >> >> > >>> Best,
>> >> >> > >>> David
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>> On 9/27/19, Micah Kornfield <em...@gmail.com> wrote:
>> >> >> > >>> > Hi,
>> >> >> > >>> >
>> >> >> > >>> >
>> >> >> > >>> > I would like to propose the following release candidate
>> (RC1) of
>> >> >> Apache
>> >> >> > >>> >
>> >> >> > >>> > Arrow version 0.15.0. This is a release consisting of 672
>> >> >> > >>> >
>> >> >> > >>> > resolved JIRA issues[1]. (RC0 was aborted due to release
>> script
>> >> >> > >>> issues).
>> >> >> > >>> >
>> >> >> > >>> >
>> >> >> > >>> > This release candidate is based on commit:
>> >> >> > >>> >
>> >> >> > >>> > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
>> >> >> > >>> >
>> >> >> > >>> >
>> >> >> > >>> > The source release rc1 is hosted at [3].
>> >> >> > >>> >
>> >> >> > >>> > The binary artifacts are hosted at [4][5][6][7].
>> >> >> > >>> >
>> >> >> > >>> > The changelog is located at [8].
>> >> >> > >>> >
>> >> >> > >>> >
>> >> >> > >>> > Please download, verify checksums and signatures, run the
>> unit
>> >> >> tests,
>> >> >> > >>> >
>> >> >> > >>> > and vote on the release. See [9] for how to validate a
>> release
>> >> >> > >>> candidate.
>> >> >> > >>> >
>> >> >> > >>> >
>> >> >> > >>> > The vote will be open for at least 72 hours.
>> >> >> > >>> >
>> >> >> > >>> >
>> >> >> > >>> > [ ] +1 Release this as Apache Arrow 0.15.0
>> >> >> > >>> >
>> >> >> > >>> > [ ] +0
>> >> >> > >>> >
>> >> >> > >>> > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
>> >> >> > >>> >
>> >> >> > >>> >
>> >> >> > >>> > [1]:
>> >> >> > >>> >
>> >> >> > >>>
>> >> >>
>> >>
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
>> >> >> > >>> >
>> >> >> > >>> > [2]:
>> >> >> > >>> >
>> >> >> > >>>
>> >> >>
>> >>
>> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
>> >> >> > >>> >
>> >> >> > >>> > [3]:
>> >> >> > >>>
>> >> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
>> >> >> > >>> >
>> >> >> > >>> > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
>> >> >> > >>> >
>> >> >> > >>> > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
>> >> >> > >>> >
>> >> >> > >>> > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
>> >> >> > >>> >
>> >> >> > >>> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
>> >> >> > >>> >
>> >> >> > >>> > [8]:
>> >> >> > >>> >
>> >> >> > >>>
>> >> >>
>> >>
>> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
>> >> >> > >>> >
>> >> >> > >>> > [9]:
>> >> >> > >>> >
>> >> >> > >>>
>> >> >>
>> >>
>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> >> >> > >>> >
>> >> >> > >>>
>> >> >> > >>
>> >> >>
>> >>
>>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Micah Kornfield <em...@gmail.com>.
>
> Could you show the real warning message as-is?


gpg: Good signature from "Micah Kornfield (Apache Arrow Code Signing Key) <
emkornfield@gmail.com>" [unknown]
gpg: WARNING: This key is not certified with a trusted signature!

gpg:          There is no indication that the signature belongs to the
owner.
Primary key fingerprint: E47C 810A 90FE 21FF 448D  A938 755E 7436 92EA
1D85

On Sat, Sep 28, 2019 at 6:28 PM Sutou Kouhei <ko...@clear-code.com> wrote:

> Hi,
>
> > Yes I re-ran the command.
>
> I got it.
>
> It seems that
>
> https://bintray.com/apache/arrow/download_file?file_path=centos-rc%2F6%2FSource%2Frepodata%2Frepomd.xml.asc
> is broken.
>
> % LANG=C gpg --verify ./centos-rc/6/Source/repodata/repomd.xml.asc
> ./centos-rc/6/Source/repodata/repomd.xml
> gpg: Signature made Fri Sep 27 17:12:05 2019 JST
> gpg:                using RSA key E47C810A90FE21FF448DA938755E743692EA1D85
> gpg: BAD signature from "Micah Kornfield (Apache Arrow Code Signing Key) <
> emkornfield@gmail.com>" [unknown]
>
> Umm... It's strange...
>
>
> I noticed that I forgot to add support for arm64 APT
> repository and aarch64 Yum repository. We should not have
> /dists/buster-arm64, /7-aarch64 and so on. We've added
> support for arm64 deb and aarch64 RPM packages but users
> can't install them by apt/yum.
>
> Note that this is not a blocker of 0.15.0.
>
>
> > There is still the question about the warnings, displayed about my
> identity.
>
> Could you show the real warning message as-is?
>
>
> Thanks,
> --
> kou
>
> In <CA...@mail.gmail.com>
>   "Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Sat, 28 Sep
> 2019 17:05:01 -0700,
>   Micah Kornfield <em...@gmail.com> wrote:
>
> > Yes I re-ran the command.  The re-upload fixed issues I had with APT but
> I
> > hit an issue on YUM, I can try to rerun to see if I am still seeing the
> > issue.
> >
> > There is still the question about the warnings, displayed about my
> identity.
> >
> > On Sat, Sep 28, 2019 at 3:37 PM Sutou Kouhei <ko...@clear-code.com> wrote:
> >
> >> Hi,
> >>
> >> I'm verifying the RC. There is no problem for APT and Yum
> >> repositories. Did you already re-upload the following files?
> >>
> >>   *
> >>
> https://bintray.com/apache/arrow/download_file?file_path=debian-rc%2Fapache-arrow-keyring.gpg
> >>   *
> >>
> https://bintray.com/apache/arrow/download_file?file_path=ubuntu-rc%2Fapache-arrow-keyring.gpg
> >>   *
> >>
> https://bintray.com/apache/arrow/download_file?file_path=centos-rc%2FRPM-GPG-KEY-apache-arrow
> >>
> >> FYI: We can re-upload only them by the following command line:
> >>
> >>   UPLOAD_DEFAULT=0 \
> >>     UPLOAD_DEBIAN_APT=1 \
> >>     UPLOAD_UBUNTU_APT=1 \
> >>     UPLOAD_CENTOS_YUM=1 \
> >>       dev/release/03-binary.sh 0.15.0 1 ...
> >>
> >>
> >> Thanks,
> >> --
> >> kou
> >>
> >> In <CA...@mail.gmail.com>
> >>   "Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep
> >> 2019 18:45:47 -0600,
> >>   Micah Kornfield <em...@gmail.com> wrote:
> >>
> >> > I'm seeing issues with a bad signature on Centos binaries (I had to
> >> > regenerate some files here because my signature was initially missing
> >> from
> >> > the dev KEYS file).  Can anyone else confirm?
> >> >
> >> > Also, for Debian and Ubuntu I'm seeing warnings about not being able
> to
> >> > verify the identify of my signature (I assume because I am not in the
> web
> >> > of trust).  Not sure if we care about the optics on this.
> >> >
> >> > Thanks,
> >> > Micah
> >> >
> >> > On Fri, Sep 27, 2019 at 12:01 PM Wes McKinney <we...@gmail.com>
> >> wrote:
> >> >
> >> >> @David -- the macOS conda-based build is a bit finicky due to the
> >> >> SDK-related issues. In any case since we can successfully produce
> >> >> macOS binaries for Homebrew and wheel/conda, that's the most
> important
> >> >> thing, though we should aim for a more refined out-of-the-box
> >> >> development experience
> >> >>
> >> >> Not sure if
> >> >>
> >>
> https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst
> >> >> contains any helpful environment configuration related information
> >> >>
> >> >> On Fri, Sep 27, 2019 at 9:56 AM Micah Kornfield <
> emkornfield@gmail.com>
> >> >> wrote:
> >> >> >
> >> >> > >
> >> >> > > I checked in the key to
> >> >> https://dist.apache.org/repos/dist/release/arrow/.
> >> >> > > Is there something else I need to do to make it available for
> >> >> verification?
> >> >> >
> >> >> > To answer my own question I think I missed adding them to the the
> dev
> >> >> > branch (I just did this so hopefully they will propagate soon).
> >> >> >
> >> >> > On Fri, Sep 27, 2019 at 8:46 AM Micah Kornfield <
> >> emkornfield@gmail.com>
> >> >> > wrote:
> >> >> >
> >> >> > > I found that Micah's GPG key did not seem to be in KEYS and had
> to
> >> >> > >> import it manually.
> >> >> > >
> >> >> > >
> >> >> > > I checked in the key to
> >> >> https://dist.apache.org/repos/dist/release/arrow/.
> >> >> > > Is there something else I need to do to make it available for
> >> >> verification?
> >> >> > >
> >> >> > > On Fri, Sep 27, 2019 at 7:45 AM Andy Grove <
> andygrove73@gmail.com>
> >> >> wrote:
> >> >> > >
> >> >> > >> +1 for Rust implementation. Tests run fine out the box. Version
> >> >> numbers
> >> >> > >> are correct.
> >> >> > >>
> >> >> > >> On Fri, Sep 27, 2019 at 7:26 AM David Li <li.davidm96@gmail.com
> >
> >> >> wrote:
> >> >> > >>
> >> >> > >>> I ran the source verification script on MacOS 10.12 (Sierra).
> >> >> > >>>
> >> >> > >>> I found that Micah's GPG key did not seem to be in KEYS and
> had to
> >> >> > >>> import it manually.
> >> >> > >>>
> >> >> > >>> Python failed in pyarrow/tests/test_cython.py::test_cython_api
> >> when
> >> >> > >>> invoking gcc. Is this the MacOS conda toolchain issue? It works
> >> if I
> >> >> > >>> add `-stdlib=libc++` to the compiler options
> >> >> > >>> (https://stackoverflow.com/questions/40301619)
> >> >> > >>>
> >> >> > >>> Compiling pyarrow_cython_example.pyx because it changed.
> >> >> > >>> [1/1] Cythonizing pyarrow_cython_example.pyx
> >> >> > >>> Extension module:
> >> >> > >>> <distutils.extension.Extension('pyarrow_cython_example') at
> >> >> > >>> 0x112c40390>
> >> >> > >>>
> >> >>
> >>
> ['/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include',
> >> >> > >>>
> >> >> > >>>
> >> >>
> >>
> '/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include']
> >> >> > >>> ['arrow', 'arrow_python']
> >> >> > >>>
> >> >> > >>>
> >> >>
> >>
> ['/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow',
> >> >> > >>>
> >> >> > >>>
> >> >>
> >>
> '/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/install/lib']
> >> >> > >>> running build_ext
> >> >> > >>> building 'pyarrow_cython_example' extension
> >> >> > >>> creating build
> >> >> > >>> creating build/temp.macosx-10.7-x86_64-3.6
> >> >> > >>> gcc -Wno-unused-result -Wsign-compare -Wunreachable-code
> -DNDEBUG
> >> -g
> >> >> > >>> -fwrapv -O3 -Wall -Wstrict-prototypes
> >> >> > >>>
> >> >> > >>>
> >> >>
> >>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
> >> >> > >>> -arch x86_64
> >> >> > >>>
> >> >>
> >>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
> >> >> > >>> -arch x86_64
> >> >> > >>>
> >> >>
> >>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include
> >> >> > >>>
> >> >> > >>>
> >> >>
> >>
> -I/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include
> >> >> > >>>
> >> >> > >>>
> >> >>
> >>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include/python3.6m
> >> >> > >>> -c pyarrow_cython_example.cpp -o
> >> >> > >>> build/temp.macosx-10.7-x86_64-3.6/pyarrow_cython_example.o
> >> -std=c++11
> >> >> > >>>
> >> >> > >>> pyarrow_cython_example.cpp:634:10: fatal error: 'unordered_map'
> >> file
> >> >> not
> >> >> > >>> found
> >> >> > >>> #include <unordered_map>
> >> >> > >>>          ^~~~~~~~~~~~~~~
> >> >> > >>> 1 error generated.
> >> >> > >>> error: command 'gcc' failed with exit status 1
> >> >> > >>>
> >> >> > >>>
> >> >> > >>> It also failed in all the tests in
> >> >> > >>> pyarrow/tests/test_plasma.py::TestPlasmaClient:
> >> >> > >>>
> >> >> > >>> WARNING: Logging before InitGoogleLogging() is written to
> STDERR
> >> >> > >>> I0927 08:54:13.048408 2902139840 store.cc:1149] Allowing the
> >> Plasma
> >> >> > >>> store to use up to 0.1GB of memory.
> >> >> > >>> I0927 08:54:13.049072 2902139840 store.cc:1176] Starting object
> >> store
> >> >> > >>> with directory /tmp and huge page support disabled
> >> >> > >>> E0927 08:54:13.049446 2902139840 io.cc:137] Socket pathname is
> too
> >> >> long.
> >> >> > >>> F0927 08:54:13.049515 2902139840 store.cc:1074]  Check failed:
> >> >> socket >=
> >> >> > >>> 0
> >> >> > >>> *** Check failure stack trace: ***
> >> >> > >>> *** Aborted at 1569588853 (unix time) try "date -d
> @1569588853" if
> >> >> you
> >> >> > >>> are using GNU date ***
> >> >> > >>> PC: @                0x0 (unknown)
> >> >> > >>> *** SIGABRT (@0x7fffa41c7d42) received by PID 61396 (TID
> >> >> > >>> 0x7fffacfb23c0) stack trace: ***
> >> >> > >>>     @     0x7fffa42a8b3a _sigtramp
> >> >> > >>>
> >> >> > >>> For this latter issue, I believe we ran into this with Flight
> last
> >> >> > >>> release. MacOS generates very long temporary directory paths,
> and
> >> >> this
> >> >> > >>> usually exceeds the limit on domain socket path lengths. (I
> also
> >> >> can't
> >> >> > >>> get mktemp to respect TMPDIR.)
> >> >> > >>>
> >> >> > >>> Best,
> >> >> > >>> David
> >> >> > >>>
> >> >> > >>>
> >> >> > >>> On 9/27/19, Micah Kornfield <em...@gmail.com> wrote:
> >> >> > >>> > Hi,
> >> >> > >>> >
> >> >> > >>> >
> >> >> > >>> > I would like to propose the following release candidate
> (RC1) of
> >> >> Apache
> >> >> > >>> >
> >> >> > >>> > Arrow version 0.15.0. This is a release consisting of 672
> >> >> > >>> >
> >> >> > >>> > resolved JIRA issues[1]. (RC0 was aborted due to release
> script
> >> >> > >>> issues).
> >> >> > >>> >
> >> >> > >>> >
> >> >> > >>> > This release candidate is based on commit:
> >> >> > >>> >
> >> >> > >>> > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
> >> >> > >>> >
> >> >> > >>> >
> >> >> > >>> > The source release rc1 is hosted at [3].
> >> >> > >>> >
> >> >> > >>> > The binary artifacts are hosted at [4][5][6][7].
> >> >> > >>> >
> >> >> > >>> > The changelog is located at [8].
> >> >> > >>> >
> >> >> > >>> >
> >> >> > >>> > Please download, verify checksums and signatures, run the
> unit
> >> >> tests,
> >> >> > >>> >
> >> >> > >>> > and vote on the release. See [9] for how to validate a
> release
> >> >> > >>> candidate.
> >> >> > >>> >
> >> >> > >>> >
> >> >> > >>> > The vote will be open for at least 72 hours.
> >> >> > >>> >
> >> >> > >>> >
> >> >> > >>> > [ ] +1 Release this as Apache Arrow 0.15.0
> >> >> > >>> >
> >> >> > >>> > [ ] +0
> >> >> > >>> >
> >> >> > >>> > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
> >> >> > >>> >
> >> >> > >>> >
> >> >> > >>> > [1]:
> >> >> > >>> >
> >> >> > >>>
> >> >>
> >>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
> >> >> > >>> >
> >> >> > >>> > [2]:
> >> >> > >>> >
> >> >> > >>>
> >> >>
> >>
> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
> >> >> > >>> >
> >> >> > >>> > [3]:
> >> >> > >>>
> >> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
> >> >> > >>> >
> >> >> > >>> > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
> >> >> > >>> >
> >> >> > >>> > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
> >> >> > >>> >
> >> >> > >>> > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
> >> >> > >>> >
> >> >> > >>> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
> >> >> > >>> >
> >> >> > >>> > [8]:
> >> >> > >>> >
> >> >> > >>>
> >> >>
> >>
> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
> >> >> > >>> >
> >> >> > >>> > [9]:
> >> >> > >>> >
> >> >> > >>>
> >> >>
> >>
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >> >> > >>> >
> >> >> > >>>
> >> >> > >>
> >> >>
> >>
>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Sutou Kouhei <ko...@clear-code.com>.
Hi,

> Yes I re-ran the command.

I got it.

It seems that
https://bintray.com/apache/arrow/download_file?file_path=centos-rc%2F6%2FSource%2Frepodata%2Frepomd.xml.asc
is broken.

% LANG=C gpg --verify ./centos-rc/6/Source/repodata/repomd.xml.asc ./centos-rc/6/Source/repodata/repomd.xml      
gpg: Signature made Fri Sep 27 17:12:05 2019 JST
gpg:                using RSA key E47C810A90FE21FF448DA938755E743692EA1D85
gpg: BAD signature from "Micah Kornfield (Apache Arrow Code Signing Key) <em...@gmail.com>" [unknown]

Umm... It's strange...


I noticed that I forgot to add support for arm64 APT
repository and aarch64 Yum repository. We should not have
/dists/buster-arm64, /7-aarch64 and so on. We've added
support for arm64 deb and aarch64 RPM packages but users
can't install them by apt/yum.

Note that this is not a blocker of 0.15.0.


> There is still the question about the warnings, displayed about my identity.

Could you show the real warning message as-is?


Thanks,
--
kou

In <CA...@mail.gmail.com>
  "Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Sat, 28 Sep 2019 17:05:01 -0700,
  Micah Kornfield <em...@gmail.com> wrote:

> Yes I re-ran the command.  The re-upload fixed issues I had with APT but I
> hit an issue on YUM, I can try to rerun to see if I am still seeing the
> issue.
> 
> There is still the question about the warnings, displayed about my identity.
> 
> On Sat, Sep 28, 2019 at 3:37 PM Sutou Kouhei <ko...@clear-code.com> wrote:
> 
>> Hi,
>>
>> I'm verifying the RC. There is no problem for APT and Yum
>> repositories. Did you already re-upload the following files?
>>
>>   *
>> https://bintray.com/apache/arrow/download_file?file_path=debian-rc%2Fapache-arrow-keyring.gpg
>>   *
>> https://bintray.com/apache/arrow/download_file?file_path=ubuntu-rc%2Fapache-arrow-keyring.gpg
>>   *
>> https://bintray.com/apache/arrow/download_file?file_path=centos-rc%2FRPM-GPG-KEY-apache-arrow
>>
>> FYI: We can re-upload only them by the following command line:
>>
>>   UPLOAD_DEFAULT=0 \
>>     UPLOAD_DEBIAN_APT=1 \
>>     UPLOAD_UBUNTU_APT=1 \
>>     UPLOAD_CENTOS_YUM=1 \
>>       dev/release/03-binary.sh 0.15.0 1 ...
>>
>>
>> Thanks,
>> --
>> kou
>>
>> In <CA...@mail.gmail.com>
>>   "Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep
>> 2019 18:45:47 -0600,
>>   Micah Kornfield <em...@gmail.com> wrote:
>>
>> > I'm seeing issues with a bad signature on Centos binaries (I had to
>> > regenerate some files here because my signature was initially missing
>> from
>> > the dev KEYS file).  Can anyone else confirm?
>> >
>> > Also, for Debian and Ubuntu I'm seeing warnings about not being able to
>> > verify the identify of my signature (I assume because I am not in the web
>> > of trust).  Not sure if we care about the optics on this.
>> >
>> > Thanks,
>> > Micah
>> >
>> > On Fri, Sep 27, 2019 at 12:01 PM Wes McKinney <we...@gmail.com>
>> wrote:
>> >
>> >> @David -- the macOS conda-based build is a bit finicky due to the
>> >> SDK-related issues. In any case since we can successfully produce
>> >> macOS binaries for Homebrew and wheel/conda, that's the most important
>> >> thing, though we should aim for a more refined out-of-the-box
>> >> development experience
>> >>
>> >> Not sure if
>> >>
>> https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst
>> >> contains any helpful environment configuration related information
>> >>
>> >> On Fri, Sep 27, 2019 at 9:56 AM Micah Kornfield <em...@gmail.com>
>> >> wrote:
>> >> >
>> >> > >
>> >> > > I checked in the key to
>> >> https://dist.apache.org/repos/dist/release/arrow/.
>> >> > > Is there something else I need to do to make it available for
>> >> verification?
>> >> >
>> >> > To answer my own question I think I missed adding them to the the dev
>> >> > branch (I just did this so hopefully they will propagate soon).
>> >> >
>> >> > On Fri, Sep 27, 2019 at 8:46 AM Micah Kornfield <
>> emkornfield@gmail.com>
>> >> > wrote:
>> >> >
>> >> > > I found that Micah's GPG key did not seem to be in KEYS and had to
>> >> > >> import it manually.
>> >> > >
>> >> > >
>> >> > > I checked in the key to
>> >> https://dist.apache.org/repos/dist/release/arrow/.
>> >> > > Is there something else I need to do to make it available for
>> >> verification?
>> >> > >
>> >> > > On Fri, Sep 27, 2019 at 7:45 AM Andy Grove <an...@gmail.com>
>> >> wrote:
>> >> > >
>> >> > >> +1 for Rust implementation. Tests run fine out the box. Version
>> >> numbers
>> >> > >> are correct.
>> >> > >>
>> >> > >> On Fri, Sep 27, 2019 at 7:26 AM David Li <li...@gmail.com>
>> >> wrote:
>> >> > >>
>> >> > >>> I ran the source verification script on MacOS 10.12 (Sierra).
>> >> > >>>
>> >> > >>> I found that Micah's GPG key did not seem to be in KEYS and had to
>> >> > >>> import it manually.
>> >> > >>>
>> >> > >>> Python failed in pyarrow/tests/test_cython.py::test_cython_api
>> when
>> >> > >>> invoking gcc. Is this the MacOS conda toolchain issue? It works
>> if I
>> >> > >>> add `-stdlib=libc++` to the compiler options
>> >> > >>> (https://stackoverflow.com/questions/40301619)
>> >> > >>>
>> >> > >>> Compiling pyarrow_cython_example.pyx because it changed.
>> >> > >>> [1/1] Cythonizing pyarrow_cython_example.pyx
>> >> > >>> Extension module:
>> >> > >>> <distutils.extension.Extension('pyarrow_cython_example') at
>> >> > >>> 0x112c40390>
>> >> > >>>
>> >>
>> ['/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include',
>> >> > >>>
>> >> > >>>
>> >>
>> '/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include']
>> >> > >>> ['arrow', 'arrow_python']
>> >> > >>>
>> >> > >>>
>> >>
>> ['/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow',
>> >> > >>>
>> >> > >>>
>> >>
>> '/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/install/lib']
>> >> > >>> running build_ext
>> >> > >>> building 'pyarrow_cython_example' extension
>> >> > >>> creating build
>> >> > >>> creating build/temp.macosx-10.7-x86_64-3.6
>> >> > >>> gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG
>> -g
>> >> > >>> -fwrapv -O3 -Wall -Wstrict-prototypes
>> >> > >>>
>> >> > >>>
>> >>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
>> >> > >>> -arch x86_64
>> >> > >>>
>> >>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
>> >> > >>> -arch x86_64
>> >> > >>>
>> >>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include
>> >> > >>>
>> >> > >>>
>> >>
>> -I/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include
>> >> > >>>
>> >> > >>>
>> >>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include/python3.6m
>> >> > >>> -c pyarrow_cython_example.cpp -o
>> >> > >>> build/temp.macosx-10.7-x86_64-3.6/pyarrow_cython_example.o
>> -std=c++11
>> >> > >>>
>> >> > >>> pyarrow_cython_example.cpp:634:10: fatal error: 'unordered_map'
>> file
>> >> not
>> >> > >>> found
>> >> > >>> #include <unordered_map>
>> >> > >>>          ^~~~~~~~~~~~~~~
>> >> > >>> 1 error generated.
>> >> > >>> error: command 'gcc' failed with exit status 1
>> >> > >>>
>> >> > >>>
>> >> > >>> It also failed in all the tests in
>> >> > >>> pyarrow/tests/test_plasma.py::TestPlasmaClient:
>> >> > >>>
>> >> > >>> WARNING: Logging before InitGoogleLogging() is written to STDERR
>> >> > >>> I0927 08:54:13.048408 2902139840 store.cc:1149] Allowing the
>> Plasma
>> >> > >>> store to use up to 0.1GB of memory.
>> >> > >>> I0927 08:54:13.049072 2902139840 store.cc:1176] Starting object
>> store
>> >> > >>> with directory /tmp and huge page support disabled
>> >> > >>> E0927 08:54:13.049446 2902139840 io.cc:137] Socket pathname is too
>> >> long.
>> >> > >>> F0927 08:54:13.049515 2902139840 store.cc:1074]  Check failed:
>> >> socket >=
>> >> > >>> 0
>> >> > >>> *** Check failure stack trace: ***
>> >> > >>> *** Aborted at 1569588853 (unix time) try "date -d @1569588853" if
>> >> you
>> >> > >>> are using GNU date ***
>> >> > >>> PC: @                0x0 (unknown)
>> >> > >>> *** SIGABRT (@0x7fffa41c7d42) received by PID 61396 (TID
>> >> > >>> 0x7fffacfb23c0) stack trace: ***
>> >> > >>>     @     0x7fffa42a8b3a _sigtramp
>> >> > >>>
>> >> > >>> For this latter issue, I believe we ran into this with Flight last
>> >> > >>> release. MacOS generates very long temporary directory paths, and
>> >> this
>> >> > >>> usually exceeds the limit on domain socket path lengths. (I also
>> >> can't
>> >> > >>> get mktemp to respect TMPDIR.)
>> >> > >>>
>> >> > >>> Best,
>> >> > >>> David
>> >> > >>>
>> >> > >>>
>> >> > >>> On 9/27/19, Micah Kornfield <em...@gmail.com> wrote:
>> >> > >>> > Hi,
>> >> > >>> >
>> >> > >>> >
>> >> > >>> > I would like to propose the following release candidate (RC1) of
>> >> Apache
>> >> > >>> >
>> >> > >>> > Arrow version 0.15.0. This is a release consisting of 672
>> >> > >>> >
>> >> > >>> > resolved JIRA issues[1]. (RC0 was aborted due to release script
>> >> > >>> issues).
>> >> > >>> >
>> >> > >>> >
>> >> > >>> > This release candidate is based on commit:
>> >> > >>> >
>> >> > >>> > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
>> >> > >>> >
>> >> > >>> >
>> >> > >>> > The source release rc1 is hosted at [3].
>> >> > >>> >
>> >> > >>> > The binary artifacts are hosted at [4][5][6][7].
>> >> > >>> >
>> >> > >>> > The changelog is located at [8].
>> >> > >>> >
>> >> > >>> >
>> >> > >>> > Please download, verify checksums and signatures, run the unit
>> >> tests,
>> >> > >>> >
>> >> > >>> > and vote on the release. See [9] for how to validate a release
>> >> > >>> candidate.
>> >> > >>> >
>> >> > >>> >
>> >> > >>> > The vote will be open for at least 72 hours.
>> >> > >>> >
>> >> > >>> >
>> >> > >>> > [ ] +1 Release this as Apache Arrow 0.15.0
>> >> > >>> >
>> >> > >>> > [ ] +0
>> >> > >>> >
>> >> > >>> > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
>> >> > >>> >
>> >> > >>> >
>> >> > >>> > [1]:
>> >> > >>> >
>> >> > >>>
>> >>
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
>> >> > >>> >
>> >> > >>> > [2]:
>> >> > >>> >
>> >> > >>>
>> >>
>> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
>> >> > >>> >
>> >> > >>> > [3]:
>> >> > >>>
>> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
>> >> > >>> >
>> >> > >>> > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
>> >> > >>> >
>> >> > >>> > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
>> >> > >>> >
>> >> > >>> > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
>> >> > >>> >
>> >> > >>> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
>> >> > >>> >
>> >> > >>> > [8]:
>> >> > >>> >
>> >> > >>>
>> >>
>> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
>> >> > >>> >
>> >> > >>> > [9]:
>> >> > >>> >
>> >> > >>>
>> >>
>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> >> > >>> >
>> >> > >>>
>> >> > >>
>> >>
>>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Micah Kornfield <em...@gmail.com>.
Yes I re-ran the command.  The re-upload fixed issues I had with APT but I
hit an issue on YUM, I can try to rerun to see if I am still seeing the
issue.

There is still the question about the warnings, displayed about my identity.

On Sat, Sep 28, 2019 at 3:37 PM Sutou Kouhei <ko...@clear-code.com> wrote:

> Hi,
>
> I'm verifying the RC. There is no problem for APT and Yum
> repositories. Did you already re-upload the following files?
>
>   *
> https://bintray.com/apache/arrow/download_file?file_path=debian-rc%2Fapache-arrow-keyring.gpg
>   *
> https://bintray.com/apache/arrow/download_file?file_path=ubuntu-rc%2Fapache-arrow-keyring.gpg
>   *
> https://bintray.com/apache/arrow/download_file?file_path=centos-rc%2FRPM-GPG-KEY-apache-arrow
>
> FYI: We can re-upload only them by the following command line:
>
>   UPLOAD_DEFAULT=0 \
>     UPLOAD_DEBIAN_APT=1 \
>     UPLOAD_UBUNTU_APT=1 \
>     UPLOAD_CENTOS_YUM=1 \
>       dev/release/03-binary.sh 0.15.0 1 ...
>
>
> Thanks,
> --
> kou
>
> In <CA...@mail.gmail.com>
>   "Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep
> 2019 18:45:47 -0600,
>   Micah Kornfield <em...@gmail.com> wrote:
>
> > I'm seeing issues with a bad signature on Centos binaries (I had to
> > regenerate some files here because my signature was initially missing
> from
> > the dev KEYS file).  Can anyone else confirm?
> >
> > Also, for Debian and Ubuntu I'm seeing warnings about not being able to
> > verify the identify of my signature (I assume because I am not in the web
> > of trust).  Not sure if we care about the optics on this.
> >
> > Thanks,
> > Micah
> >
> > On Fri, Sep 27, 2019 at 12:01 PM Wes McKinney <we...@gmail.com>
> wrote:
> >
> >> @David -- the macOS conda-based build is a bit finicky due to the
> >> SDK-related issues. In any case since we can successfully produce
> >> macOS binaries for Homebrew and wheel/conda, that's the most important
> >> thing, though we should aim for a more refined out-of-the-box
> >> development experience
> >>
> >> Not sure if
> >>
> https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst
> >> contains any helpful environment configuration related information
> >>
> >> On Fri, Sep 27, 2019 at 9:56 AM Micah Kornfield <em...@gmail.com>
> >> wrote:
> >> >
> >> > >
> >> > > I checked in the key to
> >> https://dist.apache.org/repos/dist/release/arrow/.
> >> > > Is there something else I need to do to make it available for
> >> verification?
> >> >
> >> > To answer my own question I think I missed adding them to the the dev
> >> > branch (I just did this so hopefully they will propagate soon).
> >> >
> >> > On Fri, Sep 27, 2019 at 8:46 AM Micah Kornfield <
> emkornfield@gmail.com>
> >> > wrote:
> >> >
> >> > > I found that Micah's GPG key did not seem to be in KEYS and had to
> >> > >> import it manually.
> >> > >
> >> > >
> >> > > I checked in the key to
> >> https://dist.apache.org/repos/dist/release/arrow/.
> >> > > Is there something else I need to do to make it available for
> >> verification?
> >> > >
> >> > > On Fri, Sep 27, 2019 at 7:45 AM Andy Grove <an...@gmail.com>
> >> wrote:
> >> > >
> >> > >> +1 for Rust implementation. Tests run fine out the box. Version
> >> numbers
> >> > >> are correct.
> >> > >>
> >> > >> On Fri, Sep 27, 2019 at 7:26 AM David Li <li...@gmail.com>
> >> wrote:
> >> > >>
> >> > >>> I ran the source verification script on MacOS 10.12 (Sierra).
> >> > >>>
> >> > >>> I found that Micah's GPG key did not seem to be in KEYS and had to
> >> > >>> import it manually.
> >> > >>>
> >> > >>> Python failed in pyarrow/tests/test_cython.py::test_cython_api
> when
> >> > >>> invoking gcc. Is this the MacOS conda toolchain issue? It works
> if I
> >> > >>> add `-stdlib=libc++` to the compiler options
> >> > >>> (https://stackoverflow.com/questions/40301619)
> >> > >>>
> >> > >>> Compiling pyarrow_cython_example.pyx because it changed.
> >> > >>> [1/1] Cythonizing pyarrow_cython_example.pyx
> >> > >>> Extension module:
> >> > >>> <distutils.extension.Extension('pyarrow_cython_example') at
> >> > >>> 0x112c40390>
> >> > >>>
> >>
> ['/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include',
> >> > >>>
> >> > >>>
> >>
> '/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include']
> >> > >>> ['arrow', 'arrow_python']
> >> > >>>
> >> > >>>
> >>
> ['/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow',
> >> > >>>
> >> > >>>
> >>
> '/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/install/lib']
> >> > >>> running build_ext
> >> > >>> building 'pyarrow_cython_example' extension
> >> > >>> creating build
> >> > >>> creating build/temp.macosx-10.7-x86_64-3.6
> >> > >>> gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG
> -g
> >> > >>> -fwrapv -O3 -Wall -Wstrict-prototypes
> >> > >>>
> >> > >>>
> >>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
> >> > >>> -arch x86_64
> >> > >>>
> >>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
> >> > >>> -arch x86_64
> >> > >>>
> >>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include
> >> > >>>
> >> > >>>
> >>
> -I/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include
> >> > >>>
> >> > >>>
> >>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include/python3.6m
> >> > >>> -c pyarrow_cython_example.cpp -o
> >> > >>> build/temp.macosx-10.7-x86_64-3.6/pyarrow_cython_example.o
> -std=c++11
> >> > >>>
> >> > >>> pyarrow_cython_example.cpp:634:10: fatal error: 'unordered_map'
> file
> >> not
> >> > >>> found
> >> > >>> #include <unordered_map>
> >> > >>>          ^~~~~~~~~~~~~~~
> >> > >>> 1 error generated.
> >> > >>> error: command 'gcc' failed with exit status 1
> >> > >>>
> >> > >>>
> >> > >>> It also failed in all the tests in
> >> > >>> pyarrow/tests/test_plasma.py::TestPlasmaClient:
> >> > >>>
> >> > >>> WARNING: Logging before InitGoogleLogging() is written to STDERR
> >> > >>> I0927 08:54:13.048408 2902139840 store.cc:1149] Allowing the
> Plasma
> >> > >>> store to use up to 0.1GB of memory.
> >> > >>> I0927 08:54:13.049072 2902139840 store.cc:1176] Starting object
> store
> >> > >>> with directory /tmp and huge page support disabled
> >> > >>> E0927 08:54:13.049446 2902139840 io.cc:137] Socket pathname is too
> >> long.
> >> > >>> F0927 08:54:13.049515 2902139840 store.cc:1074]  Check failed:
> >> socket >=
> >> > >>> 0
> >> > >>> *** Check failure stack trace: ***
> >> > >>> *** Aborted at 1569588853 (unix time) try "date -d @1569588853" if
> >> you
> >> > >>> are using GNU date ***
> >> > >>> PC: @                0x0 (unknown)
> >> > >>> *** SIGABRT (@0x7fffa41c7d42) received by PID 61396 (TID
> >> > >>> 0x7fffacfb23c0) stack trace: ***
> >> > >>>     @     0x7fffa42a8b3a _sigtramp
> >> > >>>
> >> > >>> For this latter issue, I believe we ran into this with Flight last
> >> > >>> release. MacOS generates very long temporary directory paths, and
> >> this
> >> > >>> usually exceeds the limit on domain socket path lengths. (I also
> >> can't
> >> > >>> get mktemp to respect TMPDIR.)
> >> > >>>
> >> > >>> Best,
> >> > >>> David
> >> > >>>
> >> > >>>
> >> > >>> On 9/27/19, Micah Kornfield <em...@gmail.com> wrote:
> >> > >>> > Hi,
> >> > >>> >
> >> > >>> >
> >> > >>> > I would like to propose the following release candidate (RC1) of
> >> Apache
> >> > >>> >
> >> > >>> > Arrow version 0.15.0. This is a release consisting of 672
> >> > >>> >
> >> > >>> > resolved JIRA issues[1]. (RC0 was aborted due to release script
> >> > >>> issues).
> >> > >>> >
> >> > >>> >
> >> > >>> > This release candidate is based on commit:
> >> > >>> >
> >> > >>> > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
> >> > >>> >
> >> > >>> >
> >> > >>> > The source release rc1 is hosted at [3].
> >> > >>> >
> >> > >>> > The binary artifacts are hosted at [4][5][6][7].
> >> > >>> >
> >> > >>> > The changelog is located at [8].
> >> > >>> >
> >> > >>> >
> >> > >>> > Please download, verify checksums and signatures, run the unit
> >> tests,
> >> > >>> >
> >> > >>> > and vote on the release. See [9] for how to validate a release
> >> > >>> candidate.
> >> > >>> >
> >> > >>> >
> >> > >>> > The vote will be open for at least 72 hours.
> >> > >>> >
> >> > >>> >
> >> > >>> > [ ] +1 Release this as Apache Arrow 0.15.0
> >> > >>> >
> >> > >>> > [ ] +0
> >> > >>> >
> >> > >>> > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
> >> > >>> >
> >> > >>> >
> >> > >>> > [1]:
> >> > >>> >
> >> > >>>
> >>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
> >> > >>> >
> >> > >>> > [2]:
> >> > >>> >
> >> > >>>
> >>
> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
> >> > >>> >
> >> > >>> > [3]:
> >> > >>>
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
> >> > >>> >
> >> > >>> > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
> >> > >>> >
> >> > >>> > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
> >> > >>> >
> >> > >>> > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
> >> > >>> >
> >> > >>> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
> >> > >>> >
> >> > >>> > [8]:
> >> > >>> >
> >> > >>>
> >>
> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
> >> > >>> >
> >> > >>> > [9]:
> >> > >>> >
> >> > >>>
> >>
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >> > >>> >
> >> > >>>
> >> > >>
> >>
>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Sutou Kouhei <ko...@clear-code.com>.
Hi,

I'm verifying the RC. There is no problem for APT and Yum
repositories. Did you already re-upload the following files?

  * https://bintray.com/apache/arrow/download_file?file_path=debian-rc%2Fapache-arrow-keyring.gpg
  * https://bintray.com/apache/arrow/download_file?file_path=ubuntu-rc%2Fapache-arrow-keyring.gpg
  * https://bintray.com/apache/arrow/download_file?file_path=centos-rc%2FRPM-GPG-KEY-apache-arrow

FYI: We can re-upload only them by the following command line:

  UPLOAD_DEFAULT=0 \
    UPLOAD_DEBIAN_APT=1 \
    UPLOAD_UBUNTU_APT=1 \
    UPLOAD_CENTOS_YUM=1 \
      dev/release/03-binary.sh 0.15.0 1 ...


Thanks,
--
kou

In <CA...@mail.gmail.com>
  "Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep 2019 18:45:47 -0600,
  Micah Kornfield <em...@gmail.com> wrote:

> I'm seeing issues with a bad signature on Centos binaries (I had to
> regenerate some files here because my signature was initially missing from
> the dev KEYS file).  Can anyone else confirm?
> 
> Also, for Debian and Ubuntu I'm seeing warnings about not being able to
> verify the identify of my signature (I assume because I am not in the web
> of trust).  Not sure if we care about the optics on this.
> 
> Thanks,
> Micah
> 
> On Fri, Sep 27, 2019 at 12:01 PM Wes McKinney <we...@gmail.com> wrote:
> 
>> @David -- the macOS conda-based build is a bit finicky due to the
>> SDK-related issues. In any case since we can successfully produce
>> macOS binaries for Homebrew and wheel/conda, that's the most important
>> thing, though we should aim for a more refined out-of-the-box
>> development experience
>>
>> Not sure if
>> https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst
>> contains any helpful environment configuration related information
>>
>> On Fri, Sep 27, 2019 at 9:56 AM Micah Kornfield <em...@gmail.com>
>> wrote:
>> >
>> > >
>> > > I checked in the key to
>> https://dist.apache.org/repos/dist/release/arrow/.
>> > > Is there something else I need to do to make it available for
>> verification?
>> >
>> > To answer my own question I think I missed adding them to the the dev
>> > branch (I just did this so hopefully they will propagate soon).
>> >
>> > On Fri, Sep 27, 2019 at 8:46 AM Micah Kornfield <em...@gmail.com>
>> > wrote:
>> >
>> > > I found that Micah's GPG key did not seem to be in KEYS and had to
>> > >> import it manually.
>> > >
>> > >
>> > > I checked in the key to
>> https://dist.apache.org/repos/dist/release/arrow/.
>> > > Is there something else I need to do to make it available for
>> verification?
>> > >
>> > > On Fri, Sep 27, 2019 at 7:45 AM Andy Grove <an...@gmail.com>
>> wrote:
>> > >
>> > >> +1 for Rust implementation. Tests run fine out the box. Version
>> numbers
>> > >> are correct.
>> > >>
>> > >> On Fri, Sep 27, 2019 at 7:26 AM David Li <li...@gmail.com>
>> wrote:
>> > >>
>> > >>> I ran the source verification script on MacOS 10.12 (Sierra).
>> > >>>
>> > >>> I found that Micah's GPG key did not seem to be in KEYS and had to
>> > >>> import it manually.
>> > >>>
>> > >>> Python failed in pyarrow/tests/test_cython.py::test_cython_api when
>> > >>> invoking gcc. Is this the MacOS conda toolchain issue? It works if I
>> > >>> add `-stdlib=libc++` to the compiler options
>> > >>> (https://stackoverflow.com/questions/40301619)
>> > >>>
>> > >>> Compiling pyarrow_cython_example.pyx because it changed.
>> > >>> [1/1] Cythonizing pyarrow_cython_example.pyx
>> > >>> Extension module:
>> > >>> <distutils.extension.Extension('pyarrow_cython_example') at
>> > >>> 0x112c40390>
>> > >>>
>> ['/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include',
>> > >>>
>> > >>>
>> '/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include']
>> > >>> ['arrow', 'arrow_python']
>> > >>>
>> > >>>
>> ['/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow',
>> > >>>
>> > >>>
>> '/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/install/lib']
>> > >>> running build_ext
>> > >>> building 'pyarrow_cython_example' extension
>> > >>> creating build
>> > >>> creating build/temp.macosx-10.7-x86_64-3.6
>> > >>> gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g
>> > >>> -fwrapv -O3 -Wall -Wstrict-prototypes
>> > >>>
>> > >>>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
>> > >>> -arch x86_64
>> > >>>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
>> > >>> -arch x86_64
>> > >>>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include
>> > >>>
>> > >>>
>> -I/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include
>> > >>>
>> > >>>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include/python3.6m
>> > >>> -c pyarrow_cython_example.cpp -o
>> > >>> build/temp.macosx-10.7-x86_64-3.6/pyarrow_cython_example.o -std=c++11
>> > >>>
>> > >>> pyarrow_cython_example.cpp:634:10: fatal error: 'unordered_map' file
>> not
>> > >>> found
>> > >>> #include <unordered_map>
>> > >>>          ^~~~~~~~~~~~~~~
>> > >>> 1 error generated.
>> > >>> error: command 'gcc' failed with exit status 1
>> > >>>
>> > >>>
>> > >>> It also failed in all the tests in
>> > >>> pyarrow/tests/test_plasma.py::TestPlasmaClient:
>> > >>>
>> > >>> WARNING: Logging before InitGoogleLogging() is written to STDERR
>> > >>> I0927 08:54:13.048408 2902139840 store.cc:1149] Allowing the Plasma
>> > >>> store to use up to 0.1GB of memory.
>> > >>> I0927 08:54:13.049072 2902139840 store.cc:1176] Starting object store
>> > >>> with directory /tmp and huge page support disabled
>> > >>> E0927 08:54:13.049446 2902139840 io.cc:137] Socket pathname is too
>> long.
>> > >>> F0927 08:54:13.049515 2902139840 store.cc:1074]  Check failed:
>> socket >=
>> > >>> 0
>> > >>> *** Check failure stack trace: ***
>> > >>> *** Aborted at 1569588853 (unix time) try "date -d @1569588853" if
>> you
>> > >>> are using GNU date ***
>> > >>> PC: @                0x0 (unknown)
>> > >>> *** SIGABRT (@0x7fffa41c7d42) received by PID 61396 (TID
>> > >>> 0x7fffacfb23c0) stack trace: ***
>> > >>>     @     0x7fffa42a8b3a _sigtramp
>> > >>>
>> > >>> For this latter issue, I believe we ran into this with Flight last
>> > >>> release. MacOS generates very long temporary directory paths, and
>> this
>> > >>> usually exceeds the limit on domain socket path lengths. (I also
>> can't
>> > >>> get mktemp to respect TMPDIR.)
>> > >>>
>> > >>> Best,
>> > >>> David
>> > >>>
>> > >>>
>> > >>> On 9/27/19, Micah Kornfield <em...@gmail.com> wrote:
>> > >>> > Hi,
>> > >>> >
>> > >>> >
>> > >>> > I would like to propose the following release candidate (RC1) of
>> Apache
>> > >>> >
>> > >>> > Arrow version 0.15.0. This is a release consisting of 672
>> > >>> >
>> > >>> > resolved JIRA issues[1]. (RC0 was aborted due to release script
>> > >>> issues).
>> > >>> >
>> > >>> >
>> > >>> > This release candidate is based on commit:
>> > >>> >
>> > >>> > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
>> > >>> >
>> > >>> >
>> > >>> > The source release rc1 is hosted at [3].
>> > >>> >
>> > >>> > The binary artifacts are hosted at [4][5][6][7].
>> > >>> >
>> > >>> > The changelog is located at [8].
>> > >>> >
>> > >>> >
>> > >>> > Please download, verify checksums and signatures, run the unit
>> tests,
>> > >>> >
>> > >>> > and vote on the release. See [9] for how to validate a release
>> > >>> candidate.
>> > >>> >
>> > >>> >
>> > >>> > The vote will be open for at least 72 hours.
>> > >>> >
>> > >>> >
>> > >>> > [ ] +1 Release this as Apache Arrow 0.15.0
>> > >>> >
>> > >>> > [ ] +0
>> > >>> >
>> > >>> > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
>> > >>> >
>> > >>> >
>> > >>> > [1]:
>> > >>> >
>> > >>>
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
>> > >>> >
>> > >>> > [2]:
>> > >>> >
>> > >>>
>> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
>> > >>> >
>> > >>> > [3]:
>> > >>> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
>> > >>> >
>> > >>> > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
>> > >>> >
>> > >>> > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
>> > >>> >
>> > >>> > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
>> > >>> >
>> > >>> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
>> > >>> >
>> > >>> > [8]:
>> > >>> >
>> > >>>
>> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
>> > >>> >
>> > >>> > [9]:
>> > >>> >
>> > >>>
>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> > >>> >
>> > >>>
>> > >>
>>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Wes McKinney <we...@gmail.com>.
It definitely isn't ideal. It might be more expedient for Krisztián to cut
an RC2 and sort out the GPG issue for you for next time. If we go that
route are there any additional patches we want to include in a new RC?

On Fri, Sep 27, 2019, 8:46 PM Micah Kornfield <em...@gmail.com> wrote:

> I'm seeing issues with a bad signature on Centos binaries (I had to
> regenerate some files here because my signature was initially missing from
> the dev KEYS file).  Can anyone else confirm?
>
> Also, for Debian and Ubuntu I'm seeing warnings about not being able to
> verify the identify of my signature (I assume because I am not in the web
> of trust).  Not sure if we care about the optics on this.
>
> Thanks,
> Micah
>
> On Fri, Sep 27, 2019 at 12:01 PM Wes McKinney <we...@gmail.com> wrote:
>
>> @David -- the macOS conda-based build is a bit finicky due to the
>> SDK-related issues. In any case since we can successfully produce
>> macOS binaries for Homebrew and wheel/conda, that's the most important
>> thing, though we should aim for a more refined out-of-the-box
>> development experience
>>
>> Not sure if
>> https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst
>> contains any helpful environment configuration related information
>>
>> On Fri, Sep 27, 2019 at 9:56 AM Micah Kornfield <em...@gmail.com>
>> wrote:
>> >
>> > >
>> > > I checked in the key to
>> https://dist.apache.org/repos/dist/release/arrow/.
>> > > Is there something else I need to do to make it available for
>> verification?
>> >
>> > To answer my own question I think I missed adding them to the the dev
>> > branch (I just did this so hopefully they will propagate soon).
>> >
>> > On Fri, Sep 27, 2019 at 8:46 AM Micah Kornfield <em...@gmail.com>
>> > wrote:
>> >
>> > > I found that Micah's GPG key did not seem to be in KEYS and had to
>> > >> import it manually.
>> > >
>> > >
>> > > I checked in the key to
>> https://dist.apache.org/repos/dist/release/arrow/.
>> > > Is there something else I need to do to make it available for
>> verification?
>> > >
>> > > On Fri, Sep 27, 2019 at 7:45 AM Andy Grove <an...@gmail.com>
>> wrote:
>> > >
>> > >> +1 for Rust implementation. Tests run fine out the box. Version
>> numbers
>> > >> are correct.
>> > >>
>> > >> On Fri, Sep 27, 2019 at 7:26 AM David Li <li...@gmail.com>
>> wrote:
>> > >>
>> > >>> I ran the source verification script on MacOS 10.12 (Sierra).
>> > >>>
>> > >>> I found that Micah's GPG key did not seem to be in KEYS and had to
>> > >>> import it manually.
>> > >>>
>> > >>> Python failed in pyarrow/tests/test_cython.py::test_cython_api when
>> > >>> invoking gcc. Is this the MacOS conda toolchain issue? It works if I
>> > >>> add `-stdlib=libc++` to the compiler options
>> > >>> (https://stackoverflow.com/questions/40301619)
>> > >>>
>> > >>> Compiling pyarrow_cython_example.pyx because it changed.
>> > >>> [1/1] Cythonizing pyarrow_cython_example.pyx
>> > >>> Extension module:
>> > >>> <distutils.extension.Extension('pyarrow_cython_example') at
>> > >>> 0x112c40390>
>> > >>>
>> ['/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include',
>> > >>>
>> > >>>
>> '/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include']
>> > >>> ['arrow', 'arrow_python']
>> > >>>
>> > >>>
>> ['/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow',
>> > >>>
>> > >>>
>> '/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/install/lib']
>> > >>> running build_ext
>> > >>> building 'pyarrow_cython_example' extension
>> > >>> creating build
>> > >>> creating build/temp.macosx-10.7-x86_64-3.6
>> > >>> gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g
>> > >>> -fwrapv -O3 -Wall -Wstrict-prototypes
>> > >>>
>> > >>>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
>> > >>> -arch x86_64
>> > >>>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
>> > >>> -arch x86_64
>> > >>>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include
>> > >>>
>> > >>>
>> -I/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include
>> > >>>
>> > >>>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include/python3.6m
>> > >>> -c pyarrow_cython_example.cpp -o
>> > >>> build/temp.macosx-10.7-x86_64-3.6/pyarrow_cython_example.o
>> -std=c++11
>> > >>>
>> > >>> pyarrow_cython_example.cpp:634:10: fatal error: 'unordered_map'
>> file not
>> > >>> found
>> > >>> #include <unordered_map>
>> > >>>          ^~~~~~~~~~~~~~~
>> > >>> 1 error generated.
>> > >>> error: command 'gcc' failed with exit status 1
>> > >>>
>> > >>>
>> > >>> It also failed in all the tests in
>> > >>> pyarrow/tests/test_plasma.py::TestPlasmaClient:
>> > >>>
>> > >>> WARNING: Logging before InitGoogleLogging() is written to STDERR
>> > >>> I0927 08:54:13.048408 2902139840 store.cc:1149] Allowing the Plasma
>> > >>> store to use up to 0.1GB of memory.
>> > >>> I0927 08:54:13.049072 2902139840 store.cc:1176] Starting object
>> store
>> > >>> with directory /tmp and huge page support disabled
>> > >>> E0927 08:54:13.049446 2902139840 io.cc:137] Socket pathname is too
>> long.
>> > >>> F0927 08:54:13.049515 2902139840 store.cc:1074]  Check failed:
>> socket >=
>> > >>> 0
>> > >>> *** Check failure stack trace: ***
>> > >>> *** Aborted at 1569588853 (unix time) try "date -d @1569588853" if
>> you
>> > >>> are using GNU date ***
>> > >>> PC: @                0x0 (unknown)
>> > >>> *** SIGABRT (@0x7fffa41c7d42) received by PID 61396 (TID
>> > >>> 0x7fffacfb23c0) stack trace: ***
>> > >>>     @     0x7fffa42a8b3a _sigtramp
>> > >>>
>> > >>> For this latter issue, I believe we ran into this with Flight last
>> > >>> release. MacOS generates very long temporary directory paths, and
>> this
>> > >>> usually exceeds the limit on domain socket path lengths. (I also
>> can't
>> > >>> get mktemp to respect TMPDIR.)
>> > >>>
>> > >>> Best,
>> > >>> David
>> > >>>
>> > >>>
>> > >>> On 9/27/19, Micah Kornfield <em...@gmail.com> wrote:
>> > >>> > Hi,
>> > >>> >
>> > >>> >
>> > >>> > I would like to propose the following release candidate (RC1) of
>> Apache
>> > >>> >
>> > >>> > Arrow version 0.15.0. This is a release consisting of 672
>> > >>> >
>> > >>> > resolved JIRA issues[1]. (RC0 was aborted due to release script
>> > >>> issues).
>> > >>> >
>> > >>> >
>> > >>> > This release candidate is based on commit:
>> > >>> >
>> > >>> > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
>> > >>> >
>> > >>> >
>> > >>> > The source release rc1 is hosted at [3].
>> > >>> >
>> > >>> > The binary artifacts are hosted at [4][5][6][7].
>> > >>> >
>> > >>> > The changelog is located at [8].
>> > >>> >
>> > >>> >
>> > >>> > Please download, verify checksums and signatures, run the unit
>> tests,
>> > >>> >
>> > >>> > and vote on the release. See [9] for how to validate a release
>> > >>> candidate.
>> > >>> >
>> > >>> >
>> > >>> > The vote will be open for at least 72 hours.
>> > >>> >
>> > >>> >
>> > >>> > [ ] +1 Release this as Apache Arrow 0.15.0
>> > >>> >
>> > >>> > [ ] +0
>> > >>> >
>> > >>> > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
>> > >>> >
>> > >>> >
>> > >>> > [1]:
>> > >>> >
>> > >>>
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
>> > >>> >
>> > >>> > [2]:
>> > >>> >
>> > >>>
>> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
>> > >>> >
>> > >>> > [3]:
>> > >>>
>> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
>> > >>> >
>> > >>> > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
>> > >>> >
>> > >>> > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
>> > >>> >
>> > >>> > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
>> > >>> >
>> > >>> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
>> > >>> >
>> > >>> > [8]:
>> > >>> >
>> > >>>
>> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
>> > >>> >
>> > >>> > [9]:
>> > >>> >
>> > >>>
>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> > >>> >
>> > >>>
>> > >>
>>
>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Micah Kornfield <em...@gmail.com>.
I'm seeing issues with a bad signature on Centos binaries (I had to
regenerate some files here because my signature was initially missing from
the dev KEYS file).  Can anyone else confirm?

Also, for Debian and Ubuntu I'm seeing warnings about not being able to
verify the identify of my signature (I assume because I am not in the web
of trust).  Not sure if we care about the optics on this.

Thanks,
Micah

On Fri, Sep 27, 2019 at 12:01 PM Wes McKinney <we...@gmail.com> wrote:

> @David -- the macOS conda-based build is a bit finicky due to the
> SDK-related issues. In any case since we can successfully produce
> macOS binaries for Homebrew and wheel/conda, that's the most important
> thing, though we should aim for a more refined out-of-the-box
> development experience
>
> Not sure if
> https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst
> contains any helpful environment configuration related information
>
> On Fri, Sep 27, 2019 at 9:56 AM Micah Kornfield <em...@gmail.com>
> wrote:
> >
> > >
> > > I checked in the key to
> https://dist.apache.org/repos/dist/release/arrow/.
> > > Is there something else I need to do to make it available for
> verification?
> >
> > To answer my own question I think I missed adding them to the the dev
> > branch (I just did this so hopefully they will propagate soon).
> >
> > On Fri, Sep 27, 2019 at 8:46 AM Micah Kornfield <em...@gmail.com>
> > wrote:
> >
> > > I found that Micah's GPG key did not seem to be in KEYS and had to
> > >> import it manually.
> > >
> > >
> > > I checked in the key to
> https://dist.apache.org/repos/dist/release/arrow/.
> > > Is there something else I need to do to make it available for
> verification?
> > >
> > > On Fri, Sep 27, 2019 at 7:45 AM Andy Grove <an...@gmail.com>
> wrote:
> > >
> > >> +1 for Rust implementation. Tests run fine out the box. Version
> numbers
> > >> are correct.
> > >>
> > >> On Fri, Sep 27, 2019 at 7:26 AM David Li <li...@gmail.com>
> wrote:
> > >>
> > >>> I ran the source verification script on MacOS 10.12 (Sierra).
> > >>>
> > >>> I found that Micah's GPG key did not seem to be in KEYS and had to
> > >>> import it manually.
> > >>>
> > >>> Python failed in pyarrow/tests/test_cython.py::test_cython_api when
> > >>> invoking gcc. Is this the MacOS conda toolchain issue? It works if I
> > >>> add `-stdlib=libc++` to the compiler options
> > >>> (https://stackoverflow.com/questions/40301619)
> > >>>
> > >>> Compiling pyarrow_cython_example.pyx because it changed.
> > >>> [1/1] Cythonizing pyarrow_cython_example.pyx
> > >>> Extension module:
> > >>> <distutils.extension.Extension('pyarrow_cython_example') at
> > >>> 0x112c40390>
> > >>>
> ['/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include',
> > >>>
> > >>>
> '/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include']
> > >>> ['arrow', 'arrow_python']
> > >>>
> > >>>
> ['/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow',
> > >>>
> > >>>
> '/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/install/lib']
> > >>> running build_ext
> > >>> building 'pyarrow_cython_example' extension
> > >>> creating build
> > >>> creating build/temp.macosx-10.7-x86_64-3.6
> > >>> gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g
> > >>> -fwrapv -O3 -Wall -Wstrict-prototypes
> > >>>
> > >>>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
> > >>> -arch x86_64
> > >>>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
> > >>> -arch x86_64
> > >>>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include
> > >>>
> > >>>
> -I/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include
> > >>>
> > >>>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include/python3.6m
> > >>> -c pyarrow_cython_example.cpp -o
> > >>> build/temp.macosx-10.7-x86_64-3.6/pyarrow_cython_example.o -std=c++11
> > >>>
> > >>> pyarrow_cython_example.cpp:634:10: fatal error: 'unordered_map' file
> not
> > >>> found
> > >>> #include <unordered_map>
> > >>>          ^~~~~~~~~~~~~~~
> > >>> 1 error generated.
> > >>> error: command 'gcc' failed with exit status 1
> > >>>
> > >>>
> > >>> It also failed in all the tests in
> > >>> pyarrow/tests/test_plasma.py::TestPlasmaClient:
> > >>>
> > >>> WARNING: Logging before InitGoogleLogging() is written to STDERR
> > >>> I0927 08:54:13.048408 2902139840 store.cc:1149] Allowing the Plasma
> > >>> store to use up to 0.1GB of memory.
> > >>> I0927 08:54:13.049072 2902139840 store.cc:1176] Starting object store
> > >>> with directory /tmp and huge page support disabled
> > >>> E0927 08:54:13.049446 2902139840 io.cc:137] Socket pathname is too
> long.
> > >>> F0927 08:54:13.049515 2902139840 store.cc:1074]  Check failed:
> socket >=
> > >>> 0
> > >>> *** Check failure stack trace: ***
> > >>> *** Aborted at 1569588853 (unix time) try "date -d @1569588853" if
> you
> > >>> are using GNU date ***
> > >>> PC: @                0x0 (unknown)
> > >>> *** SIGABRT (@0x7fffa41c7d42) received by PID 61396 (TID
> > >>> 0x7fffacfb23c0) stack trace: ***
> > >>>     @     0x7fffa42a8b3a _sigtramp
> > >>>
> > >>> For this latter issue, I believe we ran into this with Flight last
> > >>> release. MacOS generates very long temporary directory paths, and
> this
> > >>> usually exceeds the limit on domain socket path lengths. (I also
> can't
> > >>> get mktemp to respect TMPDIR.)
> > >>>
> > >>> Best,
> > >>> David
> > >>>
> > >>>
> > >>> On 9/27/19, Micah Kornfield <em...@gmail.com> wrote:
> > >>> > Hi,
> > >>> >
> > >>> >
> > >>> > I would like to propose the following release candidate (RC1) of
> Apache
> > >>> >
> > >>> > Arrow version 0.15.0. This is a release consisting of 672
> > >>> >
> > >>> > resolved JIRA issues[1]. (RC0 was aborted due to release script
> > >>> issues).
> > >>> >
> > >>> >
> > >>> > This release candidate is based on commit:
> > >>> >
> > >>> > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
> > >>> >
> > >>> >
> > >>> > The source release rc1 is hosted at [3].
> > >>> >
> > >>> > The binary artifacts are hosted at [4][5][6][7].
> > >>> >
> > >>> > The changelog is located at [8].
> > >>> >
> > >>> >
> > >>> > Please download, verify checksums and signatures, run the unit
> tests,
> > >>> >
> > >>> > and vote on the release. See [9] for how to validate a release
> > >>> candidate.
> > >>> >
> > >>> >
> > >>> > The vote will be open for at least 72 hours.
> > >>> >
> > >>> >
> > >>> > [ ] +1 Release this as Apache Arrow 0.15.0
> > >>> >
> > >>> > [ ] +0
> > >>> >
> > >>> > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
> > >>> >
> > >>> >
> > >>> > [1]:
> > >>> >
> > >>>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
> > >>> >
> > >>> > [2]:
> > >>> >
> > >>>
> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
> > >>> >
> > >>> > [3]:
> > >>> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
> > >>> >
> > >>> > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
> > >>> >
> > >>> > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
> > >>> >
> > >>> > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
> > >>> >
> > >>> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
> > >>> >
> > >>> > [8]:
> > >>> >
> > >>>
> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
> > >>> >
> > >>> > [9]:
> > >>> >
> > >>>
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > >>> >
> > >>>
> > >>
>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Wes McKinney <we...@gmail.com>.
@David -- the macOS conda-based build is a bit finicky due to the
SDK-related issues. In any case since we can successfully produce
macOS binaries for Homebrew and wheel/conda, that's the most important
thing, though we should aim for a more refined out-of-the-box
development experience

Not sure if https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst
contains any helpful environment configuration related information

On Fri, Sep 27, 2019 at 9:56 AM Micah Kornfield <em...@gmail.com> wrote:
>
> >
> > I checked in the key to https://dist.apache.org/repos/dist/release/arrow/.
> > Is there something else I need to do to make it available for verification?
>
> To answer my own question I think I missed adding them to the the dev
> branch (I just did this so hopefully they will propagate soon).
>
> On Fri, Sep 27, 2019 at 8:46 AM Micah Kornfield <em...@gmail.com>
> wrote:
>
> > I found that Micah's GPG key did not seem to be in KEYS and had to
> >> import it manually.
> >
> >
> > I checked in the key to https://dist.apache.org/repos/dist/release/arrow/.
> > Is there something else I need to do to make it available for verification?
> >
> > On Fri, Sep 27, 2019 at 7:45 AM Andy Grove <an...@gmail.com> wrote:
> >
> >> +1 for Rust implementation. Tests run fine out the box. Version numbers
> >> are correct.
> >>
> >> On Fri, Sep 27, 2019 at 7:26 AM David Li <li...@gmail.com> wrote:
> >>
> >>> I ran the source verification script on MacOS 10.12 (Sierra).
> >>>
> >>> I found that Micah's GPG key did not seem to be in KEYS and had to
> >>> import it manually.
> >>>
> >>> Python failed in pyarrow/tests/test_cython.py::test_cython_api when
> >>> invoking gcc. Is this the MacOS conda toolchain issue? It works if I
> >>> add `-stdlib=libc++` to the compiler options
> >>> (https://stackoverflow.com/questions/40301619)
> >>>
> >>> Compiling pyarrow_cython_example.pyx because it changed.
> >>> [1/1] Cythonizing pyarrow_cython_example.pyx
> >>> Extension module:
> >>> <distutils.extension.Extension('pyarrow_cython_example') at
> >>> 0x112c40390>
> >>> ['/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include',
> >>>
> >>> '/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include']
> >>> ['arrow', 'arrow_python']
> >>>
> >>> ['/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow',
> >>>
> >>> '/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/install/lib']
> >>> running build_ext
> >>> building 'pyarrow_cython_example' extension
> >>> creating build
> >>> creating build/temp.macosx-10.7-x86_64-3.6
> >>> gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g
> >>> -fwrapv -O3 -Wall -Wstrict-prototypes
> >>>
> >>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
> >>> -arch x86_64
> >>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
> >>> -arch x86_64
> >>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include
> >>>
> >>> -I/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include
> >>>
> >>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include/python3.6m
> >>> -c pyarrow_cython_example.cpp -o
> >>> build/temp.macosx-10.7-x86_64-3.6/pyarrow_cython_example.o -std=c++11
> >>>
> >>> pyarrow_cython_example.cpp:634:10: fatal error: 'unordered_map' file not
> >>> found
> >>> #include <unordered_map>
> >>>          ^~~~~~~~~~~~~~~
> >>> 1 error generated.
> >>> error: command 'gcc' failed with exit status 1
> >>>
> >>>
> >>> It also failed in all the tests in
> >>> pyarrow/tests/test_plasma.py::TestPlasmaClient:
> >>>
> >>> WARNING: Logging before InitGoogleLogging() is written to STDERR
> >>> I0927 08:54:13.048408 2902139840 store.cc:1149] Allowing the Plasma
> >>> store to use up to 0.1GB of memory.
> >>> I0927 08:54:13.049072 2902139840 store.cc:1176] Starting object store
> >>> with directory /tmp and huge page support disabled
> >>> E0927 08:54:13.049446 2902139840 io.cc:137] Socket pathname is too long.
> >>> F0927 08:54:13.049515 2902139840 store.cc:1074]  Check failed: socket >=
> >>> 0
> >>> *** Check failure stack trace: ***
> >>> *** Aborted at 1569588853 (unix time) try "date -d @1569588853" if you
> >>> are using GNU date ***
> >>> PC: @                0x0 (unknown)
> >>> *** SIGABRT (@0x7fffa41c7d42) received by PID 61396 (TID
> >>> 0x7fffacfb23c0) stack trace: ***
> >>>     @     0x7fffa42a8b3a _sigtramp
> >>>
> >>> For this latter issue, I believe we ran into this with Flight last
> >>> release. MacOS generates very long temporary directory paths, and this
> >>> usually exceeds the limit on domain socket path lengths. (I also can't
> >>> get mktemp to respect TMPDIR.)
> >>>
> >>> Best,
> >>> David
> >>>
> >>>
> >>> On 9/27/19, Micah Kornfield <em...@gmail.com> wrote:
> >>> > Hi,
> >>> >
> >>> >
> >>> > I would like to propose the following release candidate (RC1) of Apache
> >>> >
> >>> > Arrow version 0.15.0. This is a release consisting of 672
> >>> >
> >>> > resolved JIRA issues[1]. (RC0 was aborted due to release script
> >>> issues).
> >>> >
> >>> >
> >>> > This release candidate is based on commit:
> >>> >
> >>> > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
> >>> >
> >>> >
> >>> > The source release rc1 is hosted at [3].
> >>> >
> >>> > The binary artifacts are hosted at [4][5][6][7].
> >>> >
> >>> > The changelog is located at [8].
> >>> >
> >>> >
> >>> > Please download, verify checksums and signatures, run the unit tests,
> >>> >
> >>> > and vote on the release. See [9] for how to validate a release
> >>> candidate.
> >>> >
> >>> >
> >>> > The vote will be open for at least 72 hours.
> >>> >
> >>> >
> >>> > [ ] +1 Release this as Apache Arrow 0.15.0
> >>> >
> >>> > [ ] +0
> >>> >
> >>> > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
> >>> >
> >>> >
> >>> > [1]:
> >>> >
> >>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
> >>> >
> >>> > [2]:
> >>> >
> >>> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
> >>> >
> >>> > [3]:
> >>> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
> >>> >
> >>> > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
> >>> >
> >>> > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
> >>> >
> >>> > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
> >>> >
> >>> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
> >>> >
> >>> > [8]:
> >>> >
> >>> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
> >>> >
> >>> > [9]:
> >>> >
> >>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >>> >
> >>>
> >>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Micah Kornfield <em...@gmail.com>.
>
> I checked in the key to https://dist.apache.org/repos/dist/release/arrow/.
> Is there something else I need to do to make it available for verification?

To answer my own question I think I missed adding them to the the dev
branch (I just did this so hopefully they will propagate soon).

On Fri, Sep 27, 2019 at 8:46 AM Micah Kornfield <em...@gmail.com>
wrote:

> I found that Micah's GPG key did not seem to be in KEYS and had to
>> import it manually.
>
>
> I checked in the key to https://dist.apache.org/repos/dist/release/arrow/.
> Is there something else I need to do to make it available for verification?
>
> On Fri, Sep 27, 2019 at 7:45 AM Andy Grove <an...@gmail.com> wrote:
>
>> +1 for Rust implementation. Tests run fine out the box. Version numbers
>> are correct.
>>
>> On Fri, Sep 27, 2019 at 7:26 AM David Li <li...@gmail.com> wrote:
>>
>>> I ran the source verification script on MacOS 10.12 (Sierra).
>>>
>>> I found that Micah's GPG key did not seem to be in KEYS and had to
>>> import it manually.
>>>
>>> Python failed in pyarrow/tests/test_cython.py::test_cython_api when
>>> invoking gcc. Is this the MacOS conda toolchain issue? It works if I
>>> add `-stdlib=libc++` to the compiler options
>>> (https://stackoverflow.com/questions/40301619)
>>>
>>> Compiling pyarrow_cython_example.pyx because it changed.
>>> [1/1] Cythonizing pyarrow_cython_example.pyx
>>> Extension module:
>>> <distutils.extension.Extension('pyarrow_cython_example') at
>>> 0x112c40390>
>>> ['/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include',
>>>
>>> '/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include']
>>> ['arrow', 'arrow_python']
>>>
>>> ['/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow',
>>>
>>> '/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/install/lib']
>>> running build_ext
>>> building 'pyarrow_cython_example' extension
>>> creating build
>>> creating build/temp.macosx-10.7-x86_64-3.6
>>> gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g
>>> -fwrapv -O3 -Wall -Wstrict-prototypes
>>>
>>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
>>> -arch x86_64
>>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
>>> -arch x86_64
>>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include
>>>
>>> -I/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include
>>>
>>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include/python3.6m
>>> -c pyarrow_cython_example.cpp -o
>>> build/temp.macosx-10.7-x86_64-3.6/pyarrow_cython_example.o -std=c++11
>>>
>>> pyarrow_cython_example.cpp:634:10: fatal error: 'unordered_map' file not
>>> found
>>> #include <unordered_map>
>>>          ^~~~~~~~~~~~~~~
>>> 1 error generated.
>>> error: command 'gcc' failed with exit status 1
>>>
>>>
>>> It also failed in all the tests in
>>> pyarrow/tests/test_plasma.py::TestPlasmaClient:
>>>
>>> WARNING: Logging before InitGoogleLogging() is written to STDERR
>>> I0927 08:54:13.048408 2902139840 store.cc:1149] Allowing the Plasma
>>> store to use up to 0.1GB of memory.
>>> I0927 08:54:13.049072 2902139840 store.cc:1176] Starting object store
>>> with directory /tmp and huge page support disabled
>>> E0927 08:54:13.049446 2902139840 io.cc:137] Socket pathname is too long.
>>> F0927 08:54:13.049515 2902139840 store.cc:1074]  Check failed: socket >=
>>> 0
>>> *** Check failure stack trace: ***
>>> *** Aborted at 1569588853 (unix time) try "date -d @1569588853" if you
>>> are using GNU date ***
>>> PC: @                0x0 (unknown)
>>> *** SIGABRT (@0x7fffa41c7d42) received by PID 61396 (TID
>>> 0x7fffacfb23c0) stack trace: ***
>>>     @     0x7fffa42a8b3a _sigtramp
>>>
>>> For this latter issue, I believe we ran into this with Flight last
>>> release. MacOS generates very long temporary directory paths, and this
>>> usually exceeds the limit on domain socket path lengths. (I also can't
>>> get mktemp to respect TMPDIR.)
>>>
>>> Best,
>>> David
>>>
>>>
>>> On 9/27/19, Micah Kornfield <em...@gmail.com> wrote:
>>> > Hi,
>>> >
>>> >
>>> > I would like to propose the following release candidate (RC1) of Apache
>>> >
>>> > Arrow version 0.15.0. This is a release consisting of 672
>>> >
>>> > resolved JIRA issues[1]. (RC0 was aborted due to release script
>>> issues).
>>> >
>>> >
>>> > This release candidate is based on commit:
>>> >
>>> > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
>>> >
>>> >
>>> > The source release rc1 is hosted at [3].
>>> >
>>> > The binary artifacts are hosted at [4][5][6][7].
>>> >
>>> > The changelog is located at [8].
>>> >
>>> >
>>> > Please download, verify checksums and signatures, run the unit tests,
>>> >
>>> > and vote on the release. See [9] for how to validate a release
>>> candidate.
>>> >
>>> >
>>> > The vote will be open for at least 72 hours.
>>> >
>>> >
>>> > [ ] +1 Release this as Apache Arrow 0.15.0
>>> >
>>> > [ ] +0
>>> >
>>> > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
>>> >
>>> >
>>> > [1]:
>>> >
>>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
>>> >
>>> > [2]:
>>> >
>>> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
>>> >
>>> > [3]:
>>> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
>>> >
>>> > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
>>> >
>>> > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
>>> >
>>> > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
>>> >
>>> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
>>> >
>>> > [8]:
>>> >
>>> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
>>> >
>>> > [9]:
>>> >
>>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>>> >
>>>
>>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Micah Kornfield <em...@gmail.com>.
>
> I found that Micah's GPG key did not seem to be in KEYS and had to
> import it manually.


I checked in the key to https://dist.apache.org/repos/dist/release/arrow/.
Is there something else I need to do to make it available for verification?

On Fri, Sep 27, 2019 at 7:45 AM Andy Grove <an...@gmail.com> wrote:

> +1 for Rust implementation. Tests run fine out the box. Version numbers
> are correct.
>
> On Fri, Sep 27, 2019 at 7:26 AM David Li <li...@gmail.com> wrote:
>
>> I ran the source verification script on MacOS 10.12 (Sierra).
>>
>> I found that Micah's GPG key did not seem to be in KEYS and had to
>> import it manually.
>>
>> Python failed in pyarrow/tests/test_cython.py::test_cython_api when
>> invoking gcc. Is this the MacOS conda toolchain issue? It works if I
>> add `-stdlib=libc++` to the compiler options
>> (https://stackoverflow.com/questions/40301619)
>>
>> Compiling pyarrow_cython_example.pyx because it changed.
>> [1/1] Cythonizing pyarrow_cython_example.pyx
>> Extension module:
>> <distutils.extension.Extension('pyarrow_cython_example') at
>> 0x112c40390>
>> ['/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include',
>>
>> '/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include']
>> ['arrow', 'arrow_python']
>>
>> ['/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow',
>>
>> '/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/install/lib']
>> running build_ext
>> building 'pyarrow_cython_example' extension
>> creating build
>> creating build/temp.macosx-10.7-x86_64-3.6
>> gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g
>> -fwrapv -O3 -Wall -Wstrict-prototypes
>>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
>> -arch x86_64
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
>> -arch x86_64
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include
>>
>> -I/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include
>>
>> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include/python3.6m
>> -c pyarrow_cython_example.cpp -o
>> build/temp.macosx-10.7-x86_64-3.6/pyarrow_cython_example.o -std=c++11
>>
>> pyarrow_cython_example.cpp:634:10: fatal error: 'unordered_map' file not
>> found
>> #include <unordered_map>
>>          ^~~~~~~~~~~~~~~
>> 1 error generated.
>> error: command 'gcc' failed with exit status 1
>>
>>
>> It also failed in all the tests in
>> pyarrow/tests/test_plasma.py::TestPlasmaClient:
>>
>> WARNING: Logging before InitGoogleLogging() is written to STDERR
>> I0927 08:54:13.048408 2902139840 store.cc:1149] Allowing the Plasma
>> store to use up to 0.1GB of memory.
>> I0927 08:54:13.049072 2902139840 store.cc:1176] Starting object store
>> with directory /tmp and huge page support disabled
>> E0927 08:54:13.049446 2902139840 io.cc:137] Socket pathname is too long.
>> F0927 08:54:13.049515 2902139840 store.cc:1074]  Check failed: socket >= 0
>> *** Check failure stack trace: ***
>> *** Aborted at 1569588853 (unix time) try "date -d @1569588853" if you
>> are using GNU date ***
>> PC: @                0x0 (unknown)
>> *** SIGABRT (@0x7fffa41c7d42) received by PID 61396 (TID
>> 0x7fffacfb23c0) stack trace: ***
>>     @     0x7fffa42a8b3a _sigtramp
>>
>> For this latter issue, I believe we ran into this with Flight last
>> release. MacOS generates very long temporary directory paths, and this
>> usually exceeds the limit on domain socket path lengths. (I also can't
>> get mktemp to respect TMPDIR.)
>>
>> Best,
>> David
>>
>>
>> On 9/27/19, Micah Kornfield <em...@gmail.com> wrote:
>> > Hi,
>> >
>> >
>> > I would like to propose the following release candidate (RC1) of Apache
>> >
>> > Arrow version 0.15.0. This is a release consisting of 672
>> >
>> > resolved JIRA issues[1]. (RC0 was aborted due to release script issues).
>> >
>> >
>> > This release candidate is based on commit:
>> >
>> > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
>> >
>> >
>> > The source release rc1 is hosted at [3].
>> >
>> > The binary artifacts are hosted at [4][5][6][7].
>> >
>> > The changelog is located at [8].
>> >
>> >
>> > Please download, verify checksums and signatures, run the unit tests,
>> >
>> > and vote on the release. See [9] for how to validate a release
>> candidate.
>> >
>> >
>> > The vote will be open for at least 72 hours.
>> >
>> >
>> > [ ] +1 Release this as Apache Arrow 0.15.0
>> >
>> > [ ] +0
>> >
>> > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
>> >
>> >
>> > [1]:
>> >
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
>> >
>> > [2]:
>> >
>> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
>> >
>> > [3]:
>> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
>> >
>> > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
>> >
>> > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
>> >
>> > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
>> >
>> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
>> >
>> > [8]:
>> >
>> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
>> >
>> > [9]:
>> >
>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> >
>>
>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Andy Grove <an...@gmail.com>.
+1 for Rust implementation. Tests run fine out the box. Version numbers are
correct.

On Fri, Sep 27, 2019 at 7:26 AM David Li <li...@gmail.com> wrote:

> I ran the source verification script on MacOS 10.12 (Sierra).
>
> I found that Micah's GPG key did not seem to be in KEYS and had to
> import it manually.
>
> Python failed in pyarrow/tests/test_cython.py::test_cython_api when
> invoking gcc. Is this the MacOS conda toolchain issue? It works if I
> add `-stdlib=libc++` to the compiler options
> (https://stackoverflow.com/questions/40301619)
>
> Compiling pyarrow_cython_example.pyx because it changed.
> [1/1] Cythonizing pyarrow_cython_example.pyx
> Extension module:
> <distutils.extension.Extension('pyarrow_cython_example') at
> 0x112c40390>
> ['/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include',
>
> '/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include']
> ['arrow', 'arrow_python']
>
> ['/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow',
>
> '/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/install/lib']
> running build_ext
> building 'pyarrow_cython_example' extension
> creating build
> creating build/temp.macosx-10.7-x86_64-3.6
> gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g
> -fwrapv -O3 -Wall -Wstrict-prototypes
>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
> -arch x86_64
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
> -arch x86_64
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include
>
> -I/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include
>
> -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include/python3.6m
> -c pyarrow_cython_example.cpp -o
> build/temp.macosx-10.7-x86_64-3.6/pyarrow_cython_example.o -std=c++11
>
> pyarrow_cython_example.cpp:634:10: fatal error: 'unordered_map' file not
> found
> #include <unordered_map>
>          ^~~~~~~~~~~~~~~
> 1 error generated.
> error: command 'gcc' failed with exit status 1
>
>
> It also failed in all the tests in
> pyarrow/tests/test_plasma.py::TestPlasmaClient:
>
> WARNING: Logging before InitGoogleLogging() is written to STDERR
> I0927 08:54:13.048408 2902139840 store.cc:1149] Allowing the Plasma
> store to use up to 0.1GB of memory.
> I0927 08:54:13.049072 2902139840 store.cc:1176] Starting object store
> with directory /tmp and huge page support disabled
> E0927 08:54:13.049446 2902139840 io.cc:137] Socket pathname is too long.
> F0927 08:54:13.049515 2902139840 store.cc:1074]  Check failed: socket >= 0
> *** Check failure stack trace: ***
> *** Aborted at 1569588853 (unix time) try "date -d @1569588853" if you
> are using GNU date ***
> PC: @                0x0 (unknown)
> *** SIGABRT (@0x7fffa41c7d42) received by PID 61396 (TID
> 0x7fffacfb23c0) stack trace: ***
>     @     0x7fffa42a8b3a _sigtramp
>
> For this latter issue, I believe we ran into this with Flight last
> release. MacOS generates very long temporary directory paths, and this
> usually exceeds the limit on domain socket path lengths. (I also can't
> get mktemp to respect TMPDIR.)
>
> Best,
> David
>
>
> On 9/27/19, Micah Kornfield <em...@gmail.com> wrote:
> > Hi,
> >
> >
> > I would like to propose the following release candidate (RC1) of Apache
> >
> > Arrow version 0.15.0. This is a release consisting of 672
> >
> > resolved JIRA issues[1]. (RC0 was aborted due to release script issues).
> >
> >
> > This release candidate is based on commit:
> >
> > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
> >
> >
> > The source release rc1 is hosted at [3].
> >
> > The binary artifacts are hosted at [4][5][6][7].
> >
> > The changelog is located at [8].
> >
> >
> > Please download, verify checksums and signatures, run the unit tests,
> >
> > and vote on the release. See [9] for how to validate a release candidate.
> >
> >
> > The vote will be open for at least 72 hours.
> >
> >
> > [ ] +1 Release this as Apache Arrow 0.15.0
> >
> > [ ] +0
> >
> > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
> >
> >
> > [1]:
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
> >
> > [2]:
> >
> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
> >
> > [3]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
> >
> > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
> >
> > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
> >
> > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
> >
> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
> >
> > [8]:
> >
> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
> >
> > [9]:
> >
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >
>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by David Li <li...@gmail.com>.
I ran the source verification script on MacOS 10.12 (Sierra).

I found that Micah's GPG key did not seem to be in KEYS and had to
import it manually.

Python failed in pyarrow/tests/test_cython.py::test_cython_api when
invoking gcc. Is this the MacOS conda toolchain issue? It works if I
add `-stdlib=libc++` to the compiler options
(https://stackoverflow.com/questions/40301619)

Compiling pyarrow_cython_example.pyx because it changed.
[1/1] Cythonizing pyarrow_cython_example.pyx
Extension module:
<distutils.extension.Extension('pyarrow_cython_example') at
0x112c40390> ['/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include',
'/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include']
['arrow', 'arrow_python']
['/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow',
'/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/install/lib']
running build_ext
building 'pyarrow_cython_example' extension
creating build
creating build/temp.macosx-10.7-x86_64-3.6
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g
-fwrapv -O3 -Wall -Wstrict-prototypes
-I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
-arch x86_64 -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include
-arch x86_64 -I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/lib/python3.6/site-packages/numpy/core/include
-I/private/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/python/pyarrow/include
-I/var/folders/tm/b4drxjmn7j79gtp0ppbw5qlh0000gn/T/arrow-0.15.0.XXXXX.O0gHnUyz/apache-arrow-0.15.0/test-miniconda/envs/arrow-test/include/python3.6m
-c pyarrow_cython_example.cpp -o
build/temp.macosx-10.7-x86_64-3.6/pyarrow_cython_example.o -std=c++11

pyarrow_cython_example.cpp:634:10: fatal error: 'unordered_map' file not found
#include <unordered_map>
         ^~~~~~~~~~~~~~~
1 error generated.
error: command 'gcc' failed with exit status 1


It also failed in all the tests in
pyarrow/tests/test_plasma.py::TestPlasmaClient:

WARNING: Logging before InitGoogleLogging() is written to STDERR
I0927 08:54:13.048408 2902139840 store.cc:1149] Allowing the Plasma
store to use up to 0.1GB of memory.
I0927 08:54:13.049072 2902139840 store.cc:1176] Starting object store
with directory /tmp and huge page support disabled
E0927 08:54:13.049446 2902139840 io.cc:137] Socket pathname is too long.
F0927 08:54:13.049515 2902139840 store.cc:1074]  Check failed: socket >= 0
*** Check failure stack trace: ***
*** Aborted at 1569588853 (unix time) try "date -d @1569588853" if you
are using GNU date ***
PC: @                0x0 (unknown)
*** SIGABRT (@0x7fffa41c7d42) received by PID 61396 (TID
0x7fffacfb23c0) stack trace: ***
    @     0x7fffa42a8b3a _sigtramp

For this latter issue, I believe we ran into this with Flight last
release. MacOS generates very long temporary directory paths, and this
usually exceeds the limit on domain socket path lengths. (I also can't
get mktemp to respect TMPDIR.)

Best,
David


On 9/27/19, Micah Kornfield <em...@gmail.com> wrote:
> Hi,
>
>
> I would like to propose the following release candidate (RC1) of Apache
>
> Arrow version 0.15.0. This is a release consisting of 672
>
> resolved JIRA issues[1]. (RC0 was aborted due to release script issues).
>
>
> This release candidate is based on commit:
>
> 77f091888dbe5a4e023a66b986a2dd474696061a [2]
>
>
> The source release rc1 is hosted at [3].
>
> The binary artifacts are hosted at [4][5][6][7].
>
> The changelog is located at [8].
>
>
> Please download, verify checksums and signatures, run the unit tests,
>
> and vote on the release. See [9] for how to validate a release candidate.
>
>
> The vote will be open for at least 72 hours.
>
>
> [ ] +1 Release this as Apache Arrow 0.15.0
>
> [ ] +0
>
> [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
>
>
> [1]:
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
>
> [2]:
> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
>
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
>
> [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
>
> [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
>
> [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
>
> [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
>
> [8]:
> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
>
> [9]:
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Sutou Kouhei <ko...@clear-code.com>.
If we don't care the rustfmt check for release, how about
removing the check from
dev/release/verify-release-candidate.sh?

In <CA...@mail.gmail.com>
  "Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Sun, 29 Sep 2019 17:40:20 -0700,
  Andy Grove <an...@gmail.com> wrote:

> Actually, I think the RC was cut just before 1.40.0 nightly was released,
> which would explain why the rustfmt check fails now. As I think you already
> said, it doesn't really matter anyway since it is just a formatting
> difference.
> 
> On Sun, Sep 29, 2019 at 2:44 PM Sutou Kouhei <ko...@clear-code.com> wrote:
> 
>> I used dev/release/verify-release-candidate.sh. It install
>> Rust automatically.
>> Should we update
>>
>> https://github.com/apache/arrow/blob/master/dev/release/verify-release-candidate.sh#L452
>> ?
>>
>> In <CA...@mail.gmail.com>
>>   "Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Sun, 29 Sep
>> 2019 07:21:27 -0600,
>>   Andy Grove <an...@gmail.com> wrote:
>>
>> > Just fyi on the rustfmt issue, the formatting was recently updated for
>> rust
>> > 1.40 nightly and if you are using an older version the formatting check
>> > will fail.
>> >
>> > On Sun, Sep 29, 2019, 5:56 AM Wes McKinney <we...@gmail.com> wrote:
>> >
>> >> It's up to Micah as RM, but I think it would be good to fix the
>> sig-related
>> >> issues or we may be dealing with "bug" reports until the next release.
>> I'll
>> >> work on source verification later today in the meantime to see if any
>> other
>> >> issues turn up
>> >>
>> >> On Sun, Sep 29, 2019, 1:19 AM Sutou Kouhei <ko...@clear-code.com> wrote:
>> >>
>> >> > -0 (binding)
>> >> >
>> >> > I ran the followings on Debian GNU/Linux sid:
>> >> >
>> >> >   * TEST_CSHARP=0 \
>> >> >       TEST_GLIB=0 \
>> >> >       TEST_RUBY=0 \
>> >> >       TEST_RUST=0 \
>> >> >       JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
>> >> >       CUDA_TOOLKIT_ROOT=/usr \
>> >> >         dev/release/verify-release-candidate.sh source 0.15.0 1
>> >> >   * dev/release/verify-release-candidate.sh binaries 0.14.1 0
>> >> >
>> >> > with:
>> >> >
>> >> >   * gcc (Debian 9.2.1-7) 9.2.1
>> >> >   * openjdk version "1.8.0_212"
>> >> >   * Node.JS v12.1.0
>> >> >   * go version go1.12.9 linux/amd64
>> >> >   * nvidia-cuda-dev 10.1.105-3
>> >> >
>> >> >
>> >> > I got the following failures:
>> >> >
>> >> >   * Not ignorable:
>> >> >     * Binary: Bad signature
>> >> >       * centos-rc/6/Source/repodata/repomd.xml is failed
>> >> >       * We can't ignore this if removing the file from
>> >> >         https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1 and
>> >> >         re-uploading it doesn't solve this problem.
>> >> >
>> >> >   * Ignorable:
>> >> >     * C GLib and Ruby: Buildable but can't run test with GLib 2.62.0.
>> >> >       * It's caused by gobject-introspection gem.
>> >> >       * This is a known problem and not a C GLib problem.
>> >> >       * We can ignore this. (I'm fixing gobject-introspection gem.)
>> >> >     * Rust: "cargo +stable fmt --all -- --check" is failed (*)
>> >> >       * If I commented the command line out, Rust verification is
>> passed.
>> >> >       * We can ignore this. Because this is just a lint error.
>> >> >     * C#: "sourcelink test" is failed
>> >> >       * We can ignore this. This is happened when we release 0.14.1
>> too.
>> >> >     * APT and Yum: arm64 and aarch64 are broken
>> >> >       * We can ignore this.
>> >> >
>> >> > (*)
>> >> > ----
>> >> > + cargo +stable fmt --all -- --check
>> >> > Diff in
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/array/
>> >> > builder.rs at line 1458:
>> >> >          let mut builder = StructBuilder::new(fields, field_builders);
>> >> >          assert!(builder.field_builder::<BinaryBuilder>(0).is_none());
>> >> >      }
>> >> > -
>> >> >  }
>> >> >
>> >> > Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/
>> >> > bitmap.rs at line 126:
>> >> >          assert_eq!(true, bitmap.is_set(6));
>> >> >          assert_eq!(false, bitmap.is_set(7));
>> >> >      }
>> >> > -
>> >> >  }
>> >> >
>> >> > Diff in
>> >> >
>> >>
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>> >> > aggregate.rs at line 1471:
>> >> >              ds,
>> >> >          )))))
>> >> >      }
>> >> > -
>> >> >  }
>> >> >
>> >> > Diff in
>> >> >
>> >>
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>> >> > context.rs at line 682:
>> >> >
>> >> >          Ok(ctx)
>> >> >      }
>> >> > -
>> >> >  }
>> >> >
>> >> > Diff in
>> >> >
>> >>
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>> >> > hash_aggregate.rs at line 720:
>> >> >
>> >> >          Ok(())
>> >> >      }
>> >> > -
>> >> >  }
>> >> >
>> >> > Diff in
>> >> >
>> >>
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>> >> > merge.rs at line 134:
>> >> >
>> >> >          Ok(())
>> >> >      }
>> >> > -
>> >> >  }
>> >> >
>> >> > Diff in
>> >> >
>> >>
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>> >> > projection.rs at line 171:
>> >> >
>> >> >          Ok(())
>> >> >      }
>> >> > -
>> >> >  }
>> >> >
>> >> > Diff in
>> >> >
>> >>
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>> >> > selection.rs at line 180:
>> >> >
>> >> >          Ok(())
>> >> >      }
>> >> > -
>> >> >  }
>> >> >
>> >> > Diff in
>> >> >
>> >>
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>> >> > projection.rs at line 141:
>> >> >
>> >> >          assert_eq!("c1", batch.schema().field(0).name());
>> >> >      }
>> >> > -
>> >> >  }
>> >> >
>> >> > Diff in
>> >> >
>> >>
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>> >> > table_impl.rs at line 315:
>> >> >              true,
>> >> >          );
>> >> >      }
>> >> > -
>> >> >  }
>> >> >
>> >> > Diff in
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/
>> >> > logicalplan.rs at line 641:
>> >> >              println!("plan: {:?}", plan1);
>> >> >          });
>> >> >      }
>> >> > -
>> >> >  }
>> >> >
>> >> > Diff in
>> >> > /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/sql/
>> >> > planner.rs at line 569:
>> >> >              }
>> >> >          }
>> >> >      }
>> >> > -
>> >> >  }
>> >> > ----
>> >> >
>> >> >
>> >> >
>> >> > Thanks,
>> >> > --
>> >> > kou
>> >> >
>> >> > In <
>> CAK7Z5T9mamQWtObWmZMJV_tMhAnWGMtndpCmE+_RPQN3LsEKmQ@mail.gmail.com>
>> >> >   "Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep
>> 2019
>> >> > 02:18:05 -0600,
>> >> >   Micah Kornfield <em...@gmail.com> wrote:
>> >> >
>> >> > > Hi,
>> >> > >
>> >> > >
>> >> > > I would like to propose the following release candidate (RC1) of
>> Apache
>> >> > >
>> >> > > Arrow version 0.15.0. This is a release consisting of 672
>> >> > >
>> >> > > resolved JIRA issues[1]. (RC0 was aborted due to release script
>> >> issues).
>> >> > >
>> >> > >
>> >> > > This release candidate is based on commit:
>> >> > >
>> >> > > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
>> >> > >
>> >> > >
>> >> > > The source release rc1 is hosted at [3].
>> >> > >
>> >> > > The binary artifacts are hosted at [4][5][6][7].
>> >> > >
>> >> > > The changelog is located at [8].
>> >> > >
>> >> > >
>> >> > > Please download, verify checksums and signatures, run the unit
>> tests,
>> >> > >
>> >> > > and vote on the release. See [9] for how to validate a release
>> >> candidate.
>> >> > >
>> >> > >
>> >> > > The vote will be open for at least 72 hours.
>> >> > >
>> >> > >
>> >> > > [ ] +1 Release this as Apache Arrow 0.15.0
>> >> > >
>> >> > > [ ] +0
>> >> > >
>> >> > > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
>> >> > >
>> >> > >
>> >> > > [1]:
>> >> > >
>> >> >
>> >>
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
>> >> > >
>> >> > > [2]:
>> >> > >
>> >> >
>> >>
>> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
>> >> > >
>> >> > > [3]:
>> >> > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
>> >> > >
>> >> > > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
>> >> > >
>> >> > > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
>> >> > >
>> >> > > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
>> >> > >
>> >> > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
>> >> > >
>> >> > > [8]:
>> >> > >
>> >> >
>> >>
>> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
>> >> > >
>> >> > > [9]:
>> >> > >
>> >> >
>> >>
>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> >> >
>> >>
>>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Andy Grove <an...@gmail.com>.
Actually, I think the RC was cut just before 1.40.0 nightly was released,
which would explain why the rustfmt check fails now. As I think you already
said, it doesn't really matter anyway since it is just a formatting
difference.

On Sun, Sep 29, 2019 at 2:44 PM Sutou Kouhei <ko...@clear-code.com> wrote:

> I used dev/release/verify-release-candidate.sh. It install
> Rust automatically.
> Should we update
>
> https://github.com/apache/arrow/blob/master/dev/release/verify-release-candidate.sh#L452
> ?
>
> In <CA...@mail.gmail.com>
>   "Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Sun, 29 Sep
> 2019 07:21:27 -0600,
>   Andy Grove <an...@gmail.com> wrote:
>
> > Just fyi on the rustfmt issue, the formatting was recently updated for
> rust
> > 1.40 nightly and if you are using an older version the formatting check
> > will fail.
> >
> > On Sun, Sep 29, 2019, 5:56 AM Wes McKinney <we...@gmail.com> wrote:
> >
> >> It's up to Micah as RM, but I think it would be good to fix the
> sig-related
> >> issues or we may be dealing with "bug" reports until the next release.
> I'll
> >> work on source verification later today in the meantime to see if any
> other
> >> issues turn up
> >>
> >> On Sun, Sep 29, 2019, 1:19 AM Sutou Kouhei <ko...@clear-code.com> wrote:
> >>
> >> > -0 (binding)
> >> >
> >> > I ran the followings on Debian GNU/Linux sid:
> >> >
> >> >   * TEST_CSHARP=0 \
> >> >       TEST_GLIB=0 \
> >> >       TEST_RUBY=0 \
> >> >       TEST_RUST=0 \
> >> >       JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
> >> >       CUDA_TOOLKIT_ROOT=/usr \
> >> >         dev/release/verify-release-candidate.sh source 0.15.0 1
> >> >   * dev/release/verify-release-candidate.sh binaries 0.14.1 0
> >> >
> >> > with:
> >> >
> >> >   * gcc (Debian 9.2.1-7) 9.2.1
> >> >   * openjdk version "1.8.0_212"
> >> >   * Node.JS v12.1.0
> >> >   * go version go1.12.9 linux/amd64
> >> >   * nvidia-cuda-dev 10.1.105-3
> >> >
> >> >
> >> > I got the following failures:
> >> >
> >> >   * Not ignorable:
> >> >     * Binary: Bad signature
> >> >       * centos-rc/6/Source/repodata/repomd.xml is failed
> >> >       * We can't ignore this if removing the file from
> >> >         https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1 and
> >> >         re-uploading it doesn't solve this problem.
> >> >
> >> >   * Ignorable:
> >> >     * C GLib and Ruby: Buildable but can't run test with GLib 2.62.0.
> >> >       * It's caused by gobject-introspection gem.
> >> >       * This is a known problem and not a C GLib problem.
> >> >       * We can ignore this. (I'm fixing gobject-introspection gem.)
> >> >     * Rust: "cargo +stable fmt --all -- --check" is failed (*)
> >> >       * If I commented the command line out, Rust verification is
> passed.
> >> >       * We can ignore this. Because this is just a lint error.
> >> >     * C#: "sourcelink test" is failed
> >> >       * We can ignore this. This is happened when we release 0.14.1
> too.
> >> >     * APT and Yum: arm64 and aarch64 are broken
> >> >       * We can ignore this.
> >> >
> >> > (*)
> >> > ----
> >> > + cargo +stable fmt --all -- --check
> >> > Diff in
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/array/
> >> > builder.rs at line 1458:
> >> >          let mut builder = StructBuilder::new(fields, field_builders);
> >> >          assert!(builder.field_builder::<BinaryBuilder>(0).is_none());
> >> >      }
> >> > -
> >> >  }
> >> >
> >> > Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/
> >> > bitmap.rs at line 126:
> >> >          assert_eq!(true, bitmap.is_set(6));
> >> >          assert_eq!(false, bitmap.is_set(7));
> >> >      }
> >> > -
> >> >  }
> >> >
> >> > Diff in
> >> >
> >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> >> > aggregate.rs at line 1471:
> >> >              ds,
> >> >          )))))
> >> >      }
> >> > -
> >> >  }
> >> >
> >> > Diff in
> >> >
> >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> >> > context.rs at line 682:
> >> >
> >> >          Ok(ctx)
> >> >      }
> >> > -
> >> >  }
> >> >
> >> > Diff in
> >> >
> >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> >> > hash_aggregate.rs at line 720:
> >> >
> >> >          Ok(())
> >> >      }
> >> > -
> >> >  }
> >> >
> >> > Diff in
> >> >
> >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> >> > merge.rs at line 134:
> >> >
> >> >          Ok(())
> >> >      }
> >> > -
> >> >  }
> >> >
> >> > Diff in
> >> >
> >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> >> > projection.rs at line 171:
> >> >
> >> >          Ok(())
> >> >      }
> >> > -
> >> >  }
> >> >
> >> > Diff in
> >> >
> >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> >> > selection.rs at line 180:
> >> >
> >> >          Ok(())
> >> >      }
> >> > -
> >> >  }
> >> >
> >> > Diff in
> >> >
> >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> >> > projection.rs at line 141:
> >> >
> >> >          assert_eq!("c1", batch.schema().field(0).name());
> >> >      }
> >> > -
> >> >  }
> >> >
> >> > Diff in
> >> >
> >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> >> > table_impl.rs at line 315:
> >> >              true,
> >> >          );
> >> >      }
> >> > -
> >> >  }
> >> >
> >> > Diff in
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/
> >> > logicalplan.rs at line 641:
> >> >              println!("plan: {:?}", plan1);
> >> >          });
> >> >      }
> >> > -
> >> >  }
> >> >
> >> > Diff in
> >> > /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/sql/
> >> > planner.rs at line 569:
> >> >              }
> >> >          }
> >> >      }
> >> > -
> >> >  }
> >> > ----
> >> >
> >> >
> >> >
> >> > Thanks,
> >> > --
> >> > kou
> >> >
> >> > In <
> CAK7Z5T9mamQWtObWmZMJV_tMhAnWGMtndpCmE+_RPQN3LsEKmQ@mail.gmail.com>
> >> >   "Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep
> 2019
> >> > 02:18:05 -0600,
> >> >   Micah Kornfield <em...@gmail.com> wrote:
> >> >
> >> > > Hi,
> >> > >
> >> > >
> >> > > I would like to propose the following release candidate (RC1) of
> Apache
> >> > >
> >> > > Arrow version 0.15.0. This is a release consisting of 672
> >> > >
> >> > > resolved JIRA issues[1]. (RC0 was aborted due to release script
> >> issues).
> >> > >
> >> > >
> >> > > This release candidate is based on commit:
> >> > >
> >> > > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
> >> > >
> >> > >
> >> > > The source release rc1 is hosted at [3].
> >> > >
> >> > > The binary artifacts are hosted at [4][5][6][7].
> >> > >
> >> > > The changelog is located at [8].
> >> > >
> >> > >
> >> > > Please download, verify checksums and signatures, run the unit
> tests,
> >> > >
> >> > > and vote on the release. See [9] for how to validate a release
> >> candidate.
> >> > >
> >> > >
> >> > > The vote will be open for at least 72 hours.
> >> > >
> >> > >
> >> > > [ ] +1 Release this as Apache Arrow 0.15.0
> >> > >
> >> > > [ ] +0
> >> > >
> >> > > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
> >> > >
> >> > >
> >> > > [1]:
> >> > >
> >> >
> >>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
> >> > >
> >> > > [2]:
> >> > >
> >> >
> >>
> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
> >> > >
> >> > > [3]:
> >> > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
> >> > >
> >> > > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
> >> > >
> >> > > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
> >> > >
> >> > > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
> >> > >
> >> > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
> >> > >
> >> > > [8]:
> >> > >
> >> >
> >>
> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
> >> > >
> >> > > [9]:
> >> > >
> >> >
> >>
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >> >
> >>
>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Sutou Kouhei <ko...@clear-code.com>.
I used dev/release/verify-release-candidate.sh. It install
Rust automatically.
Should we update
https://github.com/apache/arrow/blob/master/dev/release/verify-release-candidate.sh#L452
?

In <CA...@mail.gmail.com>
  "Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Sun, 29 Sep 2019 07:21:27 -0600,
  Andy Grove <an...@gmail.com> wrote:

> Just fyi on the rustfmt issue, the formatting was recently updated for rust
> 1.40 nightly and if you are using an older version the formatting check
> will fail.
> 
> On Sun, Sep 29, 2019, 5:56 AM Wes McKinney <we...@gmail.com> wrote:
> 
>> It's up to Micah as RM, but I think it would be good to fix the sig-related
>> issues or we may be dealing with "bug" reports until the next release. I'll
>> work on source verification later today in the meantime to see if any other
>> issues turn up
>>
>> On Sun, Sep 29, 2019, 1:19 AM Sutou Kouhei <ko...@clear-code.com> wrote:
>>
>> > -0 (binding)
>> >
>> > I ran the followings on Debian GNU/Linux sid:
>> >
>> >   * TEST_CSHARP=0 \
>> >       TEST_GLIB=0 \
>> >       TEST_RUBY=0 \
>> >       TEST_RUST=0 \
>> >       JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
>> >       CUDA_TOOLKIT_ROOT=/usr \
>> >         dev/release/verify-release-candidate.sh source 0.15.0 1
>> >   * dev/release/verify-release-candidate.sh binaries 0.14.1 0
>> >
>> > with:
>> >
>> >   * gcc (Debian 9.2.1-7) 9.2.1
>> >   * openjdk version "1.8.0_212"
>> >   * Node.JS v12.1.0
>> >   * go version go1.12.9 linux/amd64
>> >   * nvidia-cuda-dev 10.1.105-3
>> >
>> >
>> > I got the following failures:
>> >
>> >   * Not ignorable:
>> >     * Binary: Bad signature
>> >       * centos-rc/6/Source/repodata/repomd.xml is failed
>> >       * We can't ignore this if removing the file from
>> >         https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1 and
>> >         re-uploading it doesn't solve this problem.
>> >
>> >   * Ignorable:
>> >     * C GLib and Ruby: Buildable but can't run test with GLib 2.62.0.
>> >       * It's caused by gobject-introspection gem.
>> >       * This is a known problem and not a C GLib problem.
>> >       * We can ignore this. (I'm fixing gobject-introspection gem.)
>> >     * Rust: "cargo +stable fmt --all -- --check" is failed (*)
>> >       * If I commented the command line out, Rust verification is passed.
>> >       * We can ignore this. Because this is just a lint error.
>> >     * C#: "sourcelink test" is failed
>> >       * We can ignore this. This is happened when we release 0.14.1 too.
>> >     * APT and Yum: arm64 and aarch64 are broken
>> >       * We can ignore this.
>> >
>> > (*)
>> > ----
>> > + cargo +stable fmt --all -- --check
>> > Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/array/
>> > builder.rs at line 1458:
>> >          let mut builder = StructBuilder::new(fields, field_builders);
>> >          assert!(builder.field_builder::<BinaryBuilder>(0).is_none());
>> >      }
>> > -
>> >  }
>> >
>> > Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/
>> > bitmap.rs at line 126:
>> >          assert_eq!(true, bitmap.is_set(6));
>> >          assert_eq!(false, bitmap.is_set(7));
>> >      }
>> > -
>> >  }
>> >
>> > Diff in
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>> > aggregate.rs at line 1471:
>> >              ds,
>> >          )))))
>> >      }
>> > -
>> >  }
>> >
>> > Diff in
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>> > context.rs at line 682:
>> >
>> >          Ok(ctx)
>> >      }
>> > -
>> >  }
>> >
>> > Diff in
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>> > hash_aggregate.rs at line 720:
>> >
>> >          Ok(())
>> >      }
>> > -
>> >  }
>> >
>> > Diff in
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>> > merge.rs at line 134:
>> >
>> >          Ok(())
>> >      }
>> > -
>> >  }
>> >
>> > Diff in
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>> > projection.rs at line 171:
>> >
>> >          Ok(())
>> >      }
>> > -
>> >  }
>> >
>> > Diff in
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>> > selection.rs at line 180:
>> >
>> >          Ok(())
>> >      }
>> > -
>> >  }
>> >
>> > Diff in
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>> > projection.rs at line 141:
>> >
>> >          assert_eq!("c1", batch.schema().field(0).name());
>> >      }
>> > -
>> >  }
>> >
>> > Diff in
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>> > table_impl.rs at line 315:
>> >              true,
>> >          );
>> >      }
>> > -
>> >  }
>> >
>> > Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/
>> > logicalplan.rs at line 641:
>> >              println!("plan: {:?}", plan1);
>> >          });
>> >      }
>> > -
>> >  }
>> >
>> > Diff in
>> > /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/sql/
>> > planner.rs at line 569:
>> >              }
>> >          }
>> >      }
>> > -
>> >  }
>> > ----
>> >
>> >
>> >
>> > Thanks,
>> > --
>> > kou
>> >
>> > In <CA...@mail.gmail.com>
>> >   "Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep 2019
>> > 02:18:05 -0600,
>> >   Micah Kornfield <em...@gmail.com> wrote:
>> >
>> > > Hi,
>> > >
>> > >
>> > > I would like to propose the following release candidate (RC1) of Apache
>> > >
>> > > Arrow version 0.15.0. This is a release consisting of 672
>> > >
>> > > resolved JIRA issues[1]. (RC0 was aborted due to release script
>> issues).
>> > >
>> > >
>> > > This release candidate is based on commit:
>> > >
>> > > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
>> > >
>> > >
>> > > The source release rc1 is hosted at [3].
>> > >
>> > > The binary artifacts are hosted at [4][5][6][7].
>> > >
>> > > The changelog is located at [8].
>> > >
>> > >
>> > > Please download, verify checksums and signatures, run the unit tests,
>> > >
>> > > and vote on the release. See [9] for how to validate a release
>> candidate.
>> > >
>> > >
>> > > The vote will be open for at least 72 hours.
>> > >
>> > >
>> > > [ ] +1 Release this as Apache Arrow 0.15.0
>> > >
>> > > [ ] +0
>> > >
>> > > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
>> > >
>> > >
>> > > [1]:
>> > >
>> >
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
>> > >
>> > > [2]:
>> > >
>> >
>> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
>> > >
>> > > [3]:
>> > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
>> > >
>> > > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
>> > >
>> > > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
>> > >
>> > > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
>> > >
>> > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
>> > >
>> > > [8]:
>> > >
>> >
>> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
>> > >
>> > > [9]:
>> > >
>> >
>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> >
>>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Krisztián Szűcs <sz...@gmail.com>.
Hey Micah!

On Sun, Sep 29, 2019 at 10:23 PM Micah Kornfield <em...@gmail.com>
wrote:

> Krisztián do you have availability to cut a new RC (I won't be able to
> sort out my key issues for at least a week)?
>
Yes, I can cut RC2 later today.

>
> To answer Wes's question earlier in the thread it would be nice to include
> the C# fix for file formats [1].
>
> Thanks,
> Micah
>
> [1]
> https://github.com/apache/arrow/commit/5fec051d93a0e647c2330564d6d9eb0c7c896e48
>
> On Sun, Sep 29, 2019 at 11:30 AM Micah Kornfield <em...@gmail.com>
> wrote:
>
>> Im going to vote -1 on this RC.  I think we should cut a new RC with
>> someone who has verified key (I think it is the best thing from a security
>> stand point).  I didn't realize the noise that would be caused by lack of
>> cross signing.  I apologise for the churn.
>>
>> On Sunday, September 29, 2019, Andy Grove <an...@gmail.com> wrote:
>>
>>> Just fyi on the rustfmt issue, the formatting was recently updated for
>>> rust
>>> 1.40 nightly and if you are using an older version the formatting check
>>> will fail.
>>>
>>> On Sun, Sep 29, 2019, 5:56 AM Wes McKinney <we...@gmail.com> wrote:
>>>
>>> > It's up to Micah as RM, but I think it would be good to fix the
>>> sig-related
>>> > issues or we may be dealing with "bug" reports until the next release.
>>> I'll
>>> > work on source verification later today in the meantime to see if any
>>> other
>>> > issues turn up
>>> >
>>> > On Sun, Sep 29, 2019, 1:19 AM Sutou Kouhei <ko...@clear-code.com> wrote:
>>> >
>>> > > -0 (binding)
>>> > >
>>> > > I ran the followings on Debian GNU/Linux sid:
>>> > >
>>> > >   * TEST_CSHARP=0 \
>>> > >       TEST_GLIB=0 \
>>> > >       TEST_RUBY=0 \
>>> > >       TEST_RUST=0 \
>>> > >       JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
>>> > >       CUDA_TOOLKIT_ROOT=/usr \
>>> > >         dev/release/verify-release-candidate.sh source 0.15.0 1
>>> > >   * dev/release/verify-release-candidate.sh binaries 0.14.1 0
>>> > >
>>> > > with:
>>> > >
>>> > >   * gcc (Debian 9.2.1-7) 9.2.1
>>> > >   * openjdk version "1.8.0_212"
>>> > >   * Node.JS v12.1.0
>>> > >   * go version go1.12.9 linux/amd64
>>> > >   * nvidia-cuda-dev 10.1.105-3
>>> > >
>>> > >
>>> > > I got the following failures:
>>> > >
>>> > >   * Not ignorable:
>>> > >     * Binary: Bad signature
>>> > >       * centos-rc/6/Source/repodata/repomd.xml is failed
>>> > >       * We can't ignore this if removing the file from
>>> > >         https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1 and
>>> > >         re-uploading it doesn't solve this problem.
>>> > >
>>> > >   * Ignorable:
>>> > >     * C GLib and Ruby: Buildable but can't run test with GLib 2.62.0.
>>> > >       * It's caused by gobject-introspection gem.
>>> > >       * This is a known problem and not a C GLib problem.
>>> > >       * We can ignore this. (I'm fixing gobject-introspection gem.)
>>> > >     * Rust: "cargo +stable fmt --all -- --check" is failed (*)
>>> > >       * If I commented the command line out, Rust verification is
>>> passed.
>>> > >       * We can ignore this. Because this is just a lint error.
>>> > >     * C#: "sourcelink test" is failed
>>> > >       * We can ignore this. This is happened when we release 0.14.1
>>> too.
>>> > >     * APT and Yum: arm64 and aarch64 are broken
>>> > >       * We can ignore this.
>>> > >
>>> > > (*)
>>> > > ----
>>> > > + cargo +stable fmt --all -- --check
>>> > > Diff in
>>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/array/
>>> > > builder.rs at line 1458:
>>> > >          let mut builder = StructBuilder::new(fields,
>>> field_builders);
>>> > >
>>> assert!(builder.field_builder::<BinaryBuilder>(0).is_none());
>>> > >      }
>>> > > -
>>> > >  }
>>> > >
>>> > > Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/
>>> > > bitmap.rs at line 126:
>>> > >          assert_eq!(true, bitmap.is_set(6));
>>> > >          assert_eq!(false, bitmap.is_set(7));
>>> > >      }
>>> > > -
>>> > >  }
>>> > >
>>> > > Diff in
>>> > >
>>> >
>>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>>> > > aggregate.rs at line 1471:
>>> > >              ds,
>>> > >          )))))
>>> > >      }
>>> > > -
>>> > >  }
>>> > >
>>> > > Diff in
>>> > >
>>> >
>>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>>> > > context.rs at line 682:
>>> > >
>>> > >          Ok(ctx)
>>> > >      }
>>> > > -
>>> > >  }
>>> > >
>>> > > Diff in
>>> > >
>>> >
>>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>>> > > hash_aggregate.rs at line 720:
>>> > >
>>> > >          Ok(())
>>> > >      }
>>> > > -
>>> > >  }
>>> > >
>>> > > Diff in
>>> > >
>>> >
>>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>>> > > merge.rs at line 134:
>>> > >
>>> > >          Ok(())
>>> > >      }
>>> > > -
>>> > >  }
>>> > >
>>> > > Diff in
>>> > >
>>> >
>>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>>> > > projection.rs at line 171:
>>> > >
>>> > >          Ok(())
>>> > >      }
>>> > > -
>>> > >  }
>>> > >
>>> > > Diff in
>>> > >
>>> >
>>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>>> > > selection.rs at line 180:
>>> > >
>>> > >          Ok(())
>>> > >      }
>>> > > -
>>> > >  }
>>> > >
>>> > > Diff in
>>> > >
>>> >
>>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>>> > > projection.rs at line 141:
>>> > >
>>> > >          assert_eq!("c1", batch.schema().field(0).name());
>>> > >      }
>>> > > -
>>> > >  }
>>> > >
>>> > > Diff in
>>> > >
>>> >
>>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>>> > > table_impl.rs at line 315:
>>> > >              true,
>>> > >          );
>>> > >      }
>>> > > -
>>> > >  }
>>> > >
>>> > > Diff in
>>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/
>>> > > logicalplan.rs at line 641:
>>> > >              println!("plan: {:?}", plan1);
>>> > >          });
>>> > >      }
>>> > > -
>>> > >  }
>>> > >
>>> > > Diff in
>>> > > /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/sql/
>>> > > planner.rs at line 569:
>>> > >              }
>>> > >          }
>>> > >      }
>>> > > -
>>> > >  }
>>> > > ----
>>> > >
>>> > >
>>> > >
>>> > > Thanks,
>>> > > --
>>> > > kou
>>> > >
>>> > > In <
>>> CAK7Z5T9mamQWtObWmZMJV_tMhAnWGMtndpCmE+_RPQN3LsEKmQ@mail.gmail.com>
>>> > >   "Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep
>>> 2019
>>> > > 02:18:05 -0600,
>>> > >   Micah Kornfield <em...@gmail.com> wrote:
>>> > >
>>> > > > Hi,
>>> > > >
>>> > > >
>>> > > > I would like to propose the following release candidate (RC1) of
>>> Apache
>>> > > >
>>> > > > Arrow version 0.15.0. This is a release consisting of 672
>>> > > >
>>> > > > resolved JIRA issues[1]. (RC0 was aborted due to release script
>>> > issues).
>>> > > >
>>> > > >
>>> > > > This release candidate is based on commit:
>>> > > >
>>> > > > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
>>> > > >
>>> > > >
>>> > > > The source release rc1 is hosted at [3].
>>> > > >
>>> > > > The binary artifacts are hosted at [4][5][6][7].
>>> > > >
>>> > > > The changelog is located at [8].
>>> > > >
>>> > > >
>>> > > > Please download, verify checksums and signatures, run the unit
>>> tests,
>>> > > >
>>> > > > and vote on the release. See [9] for how to validate a release
>>> > candidate.
>>> > > >
>>> > > >
>>> > > > The vote will be open for at least 72 hours.
>>> > > >
>>> > > >
>>> > > > [ ] +1 Release this as Apache Arrow 0.15.0
>>> > > >
>>> > > > [ ] +0
>>> > > >
>>> > > > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
>>> > > >
>>> > > >
>>> > > > [1]:
>>> > > >
>>> > >
>>> >
>>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
>>> > > >
>>> > > > [2]:
>>> > > >
>>> > >
>>> >
>>> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
>>> > > >
>>> > > > [3]:
>>> > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
>>> > > >
>>> > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
>>> > > >
>>> > > > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
>>> > > >
>>> > > > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
>>> > > >
>>> > > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
>>> > > >
>>> > > > [8]:
>>> > > >
>>> > >
>>> >
>>> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
>>> > > >
>>> > > > [9]:
>>> > > >
>>> > >
>>> >
>>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>>> > >
>>> >
>>>
>>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Krisztián Szűcs <sz...@gmail.com>.
On Mon, Sep 30, 2019 at 12:27 AM Wes McKinney <we...@gmail.com> wrote:

> OK. I think an RC2 can be based off of the current master branch to
> make things simple. Do any more patches need to be cherry-picked?
> There are some other C# protocol-related bug fixes but they seem
> incomplete
>
I'll use the master branch then. I'll need some JIRA gardening to update
the
version numbers for JIRAs merged after the RC1. I can start to cut RC2 later
today, after 12:00 UTC.

>
> On Sun, Sep 29, 2019 at 3:23 PM Micah Kornfield <em...@gmail.com>
> wrote:
> >
> > Krisztián do you have availability to cut a new RC (I won't be able to
> sort
> > out my key issues for at least a week)?
> >
> > To answer Wes's question earlier in the thread it would be nice to
> include
> > the C# fix for file formats [1].
> >
> > Thanks,
> > Micah
> >
> > [1]
> >
> https://github.com/apache/arrow/commit/5fec051d93a0e647c2330564d6d9eb0c7c896e48
> >
> > On Sun, Sep 29, 2019 at 11:30 AM Micah Kornfield <em...@gmail.com>
> > wrote:
> >
> > > Im going to vote -1 on this RC.  I think we should cut a new RC with
> > > someone who has verified key (I think it is the best thing from a
> security
> > > stand point).  I didn't realize the noise that would be caused by lack
> of
> > > cross signing.  I apologise for the churn.
> > >
> > > On Sunday, September 29, 2019, Andy Grove <an...@gmail.com>
> wrote:
> > >
> > >> Just fyi on the rustfmt issue, the formatting was recently updated for
> > >> rust
> > >> 1.40 nightly and if you are using an older version the formatting
> check
> > >> will fail.
> > >>
> > >> On Sun, Sep 29, 2019, 5:56 AM Wes McKinney <we...@gmail.com>
> wrote:
> > >>
> > >> > It's up to Micah as RM, but I think it would be good to fix the
> > >> sig-related
> > >> > issues or we may be dealing with "bug" reports until the next
> release.
> > >> I'll
> > >> > work on source verification later today in the meantime to see if
> any
> > >> other
> > >> > issues turn up
> > >> >
> > >> > On Sun, Sep 29, 2019, 1:19 AM Sutou Kouhei <ko...@clear-code.com>
> wrote:
> > >> >
> > >> > > -0 (binding)
> > >> > >
> > >> > > I ran the followings on Debian GNU/Linux sid:
> > >> > >
> > >> > >   * TEST_CSHARP=0 \
> > >> > >       TEST_GLIB=0 \
> > >> > >       TEST_RUBY=0 \
> > >> > >       TEST_RUST=0 \
> > >> > >       JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
> > >> > >       CUDA_TOOLKIT_ROOT=/usr \
> > >> > >         dev/release/verify-release-candidate.sh source 0.15.0 1
> > >> > >   * dev/release/verify-release-candidate.sh binaries 0.14.1 0
> > >> > >
> > >> > > with:
> > >> > >
> > >> > >   * gcc (Debian 9.2.1-7) 9.2.1
> > >> > >   * openjdk version "1.8.0_212"
> > >> > >   * Node.JS v12.1.0
> > >> > >   * go version go1.12.9 linux/amd64
> > >> > >   * nvidia-cuda-dev 10.1.105-3
> > >> > >
> > >> > >
> > >> > > I got the following failures:
> > >> > >
> > >> > >   * Not ignorable:
> > >> > >     * Binary: Bad signature
> > >> > >       * centos-rc/6/Source/repodata/repomd.xml is failed
> > >> > >       * We can't ignore this if removing the file from
> > >> > >         https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1 and
> > >> > >         re-uploading it doesn't solve this problem.
> > >> > >
> > >> > >   * Ignorable:
> > >> > >     * C GLib and Ruby: Buildable but can't run test with GLib
> 2.62.0.
> > >> > >       * It's caused by gobject-introspection gem.
> > >> > >       * This is a known problem and not a C GLib problem.
> > >> > >       * We can ignore this. (I'm fixing gobject-introspection
> gem.)
> > >> > >     * Rust: "cargo +stable fmt --all -- --check" is failed (*)
> > >> > >       * If I commented the command line out, Rust verification is
> > >> passed.
> > >> > >       * We can ignore this. Because this is just a lint error.
> > >> > >     * C#: "sourcelink test" is failed
> > >> > >       * We can ignore this. This is happened when we release
> 0.14.1
> > >> too.
> > >> > >     * APT and Yum: arm64 and aarch64 are broken
> > >> > >       * We can ignore this.
> > >> > >
> > >> > > (*)
> > >> > > ----
> > >> > > + cargo +stable fmt --all -- --check
> > >> > > Diff in
> > >> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/array/
> > >> > > builder.rs at line 1458:
> > >> > >          let mut builder = StructBuilder::new(fields,
> field_builders);
> > >> > >
> assert!(builder.field_builder::<BinaryBuilder>(0).is_none());
> > >> > >      }
> > >> > > -
> > >> > >  }
> > >> > >
> > >> > > Diff in
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/
> > >> > > bitmap.rs at line 126:
> > >> > >          assert_eq!(true, bitmap.is_set(6));
> > >> > >          assert_eq!(false, bitmap.is_set(7));
> > >> > >      }
> > >> > > -
> > >> > >  }
> > >> > >
> > >> > > Diff in
> > >> > >
> > >> >
> > >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> > >> > > aggregate.rs at line 1471:
> > >> > >              ds,
> > >> > >          )))))
> > >> > >      }
> > >> > > -
> > >> > >  }
> > >> > >
> > >> > > Diff in
> > >> > >
> > >> >
> > >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> > >> > > context.rs at line 682:
> > >> > >
> > >> > >          Ok(ctx)
> > >> > >      }
> > >> > > -
> > >> > >  }
> > >> > >
> > >> > > Diff in
> > >> > >
> > >> >
> > >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> > >> > > hash_aggregate.rs at line 720:
> > >> > >
> > >> > >          Ok(())
> > >> > >      }
> > >> > > -
> > >> > >  }
> > >> > >
> > >> > > Diff in
> > >> > >
> > >> >
> > >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> > >> > > merge.rs at line 134:
> > >> > >
> > >> > >          Ok(())
> > >> > >      }
> > >> > > -
> > >> > >  }
> > >> > >
> > >> > > Diff in
> > >> > >
> > >> >
> > >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> > >> > > projection.rs at line 171:
> > >> > >
> > >> > >          Ok(())
> > >> > >      }
> > >> > > -
> > >> > >  }
> > >> > >
> > >> > > Diff in
> > >> > >
> > >> >
> > >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> > >> > > selection.rs at line 180:
> > >> > >
> > >> > >          Ok(())
> > >> > >      }
> > >> > > -
> > >> > >  }
> > >> > >
> > >> > > Diff in
> > >> > >
> > >> >
> > >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> > >> > > projection.rs at line 141:
> > >> > >
> > >> > >          assert_eq!("c1", batch.schema().field(0).name());
> > >> > >      }
> > >> > > -
> > >> > >  }
> > >> > >
> > >> > > Diff in
> > >> > >
> > >> >
> > >>
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> > >> > > table_impl.rs at line 315:
> > >> > >              true,
> > >> > >          );
> > >> > >      }
> > >> > > -
> > >> > >  }
> > >> > >
> > >> > > Diff in
> > >> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/
> > >> > > logicalplan.rs at line 641:
> > >> > >              println!("plan: {:?}", plan1);
> > >> > >          });
> > >> > >      }
> > >> > > -
> > >> > >  }
> > >> > >
> > >> > > Diff in
> > >> > >
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/sql/
> > >> > > planner.rs at line 569:
> > >> > >              }
> > >> > >          }
> > >> > >      }
> > >> > > -
> > >> > >  }
> > >> > > ----
> > >> > >
> > >> > >
> > >> > >
> > >> > > Thanks,
> > >> > > --
> > >> > > kou
> > >> > >
> > >> > > In <
> > >> CAK7Z5T9mamQWtObWmZMJV_tMhAnWGMtndpCmE+_RPQN3LsEKmQ@mail.gmail.com>
> > >> > >   "Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27
> Sep
> > >> 2019
> > >> > > 02:18:05 -0600,
> > >> > >   Micah Kornfield <em...@gmail.com> wrote:
> > >> > >
> > >> > > > Hi,
> > >> > > >
> > >> > > >
> > >> > > > I would like to propose the following release candidate (RC1) of
> > >> Apache
> > >> > > >
> > >> > > > Arrow version 0.15.0. This is a release consisting of 672
> > >> > > >
> > >> > > > resolved JIRA issues[1]. (RC0 was aborted due to release script
> > >> > issues).
> > >> > > >
> > >> > > >
> > >> > > > This release candidate is based on commit:
> > >> > > >
> > >> > > > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
> > >> > > >
> > >> > > >
> > >> > > > The source release rc1 is hosted at [3].
> > >> > > >
> > >> > > > The binary artifacts are hosted at [4][5][6][7].
> > >> > > >
> > >> > > > The changelog is located at [8].
> > >> > > >
> > >> > > >
> > >> > > > Please download, verify checksums and signatures, run the unit
> > >> tests,
> > >> > > >
> > >> > > > and vote on the release. See [9] for how to validate a release
> > >> > candidate.
> > >> > > >
> > >> > > >
> > >> > > > The vote will be open for at least 72 hours.
> > >> > > >
> > >> > > >
> > >> > > > [ ] +1 Release this as Apache Arrow 0.15.0
> > >> > > >
> > >> > > > [ ] +0
> > >> > > >
> > >> > > > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
> > >> > > >
> > >> > > >
> > >> > > > [1]:
> > >> > > >
> > >> > >
> > >> >
> > >>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
> > >> > > >
> > >> > > > [2]:
> > >> > > >
> > >> > >
> > >> >
> > >>
> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
> > >> > > >
> > >> > > > [3]:
> > >> > >
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
> > >> > > >
> > >> > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
> > >> > > >
> > >> > > > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
> > >> > > >
> > >> > > > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
> > >> > > >
> > >> > > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
> > >> > > >
> > >> > > > [8]:
> > >> > > >
> > >> > >
> > >> >
> > >>
> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
> > >> > > >
> > >> > > > [9]:
> > >> > > >
> > >> > >
> > >> >
> > >>
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> > >> > >
> > >> >
> > >>
> > >
>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Wes McKinney <we...@gmail.com>.
OK. I think an RC2 can be based off of the current master branch to
make things simple. Do any more patches need to be cherry-picked?
There are some other C# protocol-related bug fixes but they seem
incomplete

On Sun, Sep 29, 2019 at 3:23 PM Micah Kornfield <em...@gmail.com> wrote:
>
> Krisztián do you have availability to cut a new RC (I won't be able to sort
> out my key issues for at least a week)?
>
> To answer Wes's question earlier in the thread it would be nice to include
> the C# fix for file formats [1].
>
> Thanks,
> Micah
>
> [1]
> https://github.com/apache/arrow/commit/5fec051d93a0e647c2330564d6d9eb0c7c896e48
>
> On Sun, Sep 29, 2019 at 11:30 AM Micah Kornfield <em...@gmail.com>
> wrote:
>
> > Im going to vote -1 on this RC.  I think we should cut a new RC with
> > someone who has verified key (I think it is the best thing from a security
> > stand point).  I didn't realize the noise that would be caused by lack of
> > cross signing.  I apologise for the churn.
> >
> > On Sunday, September 29, 2019, Andy Grove <an...@gmail.com> wrote:
> >
> >> Just fyi on the rustfmt issue, the formatting was recently updated for
> >> rust
> >> 1.40 nightly and if you are using an older version the formatting check
> >> will fail.
> >>
> >> On Sun, Sep 29, 2019, 5:56 AM Wes McKinney <we...@gmail.com> wrote:
> >>
> >> > It's up to Micah as RM, but I think it would be good to fix the
> >> sig-related
> >> > issues or we may be dealing with "bug" reports until the next release.
> >> I'll
> >> > work on source verification later today in the meantime to see if any
> >> other
> >> > issues turn up
> >> >
> >> > On Sun, Sep 29, 2019, 1:19 AM Sutou Kouhei <ko...@clear-code.com> wrote:
> >> >
> >> > > -0 (binding)
> >> > >
> >> > > I ran the followings on Debian GNU/Linux sid:
> >> > >
> >> > >   * TEST_CSHARP=0 \
> >> > >       TEST_GLIB=0 \
> >> > >       TEST_RUBY=0 \
> >> > >       TEST_RUST=0 \
> >> > >       JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
> >> > >       CUDA_TOOLKIT_ROOT=/usr \
> >> > >         dev/release/verify-release-candidate.sh source 0.15.0 1
> >> > >   * dev/release/verify-release-candidate.sh binaries 0.14.1 0
> >> > >
> >> > > with:
> >> > >
> >> > >   * gcc (Debian 9.2.1-7) 9.2.1
> >> > >   * openjdk version "1.8.0_212"
> >> > >   * Node.JS v12.1.0
> >> > >   * go version go1.12.9 linux/amd64
> >> > >   * nvidia-cuda-dev 10.1.105-3
> >> > >
> >> > >
> >> > > I got the following failures:
> >> > >
> >> > >   * Not ignorable:
> >> > >     * Binary: Bad signature
> >> > >       * centos-rc/6/Source/repodata/repomd.xml is failed
> >> > >       * We can't ignore this if removing the file from
> >> > >         https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1 and
> >> > >         re-uploading it doesn't solve this problem.
> >> > >
> >> > >   * Ignorable:
> >> > >     * C GLib and Ruby: Buildable but can't run test with GLib 2.62.0.
> >> > >       * It's caused by gobject-introspection gem.
> >> > >       * This is a known problem and not a C GLib problem.
> >> > >       * We can ignore this. (I'm fixing gobject-introspection gem.)
> >> > >     * Rust: "cargo +stable fmt --all -- --check" is failed (*)
> >> > >       * If I commented the command line out, Rust verification is
> >> passed.
> >> > >       * We can ignore this. Because this is just a lint error.
> >> > >     * C#: "sourcelink test" is failed
> >> > >       * We can ignore this. This is happened when we release 0.14.1
> >> too.
> >> > >     * APT and Yum: arm64 and aarch64 are broken
> >> > >       * We can ignore this.
> >> > >
> >> > > (*)
> >> > > ----
> >> > > + cargo +stable fmt --all -- --check
> >> > > Diff in
> >> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/array/
> >> > > builder.rs at line 1458:
> >> > >          let mut builder = StructBuilder::new(fields, field_builders);
> >> > >          assert!(builder.field_builder::<BinaryBuilder>(0).is_none());
> >> > >      }
> >> > > -
> >> > >  }
> >> > >
> >> > > Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/
> >> > > bitmap.rs at line 126:
> >> > >          assert_eq!(true, bitmap.is_set(6));
> >> > >          assert_eq!(false, bitmap.is_set(7));
> >> > >      }
> >> > > -
> >> > >  }
> >> > >
> >> > > Diff in
> >> > >
> >> >
> >> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> >> > > aggregate.rs at line 1471:
> >> > >              ds,
> >> > >          )))))
> >> > >      }
> >> > > -
> >> > >  }
> >> > >
> >> > > Diff in
> >> > >
> >> >
> >> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> >> > > context.rs at line 682:
> >> > >
> >> > >          Ok(ctx)
> >> > >      }
> >> > > -
> >> > >  }
> >> > >
> >> > > Diff in
> >> > >
> >> >
> >> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> >> > > hash_aggregate.rs at line 720:
> >> > >
> >> > >          Ok(())
> >> > >      }
> >> > > -
> >> > >  }
> >> > >
> >> > > Diff in
> >> > >
> >> >
> >> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> >> > > merge.rs at line 134:
> >> > >
> >> > >          Ok(())
> >> > >      }
> >> > > -
> >> > >  }
> >> > >
> >> > > Diff in
> >> > >
> >> >
> >> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> >> > > projection.rs at line 171:
> >> > >
> >> > >          Ok(())
> >> > >      }
> >> > > -
> >> > >  }
> >> > >
> >> > > Diff in
> >> > >
> >> >
> >> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> >> > > selection.rs at line 180:
> >> > >
> >> > >          Ok(())
> >> > >      }
> >> > > -
> >> > >  }
> >> > >
> >> > > Diff in
> >> > >
> >> >
> >> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> >> > > projection.rs at line 141:
> >> > >
> >> > >          assert_eq!("c1", batch.schema().field(0).name());
> >> > >      }
> >> > > -
> >> > >  }
> >> > >
> >> > > Diff in
> >> > >
> >> >
> >> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> >> > > table_impl.rs at line 315:
> >> > >              true,
> >> > >          );
> >> > >      }
> >> > > -
> >> > >  }
> >> > >
> >> > > Diff in
> >> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/
> >> > > logicalplan.rs at line 641:
> >> > >              println!("plan: {:?}", plan1);
> >> > >          });
> >> > >      }
> >> > > -
> >> > >  }
> >> > >
> >> > > Diff in
> >> > > /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/sql/
> >> > > planner.rs at line 569:
> >> > >              }
> >> > >          }
> >> > >      }
> >> > > -
> >> > >  }
> >> > > ----
> >> > >
> >> > >
> >> > >
> >> > > Thanks,
> >> > > --
> >> > > kou
> >> > >
> >> > > In <
> >> CAK7Z5T9mamQWtObWmZMJV_tMhAnWGMtndpCmE+_RPQN3LsEKmQ@mail.gmail.com>
> >> > >   "Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep
> >> 2019
> >> > > 02:18:05 -0600,
> >> > >   Micah Kornfield <em...@gmail.com> wrote:
> >> > >
> >> > > > Hi,
> >> > > >
> >> > > >
> >> > > > I would like to propose the following release candidate (RC1) of
> >> Apache
> >> > > >
> >> > > > Arrow version 0.15.0. This is a release consisting of 672
> >> > > >
> >> > > > resolved JIRA issues[1]. (RC0 was aborted due to release script
> >> > issues).
> >> > > >
> >> > > >
> >> > > > This release candidate is based on commit:
> >> > > >
> >> > > > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
> >> > > >
> >> > > >
> >> > > > The source release rc1 is hosted at [3].
> >> > > >
> >> > > > The binary artifacts are hosted at [4][5][6][7].
> >> > > >
> >> > > > The changelog is located at [8].
> >> > > >
> >> > > >
> >> > > > Please download, verify checksums and signatures, run the unit
> >> tests,
> >> > > >
> >> > > > and vote on the release. See [9] for how to validate a release
> >> > candidate.
> >> > > >
> >> > > >
> >> > > > The vote will be open for at least 72 hours.
> >> > > >
> >> > > >
> >> > > > [ ] +1 Release this as Apache Arrow 0.15.0
> >> > > >
> >> > > > [ ] +0
> >> > > >
> >> > > > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
> >> > > >
> >> > > >
> >> > > > [1]:
> >> > > >
> >> > >
> >> >
> >> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
> >> > > >
> >> > > > [2]:
> >> > > >
> >> > >
> >> >
> >> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
> >> > > >
> >> > > > [3]:
> >> > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
> >> > > >
> >> > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
> >> > > >
> >> > > > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
> >> > > >
> >> > > > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
> >> > > >
> >> > > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
> >> > > >
> >> > > > [8]:
> >> > > >
> >> > >
> >> >
> >> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
> >> > > >
> >> > > > [9]:
> >> > > >
> >> > >
> >> >
> >> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >> > >
> >> >
> >>
> >

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Micah Kornfield <em...@gmail.com>.
Krisztián do you have availability to cut a new RC (I won't be able to sort
out my key issues for at least a week)?

To answer Wes's question earlier in the thread it would be nice to include
the C# fix for file formats [1].

Thanks,
Micah

[1]
https://github.com/apache/arrow/commit/5fec051d93a0e647c2330564d6d9eb0c7c896e48

On Sun, Sep 29, 2019 at 11:30 AM Micah Kornfield <em...@gmail.com>
wrote:

> Im going to vote -1 on this RC.  I think we should cut a new RC with
> someone who has verified key (I think it is the best thing from a security
> stand point).  I didn't realize the noise that would be caused by lack of
> cross signing.  I apologise for the churn.
>
> On Sunday, September 29, 2019, Andy Grove <an...@gmail.com> wrote:
>
>> Just fyi on the rustfmt issue, the formatting was recently updated for
>> rust
>> 1.40 nightly and if you are using an older version the formatting check
>> will fail.
>>
>> On Sun, Sep 29, 2019, 5:56 AM Wes McKinney <we...@gmail.com> wrote:
>>
>> > It's up to Micah as RM, but I think it would be good to fix the
>> sig-related
>> > issues or we may be dealing with "bug" reports until the next release.
>> I'll
>> > work on source verification later today in the meantime to see if any
>> other
>> > issues turn up
>> >
>> > On Sun, Sep 29, 2019, 1:19 AM Sutou Kouhei <ko...@clear-code.com> wrote:
>> >
>> > > -0 (binding)
>> > >
>> > > I ran the followings on Debian GNU/Linux sid:
>> > >
>> > >   * TEST_CSHARP=0 \
>> > >       TEST_GLIB=0 \
>> > >       TEST_RUBY=0 \
>> > >       TEST_RUST=0 \
>> > >       JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
>> > >       CUDA_TOOLKIT_ROOT=/usr \
>> > >         dev/release/verify-release-candidate.sh source 0.15.0 1
>> > >   * dev/release/verify-release-candidate.sh binaries 0.14.1 0
>> > >
>> > > with:
>> > >
>> > >   * gcc (Debian 9.2.1-7) 9.2.1
>> > >   * openjdk version "1.8.0_212"
>> > >   * Node.JS v12.1.0
>> > >   * go version go1.12.9 linux/amd64
>> > >   * nvidia-cuda-dev 10.1.105-3
>> > >
>> > >
>> > > I got the following failures:
>> > >
>> > >   * Not ignorable:
>> > >     * Binary: Bad signature
>> > >       * centos-rc/6/Source/repodata/repomd.xml is failed
>> > >       * We can't ignore this if removing the file from
>> > >         https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1 and
>> > >         re-uploading it doesn't solve this problem.
>> > >
>> > >   * Ignorable:
>> > >     * C GLib and Ruby: Buildable but can't run test with GLib 2.62.0.
>> > >       * It's caused by gobject-introspection gem.
>> > >       * This is a known problem and not a C GLib problem.
>> > >       * We can ignore this. (I'm fixing gobject-introspection gem.)
>> > >     * Rust: "cargo +stable fmt --all -- --check" is failed (*)
>> > >       * If I commented the command line out, Rust verification is
>> passed.
>> > >       * We can ignore this. Because this is just a lint error.
>> > >     * C#: "sourcelink test" is failed
>> > >       * We can ignore this. This is happened when we release 0.14.1
>> too.
>> > >     * APT and Yum: arm64 and aarch64 are broken
>> > >       * We can ignore this.
>> > >
>> > > (*)
>> > > ----
>> > > + cargo +stable fmt --all -- --check
>> > > Diff in
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/array/
>> > > builder.rs at line 1458:
>> > >          let mut builder = StructBuilder::new(fields, field_builders);
>> > >          assert!(builder.field_builder::<BinaryBuilder>(0).is_none());
>> > >      }
>> > > -
>> > >  }
>> > >
>> > > Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/
>> > > bitmap.rs at line 126:
>> > >          assert_eq!(true, bitmap.is_set(6));
>> > >          assert_eq!(false, bitmap.is_set(7));
>> > >      }
>> > > -
>> > >  }
>> > >
>> > > Diff in
>> > >
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>> > > aggregate.rs at line 1471:
>> > >              ds,
>> > >          )))))
>> > >      }
>> > > -
>> > >  }
>> > >
>> > > Diff in
>> > >
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>> > > context.rs at line 682:
>> > >
>> > >          Ok(ctx)
>> > >      }
>> > > -
>> > >  }
>> > >
>> > > Diff in
>> > >
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>> > > hash_aggregate.rs at line 720:
>> > >
>> > >          Ok(())
>> > >      }
>> > > -
>> > >  }
>> > >
>> > > Diff in
>> > >
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>> > > merge.rs at line 134:
>> > >
>> > >          Ok(())
>> > >      }
>> > > -
>> > >  }
>> > >
>> > > Diff in
>> > >
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>> > > projection.rs at line 171:
>> > >
>> > >          Ok(())
>> > >      }
>> > > -
>> > >  }
>> > >
>> > > Diff in
>> > >
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
>> > > selection.rs at line 180:
>> > >
>> > >          Ok(())
>> > >      }
>> > > -
>> > >  }
>> > >
>> > > Diff in
>> > >
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>> > > projection.rs at line 141:
>> > >
>> > >          assert_eq!("c1", batch.schema().field(0).name());
>> > >      }
>> > > -
>> > >  }
>> > >
>> > > Diff in
>> > >
>> >
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
>> > > table_impl.rs at line 315:
>> > >              true,
>> > >          );
>> > >      }
>> > > -
>> > >  }
>> > >
>> > > Diff in
>> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/
>> > > logicalplan.rs at line 641:
>> > >              println!("plan: {:?}", plan1);
>> > >          });
>> > >      }
>> > > -
>> > >  }
>> > >
>> > > Diff in
>> > > /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/sql/
>> > > planner.rs at line 569:
>> > >              }
>> > >          }
>> > >      }
>> > > -
>> > >  }
>> > > ----
>> > >
>> > >
>> > >
>> > > Thanks,
>> > > --
>> > > kou
>> > >
>> > > In <
>> CAK7Z5T9mamQWtObWmZMJV_tMhAnWGMtndpCmE+_RPQN3LsEKmQ@mail.gmail.com>
>> > >   "Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep
>> 2019
>> > > 02:18:05 -0600,
>> > >   Micah Kornfield <em...@gmail.com> wrote:
>> > >
>> > > > Hi,
>> > > >
>> > > >
>> > > > I would like to propose the following release candidate (RC1) of
>> Apache
>> > > >
>> > > > Arrow version 0.15.0. This is a release consisting of 672
>> > > >
>> > > > resolved JIRA issues[1]. (RC0 was aborted due to release script
>> > issues).
>> > > >
>> > > >
>> > > > This release candidate is based on commit:
>> > > >
>> > > > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
>> > > >
>> > > >
>> > > > The source release rc1 is hosted at [3].
>> > > >
>> > > > The binary artifacts are hosted at [4][5][6][7].
>> > > >
>> > > > The changelog is located at [8].
>> > > >
>> > > >
>> > > > Please download, verify checksums and signatures, run the unit
>> tests,
>> > > >
>> > > > and vote on the release. See [9] for how to validate a release
>> > candidate.
>> > > >
>> > > >
>> > > > The vote will be open for at least 72 hours.
>> > > >
>> > > >
>> > > > [ ] +1 Release this as Apache Arrow 0.15.0
>> > > >
>> > > > [ ] +0
>> > > >
>> > > > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
>> > > >
>> > > >
>> > > > [1]:
>> > > >
>> > >
>> >
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
>> > > >
>> > > > [2]:
>> > > >
>> > >
>> >
>> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
>> > > >
>> > > > [3]:
>> > > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
>> > > >
>> > > > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
>> > > >
>> > > > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
>> > > >
>> > > > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
>> > > >
>> > > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
>> > > >
>> > > > [8]:
>> > > >
>> > >
>> >
>> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
>> > > >
>> > > > [9]:
>> > > >
>> > >
>> >
>> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>> > >
>> >
>>
>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Andy Grove <an...@gmail.com>.
Just fyi on the rustfmt issue, the formatting was recently updated for rust
1.40 nightly and if you are using an older version the formatting check
will fail.

On Sun, Sep 29, 2019, 5:56 AM Wes McKinney <we...@gmail.com> wrote:

> It's up to Micah as RM, but I think it would be good to fix the sig-related
> issues or we may be dealing with "bug" reports until the next release. I'll
> work on source verification later today in the meantime to see if any other
> issues turn up
>
> On Sun, Sep 29, 2019, 1:19 AM Sutou Kouhei <ko...@clear-code.com> wrote:
>
> > -0 (binding)
> >
> > I ran the followings on Debian GNU/Linux sid:
> >
> >   * TEST_CSHARP=0 \
> >       TEST_GLIB=0 \
> >       TEST_RUBY=0 \
> >       TEST_RUST=0 \
> >       JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
> >       CUDA_TOOLKIT_ROOT=/usr \
> >         dev/release/verify-release-candidate.sh source 0.15.0 1
> >   * dev/release/verify-release-candidate.sh binaries 0.14.1 0
> >
> > with:
> >
> >   * gcc (Debian 9.2.1-7) 9.2.1
> >   * openjdk version "1.8.0_212"
> >   * Node.JS v12.1.0
> >   * go version go1.12.9 linux/amd64
> >   * nvidia-cuda-dev 10.1.105-3
> >
> >
> > I got the following failures:
> >
> >   * Not ignorable:
> >     * Binary: Bad signature
> >       * centos-rc/6/Source/repodata/repomd.xml is failed
> >       * We can't ignore this if removing the file from
> >         https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1 and
> >         re-uploading it doesn't solve this problem.
> >
> >   * Ignorable:
> >     * C GLib and Ruby: Buildable but can't run test with GLib 2.62.0.
> >       * It's caused by gobject-introspection gem.
> >       * This is a known problem and not a C GLib problem.
> >       * We can ignore this. (I'm fixing gobject-introspection gem.)
> >     * Rust: "cargo +stable fmt --all -- --check" is failed (*)
> >       * If I commented the command line out, Rust verification is passed.
> >       * We can ignore this. Because this is just a lint error.
> >     * C#: "sourcelink test" is failed
> >       * We can ignore this. This is happened when we release 0.14.1 too.
> >     * APT and Yum: arm64 and aarch64 are broken
> >       * We can ignore this.
> >
> > (*)
> > ----
> > + cargo +stable fmt --all -- --check
> > Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/array/
> > builder.rs at line 1458:
> >          let mut builder = StructBuilder::new(fields, field_builders);
> >          assert!(builder.field_builder::<BinaryBuilder>(0).is_none());
> >      }
> > -
> >  }
> >
> > Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/
> > bitmap.rs at line 126:
> >          assert_eq!(true, bitmap.is_set(6));
> >          assert_eq!(false, bitmap.is_set(7));
> >      }
> > -
> >  }
> >
> > Diff in
> >
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> > aggregate.rs at line 1471:
> >              ds,
> >          )))))
> >      }
> > -
> >  }
> >
> > Diff in
> >
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> > context.rs at line 682:
> >
> >          Ok(ctx)
> >      }
> > -
> >  }
> >
> > Diff in
> >
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> > hash_aggregate.rs at line 720:
> >
> >          Ok(())
> >      }
> > -
> >  }
> >
> > Diff in
> >
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> > merge.rs at line 134:
> >
> >          Ok(())
> >      }
> > -
> >  }
> >
> > Diff in
> >
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> > projection.rs at line 171:
> >
> >          Ok(())
> >      }
> > -
> >  }
> >
> > Diff in
> >
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> > selection.rs at line 180:
> >
> >          Ok(())
> >      }
> > -
> >  }
> >
> > Diff in
> >
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> > projection.rs at line 141:
> >
> >          assert_eq!("c1", batch.schema().field(0).name());
> >      }
> > -
> >  }
> >
> > Diff in
> >
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> > table_impl.rs at line 315:
> >              true,
> >          );
> >      }
> > -
> >  }
> >
> > Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/
> > logicalplan.rs at line 641:
> >              println!("plan: {:?}", plan1);
> >          });
> >      }
> > -
> >  }
> >
> > Diff in
> > /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/sql/
> > planner.rs at line 569:
> >              }
> >          }
> >      }
> > -
> >  }
> > ----
> >
> >
> >
> > Thanks,
> > --
> > kou
> >
> > In <CA...@mail.gmail.com>
> >   "Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep 2019
> > 02:18:05 -0600,
> >   Micah Kornfield <em...@gmail.com> wrote:
> >
> > > Hi,
> > >
> > >
> > > I would like to propose the following release candidate (RC1) of Apache
> > >
> > > Arrow version 0.15.0. This is a release consisting of 672
> > >
> > > resolved JIRA issues[1]. (RC0 was aborted due to release script
> issues).
> > >
> > >
> > > This release candidate is based on commit:
> > >
> > > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
> > >
> > >
> > > The source release rc1 is hosted at [3].
> > >
> > > The binary artifacts are hosted at [4][5][6][7].
> > >
> > > The changelog is located at [8].
> > >
> > >
> > > Please download, verify checksums and signatures, run the unit tests,
> > >
> > > and vote on the release. See [9] for how to validate a release
> candidate.
> > >
> > >
> > > The vote will be open for at least 72 hours.
> > >
> > >
> > > [ ] +1 Release this as Apache Arrow 0.15.0
> > >
> > > [ ] +0
> > >
> > > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
> > >
> > >
> > > [1]:
> > >
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
> > >
> > > [2]:
> > >
> >
> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
> > >
> > > [3]:
> > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
> > >
> > > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
> > >
> > > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
> > >
> > > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
> > >
> > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
> > >
> > > [8]:
> > >
> >
> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
> > >
> > > [9]:
> > >
> >
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
> >
>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Wes McKinney <we...@gmail.com>.
It's up to Micah as RM, but I think it would be good to fix the sig-related
issues or we may be dealing with "bug" reports until the next release. I'll
work on source verification later today in the meantime to see if any other
issues turn up

On Sun, Sep 29, 2019, 1:19 AM Sutou Kouhei <ko...@clear-code.com> wrote:

> -0 (binding)
>
> I ran the followings on Debian GNU/Linux sid:
>
>   * TEST_CSHARP=0 \
>       TEST_GLIB=0 \
>       TEST_RUBY=0 \
>       TEST_RUST=0 \
>       JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
>       CUDA_TOOLKIT_ROOT=/usr \
>         dev/release/verify-release-candidate.sh source 0.15.0 1
>   * dev/release/verify-release-candidate.sh binaries 0.14.1 0
>
> with:
>
>   * gcc (Debian 9.2.1-7) 9.2.1
>   * openjdk version "1.8.0_212"
>   * Node.JS v12.1.0
>   * go version go1.12.9 linux/amd64
>   * nvidia-cuda-dev 10.1.105-3
>
>
> I got the following failures:
>
>   * Not ignorable:
>     * Binary: Bad signature
>       * centos-rc/6/Source/repodata/repomd.xml is failed
>       * We can't ignore this if removing the file from
>         https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1 and
>         re-uploading it doesn't solve this problem.
>
>   * Ignorable:
>     * C GLib and Ruby: Buildable but can't run test with GLib 2.62.0.
>       * It's caused by gobject-introspection gem.
>       * This is a known problem and not a C GLib problem.
>       * We can ignore this. (I'm fixing gobject-introspection gem.)
>     * Rust: "cargo +stable fmt --all -- --check" is failed (*)
>       * If I commented the command line out, Rust verification is passed.
>       * We can ignore this. Because this is just a lint error.
>     * C#: "sourcelink test" is failed
>       * We can ignore this. This is happened when we release 0.14.1 too.
>     * APT and Yum: arm64 and aarch64 are broken
>       * We can ignore this.
>
> (*)
> ----
> + cargo +stable fmt --all -- --check
> Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/array/
> builder.rs at line 1458:
>          let mut builder = StructBuilder::new(fields, field_builders);
>          assert!(builder.field_builder::<BinaryBuilder>(0).is_none());
>      }
> -
>  }
>
> Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/
> bitmap.rs at line 126:
>          assert_eq!(true, bitmap.is_set(6));
>          assert_eq!(false, bitmap.is_set(7));
>      }
> -
>  }
>
> Diff in
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> aggregate.rs at line 1471:
>              ds,
>          )))))
>      }
> -
>  }
>
> Diff in
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> context.rs at line 682:
>
>          Ok(ctx)
>      }
> -
>  }
>
> Diff in
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> hash_aggregate.rs at line 720:
>
>          Ok(())
>      }
> -
>  }
>
> Diff in
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> merge.rs at line 134:
>
>          Ok(())
>      }
> -
>  }
>
> Diff in
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> projection.rs at line 171:
>
>          Ok(())
>      }
> -
>  }
>
> Diff in
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/
> selection.rs at line 180:
>
>          Ok(())
>      }
> -
>  }
>
> Diff in
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> projection.rs at line 141:
>
>          assert_eq!("c1", batch.schema().field(0).name());
>      }
> -
>  }
>
> Diff in
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/
> table_impl.rs at line 315:
>              true,
>          );
>      }
> -
>  }
>
> Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/
> logicalplan.rs at line 641:
>              println!("plan: {:?}", plan1);
>          });
>      }
> -
>  }
>
> Diff in
> /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/sql/
> planner.rs at line 569:
>              }
>          }
>      }
> -
>  }
> ----
>
>
>
> Thanks,
> --
> kou
>
> In <CA...@mail.gmail.com>
>   "Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep 2019
> 02:18:05 -0600,
>   Micah Kornfield <em...@gmail.com> wrote:
>
> > Hi,
> >
> >
> > I would like to propose the following release candidate (RC1) of Apache
> >
> > Arrow version 0.15.0. This is a release consisting of 672
> >
> > resolved JIRA issues[1]. (RC0 was aborted due to release script issues).
> >
> >
> > This release candidate is based on commit:
> >
> > 77f091888dbe5a4e023a66b986a2dd474696061a [2]
> >
> >
> > The source release rc1 is hosted at [3].
> >
> > The binary artifacts are hosted at [4][5][6][7].
> >
> > The changelog is located at [8].
> >
> >
> > Please download, verify checksums and signatures, run the unit tests,
> >
> > and vote on the release. See [9] for how to validate a release candidate.
> >
> >
> > The vote will be open for at least 72 hours.
> >
> >
> > [ ] +1 Release this as Apache Arrow 0.15.0
> >
> > [ ] +0
> >
> > [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
> >
> >
> > [1]:
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
> >
> > [2]:
> >
> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
> >
> > [3]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
> >
> > [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
> >
> > [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
> >
> > [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
> >
> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
> >
> > [8]:
> >
> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
> >
> > [9]:
> >
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>

Re: Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1

Posted by Sutou Kouhei <ko...@clear-code.com>.
-0 (binding)

I ran the followings on Debian GNU/Linux sid:

  * TEST_CSHARP=0 \
      TEST_GLIB=0 \
      TEST_RUBY=0 \
      TEST_RUST=0 \
      JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
      CUDA_TOOLKIT_ROOT=/usr \
        dev/release/verify-release-candidate.sh source 0.15.0 1
  * dev/release/verify-release-candidate.sh binaries 0.14.1 0

with:

  * gcc (Debian 9.2.1-7) 9.2.1
  * openjdk version "1.8.0_212"
  * Node.JS v12.1.0
  * go version go1.12.9 linux/amd64
  * nvidia-cuda-dev 10.1.105-3


I got the following failures:

  * Not ignorable:
    * Binary: Bad signature
      * centos-rc/6/Source/repodata/repomd.xml is failed
      * We can't ignore this if removing the file from
        https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1 and
        re-uploading it doesn't solve this problem.

  * Ignorable:
    * C GLib and Ruby: Buildable but can't run test with GLib 2.62.0.
      * It's caused by gobject-introspection gem.
      * This is a known problem and not a C GLib problem.
      * We can ignore this. (I'm fixing gobject-introspection gem.)
    * Rust: "cargo +stable fmt --all -- --check" is failed (*)
      * If I commented the command line out, Rust verification is passed.
      * We can ignore this. Because this is just a lint error.
    * C#: "sourcelink test" is failed
      * We can ignore this. This is happened when we release 0.14.1 too.
    * APT and Yum: arm64 and aarch64 are broken
      * We can ignore this.

(*)
----
+ cargo +stable fmt --all -- --check
Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/array/builder.rs at line 1458:
         let mut builder = StructBuilder::new(fields, field_builders);
         assert!(builder.field_builder::<BinaryBuilder>(0).is_none());
     }
-
 }
 
Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/arrow/src/bitmap.rs at line 126:
         assert_eq!(true, bitmap.is_set(6));
         assert_eq!(false, bitmap.is_set(7));
     }
-
 }
 
Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/aggregate.rs at line 1471:
             ds,
         )))))
     }
-
 }
 
Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/context.rs at line 682:
 
         Ok(ctx)
     }
-
 }
 
Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/hash_aggregate.rs at line 720:
 
         Ok(())
     }
-
 }
 
Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/merge.rs at line 134:
 
         Ok(())
     }
-
 }
 
Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/projection.rs at line 171:
 
         Ok(())
     }
-
 }
 
Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/physical_plan/selection.rs at line 180:
 
         Ok(())
     }
-
 }
 
Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/projection.rs at line 141:
 
         assert_eq!("c1", batch.schema().field(0).name());
     }
-
 }
 
Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/execution/table_impl.rs at line 315:
             true,
         );
     }
-
 }
 
Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/logicalplan.rs at line 641:
             println!("plan: {:?}", plan1);
         });
     }
-
 }
 
Diff in /tmp/arrow-0.15.0.tGMnP/apache-arrow-0.15.0/rust/datafusion/src/sql/planner.rs at line 569:
             }
         }
     }
-
 }
----



Thanks,
--
kou

In <CA...@mail.gmail.com>
  "Subject: [VOTE] Release Apache Arrow 0.15.0 - RC1" on Fri, 27 Sep 2019 02:18:05 -0600,
  Micah Kornfield <em...@gmail.com> wrote:

> Hi,
> 
> 
> I would like to propose the following release candidate (RC1) of Apache
> 
> Arrow version 0.15.0. This is a release consisting of 672
> 
> resolved JIRA issues[1]. (RC0 was aborted due to release script issues).
> 
> 
> This release candidate is based on commit:
> 
> 77f091888dbe5a4e023a66b986a2dd474696061a [2]
> 
> 
> The source release rc1 is hosted at [3].
> 
> The binary artifacts are hosted at [4][5][6][7].
> 
> The changelog is located at [8].
> 
> 
> Please download, verify checksums and signatures, run the unit tests,
> 
> and vote on the release. See [9] for how to validate a release candidate.
> 
> 
> The vote will be open for at least 72 hours.
> 
> 
> [ ] +1 Release this as Apache Arrow 0.15.0
> 
> [ ] +0
> 
> [ ] -1 Do not release this as Apache Arrow 0.15.0 because...
> 
> 
> [1]:
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%200.15.0
> 
> [2]:
> https://github.com/apache/arrow/tree/77f091888dbe5a4e023a66b986a2dd474696061a
> 
> [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.15.0-rc1
> 
> [4]: https://bintray.com/apache/arrow/centos-rc/0.15.0-rc1
> 
> [5]: https://bintray.com/apache/arrow/debian-rc/0.15.0-rc1
> 
> [6]: https://bintray.com/apache/arrow/python-rc/0.15.0-rc1
> 
> [7]: https://bintray.com/apache/arrow/ubuntu-rc/0.15.0-rc1
> 
> [8]:
> https://github.com/apache/arrow/blob/77f091888dbe5a4e023a66b986a2dd474696061a/CHANGELOG.md
> 
> [9]:
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates