You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Wes McKinney <we...@gmail.com> on 2018/09/17 17:26:55 UTC
Re: Timeline for 0.11 Arrow release
hi folks,
It looks like we are closing in on the 0.11 release -- I have spent a
bunch of time gardening the backlog.
https://issues.apache.org/jira/projects/ARROW/versions/12343066
There are quite a few open patches still and housekeeping items
remaining. If you can help complete some of these issues this week,
please take a look and assign yourself to the issue.
I reckon we need this whole week to get into release-ready shape. Any
reason why we could not have a release vote next week?
Thanks,
Wes
On Wed, Aug 22, 2018 at 2:31 AM Uwe L. Korn <uw...@xhochy.com> wrote:
>
> Hello,
>
> I will also go over the release and add items. For my personal goal for 0.11, I want to have predicate pushdown for Parquet files working. This means that we should be able to determine in Python code what the relevant RowGroups in a file are as well as filtering a Table given the set of predicates. Thus we want to have a pyarrow.parquet.read_table variant that takes in a set of predicates in disjunctive normal form and returns a (possibly empty) table with only the rows that match the predicates. Please be aware when of this when moving issues to 0.12.
>
> Uwe
>
> On Tue, Aug 21, 2018, at 9:01 PM, Wes McKinney wrote:
> > hi all,
> >
> > I know it seems like we just released 0.10, but we are already 75
> > issues deep in 0.11 and have addressed a number of issues that
> > surfaced with 0.10
> >
> > https://issues.apache.org/jira/projects/ARROW/versions/12343066
> >
> > I suggest that we plan to release again the week of September 10. That
> > will be a slow week for me anyway because of the Strata conference in
> > NYC. This gives us enough time to resolve the outstanding packaging
> > issues and to complete the parquet-cpp merge and associated packaging
> > changes needed there.
> >
> > I will start curating the backlog next week to move anything
> > definitely aspirational to 0.12 so we can have a sense of the must-do
> > work for 0.11. Any help with backlog curation would be appreciated.
> >
> > Any other thoughts? In general I think we should be releasing every
> > 4-6 weeks for a while since the pace of progress is quite fast, and
> > many new users are coming into the ecosystem which will benefit from
> > more frequent releases.
> >
> > Thanks,
> > Wes
Re: Timeline for 0.11 Arrow release
Posted by Kouhei Sutou <ko...@clear-code.com>.
Hi,
Thanks for looking into this. I've ignored this in
0.11.0-rc1.
Thanks,
--
kou
In <CA...@mail.gmail.com>
"Re: Timeline for 0.11 Arrow release" on Wed, 3 Oct 2018 05:27:29 -0400,
Wes McKinney <we...@gmail.com> wrote:
> So, I untarred the folder, retarred it, and then ran RAT again and it says
>
> $ tar xf apache-arrow-0.11.0.tar.gz && tar zc apache-arrow-0.11.0/ >
> apache-arrow-0.11.0.tar.gz
>
> $ dev/release/run-rat.sh apache-arrow-0.11.0.tar.gz
> NOT APPROVED: cpp/cmake_modules/FindInferTools.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindInferTools.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindZLIB.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindZLIB.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindGPerf.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindGPerf.cmake): false
> NOT APPROVED: cpp/cmake_modules/Findjemalloc.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/Findjemalloc.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindArrowCuda.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindArrowCuda.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindFlatbuffers.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindFlatbuffers.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindParquet.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindParquet.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindZSTD.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindZSTD.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindLLVM.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindLLVM.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindThrift.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindThrift.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindRE2.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindRE2.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindGFlags.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindGFlags.cmake): false
> NOT APPROVED: cpp/cmake_modules/UseCython.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/UseCython.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindProtobuf.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindProtobuf.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindLz4.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindLz4.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindClangTools.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindClangTools.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindArrow.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindArrow.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindPlasma.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindPlasma.cmake): false
> NOT APPROVED: cpp/cmake_modules/GandivaBuildUtils.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/GandivaBuildUtils.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindGTest.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindGTest.cmake): false
> NOT APPROVED: cpp/cmake_modules/san-config.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/san-config.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindSnappy.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindSnappy.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindGBenchmark.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindGBenchmark.cmake): false
> NOT APPROVED: cpp/cmake_modules/ThirdpartyToolchain.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/ThirdpartyToolchain.cmake):
> false
> NOT APPROVED: cpp/cmake_modules/FindGLOG.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindGLOG.cmake): false
> NOT APPROVED: cpp/cmake_modules/FindBrotli.cmake
> (apache-arrow-0.11.0/cpp/cmake_modules/FindBrotli.cmake): false
> 26 unapproved licences. Check rat report: rat.txt
>
> It seems like a bug in Apache RAT. I'm not sure how to proceed with
> debugging, but I don't think this should block the release
> On Wed, Oct 3, 2018 at 4:54 AM Wes McKinney <we...@gmail.com> wrote:
>>
>> hi Kou,
>>
>> Thank you for working on the release. I'm looking into the RAT problem.
>>
>> Also, the .parquetcppversion needs to be updated so the version number
>> in files is > 1.5.0. I will post a patch. We need to decide in general
>> how to handle the version metadata that is written to Parquet files by
>> libraries from an Arrow release
>>
>> - Wes
>>
>>
>> On Wed, Oct 3, 2018 at 4:38 AM Kouhei Sutou <ko...@clear-code.com> wrote:
>> >
>> > Hi,
>> >
>> > I've created RC0 archive but there are some problems.
>> > Most problems has been fixed. I'll create RC1 archive
>> > tomorrow.
>> >
>> > There is a problem that I couldn't fix:
>> >
>> > https://issues.apache.org/jira/browse/ARROW-3412
>> >
>> > rat reports a failure for cpp/cmake_modules/FindArrow.cmake
>> > in tar.gz. Can someone help us?
>> >
>> > You can reproduce this case:
>> >
>> >
>> > % wget https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.11.0-rc0/apache-arrow-0.11.0.tar.gz
>> > % dev/release/run-rat.sh apache-arrow-0.11.0.tar.gz
>> > NOT APPROVED: cpp/cmake_modules/FindArrow.cmake (apache-arrow-0.11.0/cpp/cmake_modules/FindArrow.cmake): false
>> > 1 unapproved licences. Check rat report: rat.txt
>> >
>> >
>> > Thanks,
>> > --
>> > kou
>> >
>> > In <20...@clear-code.com>
>> > "Re: Timeline for 0.11 Arrow release" on Tue, 02 Oct 2018 23:58:48 +0900 (JST),
>> > Kouhei Sutou <ko...@clear-code.com> wrote:
>> >
>> > > Hi,
>> > >
>> > > I've finished Parquet GLib dev/rpm packages task but cwiki
>> > > is down just now...
>> > >
>> > > https://status.apache.org/incidents/rp15hsl5vrc9
>> > >
>> > > So I'll work on creating RC0 archive tomorrow.
>> > >
>> > >
>> > > Thanks,
>> > > --
>> > > kou
>> > >
>> > > In <20...@clear-code.com>
>> > > "Re: Timeline for 0.11 Arrow release" on Tue, 02 Oct 2018 11:37:21 +0900 (JST),
>> > > Kouhei Sutou <ko...@clear-code.com> wrote:
>> > >
>> > >> Hi all,
>> > >>
>> > >> Thanks for working together for 0.11.0!
>> > >>
>> > >> I'll add support for Parquet GLib deb/rpm packages and then
>> > >> create RC0 archive.
>> > >>
>> > >>
>> > >> Thanks,
>> > >> --
>> > >> kou
>> > >>
>> > >>
>> > >> In <CA...@mail.gmail.com>
>> > >> "Re: Timeline for 0.11 Arrow release" on Mon, 1 Oct 2018 17:32:45 -0400,
>> > >> Wes McKinney <we...@gmail.com> wrote:
>> > >>
>> > >>> I think we're ready to cut a release candidate. Thanks to everyone
>> > >>> On Mon, Oct 1, 2018 at 6:50 AM Wes McKinney <we...@gmail.com> wrote:
>> > >>>>
>> > >>>> hi Kou,
>> > >>>>
>> > >>>> Looks like we are closing out the remaining items right now with a
>> > >>>> couple more patches going in today. There's some housekeeping items
>> > >>>> like ARROW-2310, ARROW-2983, but they are not blockers. I would say
>> > >>>> when you are awake on Tuesday in Japan you can move forward with
>> > >>>> cutting the release candidate.
>> > >>>>
>> > >>>> As usual I can write the release announcement blog post and have that
>> > >>>> ready when we are ready to announce the release later this week or
>> > >>>> first thing next week.
>> > >>>>
>> > >>>> thanks
>> > >>>> Wes
>> > >>>> On Sun, Sep 30, 2018 at 8:40 PM Kouhei Sutou <ko...@clear-code.com> wrote:
>> > >>>> >
>> > >>>> > Hi,
>> > >>>> >
>> > >>>> > I'll start RC release process.
>> > >>>> >
>> > >>>> > I've just created Arrow 0.11.0 Release page:
>> > >>>> >
>> > >>>> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+0.11.0+Release
>> > >>>> >
>> > >>>> > Are there any blockers?
>> > >>>> >
>> > >>>> > If anyone can work together for the process, it's very
>> > >>>> > helpful. For example, resolving blockers, writing release
>> > >>>> > announce blog post and so on.
>> > >>>> >
>> > >>>> > See also:
>> > >>>> > https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide
>> > >>>> >
>> > >>>> > Thanks,
>> > >>>> > --
>> > >>>> > kou
>> > >>>> >
>> > >>>> > In <CA...@mail.gmail.com>
>> > >>>> > "Re: Timeline for 0.11 Arrow release" on Thu, 27 Sep 2018 11:24:01 -0400,
>> > >>>> > Wes McKinney <we...@gmail.com> wrote:
>> > >>>> >
>> > >>>> > > Thanks Kou. I suggest we shoot for an RC on Monday or Tuesday since we
>> > >>>> > > are working through some last-minute issues. I'm going to be code
>> > >>>> > > reviewing and hacking through the weekend so we can hopefully be in
>> > >>>> > > release-ready shape by Monday
>> > >>>> > > On Tue, Sep 25, 2018 at 10:14 AM Kouhei Sutou <ko...@clear-code.com> wrote:
>> > >>>> > >>
>> > >>>> > >> Hi,
>> > >>>> > >>
>> > >>>> > >> In <15...@webmail.messagingengine.com>
>> > >>>> > >> "Re: Timeline for 0.11 Arrow release" on Tue, 25 Sep 2018 16:01:46 +0200,
>> > >>>> > >> "Uwe L. Korn" <uw...@xhochy.com> wrote:
>> > >>>> > >>
>> > >>>> > >> >> I may not be able to work on this for 0.11 but can you add
>> > >>>> > >> >> me to https://bintray.com/apache ? I want write permission
>> > >>>> > >> >> to https://bintray.com/apache/arrow .
>> > >>>> > >> >>
>> > >>>> > >> >> https://bintray.com/kou is my account.
>> > >>>> > >> >
>> > >>>> > >> > You will need to make an INFRA ticket for this. The apache org is centrally managed.
>> > >>>> > >>
>> > >>>> > >> Thanks.
>> > >>>> > >> I've create an INFRA ticket:
>> > >>>> > >> https://issues.apache.org/jira/browse/INFRA-17059
>> > >>>> > >>
>> > >>>> > >>
>> > >>>> > >> --
>> > >>>> > >> kou
Re: Timeline for 0.11 Arrow release
Posted by Wes McKinney <we...@gmail.com>.
So, I untarred the folder, retarred it, and then ran RAT again and it says
$ tar xf apache-arrow-0.11.0.tar.gz && tar zc apache-arrow-0.11.0/ >
apache-arrow-0.11.0.tar.gz
$ dev/release/run-rat.sh apache-arrow-0.11.0.tar.gz
NOT APPROVED: cpp/cmake_modules/FindInferTools.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindInferTools.cmake): false
NOT APPROVED: cpp/cmake_modules/FindZLIB.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindZLIB.cmake): false
NOT APPROVED: cpp/cmake_modules/FindGPerf.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindGPerf.cmake): false
NOT APPROVED: cpp/cmake_modules/Findjemalloc.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/Findjemalloc.cmake): false
NOT APPROVED: cpp/cmake_modules/FindArrowCuda.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindArrowCuda.cmake): false
NOT APPROVED: cpp/cmake_modules/FindFlatbuffers.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindFlatbuffers.cmake): false
NOT APPROVED: cpp/cmake_modules/FindParquet.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindParquet.cmake): false
NOT APPROVED: cpp/cmake_modules/FindZSTD.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindZSTD.cmake): false
NOT APPROVED: cpp/cmake_modules/FindLLVM.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindLLVM.cmake): false
NOT APPROVED: cpp/cmake_modules/FindThrift.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindThrift.cmake): false
NOT APPROVED: cpp/cmake_modules/FindRE2.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindRE2.cmake): false
NOT APPROVED: cpp/cmake_modules/FindGFlags.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindGFlags.cmake): false
NOT APPROVED: cpp/cmake_modules/UseCython.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/UseCython.cmake): false
NOT APPROVED: cpp/cmake_modules/FindProtobuf.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindProtobuf.cmake): false
NOT APPROVED: cpp/cmake_modules/FindLz4.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindLz4.cmake): false
NOT APPROVED: cpp/cmake_modules/FindClangTools.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindClangTools.cmake): false
NOT APPROVED: cpp/cmake_modules/FindArrow.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindArrow.cmake): false
NOT APPROVED: cpp/cmake_modules/FindPlasma.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindPlasma.cmake): false
NOT APPROVED: cpp/cmake_modules/GandivaBuildUtils.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/GandivaBuildUtils.cmake): false
NOT APPROVED: cpp/cmake_modules/FindGTest.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindGTest.cmake): false
NOT APPROVED: cpp/cmake_modules/san-config.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/san-config.cmake): false
NOT APPROVED: cpp/cmake_modules/FindSnappy.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindSnappy.cmake): false
NOT APPROVED: cpp/cmake_modules/FindGBenchmark.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindGBenchmark.cmake): false
NOT APPROVED: cpp/cmake_modules/ThirdpartyToolchain.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/ThirdpartyToolchain.cmake):
false
NOT APPROVED: cpp/cmake_modules/FindGLOG.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindGLOG.cmake): false
NOT APPROVED: cpp/cmake_modules/FindBrotli.cmake
(apache-arrow-0.11.0/cpp/cmake_modules/FindBrotli.cmake): false
26 unapproved licences. Check rat report: rat.txt
It seems like a bug in Apache RAT. I'm not sure how to proceed with
debugging, but I don't think this should block the release
On Wed, Oct 3, 2018 at 4:54 AM Wes McKinney <we...@gmail.com> wrote:
>
> hi Kou,
>
> Thank you for working on the release. I'm looking into the RAT problem.
>
> Also, the .parquetcppversion needs to be updated so the version number
> in files is > 1.5.0. I will post a patch. We need to decide in general
> how to handle the version metadata that is written to Parquet files by
> libraries from an Arrow release
>
> - Wes
>
>
> On Wed, Oct 3, 2018 at 4:38 AM Kouhei Sutou <ko...@clear-code.com> wrote:
> >
> > Hi,
> >
> > I've created RC0 archive but there are some problems.
> > Most problems has been fixed. I'll create RC1 archive
> > tomorrow.
> >
> > There is a problem that I couldn't fix:
> >
> > https://issues.apache.org/jira/browse/ARROW-3412
> >
> > rat reports a failure for cpp/cmake_modules/FindArrow.cmake
> > in tar.gz. Can someone help us?
> >
> > You can reproduce this case:
> >
> >
> > % wget https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.11.0-rc0/apache-arrow-0.11.0.tar.gz
> > % dev/release/run-rat.sh apache-arrow-0.11.0.tar.gz
> > NOT APPROVED: cpp/cmake_modules/FindArrow.cmake (apache-arrow-0.11.0/cpp/cmake_modules/FindArrow.cmake): false
> > 1 unapproved licences. Check rat report: rat.txt
> >
> >
> > Thanks,
> > --
> > kou
> >
> > In <20...@clear-code.com>
> > "Re: Timeline for 0.11 Arrow release" on Tue, 02 Oct 2018 23:58:48 +0900 (JST),
> > Kouhei Sutou <ko...@clear-code.com> wrote:
> >
> > > Hi,
> > >
> > > I've finished Parquet GLib dev/rpm packages task but cwiki
> > > is down just now...
> > >
> > > https://status.apache.org/incidents/rp15hsl5vrc9
> > >
> > > So I'll work on creating RC0 archive tomorrow.
> > >
> > >
> > > Thanks,
> > > --
> > > kou
> > >
> > > In <20...@clear-code.com>
> > > "Re: Timeline for 0.11 Arrow release" on Tue, 02 Oct 2018 11:37:21 +0900 (JST),
> > > Kouhei Sutou <ko...@clear-code.com> wrote:
> > >
> > >> Hi all,
> > >>
> > >> Thanks for working together for 0.11.0!
> > >>
> > >> I'll add support for Parquet GLib deb/rpm packages and then
> > >> create RC0 archive.
> > >>
> > >>
> > >> Thanks,
> > >> --
> > >> kou
> > >>
> > >>
> > >> In <CA...@mail.gmail.com>
> > >> "Re: Timeline for 0.11 Arrow release" on Mon, 1 Oct 2018 17:32:45 -0400,
> > >> Wes McKinney <we...@gmail.com> wrote:
> > >>
> > >>> I think we're ready to cut a release candidate. Thanks to everyone
> > >>> On Mon, Oct 1, 2018 at 6:50 AM Wes McKinney <we...@gmail.com> wrote:
> > >>>>
> > >>>> hi Kou,
> > >>>>
> > >>>> Looks like we are closing out the remaining items right now with a
> > >>>> couple more patches going in today. There's some housekeeping items
> > >>>> like ARROW-2310, ARROW-2983, but they are not blockers. I would say
> > >>>> when you are awake on Tuesday in Japan you can move forward with
> > >>>> cutting the release candidate.
> > >>>>
> > >>>> As usual I can write the release announcement blog post and have that
> > >>>> ready when we are ready to announce the release later this week or
> > >>>> first thing next week.
> > >>>>
> > >>>> thanks
> > >>>> Wes
> > >>>> On Sun, Sep 30, 2018 at 8:40 PM Kouhei Sutou <ko...@clear-code.com> wrote:
> > >>>> >
> > >>>> > Hi,
> > >>>> >
> > >>>> > I'll start RC release process.
> > >>>> >
> > >>>> > I've just created Arrow 0.11.0 Release page:
> > >>>> >
> > >>>> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+0.11.0+Release
> > >>>> >
> > >>>> > Are there any blockers?
> > >>>> >
> > >>>> > If anyone can work together for the process, it's very
> > >>>> > helpful. For example, resolving blockers, writing release
> > >>>> > announce blog post and so on.
> > >>>> >
> > >>>> > See also:
> > >>>> > https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide
> > >>>> >
> > >>>> > Thanks,
> > >>>> > --
> > >>>> > kou
> > >>>> >
> > >>>> > In <CA...@mail.gmail.com>
> > >>>> > "Re: Timeline for 0.11 Arrow release" on Thu, 27 Sep 2018 11:24:01 -0400,
> > >>>> > Wes McKinney <we...@gmail.com> wrote:
> > >>>> >
> > >>>> > > Thanks Kou. I suggest we shoot for an RC on Monday or Tuesday since we
> > >>>> > > are working through some last-minute issues. I'm going to be code
> > >>>> > > reviewing and hacking through the weekend so we can hopefully be in
> > >>>> > > release-ready shape by Monday
> > >>>> > > On Tue, Sep 25, 2018 at 10:14 AM Kouhei Sutou <ko...@clear-code.com> wrote:
> > >>>> > >>
> > >>>> > >> Hi,
> > >>>> > >>
> > >>>> > >> In <15...@webmail.messagingengine.com>
> > >>>> > >> "Re: Timeline for 0.11 Arrow release" on Tue, 25 Sep 2018 16:01:46 +0200,
> > >>>> > >> "Uwe L. Korn" <uw...@xhochy.com> wrote:
> > >>>> > >>
> > >>>> > >> >> I may not be able to work on this for 0.11 but can you add
> > >>>> > >> >> me to https://bintray.com/apache ? I want write permission
> > >>>> > >> >> to https://bintray.com/apache/arrow .
> > >>>> > >> >>
> > >>>> > >> >> https://bintray.com/kou is my account.
> > >>>> > >> >
> > >>>> > >> > You will need to make an INFRA ticket for this. The apache org is centrally managed.
> > >>>> > >>
> > >>>> > >> Thanks.
> > >>>> > >> I've create an INFRA ticket:
> > >>>> > >> https://issues.apache.org/jira/browse/INFRA-17059
> > >>>> > >>
> > >>>> > >>
> > >>>> > >> --
> > >>>> > >> kou
Re: Timeline for 0.11 Arrow release
Posted by Wes McKinney <we...@gmail.com>.
hi Kou,
Thank you for working on the release. I'm looking into the RAT problem.
Also, the .parquetcppversion needs to be updated so the version number
in files is > 1.5.0. I will post a patch. We need to decide in general
how to handle the version metadata that is written to Parquet files by
libraries from an Arrow release
- Wes
On Wed, Oct 3, 2018 at 4:38 AM Kouhei Sutou <ko...@clear-code.com> wrote:
>
> Hi,
>
> I've created RC0 archive but there are some problems.
> Most problems has been fixed. I'll create RC1 archive
> tomorrow.
>
> There is a problem that I couldn't fix:
>
> https://issues.apache.org/jira/browse/ARROW-3412
>
> rat reports a failure for cpp/cmake_modules/FindArrow.cmake
> in tar.gz. Can someone help us?
>
> You can reproduce this case:
>
>
> % wget https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.11.0-rc0/apache-arrow-0.11.0.tar.gz
> % dev/release/run-rat.sh apache-arrow-0.11.0.tar.gz
> NOT APPROVED: cpp/cmake_modules/FindArrow.cmake (apache-arrow-0.11.0/cpp/cmake_modules/FindArrow.cmake): false
> 1 unapproved licences. Check rat report: rat.txt
>
>
> Thanks,
> --
> kou
>
> In <20...@clear-code.com>
> "Re: Timeline for 0.11 Arrow release" on Tue, 02 Oct 2018 23:58:48 +0900 (JST),
> Kouhei Sutou <ko...@clear-code.com> wrote:
>
> > Hi,
> >
> > I've finished Parquet GLib dev/rpm packages task but cwiki
> > is down just now...
> >
> > https://status.apache.org/incidents/rp15hsl5vrc9
> >
> > So I'll work on creating RC0 archive tomorrow.
> >
> >
> > Thanks,
> > --
> > kou
> >
> > In <20...@clear-code.com>
> > "Re: Timeline for 0.11 Arrow release" on Tue, 02 Oct 2018 11:37:21 +0900 (JST),
> > Kouhei Sutou <ko...@clear-code.com> wrote:
> >
> >> Hi all,
> >>
> >> Thanks for working together for 0.11.0!
> >>
> >> I'll add support for Parquet GLib deb/rpm packages and then
> >> create RC0 archive.
> >>
> >>
> >> Thanks,
> >> --
> >> kou
> >>
> >>
> >> In <CA...@mail.gmail.com>
> >> "Re: Timeline for 0.11 Arrow release" on Mon, 1 Oct 2018 17:32:45 -0400,
> >> Wes McKinney <we...@gmail.com> wrote:
> >>
> >>> I think we're ready to cut a release candidate. Thanks to everyone
> >>> On Mon, Oct 1, 2018 at 6:50 AM Wes McKinney <we...@gmail.com> wrote:
> >>>>
> >>>> hi Kou,
> >>>>
> >>>> Looks like we are closing out the remaining items right now with a
> >>>> couple more patches going in today. There's some housekeeping items
> >>>> like ARROW-2310, ARROW-2983, but they are not blockers. I would say
> >>>> when you are awake on Tuesday in Japan you can move forward with
> >>>> cutting the release candidate.
> >>>>
> >>>> As usual I can write the release announcement blog post and have that
> >>>> ready when we are ready to announce the release later this week or
> >>>> first thing next week.
> >>>>
> >>>> thanks
> >>>> Wes
> >>>> On Sun, Sep 30, 2018 at 8:40 PM Kouhei Sutou <ko...@clear-code.com> wrote:
> >>>> >
> >>>> > Hi,
> >>>> >
> >>>> > I'll start RC release process.
> >>>> >
> >>>> > I've just created Arrow 0.11.0 Release page:
> >>>> >
> >>>> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+0.11.0+Release
> >>>> >
> >>>> > Are there any blockers?
> >>>> >
> >>>> > If anyone can work together for the process, it's very
> >>>> > helpful. For example, resolving blockers, writing release
> >>>> > announce blog post and so on.
> >>>> >
> >>>> > See also:
> >>>> > https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide
> >>>> >
> >>>> > Thanks,
> >>>> > --
> >>>> > kou
> >>>> >
> >>>> > In <CA...@mail.gmail.com>
> >>>> > "Re: Timeline for 0.11 Arrow release" on Thu, 27 Sep 2018 11:24:01 -0400,
> >>>> > Wes McKinney <we...@gmail.com> wrote:
> >>>> >
> >>>> > > Thanks Kou. I suggest we shoot for an RC on Monday or Tuesday since we
> >>>> > > are working through some last-minute issues. I'm going to be code
> >>>> > > reviewing and hacking through the weekend so we can hopefully be in
> >>>> > > release-ready shape by Monday
> >>>> > > On Tue, Sep 25, 2018 at 10:14 AM Kouhei Sutou <ko...@clear-code.com> wrote:
> >>>> > >>
> >>>> > >> Hi,
> >>>> > >>
> >>>> > >> In <15...@webmail.messagingengine.com>
> >>>> > >> "Re: Timeline for 0.11 Arrow release" on Tue, 25 Sep 2018 16:01:46 +0200,
> >>>> > >> "Uwe L. Korn" <uw...@xhochy.com> wrote:
> >>>> > >>
> >>>> > >> >> I may not be able to work on this for 0.11 but can you add
> >>>> > >> >> me to https://bintray.com/apache ? I want write permission
> >>>> > >> >> to https://bintray.com/apache/arrow .
> >>>> > >> >>
> >>>> > >> >> https://bintray.com/kou is my account.
> >>>> > >> >
> >>>> > >> > You will need to make an INFRA ticket for this. The apache org is centrally managed.
> >>>> > >>
> >>>> > >> Thanks.
> >>>> > >> I've create an INFRA ticket:
> >>>> > >> https://issues.apache.org/jira/browse/INFRA-17059
> >>>> > >>
> >>>> > >>
> >>>> > >> --
> >>>> > >> kou
Re: Timeline for 0.11 Arrow release
Posted by Kouhei Sutou <ko...@clear-code.com>.
Hi,
I've created RC0 archive but there are some problems.
Most problems has been fixed. I'll create RC1 archive
tomorrow.
There is a problem that I couldn't fix:
https://issues.apache.org/jira/browse/ARROW-3412
rat reports a failure for cpp/cmake_modules/FindArrow.cmake
in tar.gz. Can someone help us?
You can reproduce this case:
% wget https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-0.11.0-rc0/apache-arrow-0.11.0.tar.gz
% dev/release/run-rat.sh apache-arrow-0.11.0.tar.gz
NOT APPROVED: cpp/cmake_modules/FindArrow.cmake (apache-arrow-0.11.0/cpp/cmake_modules/FindArrow.cmake): false
1 unapproved licences. Check rat report: rat.txt
Thanks,
--
kou
In <20...@clear-code.com>
"Re: Timeline for 0.11 Arrow release" on Tue, 02 Oct 2018 23:58:48 +0900 (JST),
Kouhei Sutou <ko...@clear-code.com> wrote:
> Hi,
>
> I've finished Parquet GLib dev/rpm packages task but cwiki
> is down just now...
>
> https://status.apache.org/incidents/rp15hsl5vrc9
>
> So I'll work on creating RC0 archive tomorrow.
>
>
> Thanks,
> --
> kou
>
> In <20...@clear-code.com>
> "Re: Timeline for 0.11 Arrow release" on Tue, 02 Oct 2018 11:37:21 +0900 (JST),
> Kouhei Sutou <ko...@clear-code.com> wrote:
>
>> Hi all,
>>
>> Thanks for working together for 0.11.0!
>>
>> I'll add support for Parquet GLib deb/rpm packages and then
>> create RC0 archive.
>>
>>
>> Thanks,
>> --
>> kou
>>
>>
>> In <CA...@mail.gmail.com>
>> "Re: Timeline for 0.11 Arrow release" on Mon, 1 Oct 2018 17:32:45 -0400,
>> Wes McKinney <we...@gmail.com> wrote:
>>
>>> I think we're ready to cut a release candidate. Thanks to everyone
>>> On Mon, Oct 1, 2018 at 6:50 AM Wes McKinney <we...@gmail.com> wrote:
>>>>
>>>> hi Kou,
>>>>
>>>> Looks like we are closing out the remaining items right now with a
>>>> couple more patches going in today. There's some housekeeping items
>>>> like ARROW-2310, ARROW-2983, but they are not blockers. I would say
>>>> when you are awake on Tuesday in Japan you can move forward with
>>>> cutting the release candidate.
>>>>
>>>> As usual I can write the release announcement blog post and have that
>>>> ready when we are ready to announce the release later this week or
>>>> first thing next week.
>>>>
>>>> thanks
>>>> Wes
>>>> On Sun, Sep 30, 2018 at 8:40 PM Kouhei Sutou <ko...@clear-code.com> wrote:
>>>> >
>>>> > Hi,
>>>> >
>>>> > I'll start RC release process.
>>>> >
>>>> > I've just created Arrow 0.11.0 Release page:
>>>> >
>>>> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+0.11.0+Release
>>>> >
>>>> > Are there any blockers?
>>>> >
>>>> > If anyone can work together for the process, it's very
>>>> > helpful. For example, resolving blockers, writing release
>>>> > announce blog post and so on.
>>>> >
>>>> > See also:
>>>> > https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide
>>>> >
>>>> > Thanks,
>>>> > --
>>>> > kou
>>>> >
>>>> > In <CA...@mail.gmail.com>
>>>> > "Re: Timeline for 0.11 Arrow release" on Thu, 27 Sep 2018 11:24:01 -0400,
>>>> > Wes McKinney <we...@gmail.com> wrote:
>>>> >
>>>> > > Thanks Kou. I suggest we shoot for an RC on Monday or Tuesday since we
>>>> > > are working through some last-minute issues. I'm going to be code
>>>> > > reviewing and hacking through the weekend so we can hopefully be in
>>>> > > release-ready shape by Monday
>>>> > > On Tue, Sep 25, 2018 at 10:14 AM Kouhei Sutou <ko...@clear-code.com> wrote:
>>>> > >>
>>>> > >> Hi,
>>>> > >>
>>>> > >> In <15...@webmail.messagingengine.com>
>>>> > >> "Re: Timeline for 0.11 Arrow release" on Tue, 25 Sep 2018 16:01:46 +0200,
>>>> > >> "Uwe L. Korn" <uw...@xhochy.com> wrote:
>>>> > >>
>>>> > >> >> I may not be able to work on this for 0.11 but can you add
>>>> > >> >> me to https://bintray.com/apache ? I want write permission
>>>> > >> >> to https://bintray.com/apache/arrow .
>>>> > >> >>
>>>> > >> >> https://bintray.com/kou is my account.
>>>> > >> >
>>>> > >> > You will need to make an INFRA ticket for this. The apache org is centrally managed.
>>>> > >>
>>>> > >> Thanks.
>>>> > >> I've create an INFRA ticket:
>>>> > >> https://issues.apache.org/jira/browse/INFRA-17059
>>>> > >>
>>>> > >>
>>>> > >> --
>>>> > >> kou
Re: Timeline for 0.11 Arrow release
Posted by Kouhei Sutou <ko...@clear-code.com>.
Hi,
I've finished Parquet GLib dev/rpm packages task but cwiki
is down just now...
https://status.apache.org/incidents/rp15hsl5vrc9
So I'll work on creating RC0 archive tomorrow.
Thanks,
--
kou
In <20...@clear-code.com>
"Re: Timeline for 0.11 Arrow release" on Tue, 02 Oct 2018 11:37:21 +0900 (JST),
Kouhei Sutou <ko...@clear-code.com> wrote:
> Hi all,
>
> Thanks for working together for 0.11.0!
>
> I'll add support for Parquet GLib deb/rpm packages and then
> create RC0 archive.
>
>
> Thanks,
> --
> kou
>
>
> In <CA...@mail.gmail.com>
> "Re: Timeline for 0.11 Arrow release" on Mon, 1 Oct 2018 17:32:45 -0400,
> Wes McKinney <we...@gmail.com> wrote:
>
>> I think we're ready to cut a release candidate. Thanks to everyone
>> On Mon, Oct 1, 2018 at 6:50 AM Wes McKinney <we...@gmail.com> wrote:
>>>
>>> hi Kou,
>>>
>>> Looks like we are closing out the remaining items right now with a
>>> couple more patches going in today. There's some housekeeping items
>>> like ARROW-2310, ARROW-2983, but they are not blockers. I would say
>>> when you are awake on Tuesday in Japan you can move forward with
>>> cutting the release candidate.
>>>
>>> As usual I can write the release announcement blog post and have that
>>> ready when we are ready to announce the release later this week or
>>> first thing next week.
>>>
>>> thanks
>>> Wes
>>> On Sun, Sep 30, 2018 at 8:40 PM Kouhei Sutou <ko...@clear-code.com> wrote:
>>> >
>>> > Hi,
>>> >
>>> > I'll start RC release process.
>>> >
>>> > I've just created Arrow 0.11.0 Release page:
>>> >
>>> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+0.11.0+Release
>>> >
>>> > Are there any blockers?
>>> >
>>> > If anyone can work together for the process, it's very
>>> > helpful. For example, resolving blockers, writing release
>>> > announce blog post and so on.
>>> >
>>> > See also:
>>> > https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide
>>> >
>>> > Thanks,
>>> > --
>>> > kou
>>> >
>>> > In <CA...@mail.gmail.com>
>>> > "Re: Timeline for 0.11 Arrow release" on Thu, 27 Sep 2018 11:24:01 -0400,
>>> > Wes McKinney <we...@gmail.com> wrote:
>>> >
>>> > > Thanks Kou. I suggest we shoot for an RC on Monday or Tuesday since we
>>> > > are working through some last-minute issues. I'm going to be code
>>> > > reviewing and hacking through the weekend so we can hopefully be in
>>> > > release-ready shape by Monday
>>> > > On Tue, Sep 25, 2018 at 10:14 AM Kouhei Sutou <ko...@clear-code.com> wrote:
>>> > >>
>>> > >> Hi,
>>> > >>
>>> > >> In <15...@webmail.messagingengine.com>
>>> > >> "Re: Timeline for 0.11 Arrow release" on Tue, 25 Sep 2018 16:01:46 +0200,
>>> > >> "Uwe L. Korn" <uw...@xhochy.com> wrote:
>>> > >>
>>> > >> >> I may not be able to work on this for 0.11 but can you add
>>> > >> >> me to https://bintray.com/apache ? I want write permission
>>> > >> >> to https://bintray.com/apache/arrow .
>>> > >> >>
>>> > >> >> https://bintray.com/kou is my account.
>>> > >> >
>>> > >> > You will need to make an INFRA ticket for this. The apache org is centrally managed.
>>> > >>
>>> > >> Thanks.
>>> > >> I've create an INFRA ticket:
>>> > >> https://issues.apache.org/jira/browse/INFRA-17059
>>> > >>
>>> > >>
>>> > >> --
>>> > >> kou
Re: Timeline for 0.11 Arrow release
Posted by Kouhei Sutou <ko...@clear-code.com>.
Hi all,
Thanks for working together for 0.11.0!
I'll add support for Parquet GLib deb/rpm packages and then
create RC0 archive.
Thanks,
--
kou
In <CA...@mail.gmail.com>
"Re: Timeline for 0.11 Arrow release" on Mon, 1 Oct 2018 17:32:45 -0400,
Wes McKinney <we...@gmail.com> wrote:
> I think we're ready to cut a release candidate. Thanks to everyone
> On Mon, Oct 1, 2018 at 6:50 AM Wes McKinney <we...@gmail.com> wrote:
>>
>> hi Kou,
>>
>> Looks like we are closing out the remaining items right now with a
>> couple more patches going in today. There's some housekeeping items
>> like ARROW-2310, ARROW-2983, but they are not blockers. I would say
>> when you are awake on Tuesday in Japan you can move forward with
>> cutting the release candidate.
>>
>> As usual I can write the release announcement blog post and have that
>> ready when we are ready to announce the release later this week or
>> first thing next week.
>>
>> thanks
>> Wes
>> On Sun, Sep 30, 2018 at 8:40 PM Kouhei Sutou <ko...@clear-code.com> wrote:
>> >
>> > Hi,
>> >
>> > I'll start RC release process.
>> >
>> > I've just created Arrow 0.11.0 Release page:
>> >
>> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+0.11.0+Release
>> >
>> > Are there any blockers?
>> >
>> > If anyone can work together for the process, it's very
>> > helpful. For example, resolving blockers, writing release
>> > announce blog post and so on.
>> >
>> > See also:
>> > https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide
>> >
>> > Thanks,
>> > --
>> > kou
>> >
>> > In <CA...@mail.gmail.com>
>> > "Re: Timeline for 0.11 Arrow release" on Thu, 27 Sep 2018 11:24:01 -0400,
>> > Wes McKinney <we...@gmail.com> wrote:
>> >
>> > > Thanks Kou. I suggest we shoot for an RC on Monday or Tuesday since we
>> > > are working through some last-minute issues. I'm going to be code
>> > > reviewing and hacking through the weekend so we can hopefully be in
>> > > release-ready shape by Monday
>> > > On Tue, Sep 25, 2018 at 10:14 AM Kouhei Sutou <ko...@clear-code.com> wrote:
>> > >>
>> > >> Hi,
>> > >>
>> > >> In <15...@webmail.messagingengine.com>
>> > >> "Re: Timeline for 0.11 Arrow release" on Tue, 25 Sep 2018 16:01:46 +0200,
>> > >> "Uwe L. Korn" <uw...@xhochy.com> wrote:
>> > >>
>> > >> >> I may not be able to work on this for 0.11 but can you add
>> > >> >> me to https://bintray.com/apache ? I want write permission
>> > >> >> to https://bintray.com/apache/arrow .
>> > >> >>
>> > >> >> https://bintray.com/kou is my account.
>> > >> >
>> > >> > You will need to make an INFRA ticket for this. The apache org is centrally managed.
>> > >>
>> > >> Thanks.
>> > >> I've create an INFRA ticket:
>> > >> https://issues.apache.org/jira/browse/INFRA-17059
>> > >>
>> > >>
>> > >> --
>> > >> kou
Re: Timeline for 0.11 Arrow release
Posted by Wes McKinney <we...@gmail.com>.
I think we're ready to cut a release candidate. Thanks to everyone
On Mon, Oct 1, 2018 at 6:50 AM Wes McKinney <we...@gmail.com> wrote:
>
> hi Kou,
>
> Looks like we are closing out the remaining items right now with a
> couple more patches going in today. There's some housekeeping items
> like ARROW-2310, ARROW-2983, but they are not blockers. I would say
> when you are awake on Tuesday in Japan you can move forward with
> cutting the release candidate.
>
> As usual I can write the release announcement blog post and have that
> ready when we are ready to announce the release later this week or
> first thing next week.
>
> thanks
> Wes
> On Sun, Sep 30, 2018 at 8:40 PM Kouhei Sutou <ko...@clear-code.com> wrote:
> >
> > Hi,
> >
> > I'll start RC release process.
> >
> > I've just created Arrow 0.11.0 Release page:
> >
> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+0.11.0+Release
> >
> > Are there any blockers?
> >
> > If anyone can work together for the process, it's very
> > helpful. For example, resolving blockers, writing release
> > announce blog post and so on.
> >
> > See also:
> > https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide
> >
> > Thanks,
> > --
> > kou
> >
> > In <CA...@mail.gmail.com>
> > "Re: Timeline for 0.11 Arrow release" on Thu, 27 Sep 2018 11:24:01 -0400,
> > Wes McKinney <we...@gmail.com> wrote:
> >
> > > Thanks Kou. I suggest we shoot for an RC on Monday or Tuesday since we
> > > are working through some last-minute issues. I'm going to be code
> > > reviewing and hacking through the weekend so we can hopefully be in
> > > release-ready shape by Monday
> > > On Tue, Sep 25, 2018 at 10:14 AM Kouhei Sutou <ko...@clear-code.com> wrote:
> > >>
> > >> Hi,
> > >>
> > >> In <15...@webmail.messagingengine.com>
> > >> "Re: Timeline for 0.11 Arrow release" on Tue, 25 Sep 2018 16:01:46 +0200,
> > >> "Uwe L. Korn" <uw...@xhochy.com> wrote:
> > >>
> > >> >> I may not be able to work on this for 0.11 but can you add
> > >> >> me to https://bintray.com/apache ? I want write permission
> > >> >> to https://bintray.com/apache/arrow .
> > >> >>
> > >> >> https://bintray.com/kou is my account.
> > >> >
> > >> > You will need to make an INFRA ticket for this. The apache org is centrally managed.
> > >>
> > >> Thanks.
> > >> I've create an INFRA ticket:
> > >> https://issues.apache.org/jira/browse/INFRA-17059
> > >>
> > >>
> > >> --
> > >> kou
Re: Timeline for 0.11 Arrow release
Posted by Wes McKinney <we...@gmail.com>.
hi Kou,
Looks like we are closing out the remaining items right now with a
couple more patches going in today. There's some housekeeping items
like ARROW-2310, ARROW-2983, but they are not blockers. I would say
when you are awake on Tuesday in Japan you can move forward with
cutting the release candidate.
As usual I can write the release announcement blog post and have that
ready when we are ready to announce the release later this week or
first thing next week.
thanks
Wes
On Sun, Sep 30, 2018 at 8:40 PM Kouhei Sutou <ko...@clear-code.com> wrote:
>
> Hi,
>
> I'll start RC release process.
>
> I've just created Arrow 0.11.0 Release page:
>
> https://cwiki.apache.org/confluence/display/ARROW/Arrow+0.11.0+Release
>
> Are there any blockers?
>
> If anyone can work together for the process, it's very
> helpful. For example, resolving blockers, writing release
> announce blog post and so on.
>
> See also:
> https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide
>
> Thanks,
> --
> kou
>
> In <CA...@mail.gmail.com>
> "Re: Timeline for 0.11 Arrow release" on Thu, 27 Sep 2018 11:24:01 -0400,
> Wes McKinney <we...@gmail.com> wrote:
>
> > Thanks Kou. I suggest we shoot for an RC on Monday or Tuesday since we
> > are working through some last-minute issues. I'm going to be code
> > reviewing and hacking through the weekend so we can hopefully be in
> > release-ready shape by Monday
> > On Tue, Sep 25, 2018 at 10:14 AM Kouhei Sutou <ko...@clear-code.com> wrote:
> >>
> >> Hi,
> >>
> >> In <15...@webmail.messagingengine.com>
> >> "Re: Timeline for 0.11 Arrow release" on Tue, 25 Sep 2018 16:01:46 +0200,
> >> "Uwe L. Korn" <uw...@xhochy.com> wrote:
> >>
> >> >> I may not be able to work on this for 0.11 but can you add
> >> >> me to https://bintray.com/apache ? I want write permission
> >> >> to https://bintray.com/apache/arrow .
> >> >>
> >> >> https://bintray.com/kou is my account.
> >> >
> >> > You will need to make an INFRA ticket for this. The apache org is centrally managed.
> >>
> >> Thanks.
> >> I've create an INFRA ticket:
> >> https://issues.apache.org/jira/browse/INFRA-17059
> >>
> >>
> >> --
> >> kou
Re: Timeline for 0.11 Arrow release
Posted by Kouhei Sutou <ko...@clear-code.com>.
Hi,
I'll start RC release process.
I've just created Arrow 0.11.0 Release page:
https://cwiki.apache.org/confluence/display/ARROW/Arrow+0.11.0+Release
Are there any blockers?
If anyone can work together for the process, it's very
helpful. For example, resolving blockers, writing release
announce blog post and so on.
See also:
https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide
Thanks,
--
kou
In <CA...@mail.gmail.com>
"Re: Timeline for 0.11 Arrow release" on Thu, 27 Sep 2018 11:24:01 -0400,
Wes McKinney <we...@gmail.com> wrote:
> Thanks Kou. I suggest we shoot for an RC on Monday or Tuesday since we
> are working through some last-minute issues. I'm going to be code
> reviewing and hacking through the weekend so we can hopefully be in
> release-ready shape by Monday
> On Tue, Sep 25, 2018 at 10:14 AM Kouhei Sutou <ko...@clear-code.com> wrote:
>>
>> Hi,
>>
>> In <15...@webmail.messagingengine.com>
>> "Re: Timeline for 0.11 Arrow release" on Tue, 25 Sep 2018 16:01:46 +0200,
>> "Uwe L. Korn" <uw...@xhochy.com> wrote:
>>
>> >> I may not be able to work on this for 0.11 but can you add
>> >> me to https://bintray.com/apache ? I want write permission
>> >> to https://bintray.com/apache/arrow .
>> >>
>> >> https://bintray.com/kou is my account.
>> >
>> > You will need to make an INFRA ticket for this. The apache org is centrally managed.
>>
>> Thanks.
>> I've create an INFRA ticket:
>> https://issues.apache.org/jira/browse/INFRA-17059
>>
>>
>> --
>> kou
Re: Timeline for 0.11 Arrow release
Posted by Kouhei Sutou <ko...@clear-code.com>.
Hi,
I'll start RC release process.
I've just created Arrow 0.11.0 Release page:
https://cwiki.apache.org/confluence/display/ARROW/Arrow+0.11.0+Release
Are there any blockers?
If anyone can work together for the process, it's very
helpful. For example, resolving blockers, writing release
announce blog post and so on.
See also:
https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide
Thanks,
--
kou
In <CA...@mail.gmail.com>
"Re: Timeline for 0.11 Arrow release" on Thu, 27 Sep 2018 11:24:01 -0400,
Wes McKinney <we...@gmail.com> wrote:
> Thanks Kou. I suggest we shoot for an RC on Monday or Tuesday since we
> are working through some last-minute issues. I'm going to be code
> reviewing and hacking through the weekend so we can hopefully be in
> release-ready shape by Monday
> On Tue, Sep 25, 2018 at 10:14 AM Kouhei Sutou <ko...@clear-code.com> wrote:
>>
>> Hi,
>>
>> In <15...@webmail.messagingengine.com>
>> "Re: Timeline for 0.11 Arrow release" on Tue, 25 Sep 2018 16:01:46 +0200,
>> "Uwe L. Korn" <uw...@xhochy.com> wrote:
>>
>> >> I may not be able to work on this for 0.11 but can you add
>> >> me to https://bintray.com/apache ? I want write permission
>> >> to https://bintray.com/apache/arrow .
>> >>
>> >> https://bintray.com/kou is my account.
>> >
>> > You will need to make an INFRA ticket for this. The apache org is centrally managed.
>>
>> Thanks.
>> I've create an INFRA ticket:
>> https://issues.apache.org/jira/browse/INFRA-17059
>>
>>
>> --
>> kou
Re: Timeline for 0.11 Arrow release
Posted by Wes McKinney <we...@gmail.com>.
Thanks Kou. I suggest we shoot for an RC on Monday or Tuesday since we
are working through some last-minute issues. I'm going to be code
reviewing and hacking through the weekend so we can hopefully be in
release-ready shape by Monday
On Tue, Sep 25, 2018 at 10:14 AM Kouhei Sutou <ko...@clear-code.com> wrote:
>
> Hi,
>
> In <15...@webmail.messagingengine.com>
> "Re: Timeline for 0.11 Arrow release" on Tue, 25 Sep 2018 16:01:46 +0200,
> "Uwe L. Korn" <uw...@xhochy.com> wrote:
>
> >> I may not be able to work on this for 0.11 but can you add
> >> me to https://bintray.com/apache ? I want write permission
> >> to https://bintray.com/apache/arrow .
> >>
> >> https://bintray.com/kou is my account.
> >
> > You will need to make an INFRA ticket for this. The apache org is centrally managed.
>
> Thanks.
> I've create an INFRA ticket:
> https://issues.apache.org/jira/browse/INFRA-17059
>
>
> --
> kou
Re: Timeline for 0.11 Arrow release
Posted by Kouhei Sutou <ko...@clear-code.com>.
Hi,
In <15...@webmail.messagingengine.com>
"Re: Timeline for 0.11 Arrow release" on Tue, 25 Sep 2018 16:01:46 +0200,
"Uwe L. Korn" <uw...@xhochy.com> wrote:
>> I may not be able to work on this for 0.11 but can you add
>> me to https://bintray.com/apache ? I want write permission
>> to https://bintray.com/apache/arrow .
>>
>> https://bintray.com/kou is my account.
>
> You will need to make an INFRA ticket for this. The apache org is centrally managed.
Thanks.
I've create an INFRA ticket:
https://issues.apache.org/jira/browse/INFRA-17059
--
kou
Re: Timeline for 0.11 Arrow release
Posted by "Uwe L. Korn" <uw...@xhochy.com>.
> I may not be able to work on this for 0.11 but can you add
> me to https://bintray.com/apache ? I want write permission
> to https://bintray.com/apache/arrow .
>
> https://bintray.com/kou is my account.
You will need to make an INFRA ticket for this. The apache org is centrally managed.
Uwe
Re: Timeline for 0.11 Arrow release
Posted by Kouhei Sutou <ko...@clear-code.com>.
Hi,
> It would be great to move the binary artifacts to Bintray
> but perhaps there is not enough bandwidth for this
> release, we can always do that for 0.12.
I may not be able to work on this for 0.11 but can you add
me to https://bintray.com/apache ? I want write permission
to https://bintray.com/apache/arrow .
https://bintray.com/kou is my account.
> Also, can someone volunteer to be the release manager?
I can't work on it this week... (I can do some works the
same as the previous release.)
I can work on it the next week. If nobody can work on it
this week, I'll work on it the next week.
Thanks,
--
kou
In <CA...@mail.gmail.com>
"Re: Timeline for 0.11 Arrow release" on Mon, 24 Sep 2018 04:24:58 -0400,
Wes McKinney <we...@gmail.com> wrote:
> hi all,
>
> The 0.11 release push seems to be winding down. I just put up a fairly
> high priority C++ patch (https://github.com/apache/arrow/pull/2615)
> containing a bunch of interrelated IPC fixes, careful review requested
>
> Out of the remaining issues, I have questions about:
>
> * ARROW-3175 -- upgrading Flatbuffers for Java
> * ARROW-3141 -- minimum NumPy version in Python wheels
> * ARROW-1983 -- Writing the _metadata Parquet file from Python
>
> The rest of the issues are related to release packaging and
> verification workflow, or updating the website. It would be great to
> move the binary artifacts to Bintray but perhaps there is not enough
> bandwidth for this release, we can always do that for 0.12.
>
> Are there any other patches that definitely need to go into 0.11? Any
> reasons why we could not cut a release candidate this week?
>
> Also, can someone volunteer to be the release manager?
>
> Thank you,
> Wes
> On Mon, Sep 17, 2018 at 1:26 PM Wes McKinney <we...@gmail.com> wrote:
>>
>> hi folks,
>>
>> It looks like we are closing in on the 0.11 release -- I have spent a
>> bunch of time gardening the backlog.
>>
>> https://issues.apache.org/jira/projects/ARROW/versions/12343066
>>
>> There are quite a few open patches still and housekeeping items
>> remaining. If you can help complete some of these issues this week,
>> please take a look and assign yourself to the issue.
>>
>> I reckon we need this whole week to get into release-ready shape. Any
>> reason why we could not have a release vote next week?
>>
>> Thanks,
>> Wes
>> On Wed, Aug 22, 2018 at 2:31 AM Uwe L. Korn <uw...@xhochy.com> wrote:
>> >
>> > Hello,
>> >
>> > I will also go over the release and add items. For my personal goal for 0.11, I want to have predicate pushdown for Parquet files working. This means that we should be able to determine in Python code what the relevant RowGroups in a file are as well as filtering a Table given the set of predicates. Thus we want to have a pyarrow.parquet.read_table variant that takes in a set of predicates in disjunctive normal form and returns a (possibly empty) table with only the rows that match the predicates. Please be aware when of this when moving issues to 0.12.
>> >
>> > Uwe
>> >
>> > On Tue, Aug 21, 2018, at 9:01 PM, Wes McKinney wrote:
>> > > hi all,
>> > >
>> > > I know it seems like we just released 0.10, but we are already 75
>> > > issues deep in 0.11 and have addressed a number of issues that
>> > > surfaced with 0.10
>> > >
>> > > https://issues.apache.org/jira/projects/ARROW/versions/12343066
>> > >
>> > > I suggest that we plan to release again the week of September 10. That
>> > > will be a slow week for me anyway because of the Strata conference in
>> > > NYC. This gives us enough time to resolve the outstanding packaging
>> > > issues and to complete the parquet-cpp merge and associated packaging
>> > > changes needed there.
>> > >
>> > > I will start curating the backlog next week to move anything
>> > > definitely aspirational to 0.12 so we can have a sense of the must-do
>> > > work for 0.11. Any help with backlog curation would be appreciated.
>> > >
>> > > Any other thoughts? In general I think we should be releasing every
>> > > 4-6 weeks for a while since the pace of progress is quite fast, and
>> > > many new users are coming into the ecosystem which will benefit from
>> > > more frequent releases.
>> > >
>> > > Thanks,
>> > > Wes
Re: Timeline for 0.11 Arrow release
Posted by Wes McKinney <we...@gmail.com>.
hi all,
The 0.11 release push seems to be winding down. I just put up a fairly
high priority C++ patch (https://github.com/apache/arrow/pull/2615)
containing a bunch of interrelated IPC fixes, careful review requested
Out of the remaining issues, I have questions about:
* ARROW-3175 -- upgrading Flatbuffers for Java
* ARROW-3141 -- minimum NumPy version in Python wheels
* ARROW-1983 -- Writing the _metadata Parquet file from Python
The rest of the issues are related to release packaging and
verification workflow, or updating the website. It would be great to
move the binary artifacts to Bintray but perhaps there is not enough
bandwidth for this release, we can always do that for 0.12.
Are there any other patches that definitely need to go into 0.11? Any
reasons why we could not cut a release candidate this week?
Also, can someone volunteer to be the release manager?
Thank you,
Wes
On Mon, Sep 17, 2018 at 1:26 PM Wes McKinney <we...@gmail.com> wrote:
>
> hi folks,
>
> It looks like we are closing in on the 0.11 release -- I have spent a
> bunch of time gardening the backlog.
>
> https://issues.apache.org/jira/projects/ARROW/versions/12343066
>
> There are quite a few open patches still and housekeeping items
> remaining. If you can help complete some of these issues this week,
> please take a look and assign yourself to the issue.
>
> I reckon we need this whole week to get into release-ready shape. Any
> reason why we could not have a release vote next week?
>
> Thanks,
> Wes
> On Wed, Aug 22, 2018 at 2:31 AM Uwe L. Korn <uw...@xhochy.com> wrote:
> >
> > Hello,
> >
> > I will also go over the release and add items. For my personal goal for 0.11, I want to have predicate pushdown for Parquet files working. This means that we should be able to determine in Python code what the relevant RowGroups in a file are as well as filtering a Table given the set of predicates. Thus we want to have a pyarrow.parquet.read_table variant that takes in a set of predicates in disjunctive normal form and returns a (possibly empty) table with only the rows that match the predicates. Please be aware when of this when moving issues to 0.12.
> >
> > Uwe
> >
> > On Tue, Aug 21, 2018, at 9:01 PM, Wes McKinney wrote:
> > > hi all,
> > >
> > > I know it seems like we just released 0.10, but we are already 75
> > > issues deep in 0.11 and have addressed a number of issues that
> > > surfaced with 0.10
> > >
> > > https://issues.apache.org/jira/projects/ARROW/versions/12343066
> > >
> > > I suggest that we plan to release again the week of September 10. That
> > > will be a slow week for me anyway because of the Strata conference in
> > > NYC. This gives us enough time to resolve the outstanding packaging
> > > issues and to complete the parquet-cpp merge and associated packaging
> > > changes needed there.
> > >
> > > I will start curating the backlog next week to move anything
> > > definitely aspirational to 0.12 so we can have a sense of the must-do
> > > work for 0.11. Any help with backlog curation would be appreciated.
> > >
> > > Any other thoughts? In general I think we should be releasing every
> > > 4-6 weeks for a while since the pace of progress is quite fast, and
> > > many new users are coming into the ecosystem which will benefit from
> > > more frequent releases.
> > >
> > > Thanks,
> > > Wes