You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by Neal Richardson <ne...@gmail.com> on 2020/12/14 19:36:10 UTC

Arrow 3.0 release dashboard

Hi all,
I've created
https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release,
cloned from our previous release dashboards, for our upcoming release. A
few things I'd like to draw your attention to:

* Blockers: there are 5 currently. I'm not certain that they all are
blockers, nor am I sure that there aren't other blockers. I know we've had
some issues lately with python wheel builds, and I've added a couple of
known issues, but there may be others. If you know of other release
blockers, please note them.
* There are over 300 unstarted issues tagged for 3.0.0. Given holiday
schedules and the release target in the first week of January, that's at
least 200 too many. Please review your backlogs and start bumping things
out of scope. I've added a 4.0.0 version that you can move things to, if
you want.
* Release process improvements: there was some discussion a few weeks ago
about what could be done to make it easier to cut releases (
https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E).
A few tasks were mentioned in that thread. If anyone is going to take
action, now would be a good time.

Thanks,
Neal

Re: Arrow 3.0 release

Posted by Adam Lippai <ad...@rigo.sk>.

There were so many Rust developments recently (321 issues out of the total
650, daily almost 4 issues - including the weekends and holidays) that
there is a big chance cool and great PRs are delayed to 4.0.0.
This is not "just okay", but something we should celebrate.
I'm simply stunned with the amount of work you have done since 2.0.0.
If anything, the release cadence could be improved, but that's already on
the horizon.

I'm just a simple user, but thanks to everybody in the Arrow community. I'm
learning a lot just by reading the developments in different fields
(datafusion optimizer, python api improvements, kernels optimizations,
parquet integrations).

Best regards,
Adam Lippai

On Wed, Jan 13, 2021 at 3:30 PM Neville Dipale <ne...@gmail.com>
wrote:

> Good day,
>
> I was hoping to complete the parquet list writer PR in time, but even
> though I've been burning the midnight oil addressing the remaining
> issues in the PR, I won't make it in time :(
>
> I've removed the Rust blocker from the milestone, so there should be
> nothing on my side blocking us.
>
> Thanks everyone for the hard work.
>
> Neville
>
> On Wed, 13 Jan 2021 at 03:29, Neal Richardson <neal.p.richardson@gmail.com
> >
> wrote:
>
> > Last call for 3.0.
> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release is
> > closing out, and hopefully we'll be releasable by the end of tomorrow. If
> > you're trying to get something merged in time for the release, now is the
> > time!
> >
> > Thanks all for your hard work under challenging circumstances to get us
> to
> > this point.
> >
> > Neal
> >
> > On Mon, Jan 11, 2021 at 11:48 AM Antoine Pitrou <an...@python.org>
> > wrote:
> >
> > >
> > > I think it would be nice to get
> > > https://github.com/apache/arrow/pull/9164 in because it changes the
> > > current behaviour and is also stricter with its inputs.
> > >
> > > Regards
> > >
> > > Antoine.
> > >
> > >
> > > Le 11/01/2021 à 20:46, Neal Richardson a écrit :
> > > > Hi all,
> > > > We seem to be getting closer on resolving our CI and packaging
> > > challenges,
> > > > despite several additional, unexpected setbacks last week. I think we
> > > > should be in releasable condition in the next day or two. If you have
> > any
> > > > other outstanding issues you're trying to get in the 3.0 release, now
> > is
> > > > the time.
> > > >
> > > > We need a volunteer from the PMC to be release manager for 3.0.0.
> > > Krisztián
> > > > has done the last several releases, and I was wondering if there was
> > > anyone
> > > > else out there who wanted to take a turn and give him a break this
> > time.
> > > >
> > > > Neal
> > > >
> > > > On Wed, Jan 6, 2021 at 9:03 PM Sutou Kouhei <ko...@clear-code.com>
> > wrote:
> > > >
> > > >> Hi Neal,
> > > >>
> > > >> Thanks!
> > > >>
> > > >>> ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of
> > > Travis-CI
> > > >>
> > > >> I closed this because it has been done by
> > > >> https://issues.apache.org/jira/browse/ARROW-11015 .
> > > >>
> > > >>
> > > >> Thanks,
> > > >> --
> > > >> kou
> > > >>
> > > >> In <CAOCv4hhMyRA8qQsRcev7ar8QHykMc2Mf6=
> > gCx6bsKna6uDZVHQ@mail.gmail.com>
> > > >>   "Re: Arrow 3.0 release" on Wed, 6 Jan 2021 11:39:02 -0800,
> > > >>   Neal Richardson <ne...@gmail.com> wrote:
> > > >>
> > > >>> I made some JIRAs for these issues:
> > > >>>
> > > >>> ARROW-11152: [CI][C++] Fix Homebrew numpy installation on macOS
> > builds
> > > >>> ARROW-11153: [C++][Packaging] Move debian/ubuntu/centos packaging
> off
> > > of
> > > >>> Travis-CI (assigned to Kou)
> > > >>> ARROW-11154: [CI][C++] Move homebrew crossbow tests off of
> Travis-CI
> > > >>> ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of
> > > Travis-CI
> > > >>>
> > > >>> On Wed, Jan 6, 2021 at 5:50 AM Andrew Wieteska <
> > > >> andrew.r.wieteska@gmail.com>
> > > >>> wrote:
> > > >>>
> > > >>>> Hi Kou,
> > > >>>>
> > > >>>> For sure! I'll work on this.
> > > >>>>
> > > >>>> Best
> > > >>>> Andrew
> > > >>>>
> > > >>>> On Tue, Jan 5, 2021 at 8:06 PM Sutou Kouhei <ko...@clear-code.com>
> > > wrote:
> > > >>>>
> > > >>>>> Hi Andrew,
> > > >>>>>
> > > >>>>> We need to fix nightly builds to release a new version.
> > > >>>>>
> > > >>>>> Could you check the latest nightly builds[1], open JIRA
> > > >>>>> issues for not unaddressed failed builds and fix them one by
> > > >>>>> one?
> > > >>>>>
> > > >>>>> [1]
> > > >>>>>
> > > >>>>
> > > >>
> > >
> >
> https://lists.apache.org/thread.html/ra17f2f9c2323498edd45665d78ce669ae90c0bbd888921f94cf9ca5c%40%3Cdev.arrow.apache.org%3E
> > > >>>>>
> > > >>>>> For example, wheel-win-* are worked at
> > > >>>>> https://github.com/apache/arrow/pull/9096 . We don't need to
> > > >>>>> open new JIRA issues for them.
> > > >>>>>
> > > >>>>>
> > > >>>>> We also need to move away from Travis CI in nightly builds.
> > > >>>>> See also:
> > > >>>>>
> > > >>>>
> > > >>
> > >
> >
> https://lists.apache.org/thread.html/r43ddf0ed5a3d21831edfa20bbe87514dc433e17ec86199c5a4cb80d4%40%3Cdev.arrow.apache.org%3E
> > > >>>>>
> > > >>>>> We need to change "ci: travis" in
> > > >>>>> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml
> > > >>>>> for it.
> > > >>>>>
> > > >>>>> wheel-osx-* are worked at
> > > >>>>> https://github.com/apache/arrow/pull/8915 .
> > > >>>>>
> > > >>>>> I'll work on debian-*, ubuntu-* and centos-*.
> > > >>>>>
> > > >>>>> homebrew-* aren't unaddressed. Could you also work on them?
> > > >>>>>
> > > >>>>>
> > > >>>>> Thanks,
> > > >>>>> --
> > > >>>>> kou
> > > >>>>>
> > > >>>>>
> > > >>>>> In <CAGeKrB_XFiu3=
> > > >> Fn3mBvhDD4YFQOi1hAVjRNKho0NwvV6qdfm+g@mail.gmail.com>
> > > >>>>>   "Re: Arrow 3.0 release" on Mon, 4 Jan 2021 19:45:32 -0500,
> > > >>>>>   Andrew Wieteska <an...@gmail.com> wrote:
> > > >>>>>
> > > >>>>>> Dear all,
> > > >>>>>>
> > > >>>>>> I will have time and would be happy to help with the release if
> > the
> > > >> PMC
> > > >>>>>> release manager could use a second person. I don't have
> experience
> > > >> with
> > > >>>>> the
> > > >>>>>> release process so I might need some detailed pointers on where
> > and
> > > >>>> how I
> > > >>>>>> can help - but if I can help to relieve the load on the release
> > > >>>> manager,
> > > >>>>>> I'm available!
> > > >>>>>>
> > > >>>>>> All the best
> > > >>>>>> Andrew
> > > >>>>>>
> > > >>>>>> On Mon, Jan 4, 2021 at 7:24 PM Neal Richardson <
> > > >>>>> neal.p.richardson@gmail.com>
> > > >>>>>> wrote:
> > > >>>>>>
> > > >>>>>>> Hi folks,
> > > >>>>>>> It's time to get oriented for our 3.0.0 Arrow release. We had
> > > >>>> previously
> > > >>>>>>> said that we wanted to be release-ready by the end of this
> week,
> > > >> but
> > > >>>>> that
> > > >>>>>>> seems unlikely. There are a number of challenges in front of
> us,
> > > >> and
> > > >>>> we
> > > >>>>>>> need to step up and address them. Updating on the points I sent
> > > >> out 3
> > > >>>>> weeks
> > > >>>>>>> ago (see below):
> > > >>>>>>>
> > > >>>>>>> * Release blockers: per
> > > >>>>>>>
> > > >>
> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
> > > >>>>> we
> > > >>>>>>> are up to 6 blockers, and that's not a complete list. We have
> > > >> failing
> > > >>>>>>> nightly builds, and we don't have any macOS crossbow builds due
> > to
> > > >>>>>>> Travis-CI limits, so that means no mac wheels at the moment. So
> > we
> > > >> are
> > > >>>>> not
> > > >>>>>>> releasable today.
> > > >>>>>>> * Backlog: I did some pushing of issues to 4.0 today, so we're
> > > >> down to
> > > >>>>>>> 180ish open issues tagged for 3.0. Please review your own
> > backlogs
> > > >> and
> > > >>>>> bump
> > > >>>>>>> anything you aren't going to get done for this release out.
> > > >>>>>>> * Pull requests: https://github.com/apache/arrow/pulls shows
> 118
> > > >> open
> > > >>>>> PRs
> > > >>>>>>> right now. Some of that is probably a holiday backup, but
> please
> > do
> > > >>>>> spend
> > > >>>>>>> some time reviewing and merging (or closing, if appropriate) so
> > we
> > > >>>> have
> > > >>>>>>> fewer things hanging on past this release.
> > > >>>>>>> * Release process: despite the burst of interest a while back,
> > > >> there
> > > >>>>>>> doesn't seem to have been any movement on the proposed
> > improvements
> > > >>>> that
> > > >>>>>>> would make it less expensive for us to release, and thus be
> able
> > to
> > > >>>>> release
> > > >>>>>>> more frequently. Nevertheless, we still need to release now,
> and
> > we
> > > >>>> will
> > > >>>>>>> need someone (I believe from the PMC) to volunteer to be
> release
> > > >>>> manager
> > > >>>>>>> for 3.0.
> > > >>>>>>>
> > > >>>>>>> If you think you can help on any of these issues, please do!
> This
> > > >>>>> release
> > > >>>>>>> won't happen without some collective effort.
> > > >>>>>>>
> > > >>>>>>> Thanks, and happy 2021 to you all.
> > > >>>>>>>
> > > >>>>>>> Neal
> > > >>>>>>>
> > > >>>>>>>
> > > >>>>>>> On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
> > > >>>>>>> neal.p.richardson@gmail.com> wrote:
> > > >>>>>>>
> > > >>>>>>>> Hi all,
> > > >>>>>>>> I've created
> > > >>>>>>>>
> > > >>>>
> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
> > > >>>>> ,
> > > >>>>>>>> cloned from our previous release dashboards, for our upcoming
> > > >>>>> release. A
> > > >>>>>>>> few things I'd like to draw your attention to:
> > > >>>>>>>>
> > > >>>>>>>> * Blockers: there are 5 currently. I'm not certain that they
> all
> > > >> are
> > > >>>>>>>> blockers, nor am I sure that there aren't other blockers. I
> know
> > > >>>> we've
> > > >>>>>>> had
> > > >>>>>>>> some issues lately with python wheel builds, and I've added a
> > > >> couple
> > > >>>>> of
> > > >>>>>>>> known issues, but there may be others. If you know of other
> > > >> release
> > > >>>>>>>> blockers, please note them.
> > > >>>>>>>> * There are over 300 unstarted issues tagged for 3.0.0. Given
> > > >>>> holiday
> > > >>>>>>>> schedules and the release target in the first week of January,
> > > >>>> that's
> > > >>>>> at
> > > >>>>>>>> least 200 too many. Please review your backlogs and start
> > bumping
> > > >>>>> things
> > > >>>>>>>> out of scope. I've added a 4.0.0 version that you can move
> > things
> > > >>>> to,
> > > >>>>> if
> > > >>>>>>>> you want.
> > > >>>>>>>> * Release process improvements: there was some discussion a
> few
> > > >>>> weeks
> > > >>>>> ago
> > > >>>>>>>> about what could be done to make it easier to cut releases (
> > > >>>>>>>>
> > > >>>>>>>
> > > >>>>>
> > > >>>>
> > > >>
> > >
> >
> https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E
> > > >>>>>>> ).
> > > >>>>>>>> A few tasks were mentioned in that thread. If anyone is going
> to
> > > >>>> take
> > > >>>>>>>> action, now would be a good time.
> > > >>>>>>>>
> > > >>>>>>>> Thanks,
> > > >>>>>>>> Neal
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>
> > > >>>>>
> > > >>>>
> > > >>
> > > >
> > >
> >
>

Re: Arrow 3.0 release

Posted by Neville Dipale <ne...@gmail.com>.

Good day,

I was hoping to complete the parquet list writer PR in time, but even
though I've been burning the midnight oil addressing the remaining
issues in the PR, I won't make it in time :(

I've removed the Rust blocker from the milestone, so there should be
nothing on my side blocking us.

Thanks everyone for the hard work.

Neville

On Wed, 13 Jan 2021 at 03:29, Neal Richardson <ne...@gmail.com>
wrote:

> Last call for 3.0.
> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release is
> closing out, and hopefully we'll be releasable by the end of tomorrow. If
> you're trying to get something merged in time for the release, now is the
> time!
>
> Thanks all for your hard work under challenging circumstances to get us to
> this point.
>
> Neal
>
> On Mon, Jan 11, 2021 at 11:48 AM Antoine Pitrou <an...@python.org>
> wrote:
>
> >
> > I think it would be nice to get
> > https://github.com/apache/arrow/pull/9164 in because it changes the
> > current behaviour and is also stricter with its inputs.
> >
> > Regards
> >
> > Antoine.
> >
> >
> > Le 11/01/2021 à 20:46, Neal Richardson a écrit :
> > > Hi all,
> > > We seem to be getting closer on resolving our CI and packaging
> > challenges,
> > > despite several additional, unexpected setbacks last week. I think we
> > > should be in releasable condition in the next day or two. If you have
> any
> > > other outstanding issues you're trying to get in the 3.0 release, now
> is
> > > the time.
> > >
> > > We need a volunteer from the PMC to be release manager for 3.0.0.
> > Krisztián
> > > has done the last several releases, and I was wondering if there was
> > anyone
> > > else out there who wanted to take a turn and give him a break this
> time.
> > >
> > > Neal
> > >
> > > On Wed, Jan 6, 2021 at 9:03 PM Sutou Kouhei <ko...@clear-code.com>
> wrote:
> > >
> > >> Hi Neal,
> > >>
> > >> Thanks!
> > >>
> > >>> ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of
> > Travis-CI
> > >>
> > >> I closed this because it has been done by
> > >> https://issues.apache.org/jira/browse/ARROW-11015 .
> > >>
> > >>
> > >> Thanks,
> > >> --
> > >> kou
> > >>
> > >> In <CAOCv4hhMyRA8qQsRcev7ar8QHykMc2Mf6=
> gCx6bsKna6uDZVHQ@mail.gmail.com>
> > >>   "Re: Arrow 3.0 release" on Wed, 6 Jan 2021 11:39:02 -0800,
> > >>   Neal Richardson <ne...@gmail.com> wrote:
> > >>
> > >>> I made some JIRAs for these issues:
> > >>>
> > >>> ARROW-11152: [CI][C++] Fix Homebrew numpy installation on macOS
> builds
> > >>> ARROW-11153: [C++][Packaging] Move debian/ubuntu/centos packaging off
> > of
> > >>> Travis-CI (assigned to Kou)
> > >>> ARROW-11154: [CI][C++] Move homebrew crossbow tests off of Travis-CI
> > >>> ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of
> > Travis-CI
> > >>>
> > >>> On Wed, Jan 6, 2021 at 5:50 AM Andrew Wieteska <
> > >> andrew.r.wieteska@gmail.com>
> > >>> wrote:
> > >>>
> > >>>> Hi Kou,
> > >>>>
> > >>>> For sure! I'll work on this.
> > >>>>
> > >>>> Best
> > >>>> Andrew
> > >>>>
> > >>>> On Tue, Jan 5, 2021 at 8:06 PM Sutou Kouhei <ko...@clear-code.com>
> > wrote:
> > >>>>
> > >>>>> Hi Andrew,
> > >>>>>
> > >>>>> We need to fix nightly builds to release a new version.
> > >>>>>
> > >>>>> Could you check the latest nightly builds[1], open JIRA
> > >>>>> issues for not unaddressed failed builds and fix them one by
> > >>>>> one?
> > >>>>>
> > >>>>> [1]
> > >>>>>
> > >>>>
> > >>
> >
> https://lists.apache.org/thread.html/ra17f2f9c2323498edd45665d78ce669ae90c0bbd888921f94cf9ca5c%40%3Cdev.arrow.apache.org%3E
> > >>>>>
> > >>>>> For example, wheel-win-* are worked at
> > >>>>> https://github.com/apache/arrow/pull/9096 . We don't need to
> > >>>>> open new JIRA issues for them.
> > >>>>>
> > >>>>>
> > >>>>> We also need to move away from Travis CI in nightly builds.
> > >>>>> See also:
> > >>>>>
> > >>>>
> > >>
> >
> https://lists.apache.org/thread.html/r43ddf0ed5a3d21831edfa20bbe87514dc433e17ec86199c5a4cb80d4%40%3Cdev.arrow.apache.org%3E
> > >>>>>
> > >>>>> We need to change "ci: travis" in
> > >>>>> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml
> > >>>>> for it.
> > >>>>>
> > >>>>> wheel-osx-* are worked at
> > >>>>> https://github.com/apache/arrow/pull/8915 .
> > >>>>>
> > >>>>> I'll work on debian-*, ubuntu-* and centos-*.
> > >>>>>
> > >>>>> homebrew-* aren't unaddressed. Could you also work on them?
> > >>>>>
> > >>>>>
> > >>>>> Thanks,
> > >>>>> --
> > >>>>> kou
> > >>>>>
> > >>>>>
> > >>>>> In <CAGeKrB_XFiu3=
> > >> Fn3mBvhDD4YFQOi1hAVjRNKho0NwvV6qdfm+g@mail.gmail.com>
> > >>>>>   "Re: Arrow 3.0 release" on Mon, 4 Jan 2021 19:45:32 -0500,
> > >>>>>   Andrew Wieteska <an...@gmail.com> wrote:
> > >>>>>
> > >>>>>> Dear all,
> > >>>>>>
> > >>>>>> I will have time and would be happy to help with the release if
> the
> > >> PMC
> > >>>>>> release manager could use a second person. I don't have experience
> > >> with
> > >>>>> the
> > >>>>>> release process so I might need some detailed pointers on where
> and
> > >>>> how I
> > >>>>>> can help - but if I can help to relieve the load on the release
> > >>>> manager,
> > >>>>>> I'm available!
> > >>>>>>
> > >>>>>> All the best
> > >>>>>> Andrew
> > >>>>>>
> > >>>>>> On Mon, Jan 4, 2021 at 7:24 PM Neal Richardson <
> > >>>>> neal.p.richardson@gmail.com>
> > >>>>>> wrote:
> > >>>>>>
> > >>>>>>> Hi folks,
> > >>>>>>> It's time to get oriented for our 3.0.0 Arrow release. We had
> > >>>> previously
> > >>>>>>> said that we wanted to be release-ready by the end of this week,
> > >> but
> > >>>>> that
> > >>>>>>> seems unlikely. There are a number of challenges in front of us,
> > >> and
> > >>>> we
> > >>>>>>> need to step up and address them. Updating on the points I sent
> > >> out 3
> > >>>>> weeks
> > >>>>>>> ago (see below):
> > >>>>>>>
> > >>>>>>> * Release blockers: per
> > >>>>>>>
> > >> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
> > >>>>> we
> > >>>>>>> are up to 6 blockers, and that's not a complete list. We have
> > >> failing
> > >>>>>>> nightly builds, and we don't have any macOS crossbow builds due
> to
> > >>>>>>> Travis-CI limits, so that means no mac wheels at the moment. So
> we
> > >> are
> > >>>>> not
> > >>>>>>> releasable today.
> > >>>>>>> * Backlog: I did some pushing of issues to 4.0 today, so we're
> > >> down to
> > >>>>>>> 180ish open issues tagged for 3.0. Please review your own
> backlogs
> > >> and
> > >>>>> bump
> > >>>>>>> anything you aren't going to get done for this release out.
> > >>>>>>> * Pull requests: https://github.com/apache/arrow/pulls shows 118
> > >> open
> > >>>>> PRs
> > >>>>>>> right now. Some of that is probably a holiday backup, but please
> do
> > >>>>> spend
> > >>>>>>> some time reviewing and merging (or closing, if appropriate) so
> we
> > >>>> have
> > >>>>>>> fewer things hanging on past this release.
> > >>>>>>> * Release process: despite the burst of interest a while back,
> > >> there
> > >>>>>>> doesn't seem to have been any movement on the proposed
> improvements
> > >>>> that
> > >>>>>>> would make it less expensive for us to release, and thus be able
> to
> > >>>>> release
> > >>>>>>> more frequently. Nevertheless, we still need to release now, and
> we
> > >>>> will
> > >>>>>>> need someone (I believe from the PMC) to volunteer to be release
> > >>>> manager
> > >>>>>>> for 3.0.
> > >>>>>>>
> > >>>>>>> If you think you can help on any of these issues, please do! This
> > >>>>> release
> > >>>>>>> won't happen without some collective effort.
> > >>>>>>>
> > >>>>>>> Thanks, and happy 2021 to you all.
> > >>>>>>>
> > >>>>>>> Neal
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
> > >>>>>>> neal.p.richardson@gmail.com> wrote:
> > >>>>>>>
> > >>>>>>>> Hi all,
> > >>>>>>>> I've created
> > >>>>>>>>
> > >>>>
> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
> > >>>>> ,
> > >>>>>>>> cloned from our previous release dashboards, for our upcoming
> > >>>>> release. A
> > >>>>>>>> few things I'd like to draw your attention to:
> > >>>>>>>>
> > >>>>>>>> * Blockers: there are 5 currently. I'm not certain that they all
> > >> are
> > >>>>>>>> blockers, nor am I sure that there aren't other blockers. I know
> > >>>> we've
> > >>>>>>> had
> > >>>>>>>> some issues lately with python wheel builds, and I've added a
> > >> couple
> > >>>>> of
> > >>>>>>>> known issues, but there may be others. If you know of other
> > >> release
> > >>>>>>>> blockers, please note them.
> > >>>>>>>> * There are over 300 unstarted issues tagged for 3.0.0. Given
> > >>>> holiday
> > >>>>>>>> schedules and the release target in the first week of January,
> > >>>> that's
> > >>>>> at
> > >>>>>>>> least 200 too many. Please review your backlogs and start
> bumping
> > >>>>> things
> > >>>>>>>> out of scope. I've added a 4.0.0 version that you can move
> things
> > >>>> to,
> > >>>>> if
> > >>>>>>>> you want.
> > >>>>>>>> * Release process improvements: there was some discussion a few
> > >>>> weeks
> > >>>>> ago
> > >>>>>>>> about what could be done to make it easier to cut releases (
> > >>>>>>>>
> > >>>>>>>
> > >>>>>
> > >>>>
> > >>
> >
> https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E
> > >>>>>>> ).
> > >>>>>>>> A few tasks were mentioned in that thread. If anyone is going to
> > >>>> take
> > >>>>>>>> action, now would be a good time.
> > >>>>>>>>
> > >>>>>>>> Thanks,
> > >>>>>>>> Neal
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>
> > >>>>>
> > >>>>
> > >>
> > >
> >
>

Re: Arrow 3.0 release

Posted by Neal Richardson <ne...@gmail.com>.

Last call for 3.0.
https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release is
closing out, and hopefully we'll be releasable by the end of tomorrow. If
you're trying to get something merged in time for the release, now is the
time!

Thanks all for your hard work under challenging circumstances to get us to
this point.

Neal

On Mon, Jan 11, 2021 at 11:48 AM Antoine Pitrou <an...@python.org> wrote:

>
> I think it would be nice to get
> https://github.com/apache/arrow/pull/9164 in because it changes the
> current behaviour and is also stricter with its inputs.
>
> Regards
>
> Antoine.
>
>
> Le 11/01/2021 à 20:46, Neal Richardson a écrit :
> > Hi all,
> > We seem to be getting closer on resolving our CI and packaging
> challenges,
> > despite several additional, unexpected setbacks last week. I think we
> > should be in releasable condition in the next day or two. If you have any
> > other outstanding issues you're trying to get in the 3.0 release, now is
> > the time.
> >
> > We need a volunteer from the PMC to be release manager for 3.0.0.
> Krisztián
> > has done the last several releases, and I was wondering if there was
> anyone
> > else out there who wanted to take a turn and give him a break this time.
> >
> > Neal
> >
> > On Wed, Jan 6, 2021 at 9:03 PM Sutou Kouhei <ko...@clear-code.com> wrote:
> >
> >> Hi Neal,
> >>
> >> Thanks!
> >>
> >>> ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of
> Travis-CI
> >>
> >> I closed this because it has been done by
> >> https://issues.apache.org/jira/browse/ARROW-11015 .
> >>
> >>
> >> Thanks,
> >> --
> >> kou
> >>
> >> In <CA...@mail.gmail.com>
> >>   "Re: Arrow 3.0 release" on Wed, 6 Jan 2021 11:39:02 -0800,
> >>   Neal Richardson <ne...@gmail.com> wrote:
> >>
> >>> I made some JIRAs for these issues:
> >>>
> >>> ARROW-11152: [CI][C++] Fix Homebrew numpy installation on macOS builds
> >>> ARROW-11153: [C++][Packaging] Move debian/ubuntu/centos packaging off
> of
> >>> Travis-CI (assigned to Kou)
> >>> ARROW-11154: [CI][C++] Move homebrew crossbow tests off of Travis-CI
> >>> ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of
> Travis-CI
> >>>
> >>> On Wed, Jan 6, 2021 at 5:50 AM Andrew Wieteska <
> >> andrew.r.wieteska@gmail.com>
> >>> wrote:
> >>>
> >>>> Hi Kou,
> >>>>
> >>>> For sure! I'll work on this.
> >>>>
> >>>> Best
> >>>> Andrew
> >>>>
> >>>> On Tue, Jan 5, 2021 at 8:06 PM Sutou Kouhei <ko...@clear-code.com>
> wrote:
> >>>>
> >>>>> Hi Andrew,
> >>>>>
> >>>>> We need to fix nightly builds to release a new version.
> >>>>>
> >>>>> Could you check the latest nightly builds[1], open JIRA
> >>>>> issues for not unaddressed failed builds and fix them one by
> >>>>> one?
> >>>>>
> >>>>> [1]
> >>>>>
> >>>>
> >>
> https://lists.apache.org/thread.html/ra17f2f9c2323498edd45665d78ce669ae90c0bbd888921f94cf9ca5c%40%3Cdev.arrow.apache.org%3E
> >>>>>
> >>>>> For example, wheel-win-* are worked at
> >>>>> https://github.com/apache/arrow/pull/9096 . We don't need to
> >>>>> open new JIRA issues for them.
> >>>>>
> >>>>>
> >>>>> We also need to move away from Travis CI in nightly builds.
> >>>>> See also:
> >>>>>
> >>>>
> >>
> https://lists.apache.org/thread.html/r43ddf0ed5a3d21831edfa20bbe87514dc433e17ec86199c5a4cb80d4%40%3Cdev.arrow.apache.org%3E
> >>>>>
> >>>>> We need to change "ci: travis" in
> >>>>> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml
> >>>>> for it.
> >>>>>
> >>>>> wheel-osx-* are worked at
> >>>>> https://github.com/apache/arrow/pull/8915 .
> >>>>>
> >>>>> I'll work on debian-*, ubuntu-* and centos-*.
> >>>>>
> >>>>> homebrew-* aren't unaddressed. Could you also work on them?
> >>>>>
> >>>>>
> >>>>> Thanks,
> >>>>> --
> >>>>> kou
> >>>>>
> >>>>>
> >>>>> In <CAGeKrB_XFiu3=
> >> Fn3mBvhDD4YFQOi1hAVjRNKho0NwvV6qdfm+g@mail.gmail.com>
> >>>>>   "Re: Arrow 3.0 release" on Mon, 4 Jan 2021 19:45:32 -0500,
> >>>>>   Andrew Wieteska <an...@gmail.com> wrote:
> >>>>>
> >>>>>> Dear all,
> >>>>>>
> >>>>>> I will have time and would be happy to help with the release if the
> >> PMC
> >>>>>> release manager could use a second person. I don't have experience
> >> with
> >>>>> the
> >>>>>> release process so I might need some detailed pointers on where and
> >>>> how I
> >>>>>> can help - but if I can help to relieve the load on the release
> >>>> manager,
> >>>>>> I'm available!
> >>>>>>
> >>>>>> All the best
> >>>>>> Andrew
> >>>>>>
> >>>>>> On Mon, Jan 4, 2021 at 7:24 PM Neal Richardson <
> >>>>> neal.p.richardson@gmail.com>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> Hi folks,
> >>>>>>> It's time to get oriented for our 3.0.0 Arrow release. We had
> >>>> previously
> >>>>>>> said that we wanted to be release-ready by the end of this week,
> >> but
> >>>>> that
> >>>>>>> seems unlikely. There are a number of challenges in front of us,
> >> and
> >>>> we
> >>>>>>> need to step up and address them. Updating on the points I sent
> >> out 3
> >>>>> weeks
> >>>>>>> ago (see below):
> >>>>>>>
> >>>>>>> * Release blockers: per
> >>>>>>>
> >> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
> >>>>> we
> >>>>>>> are up to 6 blockers, and that's not a complete list. We have
> >> failing
> >>>>>>> nightly builds, and we don't have any macOS crossbow builds due to
> >>>>>>> Travis-CI limits, so that means no mac wheels at the moment. So we
> >> are
> >>>>> not
> >>>>>>> releasable today.
> >>>>>>> * Backlog: I did some pushing of issues to 4.0 today, so we're
> >> down to
> >>>>>>> 180ish open issues tagged for 3.0. Please review your own backlogs
> >> and
> >>>>> bump
> >>>>>>> anything you aren't going to get done for this release out.
> >>>>>>> * Pull requests: https://github.com/apache/arrow/pulls shows 118
> >> open
> >>>>> PRs
> >>>>>>> right now. Some of that is probably a holiday backup, but please do
> >>>>> spend
> >>>>>>> some time reviewing and merging (or closing, if appropriate) so we
> >>>> have
> >>>>>>> fewer things hanging on past this release.
> >>>>>>> * Release process: despite the burst of interest a while back,
> >> there
> >>>>>>> doesn't seem to have been any movement on the proposed improvements
> >>>> that
> >>>>>>> would make it less expensive for us to release, and thus be able to
> >>>>> release
> >>>>>>> more frequently. Nevertheless, we still need to release now, and we
> >>>> will
> >>>>>>> need someone (I believe from the PMC) to volunteer to be release
> >>>> manager
> >>>>>>> for 3.0.
> >>>>>>>
> >>>>>>> If you think you can help on any of these issues, please do! This
> >>>>> release
> >>>>>>> won't happen without some collective effort.
> >>>>>>>
> >>>>>>> Thanks, and happy 2021 to you all.
> >>>>>>>
> >>>>>>> Neal
> >>>>>>>
> >>>>>>>
> >>>>>>> On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
> >>>>>>> neal.p.richardson@gmail.com> wrote:
> >>>>>>>
> >>>>>>>> Hi all,
> >>>>>>>> I've created
> >>>>>>>>
> >>>> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
> >>>>> ,
> >>>>>>>> cloned from our previous release dashboards, for our upcoming
> >>>>> release. A
> >>>>>>>> few things I'd like to draw your attention to:
> >>>>>>>>
> >>>>>>>> * Blockers: there are 5 currently. I'm not certain that they all
> >> are
> >>>>>>>> blockers, nor am I sure that there aren't other blockers. I know
> >>>> we've
> >>>>>>> had
> >>>>>>>> some issues lately with python wheel builds, and I've added a
> >> couple
> >>>>> of
> >>>>>>>> known issues, but there may be others. If you know of other
> >> release
> >>>>>>>> blockers, please note them.
> >>>>>>>> * There are over 300 unstarted issues tagged for 3.0.0. Given
> >>>> holiday
> >>>>>>>> schedules and the release target in the first week of January,
> >>>> that's
> >>>>> at
> >>>>>>>> least 200 too many. Please review your backlogs and start bumping
> >>>>> things
> >>>>>>>> out of scope. I've added a 4.0.0 version that you can move things
> >>>> to,
> >>>>> if
> >>>>>>>> you want.
> >>>>>>>> * Release process improvements: there was some discussion a few
> >>>> weeks
> >>>>> ago
> >>>>>>>> about what could be done to make it easier to cut releases (
> >>>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
> https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E
> >>>>>>> ).
> >>>>>>>> A few tasks were mentioned in that thread. If anyone is going to
> >>>> take
> >>>>>>>> action, now would be a good time.
> >>>>>>>>
> >>>>>>>> Thanks,
> >>>>>>>> Neal
> >>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
> >
>

Re: Arrow 3.0 release

Posted by Antoine Pitrou <an...@python.org>.

I think it would be nice to get
https://github.com/apache/arrow/pull/9164 in because it changes the
current behaviour and is also stricter with its inputs.

Regards

Antoine.


Le 11/01/2021 à 20:46, Neal Richardson a écrit :
> Hi all,
> We seem to be getting closer on resolving our CI and packaging challenges,
> despite several additional, unexpected setbacks last week. I think we
> should be in releasable condition in the next day or two. If you have any
> other outstanding issues you're trying to get in the 3.0 release, now is
> the time.
> 
> We need a volunteer from the PMC to be release manager for 3.0.0. Krisztián
> has done the last several releases, and I was wondering if there was anyone
> else out there who wanted to take a turn and give him a break this time.
> 
> Neal
> 
> On Wed, Jan 6, 2021 at 9:03 PM Sutou Kouhei <ko...@clear-code.com> wrote:
> 
>> Hi Neal,
>>
>> Thanks!
>>
>>> ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of Travis-CI
>>
>> I closed this because it has been done by
>> https://issues.apache.org/jira/browse/ARROW-11015 .
>>
>>
>> Thanks,
>> --
>> kou
>>
>> In <CA...@mail.gmail.com>
>>   "Re: Arrow 3.0 release" on Wed, 6 Jan 2021 11:39:02 -0800,
>>   Neal Richardson <ne...@gmail.com> wrote:
>>
>>> I made some JIRAs for these issues:
>>>
>>> ARROW-11152: [CI][C++] Fix Homebrew numpy installation on macOS builds
>>> ARROW-11153: [C++][Packaging] Move debian/ubuntu/centos packaging off of
>>> Travis-CI (assigned to Kou)
>>> ARROW-11154: [CI][C++] Move homebrew crossbow tests off of Travis-CI
>>> ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of Travis-CI
>>>
>>> On Wed, Jan 6, 2021 at 5:50 AM Andrew Wieteska <
>> andrew.r.wieteska@gmail.com>
>>> wrote:
>>>
>>>> Hi Kou,
>>>>
>>>> For sure! I'll work on this.
>>>>
>>>> Best
>>>> Andrew
>>>>
>>>> On Tue, Jan 5, 2021 at 8:06 PM Sutou Kouhei <ko...@clear-code.com> wrote:
>>>>
>>>>> Hi Andrew,
>>>>>
>>>>> We need to fix nightly builds to release a new version.
>>>>>
>>>>> Could you check the latest nightly builds[1], open JIRA
>>>>> issues for not unaddressed failed builds and fix them one by
>>>>> one?
>>>>>
>>>>> [1]
>>>>>
>>>>
>> https://lists.apache.org/thread.html/ra17f2f9c2323498edd45665d78ce669ae90c0bbd888921f94cf9ca5c%40%3Cdev.arrow.apache.org%3E
>>>>>
>>>>> For example, wheel-win-* are worked at
>>>>> https://github.com/apache/arrow/pull/9096 . We don't need to
>>>>> open new JIRA issues for them.
>>>>>
>>>>>
>>>>> We also need to move away from Travis CI in nightly builds.
>>>>> See also:
>>>>>
>>>>
>> https://lists.apache.org/thread.html/r43ddf0ed5a3d21831edfa20bbe87514dc433e17ec86199c5a4cb80d4%40%3Cdev.arrow.apache.org%3E
>>>>>
>>>>> We need to change "ci: travis" in
>>>>> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml
>>>>> for it.
>>>>>
>>>>> wheel-osx-* are worked at
>>>>> https://github.com/apache/arrow/pull/8915 .
>>>>>
>>>>> I'll work on debian-*, ubuntu-* and centos-*.
>>>>>
>>>>> homebrew-* aren't unaddressed. Could you also work on them?
>>>>>
>>>>>
>>>>> Thanks,
>>>>> --
>>>>> kou
>>>>>
>>>>>
>>>>> In <CAGeKrB_XFiu3=
>> Fn3mBvhDD4YFQOi1hAVjRNKho0NwvV6qdfm+g@mail.gmail.com>
>>>>>   "Re: Arrow 3.0 release" on Mon, 4 Jan 2021 19:45:32 -0500,
>>>>>   Andrew Wieteska <an...@gmail.com> wrote:
>>>>>
>>>>>> Dear all,
>>>>>>
>>>>>> I will have time and would be happy to help with the release if the
>> PMC
>>>>>> release manager could use a second person. I don't have experience
>> with
>>>>> the
>>>>>> release process so I might need some detailed pointers on where and
>>>> how I
>>>>>> can help - but if I can help to relieve the load on the release
>>>> manager,
>>>>>> I'm available!
>>>>>>
>>>>>> All the best
>>>>>> Andrew
>>>>>>
>>>>>> On Mon, Jan 4, 2021 at 7:24 PM Neal Richardson <
>>>>> neal.p.richardson@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi folks,
>>>>>>> It's time to get oriented for our 3.0.0 Arrow release. We had
>>>> previously
>>>>>>> said that we wanted to be release-ready by the end of this week,
>> but
>>>>> that
>>>>>>> seems unlikely. There are a number of challenges in front of us,
>> and
>>>> we
>>>>>>> need to step up and address them. Updating on the points I sent
>> out 3
>>>>> weeks
>>>>>>> ago (see below):
>>>>>>>
>>>>>>> * Release blockers: per
>>>>>>>
>> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
>>>>> we
>>>>>>> are up to 6 blockers, and that's not a complete list. We have
>> failing
>>>>>>> nightly builds, and we don't have any macOS crossbow builds due to
>>>>>>> Travis-CI limits, so that means no mac wheels at the moment. So we
>> are
>>>>> not
>>>>>>> releasable today.
>>>>>>> * Backlog: I did some pushing of issues to 4.0 today, so we're
>> down to
>>>>>>> 180ish open issues tagged for 3.0. Please review your own backlogs
>> and
>>>>> bump
>>>>>>> anything you aren't going to get done for this release out.
>>>>>>> * Pull requests: https://github.com/apache/arrow/pulls shows 118
>> open
>>>>> PRs
>>>>>>> right now. Some of that is probably a holiday backup, but please do
>>>>> spend
>>>>>>> some time reviewing and merging (or closing, if appropriate) so we
>>>> have
>>>>>>> fewer things hanging on past this release.
>>>>>>> * Release process: despite the burst of interest a while back,
>> there
>>>>>>> doesn't seem to have been any movement on the proposed improvements
>>>> that
>>>>>>> would make it less expensive for us to release, and thus be able to
>>>>> release
>>>>>>> more frequently. Nevertheless, we still need to release now, and we
>>>> will
>>>>>>> need someone (I believe from the PMC) to volunteer to be release
>>>> manager
>>>>>>> for 3.0.
>>>>>>>
>>>>>>> If you think you can help on any of these issues, please do! This
>>>>> release
>>>>>>> won't happen without some collective effort.
>>>>>>>
>>>>>>> Thanks, and happy 2021 to you all.
>>>>>>>
>>>>>>> Neal
>>>>>>>
>>>>>>>
>>>>>>> On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
>>>>>>> neal.p.richardson@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi all,
>>>>>>>> I've created
>>>>>>>>
>>>> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
>>>>> ,
>>>>>>>> cloned from our previous release dashboards, for our upcoming
>>>>> release. A
>>>>>>>> few things I'd like to draw your attention to:
>>>>>>>>
>>>>>>>> * Blockers: there are 5 currently. I'm not certain that they all
>> are
>>>>>>>> blockers, nor am I sure that there aren't other blockers. I know
>>>> we've
>>>>>>> had
>>>>>>>> some issues lately with python wheel builds, and I've added a
>> couple
>>>>> of
>>>>>>>> known issues, but there may be others. If you know of other
>> release
>>>>>>>> blockers, please note them.
>>>>>>>> * There are over 300 unstarted issues tagged for 3.0.0. Given
>>>> holiday
>>>>>>>> schedules and the release target in the first week of January,
>>>> that's
>>>>> at
>>>>>>>> least 200 too many. Please review your backlogs and start bumping
>>>>> things
>>>>>>>> out of scope. I've added a 4.0.0 version that you can move things
>>>> to,
>>>>> if
>>>>>>>> you want.
>>>>>>>> * Release process improvements: there was some discussion a few
>>>> weeks
>>>>> ago
>>>>>>>> about what could be done to make it easier to cut releases (
>>>>>>>>
>>>>>>>
>>>>>
>>>>
>> https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E
>>>>>>> ).
>>>>>>>> A few tasks were mentioned in that thread. If anyone is going to
>>>> take
>>>>>>>> action, now would be a good time.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Neal
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
>

Re: Arrow 3.0 release

Posted by Neal Richardson <ne...@gmail.com>.

Hi all,
We seem to be getting closer on resolving our CI and packaging challenges,
despite several additional, unexpected setbacks last week. I think we
should be in releasable condition in the next day or two. If you have any
other outstanding issues you're trying to get in the 3.0 release, now is
the time.

We need a volunteer from the PMC to be release manager for 3.0.0. Krisztián
has done the last several releases, and I was wondering if there was anyone
else out there who wanted to take a turn and give him a break this time.

Neal

On Wed, Jan 6, 2021 at 9:03 PM Sutou Kouhei <ko...@clear-code.com> wrote:

> Hi Neal,
>
> Thanks!
>
> > ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of Travis-CI
>
> I closed this because it has been done by
> https://issues.apache.org/jira/browse/ARROW-11015 .
>
>
> Thanks,
> --
> kou
>
> In <CA...@mail.gmail.com>
>   "Re: Arrow 3.0 release" on Wed, 6 Jan 2021 11:39:02 -0800,
>   Neal Richardson <ne...@gmail.com> wrote:
>
> > I made some JIRAs for these issues:
> >
> > ARROW-11152: [CI][C++] Fix Homebrew numpy installation on macOS builds
> > ARROW-11153: [C++][Packaging] Move debian/ubuntu/centos packaging off of
> > Travis-CI (assigned to Kou)
> > ARROW-11154: [CI][C++] Move homebrew crossbow tests off of Travis-CI
> > ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of Travis-CI
> >
> > On Wed, Jan 6, 2021 at 5:50 AM Andrew Wieteska <
> andrew.r.wieteska@gmail.com>
> > wrote:
> >
> >> Hi Kou,
> >>
> >> For sure! I'll work on this.
> >>
> >> Best
> >> Andrew
> >>
> >> On Tue, Jan 5, 2021 at 8:06 PM Sutou Kouhei <ko...@clear-code.com> wrote:
> >>
> >> > Hi Andrew,
> >> >
> >> > We need to fix nightly builds to release a new version.
> >> >
> >> > Could you check the latest nightly builds[1], open JIRA
> >> > issues for not unaddressed failed builds and fix them one by
> >> > one?
> >> >
> >> > [1]
> >> >
> >>
> https://lists.apache.org/thread.html/ra17f2f9c2323498edd45665d78ce669ae90c0bbd888921f94cf9ca5c%40%3Cdev.arrow.apache.org%3E
> >> >
> >> > For example, wheel-win-* are worked at
> >> > https://github.com/apache/arrow/pull/9096 . We don't need to
> >> > open new JIRA issues for them.
> >> >
> >> >
> >> > We also need to move away from Travis CI in nightly builds.
> >> > See also:
> >> >
> >>
> https://lists.apache.org/thread.html/r43ddf0ed5a3d21831edfa20bbe87514dc433e17ec86199c5a4cb80d4%40%3Cdev.arrow.apache.org%3E
> >> >
> >> > We need to change "ci: travis" in
> >> > https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml
> >> > for it.
> >> >
> >> > wheel-osx-* are worked at
> >> > https://github.com/apache/arrow/pull/8915 .
> >> >
> >> > I'll work on debian-*, ubuntu-* and centos-*.
> >> >
> >> > homebrew-* aren't unaddressed. Could you also work on them?
> >> >
> >> >
> >> > Thanks,
> >> > --
> >> > kou
> >> >
> >> >
> >> > In <CAGeKrB_XFiu3=
> Fn3mBvhDD4YFQOi1hAVjRNKho0NwvV6qdfm+g@mail.gmail.com>
> >> >   "Re: Arrow 3.0 release" on Mon, 4 Jan 2021 19:45:32 -0500,
> >> >   Andrew Wieteska <an...@gmail.com> wrote:
> >> >
> >> > > Dear all,
> >> > >
> >> > > I will have time and would be happy to help with the release if the
> PMC
> >> > > release manager could use a second person. I don't have experience
> with
> >> > the
> >> > > release process so I might need some detailed pointers on where and
> >> how I
> >> > > can help - but if I can help to relieve the load on the release
> >> manager,
> >> > > I'm available!
> >> > >
> >> > > All the best
> >> > > Andrew
> >> > >
> >> > > On Mon, Jan 4, 2021 at 7:24 PM Neal Richardson <
> >> > neal.p.richardson@gmail.com>
> >> > > wrote:
> >> > >
> >> > >> Hi folks,
> >> > >> It's time to get oriented for our 3.0.0 Arrow release. We had
> >> previously
> >> > >> said that we wanted to be release-ready by the end of this week,
> but
> >> > that
> >> > >> seems unlikely. There are a number of challenges in front of us,
> and
> >> we
> >> > >> need to step up and address them. Updating on the points I sent
> out 3
> >> > weeks
> >> > >> ago (see below):
> >> > >>
> >> > >> * Release blockers: per
> >> > >>
> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
> >> > we
> >> > >> are up to 6 blockers, and that's not a complete list. We have
> failing
> >> > >> nightly builds, and we don't have any macOS crossbow builds due to
> >> > >> Travis-CI limits, so that means no mac wheels at the moment. So we
> are
> >> > not
> >> > >> releasable today.
> >> > >> * Backlog: I did some pushing of issues to 4.0 today, so we're
> down to
> >> > >> 180ish open issues tagged for 3.0. Please review your own backlogs
> and
> >> > bump
> >> > >> anything you aren't going to get done for this release out.
> >> > >> * Pull requests: https://github.com/apache/arrow/pulls shows 118
> open
> >> > PRs
> >> > >> right now. Some of that is probably a holiday backup, but please do
> >> > spend
> >> > >> some time reviewing and merging (or closing, if appropriate) so we
> >> have
> >> > >> fewer things hanging on past this release.
> >> > >> * Release process: despite the burst of interest a while back,
> there
> >> > >> doesn't seem to have been any movement on the proposed improvements
> >> that
> >> > >> would make it less expensive for us to release, and thus be able to
> >> > release
> >> > >> more frequently. Nevertheless, we still need to release now, and we
> >> will
> >> > >> need someone (I believe from the PMC) to volunteer to be release
> >> manager
> >> > >> for 3.0.
> >> > >>
> >> > >> If you think you can help on any of these issues, please do! This
> >> > release
> >> > >> won't happen without some collective effort.
> >> > >>
> >> > >> Thanks, and happy 2021 to you all.
> >> > >>
> >> > >> Neal
> >> > >>
> >> > >>
> >> > >> On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
> >> > >> neal.p.richardson@gmail.com> wrote:
> >> > >>
> >> > >> > Hi all,
> >> > >> > I've created
> >> > >> >
> >> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
> >> > ,
> >> > >> > cloned from our previous release dashboards, for our upcoming
> >> > release. A
> >> > >> > few things I'd like to draw your attention to:
> >> > >> >
> >> > >> > * Blockers: there are 5 currently. I'm not certain that they all
> are
> >> > >> > blockers, nor am I sure that there aren't other blockers. I know
> >> we've
> >> > >> had
> >> > >> > some issues lately with python wheel builds, and I've added a
> couple
> >> > of
> >> > >> > known issues, but there may be others. If you know of other
> release
> >> > >> > blockers, please note them.
> >> > >> > * There are over 300 unstarted issues tagged for 3.0.0. Given
> >> holiday
> >> > >> > schedules and the release target in the first week of January,
> >> that's
> >> > at
> >> > >> > least 200 too many. Please review your backlogs and start bumping
> >> > things
> >> > >> > out of scope. I've added a 4.0.0 version that you can move things
> >> to,
> >> > if
> >> > >> > you want.
> >> > >> > * Release process improvements: there was some discussion a few
> >> weeks
> >> > ago
> >> > >> > about what could be done to make it easier to cut releases (
> >> > >> >
> >> > >>
> >> >
> >>
> https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E
> >> > >> ).
> >> > >> > A few tasks were mentioned in that thread. If anyone is going to
> >> take
> >> > >> > action, now would be a good time.
> >> > >> >
> >> > >> > Thanks,
> >> > >> > Neal
> >> > >> >
> >> > >> >
> >> > >>
> >> >
> >>
>

Re: Arrow 3.0 release

Posted by Sutou Kouhei <ko...@clear-code.com>.

Hi Neal,

Thanks!

> ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of Travis-CI

I closed this because it has been done by
https://issues.apache.org/jira/browse/ARROW-11015 .


Thanks,
--
kou

In <CA...@mail.gmail.com>
  "Re: Arrow 3.0 release" on Wed, 6 Jan 2021 11:39:02 -0800,
  Neal Richardson <ne...@gmail.com> wrote:

> I made some JIRAs for these issues:
> 
> ARROW-11152: [CI][C++] Fix Homebrew numpy installation on macOS builds
> ARROW-11153: [C++][Packaging] Move debian/ubuntu/centos packaging off of
> Travis-CI (assigned to Kou)
> ARROW-11154: [CI][C++] Move homebrew crossbow tests off of Travis-CI
> ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of Travis-CI
> 
> On Wed, Jan 6, 2021 at 5:50 AM Andrew Wieteska <an...@gmail.com>
> wrote:
> 
>> Hi Kou,
>>
>> For sure! I'll work on this.
>>
>> Best
>> Andrew
>>
>> On Tue, Jan 5, 2021 at 8:06 PM Sutou Kouhei <ko...@clear-code.com> wrote:
>>
>> > Hi Andrew,
>> >
>> > We need to fix nightly builds to release a new version.
>> >
>> > Could you check the latest nightly builds[1], open JIRA
>> > issues for not unaddressed failed builds and fix them one by
>> > one?
>> >
>> > [1]
>> >
>> https://lists.apache.org/thread.html/ra17f2f9c2323498edd45665d78ce669ae90c0bbd888921f94cf9ca5c%40%3Cdev.arrow.apache.org%3E
>> >
>> > For example, wheel-win-* are worked at
>> > https://github.com/apache/arrow/pull/9096 . We don't need to
>> > open new JIRA issues for them.
>> >
>> >
>> > We also need to move away from Travis CI in nightly builds.
>> > See also:
>> >
>> https://lists.apache.org/thread.html/r43ddf0ed5a3d21831edfa20bbe87514dc433e17ec86199c5a4cb80d4%40%3Cdev.arrow.apache.org%3E
>> >
>> > We need to change "ci: travis" in
>> > https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml
>> > for it.
>> >
>> > wheel-osx-* are worked at
>> > https://github.com/apache/arrow/pull/8915 .
>> >
>> > I'll work on debian-*, ubuntu-* and centos-*.
>> >
>> > homebrew-* aren't unaddressed. Could you also work on them?
>> >
>> >
>> > Thanks,
>> > --
>> > kou
>> >
>> >
>> > In <CA...@mail.gmail.com>
>> >   "Re: Arrow 3.0 release" on Mon, 4 Jan 2021 19:45:32 -0500,
>> >   Andrew Wieteska <an...@gmail.com> wrote:
>> >
>> > > Dear all,
>> > >
>> > > I will have time and would be happy to help with the release if the PMC
>> > > release manager could use a second person. I don't have experience with
>> > the
>> > > release process so I might need some detailed pointers on where and
>> how I
>> > > can help - but if I can help to relieve the load on the release
>> manager,
>> > > I'm available!
>> > >
>> > > All the best
>> > > Andrew
>> > >
>> > > On Mon, Jan 4, 2021 at 7:24 PM Neal Richardson <
>> > neal.p.richardson@gmail.com>
>> > > wrote:
>> > >
>> > >> Hi folks,
>> > >> It's time to get oriented for our 3.0.0 Arrow release. We had
>> previously
>> > >> said that we wanted to be release-ready by the end of this week, but
>> > that
>> > >> seems unlikely. There are a number of challenges in front of us, and
>> we
>> > >> need to step up and address them. Updating on the points I sent out 3
>> > weeks
>> > >> ago (see below):
>> > >>
>> > >> * Release blockers: per
>> > >> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
>> > we
>> > >> are up to 6 blockers, and that's not a complete list. We have failing
>> > >> nightly builds, and we don't have any macOS crossbow builds due to
>> > >> Travis-CI limits, so that means no mac wheels at the moment. So we are
>> > not
>> > >> releasable today.
>> > >> * Backlog: I did some pushing of issues to 4.0 today, so we're down to
>> > >> 180ish open issues tagged for 3.0. Please review your own backlogs and
>> > bump
>> > >> anything you aren't going to get done for this release out.
>> > >> * Pull requests: https://github.com/apache/arrow/pulls shows 118 open
>> > PRs
>> > >> right now. Some of that is probably a holiday backup, but please do
>> > spend
>> > >> some time reviewing and merging (or closing, if appropriate) so we
>> have
>> > >> fewer things hanging on past this release.
>> > >> * Release process: despite the burst of interest a while back, there
>> > >> doesn't seem to have been any movement on the proposed improvements
>> that
>> > >> would make it less expensive for us to release, and thus be able to
>> > release
>> > >> more frequently. Nevertheless, we still need to release now, and we
>> will
>> > >> need someone (I believe from the PMC) to volunteer to be release
>> manager
>> > >> for 3.0.
>> > >>
>> > >> If you think you can help on any of these issues, please do! This
>> > release
>> > >> won't happen without some collective effort.
>> > >>
>> > >> Thanks, and happy 2021 to you all.
>> > >>
>> > >> Neal
>> > >>
>> > >>
>> > >> On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
>> > >> neal.p.richardson@gmail.com> wrote:
>> > >>
>> > >> > Hi all,
>> > >> > I've created
>> > >> >
>> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
>> > ,
>> > >> > cloned from our previous release dashboards, for our upcoming
>> > release. A
>> > >> > few things I'd like to draw your attention to:
>> > >> >
>> > >> > * Blockers: there are 5 currently. I'm not certain that they all are
>> > >> > blockers, nor am I sure that there aren't other blockers. I know
>> we've
>> > >> had
>> > >> > some issues lately with python wheel builds, and I've added a couple
>> > of
>> > >> > known issues, but there may be others. If you know of other release
>> > >> > blockers, please note them.
>> > >> > * There are over 300 unstarted issues tagged for 3.0.0. Given
>> holiday
>> > >> > schedules and the release target in the first week of January,
>> that's
>> > at
>> > >> > least 200 too many. Please review your backlogs and start bumping
>> > things
>> > >> > out of scope. I've added a 4.0.0 version that you can move things
>> to,
>> > if
>> > >> > you want.
>> > >> > * Release process improvements: there was some discussion a few
>> weeks
>> > ago
>> > >> > about what could be done to make it easier to cut releases (
>> > >> >
>> > >>
>> >
>> https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E
>> > >> ).
>> > >> > A few tasks were mentioned in that thread. If anyone is going to
>> take
>> > >> > action, now would be a good time.
>> > >> >
>> > >> > Thanks,
>> > >> > Neal
>> > >> >
>> > >> >
>> > >>
>> >
>>

Re: Arrow 3.0 release

Posted by Neal Richardson <ne...@gmail.com>.

I made some JIRAs for these issues:

ARROW-11152: [CI][C++] Fix Homebrew numpy installation on macOS builds
ARROW-11153: [C++][Packaging] Move debian/ubuntu/centos packaging off of
Travis-CI (assigned to Kou)
ARROW-11154: [CI][C++] Move homebrew crossbow tests off of Travis-CI
ARROW-11155: [C++][Packaging] Move gandiva crossbow jobs off of Travis-CI

On Wed, Jan 6, 2021 at 5:50 AM Andrew Wieteska <an...@gmail.com>
wrote:

> Hi Kou,
>
> For sure! I'll work on this.
>
> Best
> Andrew
>
> On Tue, Jan 5, 2021 at 8:06 PM Sutou Kouhei <ko...@clear-code.com> wrote:
>
> > Hi Andrew,
> >
> > We need to fix nightly builds to release a new version.
> >
> > Could you check the latest nightly builds[1], open JIRA
> > issues for not unaddressed failed builds and fix them one by
> > one?
> >
> > [1]
> >
> https://lists.apache.org/thread.html/ra17f2f9c2323498edd45665d78ce669ae90c0bbd888921f94cf9ca5c%40%3Cdev.arrow.apache.org%3E
> >
> > For example, wheel-win-* are worked at
> > https://github.com/apache/arrow/pull/9096 . We don't need to
> > open new JIRA issues for them.
> >
> >
> > We also need to move away from Travis CI in nightly builds.
> > See also:
> >
> https://lists.apache.org/thread.html/r43ddf0ed5a3d21831edfa20bbe87514dc433e17ec86199c5a4cb80d4%40%3Cdev.arrow.apache.org%3E
> >
> > We need to change "ci: travis" in
> > https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml
> > for it.
> >
> > wheel-osx-* are worked at
> > https://github.com/apache/arrow/pull/8915 .
> >
> > I'll work on debian-*, ubuntu-* and centos-*.
> >
> > homebrew-* aren't unaddressed. Could you also work on them?
> >
> >
> > Thanks,
> > --
> > kou
> >
> >
> > In <CA...@mail.gmail.com>
> >   "Re: Arrow 3.0 release" on Mon, 4 Jan 2021 19:45:32 -0500,
> >   Andrew Wieteska <an...@gmail.com> wrote:
> >
> > > Dear all,
> > >
> > > I will have time and would be happy to help with the release if the PMC
> > > release manager could use a second person. I don't have experience with
> > the
> > > release process so I might need some detailed pointers on where and
> how I
> > > can help - but if I can help to relieve the load on the release
> manager,
> > > I'm available!
> > >
> > > All the best
> > > Andrew
> > >
> > > On Mon, Jan 4, 2021 at 7:24 PM Neal Richardson <
> > neal.p.richardson@gmail.com>
> > > wrote:
> > >
> > >> Hi folks,
> > >> It's time to get oriented for our 3.0.0 Arrow release. We had
> previously
> > >> said that we wanted to be release-ready by the end of this week, but
> > that
> > >> seems unlikely. There are a number of challenges in front of us, and
> we
> > >> need to step up and address them. Updating on the points I sent out 3
> > weeks
> > >> ago (see below):
> > >>
> > >> * Release blockers: per
> > >> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
> > we
> > >> are up to 6 blockers, and that's not a complete list. We have failing
> > >> nightly builds, and we don't have any macOS crossbow builds due to
> > >> Travis-CI limits, so that means no mac wheels at the moment. So we are
> > not
> > >> releasable today.
> > >> * Backlog: I did some pushing of issues to 4.0 today, so we're down to
> > >> 180ish open issues tagged for 3.0. Please review your own backlogs and
> > bump
> > >> anything you aren't going to get done for this release out.
> > >> * Pull requests: https://github.com/apache/arrow/pulls shows 118 open
> > PRs
> > >> right now. Some of that is probably a holiday backup, but please do
> > spend
> > >> some time reviewing and merging (or closing, if appropriate) so we
> have
> > >> fewer things hanging on past this release.
> > >> * Release process: despite the burst of interest a while back, there
> > >> doesn't seem to have been any movement on the proposed improvements
> that
> > >> would make it less expensive for us to release, and thus be able to
> > release
> > >> more frequently. Nevertheless, we still need to release now, and we
> will
> > >> need someone (I believe from the PMC) to volunteer to be release
> manager
> > >> for 3.0.
> > >>
> > >> If you think you can help on any of these issues, please do! This
> > release
> > >> won't happen without some collective effort.
> > >>
> > >> Thanks, and happy 2021 to you all.
> > >>
> > >> Neal
> > >>
> > >>
> > >> On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
> > >> neal.p.richardson@gmail.com> wrote:
> > >>
> > >> > Hi all,
> > >> > I've created
> > >> >
> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
> > ,
> > >> > cloned from our previous release dashboards, for our upcoming
> > release. A
> > >> > few things I'd like to draw your attention to:
> > >> >
> > >> > * Blockers: there are 5 currently. I'm not certain that they all are
> > >> > blockers, nor am I sure that there aren't other blockers. I know
> we've
> > >> had
> > >> > some issues lately with python wheel builds, and I've added a couple
> > of
> > >> > known issues, but there may be others. If you know of other release
> > >> > blockers, please note them.
> > >> > * There are over 300 unstarted issues tagged for 3.0.0. Given
> holiday
> > >> > schedules and the release target in the first week of January,
> that's
> > at
> > >> > least 200 too many. Please review your backlogs and start bumping
> > things
> > >> > out of scope. I've added a 4.0.0 version that you can move things
> to,
> > if
> > >> > you want.
> > >> > * Release process improvements: there was some discussion a few
> weeks
> > ago
> > >> > about what could be done to make it easier to cut releases (
> > >> >
> > >>
> >
> https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E
> > >> ).
> > >> > A few tasks were mentioned in that thread. If anyone is going to
> take
> > >> > action, now would be a good time.
> > >> >
> > >> > Thanks,
> > >> > Neal
> > >> >
> > >> >
> > >>
> >
>

Re: Arrow 3.0 release

Posted by Andrew Wieteska <an...@gmail.com>.

Hi Kou,

For sure! I'll work on this.

Best
Andrew

On Tue, Jan 5, 2021 at 8:06 PM Sutou Kouhei <ko...@clear-code.com> wrote:

> Hi Andrew,
>
> We need to fix nightly builds to release a new version.
>
> Could you check the latest nightly builds[1], open JIRA
> issues for not unaddressed failed builds and fix them one by
> one?
>
> [1]
> https://lists.apache.org/thread.html/ra17f2f9c2323498edd45665d78ce669ae90c0bbd888921f94cf9ca5c%40%3Cdev.arrow.apache.org%3E
>
> For example, wheel-win-* are worked at
> https://github.com/apache/arrow/pull/9096 . We don't need to
> open new JIRA issues for them.
>
>
> We also need to move away from Travis CI in nightly builds.
> See also:
> https://lists.apache.org/thread.html/r43ddf0ed5a3d21831edfa20bbe87514dc433e17ec86199c5a4cb80d4%40%3Cdev.arrow.apache.org%3E
>
> We need to change "ci: travis" in
> https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml
> for it.
>
> wheel-osx-* are worked at
> https://github.com/apache/arrow/pull/8915 .
>
> I'll work on debian-*, ubuntu-* and centos-*.
>
> homebrew-* aren't unaddressed. Could you also work on them?
>
>
> Thanks,
> --
> kou
>
>
> In <CA...@mail.gmail.com>
>   "Re: Arrow 3.0 release" on Mon, 4 Jan 2021 19:45:32 -0500,
>   Andrew Wieteska <an...@gmail.com> wrote:
>
> > Dear all,
> >
> > I will have time and would be happy to help with the release if the PMC
> > release manager could use a second person. I don't have experience with
> the
> > release process so I might need some detailed pointers on where and how I
> > can help - but if I can help to relieve the load on the release manager,
> > I'm available!
> >
> > All the best
> > Andrew
> >
> > On Mon, Jan 4, 2021 at 7:24 PM Neal Richardson <
> neal.p.richardson@gmail.com>
> > wrote:
> >
> >> Hi folks,
> >> It's time to get oriented for our 3.0.0 Arrow release. We had previously
> >> said that we wanted to be release-ready by the end of this week, but
> that
> >> seems unlikely. There are a number of challenges in front of us, and we
> >> need to step up and address them. Updating on the points I sent out 3
> weeks
> >> ago (see below):
> >>
> >> * Release blockers: per
> >> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
> we
> >> are up to 6 blockers, and that's not a complete list. We have failing
> >> nightly builds, and we don't have any macOS crossbow builds due to
> >> Travis-CI limits, so that means no mac wheels at the moment. So we are
> not
> >> releasable today.
> >> * Backlog: I did some pushing of issues to 4.0 today, so we're down to
> >> 180ish open issues tagged for 3.0. Please review your own backlogs and
> bump
> >> anything you aren't going to get done for this release out.
> >> * Pull requests: https://github.com/apache/arrow/pulls shows 118 open
> PRs
> >> right now. Some of that is probably a holiday backup, but please do
> spend
> >> some time reviewing and merging (or closing, if appropriate) so we have
> >> fewer things hanging on past this release.
> >> * Release process: despite the burst of interest a while back, there
> >> doesn't seem to have been any movement on the proposed improvements that
> >> would make it less expensive for us to release, and thus be able to
> release
> >> more frequently. Nevertheless, we still need to release now, and we will
> >> need someone (I believe from the PMC) to volunteer to be release manager
> >> for 3.0.
> >>
> >> If you think you can help on any of these issues, please do! This
> release
> >> won't happen without some collective effort.
> >>
> >> Thanks, and happy 2021 to you all.
> >>
> >> Neal
> >>
> >>
> >> On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
> >> neal.p.richardson@gmail.com> wrote:
> >>
> >> > Hi all,
> >> > I've created
> >> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release
> ,
> >> > cloned from our previous release dashboards, for our upcoming
> release. A
> >> > few things I'd like to draw your attention to:
> >> >
> >> > * Blockers: there are 5 currently. I'm not certain that they all are
> >> > blockers, nor am I sure that there aren't other blockers. I know we've
> >> had
> >> > some issues lately with python wheel builds, and I've added a couple
> of
> >> > known issues, but there may be others. If you know of other release
> >> > blockers, please note them.
> >> > * There are over 300 unstarted issues tagged for 3.0.0. Given holiday
> >> > schedules and the release target in the first week of January, that's
> at
> >> > least 200 too many. Please review your backlogs and start bumping
> things
> >> > out of scope. I've added a 4.0.0 version that you can move things to,
> if
> >> > you want.
> >> > * Release process improvements: there was some discussion a few weeks
> ago
> >> > about what could be done to make it easier to cut releases (
> >> >
> >>
> https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E
> >> ).
> >> > A few tasks were mentioned in that thread. If anyone is going to take
> >> > action, now would be a good time.
> >> >
> >> > Thanks,
> >> > Neal
> >> >
> >> >
> >>
>

Re: Arrow 3.0 release

Posted by Sutou Kouhei <ko...@clear-code.com>.

Hi Andrew,

We need to fix nightly builds to release a new version.

Could you check the latest nightly builds[1], open JIRA
issues for not unaddressed failed builds and fix them one by
one?

[1] https://lists.apache.org/thread.html/ra17f2f9c2323498edd45665d78ce669ae90c0bbd888921f94cf9ca5c%40%3Cdev.arrow.apache.org%3E

For example, wheel-win-* are worked at
https://github.com/apache/arrow/pull/9096 . We don't need to
open new JIRA issues for them.


We also need to move away from Travis CI in nightly builds.
See also: https://lists.apache.org/thread.html/r43ddf0ed5a3d21831edfa20bbe87514dc433e17ec86199c5a4cb80d4%40%3Cdev.arrow.apache.org%3E

We need to change "ci: travis" in
https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml
for it.

wheel-osx-* are worked at
https://github.com/apache/arrow/pull/8915 .

I'll work on debian-*, ubuntu-* and centos-*.

homebrew-* aren't unaddressed. Could you also work on them?


Thanks,
--
kou


In <CA...@mail.gmail.com>
  "Re: Arrow 3.0 release" on Mon, 4 Jan 2021 19:45:32 -0500,
  Andrew Wieteska <an...@gmail.com> wrote:

> Dear all,
> 
> I will have time and would be happy to help with the release if the PMC
> release manager could use a second person. I don't have experience with the
> release process so I might need some detailed pointers on where and how I
> can help - but if I can help to relieve the load on the release manager,
> I'm available!
> 
> All the best
> Andrew
> 
> On Mon, Jan 4, 2021 at 7:24 PM Neal Richardson <ne...@gmail.com>
> wrote:
> 
>> Hi folks,
>> It's time to get oriented for our 3.0.0 Arrow release. We had previously
>> said that we wanted to be release-ready by the end of this week, but that
>> seems unlikely. There are a number of challenges in front of us, and we
>> need to step up and address them. Updating on the points I sent out 3 weeks
>> ago (see below):
>>
>> * Release blockers: per
>> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release we
>> are up to 6 blockers, and that's not a complete list. We have failing
>> nightly builds, and we don't have any macOS crossbow builds due to
>> Travis-CI limits, so that means no mac wheels at the moment. So we are not
>> releasable today.
>> * Backlog: I did some pushing of issues to 4.0 today, so we're down to
>> 180ish open issues tagged for 3.0. Please review your own backlogs and bump
>> anything you aren't going to get done for this release out.
>> * Pull requests: https://github.com/apache/arrow/pulls shows 118 open PRs
>> right now. Some of that is probably a holiday backup, but please do spend
>> some time reviewing and merging (or closing, if appropriate) so we have
>> fewer things hanging on past this release.
>> * Release process: despite the burst of interest a while back, there
>> doesn't seem to have been any movement on the proposed improvements that
>> would make it less expensive for us to release, and thus be able to release
>> more frequently. Nevertheless, we still need to release now, and we will
>> need someone (I believe from the PMC) to volunteer to be release manager
>> for 3.0.
>>
>> If you think you can help on any of these issues, please do! This release
>> won't happen without some collective effort.
>>
>> Thanks, and happy 2021 to you all.
>>
>> Neal
>>
>>
>> On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
>> neal.p.richardson@gmail.com> wrote:
>>
>> > Hi all,
>> > I've created
>> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release,
>> > cloned from our previous release dashboards, for our upcoming release. A
>> > few things I'd like to draw your attention to:
>> >
>> > * Blockers: there are 5 currently. I'm not certain that they all are
>> > blockers, nor am I sure that there aren't other blockers. I know we've
>> had
>> > some issues lately with python wheel builds, and I've added a couple of
>> > known issues, but there may be others. If you know of other release
>> > blockers, please note them.
>> > * There are over 300 unstarted issues tagged for 3.0.0. Given holiday
>> > schedules and the release target in the first week of January, that's at
>> > least 200 too many. Please review your backlogs and start bumping things
>> > out of scope. I've added a 4.0.0 version that you can move things to, if
>> > you want.
>> > * Release process improvements: there was some discussion a few weeks ago
>> > about what could be done to make it easier to cut releases (
>> >
>> https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E
>> ).
>> > A few tasks were mentioned in that thread. If anyone is going to take
>> > action, now would be a good time.
>> >
>> > Thanks,
>> > Neal
>> >
>> >
>>

Re: Arrow 3.0 release

Posted by Krisztián Szűcs <sz...@gmail.com>.

On Tue, Jan 5, 2021 at 1:46 AM Andrew Wieteska
<an...@gmail.com> wrote:
>
> Dear all,
>
> I will have time and would be happy to help with the release if the PMC
> release manager could use a second person. I don't have experience with the
> release process so I might need some detailed pointers on where and how I
> can help - but if I can help to relieve the load on the release manager,
> I'm available!
Thanks for volunteering!

The tasks before the release candidate vote isn't really distributable
since most of the steps require the gpg key of the release manager.
On the other hand certain post-release tasks can be done by other
committers depending if she/he has access for specific packaging
systems (e.g. cargo or npm).
>
> All the best
> Andrew
>
> On Mon, Jan 4, 2021 at 7:24 PM Neal Richardson <ne...@gmail.com>
> wrote:
>
> > Hi folks,
> > It's time to get oriented for our 3.0.0 Arrow release. We had previously
> > said that we wanted to be release-ready by the end of this week, but that
> > seems unlikely. There are a number of challenges in front of us, and we
> > need to step up and address them. Updating on the points I sent out 3 weeks
> > ago (see below):
> >
> > * Release blockers: per
> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release we
> > are up to 6 blockers, and that's not a complete list. We have failing
> > nightly builds, and we don't have any macOS crossbow builds due to
> > Travis-CI limits, so that means no mac wheels at the moment. So we are not
> > releasable today.
This is a pressing issue. There is a pull request [1] which ports the
crossbow tasks to github actions, but the comment bot has stopped
working since the infra blocked 3rdparty GHA plugins. So we have
multiple problems which need to be resolved.

The windows wheels are also failing, there is a fix at [2], but
requires a rebase.
I submitted another work in progress PR which aims to make the wheel
builds more reproducible [3].

I'm going to work on the packaging problems, but since these builds
take a lot of time I'd expect some delay.

[1]: https://github.com/apache/arrow/pull/8915
[2]: https://github.com/apache/arrow/pull/8881
[3]: https://github.com/apache/arrow/pull/9096
> > * Backlog: I did some pushing of issues to 4.0 today, so we're down to
> > 180ish open issues tagged for 3.0. Please review your own backlogs and bump
> > anything you aren't going to get done for this release out.
> > * Pull requests: https://github.com/apache/arrow/pulls shows 118 open PRs
> > right now. Some of that is probably a holiday backup, but please do spend
> > some time reviewing and merging (or closing, if appropriate) so we have
> > fewer things hanging on past this release.
> > * Release process: despite the burst of interest a while back, there
> > doesn't seem to have been any movement on the proposed improvements that
> > would make it less expensive for us to release, and thus be able to release
> > more frequently. Nevertheless, we still need to release now, and we will
> > need someone (I believe from the PMC) to volunteer to be release manager
> > for 3.0.
> >
> > If you think you can help on any of these issues, please do! This release
> > won't happen without some collective effort.
> >
> > Thanks, and happy 2021 to you all.
> >
> > Neal
> >
> >
> > On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
> > neal.p.richardson@gmail.com> wrote:
> >
> > > Hi all,
> > > I've created
> > > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release,
> > > cloned from our previous release dashboards, for our upcoming release. A
> > > few things I'd like to draw your attention to:
> > >
> > > * Blockers: there are 5 currently. I'm not certain that they all are
> > > blockers, nor am I sure that there aren't other blockers. I know we've
> > had
> > > some issues lately with python wheel builds, and I've added a couple of
> > > known issues, but there may be others. If you know of other release
> > > blockers, please note them.
> > > * There are over 300 unstarted issues tagged for 3.0.0. Given holiday
> > > schedules and the release target in the first week of January, that's at
> > > least 200 too many. Please review your backlogs and start bumping things
> > > out of scope. I've added a 4.0.0 version that you can move things to, if
> > > you want.
> > > * Release process improvements: there was some discussion a few weeks ago
> > > about what could be done to make it easier to cut releases (
> > >
> > https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E
> > ).
> > > A few tasks were mentioned in that thread. If anyone is going to take
> > > action, now would be a good time.
> > >
> > > Thanks,
> > > Neal
> > >
> > >
> >

Re: Arrow 3.0 release

Posted by Andrew Wieteska <an...@gmail.com>.

Dear all,

I will have time and would be happy to help with the release if the PMC
release manager could use a second person. I don't have experience with the
release process so I might need some detailed pointers on where and how I
can help - but if I can help to relieve the load on the release manager,
I'm available!

All the best
Andrew

On Mon, Jan 4, 2021 at 7:24 PM Neal Richardson <ne...@gmail.com>
wrote:

> Hi folks,
> It's time to get oriented for our 3.0.0 Arrow release. We had previously
> said that we wanted to be release-ready by the end of this week, but that
> seems unlikely. There are a number of challenges in front of us, and we
> need to step up and address them. Updating on the points I sent out 3 weeks
> ago (see below):
>
> * Release blockers: per
> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release we
> are up to 6 blockers, and that's not a complete list. We have failing
> nightly builds, and we don't have any macOS crossbow builds due to
> Travis-CI limits, so that means no mac wheels at the moment. So we are not
> releasable today.
> * Backlog: I did some pushing of issues to 4.0 today, so we're down to
> 180ish open issues tagged for 3.0. Please review your own backlogs and bump
> anything you aren't going to get done for this release out.
> * Pull requests: https://github.com/apache/arrow/pulls shows 118 open PRs
> right now. Some of that is probably a holiday backup, but please do spend
> some time reviewing and merging (or closing, if appropriate) so we have
> fewer things hanging on past this release.
> * Release process: despite the burst of interest a while back, there
> doesn't seem to have been any movement on the proposed improvements that
> would make it less expensive for us to release, and thus be able to release
> more frequently. Nevertheless, we still need to release now, and we will
> need someone (I believe from the PMC) to volunteer to be release manager
> for 3.0.
>
> If you think you can help on any of these issues, please do! This release
> won't happen without some collective effort.
>
> Thanks, and happy 2021 to you all.
>
> Neal
>
>
> On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
> neal.p.richardson@gmail.com> wrote:
>
> > Hi all,
> > I've created
> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release,
> > cloned from our previous release dashboards, for our upcoming release. A
> > few things I'd like to draw your attention to:
> >
> > * Blockers: there are 5 currently. I'm not certain that they all are
> > blockers, nor am I sure that there aren't other blockers. I know we've
> had
> > some issues lately with python wheel builds, and I've added a couple of
> > known issues, but there may be others. If you know of other release
> > blockers, please note them.
> > * There are over 300 unstarted issues tagged for 3.0.0. Given holiday
> > schedules and the release target in the first week of January, that's at
> > least 200 too many. Please review your backlogs and start bumping things
> > out of scope. I've added a 4.0.0 version that you can move things to, if
> > you want.
> > * Release process improvements: there was some discussion a few weeks ago
> > about what could be done to make it easier to cut releases (
> >
> https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E
> ).
> > A few tasks were mentioned in that thread. If anyone is going to take
> > action, now would be a good time.
> >
> > Thanks,
> > Neal
> >
> >
>

Re: Arrow 3.0 release

Posted by Neal Richardson <ne...@gmail.com>.

I just did this search and didn't find anything:
https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened)%20AND%20fixVersion%20%3D%203.0.0%20AND%20text%20~%20%22cuda%22%20ORDER%20BY%20created%20DESC

On Mon, Jan 4, 2021 at 4:35 PM M. Edward (Ed) Borasky <zn...@znmeb.net>
wrote:

> I'm not sure how to read the issues tracker - is there a category for
> CUDA issues?
>
> On Mon, Jan 4, 2021 at 4:24 PM Neal Richardson
> <ne...@gmail.com> wrote:
> >
> > Hi folks,
> > It's time to get oriented for our 3.0.0 Arrow release. We had previously
> > said that we wanted to be release-ready by the end of this week, but that
> > seems unlikely. There are a number of challenges in front of us, and we
> > need to step up and address them. Updating on the points I sent out 3
> weeks
> > ago (see below):
> >
> > * Release blockers: per
> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release we
> > are up to 6 blockers, and that's not a complete list. We have failing
> > nightly builds, and we don't have any macOS crossbow builds due to
> > Travis-CI limits, so that means no mac wheels at the moment. So we are
> not
> > releasable today.
> > * Backlog: I did some pushing of issues to 4.0 today, so we're down to
> > 180ish open issues tagged for 3.0. Please review your own backlogs and
> bump
> > anything you aren't going to get done for this release out.
> > * Pull requests: https://github.com/apache/arrow/pulls shows 118 open
> PRs
> > right now. Some of that is probably a holiday backup, but please do spend
> > some time reviewing and merging (or closing, if appropriate) so we have
> > fewer things hanging on past this release.
> > * Release process: despite the burst of interest a while back, there
> > doesn't seem to have been any movement on the proposed improvements that
> > would make it less expensive for us to release, and thus be able to
> release
> > more frequently. Nevertheless, we still need to release now, and we will
> > need someone (I believe from the PMC) to volunteer to be release manager
> > for 3.0.
> >
> > If you think you can help on any of these issues, please do! This release
> > won't happen without some collective effort.
> >
> > Thanks, and happy 2021 to you all.
> >
> > Neal
> >
> >
> > On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
> > neal.p.richardson@gmail.com> wrote:
> >
> > > Hi all,
> > > I've created
> > > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release,
> > > cloned from our previous release dashboards, for our upcoming release.
> A
> > > few things I'd like to draw your attention to:
> > >
> > > * Blockers: there are 5 currently. I'm not certain that they all are
> > > blockers, nor am I sure that there aren't other blockers. I know we've
> had
> > > some issues lately with python wheel builds, and I've added a couple of
> > > known issues, but there may be others. If you know of other release
> > > blockers, please note them.
> > > * There are over 300 unstarted issues tagged for 3.0.0. Given holiday
> > > schedules and the release target in the first week of January, that's
> at
> > > least 200 too many. Please review your backlogs and start bumping
> things
> > > out of scope. I've added a 4.0.0 version that you can move things to,
> if
> > > you want.
> > > * Release process improvements: there was some discussion a few weeks
> ago
> > > about what could be done to make it easier to cut releases (
> > >
> https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E
> ).
> > > A few tasks were mentioned in that thread. If anyone is going to take
> > > action, now would be a good time.
> > >
> > > Thanks,
> > > Neal
> > >
> > >
>
>
>
> --
> Borasky Research Journal https://www.znmeb.mobi
>
> Markovs of the world, unite! You have nothing to lose but your chains!
>

Re: Arrow 3.0 release

Posted by Sutou Kouhei <ko...@clear-code.com>.

Hi,

> I personally haven't been able to get a build working.

Could you open a JIRA issue and share the details such as
how to reproduce, full build log and so on?


Thanks,
--
kou

In <CA...@mail.gmail.com>
  "Re: Arrow 3.0 release" on Mon, 4 Jan 2021 16:44:23 -0800,
  "M. Edward (Ed) Borasky" <zn...@znmeb.net> wrote:

> P.S.: I can test on Linux with an NVIDIA GTX 1050 Ti, Windows 10 / WSL
> 2 with an RTX 3090 (new Ampere architecture) and Jetson Nano and AGX
> Xavier (ARM64 plus CUDA 10.2). I believe NVIDIA has an unofficial
> build of Arrow that works on the AGX Xavier but I personally haven't
> been able to get a build working.
> 
> On Mon, Jan 4, 2021 at 4:34 PM M. Edward (Ed) Borasky <zn...@znmeb.net> wrote:
>>
>> I'm not sure how to read the issues tracker - is there a category for
>> CUDA issues?
>>
>> On Mon, Jan 4, 2021 at 4:24 PM Neal Richardson
>> <ne...@gmail.com> wrote:
>> >
>> > Hi folks,
>> > It's time to get oriented for our 3.0.0 Arrow release. We had previously
>> > said that we wanted to be release-ready by the end of this week, but that
>> > seems unlikely. There are a number of challenges in front of us, and we
>> > need to step up and address them. Updating on the points I sent out 3 weeks
>> > ago (see below):
>> >
>> > * Release blockers: per
>> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release we
>> > are up to 6 blockers, and that's not a complete list. We have failing
>> > nightly builds, and we don't have any macOS crossbow builds due to
>> > Travis-CI limits, so that means no mac wheels at the moment. So we are not
>> > releasable today.
>> > * Backlog: I did some pushing of issues to 4.0 today, so we're down to
>> > 180ish open issues tagged for 3.0. Please review your own backlogs and bump
>> > anything you aren't going to get done for this release out.
>> > * Pull requests: https://github.com/apache/arrow/pulls shows 118 open PRs
>> > right now. Some of that is probably a holiday backup, but please do spend
>> > some time reviewing and merging (or closing, if appropriate) so we have
>> > fewer things hanging on past this release.
>> > * Release process: despite the burst of interest a while back, there
>> > doesn't seem to have been any movement on the proposed improvements that
>> > would make it less expensive for us to release, and thus be able to release
>> > more frequently. Nevertheless, we still need to release now, and we will
>> > need someone (I believe from the PMC) to volunteer to be release manager
>> > for 3.0.
>> >
>> > If you think you can help on any of these issues, please do! This release
>> > won't happen without some collective effort.
>> >
>> > Thanks, and happy 2021 to you all.
>> >
>> > Neal
>> >
>> >
>> > On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
>> > neal.p.richardson@gmail.com> wrote:
>> >
>> > > Hi all,
>> > > I've created
>> > > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release,
>> > > cloned from our previous release dashboards, for our upcoming release. A
>> > > few things I'd like to draw your attention to:
>> > >
>> > > * Blockers: there are 5 currently. I'm not certain that they all are
>> > > blockers, nor am I sure that there aren't other blockers. I know we've had
>> > > some issues lately with python wheel builds, and I've added a couple of
>> > > known issues, but there may be others. If you know of other release
>> > > blockers, please note them.
>> > > * There are over 300 unstarted issues tagged for 3.0.0. Given holiday
>> > > schedules and the release target in the first week of January, that's at
>> > > least 200 too many. Please review your backlogs and start bumping things
>> > > out of scope. I've added a 4.0.0 version that you can move things to, if
>> > > you want.
>> > > * Release process improvements: there was some discussion a few weeks ago
>> > > about what could be done to make it easier to cut releases (
>> > > https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E).
>> > > A few tasks were mentioned in that thread. If anyone is going to take
>> > > action, now would be a good time.
>> > >
>> > > Thanks,
>> > > Neal
>> > >
>> > >
>>
>>
>>
>> --
>> Borasky Research Journal https://www.znmeb.mobi
>>
>> Markovs of the world, unite! You have nothing to lose but your chains!
> 
> 
> 
> -- 
> Borasky Research Journal https://www.znmeb.mobi
> 
> Markovs of the world, unite! You have nothing to lose but your chains!

Re: Arrow 3.0 release

Posted by "M. Edward (Ed) Borasky" <zn...@znmeb.net>.

P.S.: I can test on Linux with an NVIDIA GTX 1050 Ti, Windows 10 / WSL
2 with an RTX 3090 (new Ampere architecture) and Jetson Nano and AGX
Xavier (ARM64 plus CUDA 10.2). I believe NVIDIA has an unofficial
build of Arrow that works on the AGX Xavier but I personally haven't
been able to get a build working.

On Mon, Jan 4, 2021 at 4:34 PM M. Edward (Ed) Borasky <zn...@znmeb.net> wrote:
>
> I'm not sure how to read the issues tracker - is there a category for
> CUDA issues?
>
> On Mon, Jan 4, 2021 at 4:24 PM Neal Richardson
> <ne...@gmail.com> wrote:
> >
> > Hi folks,
> > It's time to get oriented for our 3.0.0 Arrow release. We had previously
> > said that we wanted to be release-ready by the end of this week, but that
> > seems unlikely. There are a number of challenges in front of us, and we
> > need to step up and address them. Updating on the points I sent out 3 weeks
> > ago (see below):
> >
> > * Release blockers: per
> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release we
> > are up to 6 blockers, and that's not a complete list. We have failing
> > nightly builds, and we don't have any macOS crossbow builds due to
> > Travis-CI limits, so that means no mac wheels at the moment. So we are not
> > releasable today.
> > * Backlog: I did some pushing of issues to 4.0 today, so we're down to
> > 180ish open issues tagged for 3.0. Please review your own backlogs and bump
> > anything you aren't going to get done for this release out.
> > * Pull requests: https://github.com/apache/arrow/pulls shows 118 open PRs
> > right now. Some of that is probably a holiday backup, but please do spend
> > some time reviewing and merging (or closing, if appropriate) so we have
> > fewer things hanging on past this release.
> > * Release process: despite the burst of interest a while back, there
> > doesn't seem to have been any movement on the proposed improvements that
> > would make it less expensive for us to release, and thus be able to release
> > more frequently. Nevertheless, we still need to release now, and we will
> > need someone (I believe from the PMC) to volunteer to be release manager
> > for 3.0.
> >
> > If you think you can help on any of these issues, please do! This release
> > won't happen without some collective effort.
> >
> > Thanks, and happy 2021 to you all.
> >
> > Neal
> >
> >
> > On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
> > neal.p.richardson@gmail.com> wrote:
> >
> > > Hi all,
> > > I've created
> > > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release,
> > > cloned from our previous release dashboards, for our upcoming release. A
> > > few things I'd like to draw your attention to:
> > >
> > > * Blockers: there are 5 currently. I'm not certain that they all are
> > > blockers, nor am I sure that there aren't other blockers. I know we've had
> > > some issues lately with python wheel builds, and I've added a couple of
> > > known issues, but there may be others. If you know of other release
> > > blockers, please note them.
> > > * There are over 300 unstarted issues tagged for 3.0.0. Given holiday
> > > schedules and the release target in the first week of January, that's at
> > > least 200 too many. Please review your backlogs and start bumping things
> > > out of scope. I've added a 4.0.0 version that you can move things to, if
> > > you want.
> > > * Release process improvements: there was some discussion a few weeks ago
> > > about what could be done to make it easier to cut releases (
> > > https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E).
> > > A few tasks were mentioned in that thread. If anyone is going to take
> > > action, now would be a good time.
> > >
> > > Thanks,
> > > Neal
> > >
> > >
>
>
>
> --
> Borasky Research Journal https://www.znmeb.mobi
>
> Markovs of the world, unite! You have nothing to lose but your chains!



-- 
Borasky Research Journal https://www.znmeb.mobi

Markovs of the world, unite! You have nothing to lose but your chains!

Re: Arrow 3.0 release

Posted by "M. Edward (Ed) Borasky" <zn...@znmeb.net>.

I'm not sure how to read the issues tracker - is there a category for
CUDA issues?

On Mon, Jan 4, 2021 at 4:24 PM Neal Richardson
<ne...@gmail.com> wrote:
>
> Hi folks,
> It's time to get oriented for our 3.0.0 Arrow release. We had previously
> said that we wanted to be release-ready by the end of this week, but that
> seems unlikely. There are a number of challenges in front of us, and we
> need to step up and address them. Updating on the points I sent out 3 weeks
> ago (see below):
>
> * Release blockers: per
> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release we
> are up to 6 blockers, and that's not a complete list. We have failing
> nightly builds, and we don't have any macOS crossbow builds due to
> Travis-CI limits, so that means no mac wheels at the moment. So we are not
> releasable today.
> * Backlog: I did some pushing of issues to 4.0 today, so we're down to
> 180ish open issues tagged for 3.0. Please review your own backlogs and bump
> anything you aren't going to get done for this release out.
> * Pull requests: https://github.com/apache/arrow/pulls shows 118 open PRs
> right now. Some of that is probably a holiday backup, but please do spend
> some time reviewing and merging (or closing, if appropriate) so we have
> fewer things hanging on past this release.
> * Release process: despite the burst of interest a while back, there
> doesn't seem to have been any movement on the proposed improvements that
> would make it less expensive for us to release, and thus be able to release
> more frequently. Nevertheless, we still need to release now, and we will
> need someone (I believe from the PMC) to volunteer to be release manager
> for 3.0.
>
> If you think you can help on any of these issues, please do! This release
> won't happen without some collective effort.
>
> Thanks, and happy 2021 to you all.
>
> Neal
>
>
> On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
> neal.p.richardson@gmail.com> wrote:
>
> > Hi all,
> > I've created
> > https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release,
> > cloned from our previous release dashboards, for our upcoming release. A
> > few things I'd like to draw your attention to:
> >
> > * Blockers: there are 5 currently. I'm not certain that they all are
> > blockers, nor am I sure that there aren't other blockers. I know we've had
> > some issues lately with python wheel builds, and I've added a couple of
> > known issues, but there may be others. If you know of other release
> > blockers, please note them.
> > * There are over 300 unstarted issues tagged for 3.0.0. Given holiday
> > schedules and the release target in the first week of January, that's at
> > least 200 too many. Please review your backlogs and start bumping things
> > out of scope. I've added a 4.0.0 version that you can move things to, if
> > you want.
> > * Release process improvements: there was some discussion a few weeks ago
> > about what could be done to make it easier to cut releases (
> > https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E).
> > A few tasks were mentioned in that thread. If anyone is going to take
> > action, now would be a good time.
> >
> > Thanks,
> > Neal
> >
> >



-- 
Borasky Research Journal https://www.znmeb.mobi

Markovs of the world, unite! You have nothing to lose but your chains!

Arrow 3.0 release

Posted by Neal Richardson <ne...@gmail.com>.

Hi folks,
It's time to get oriented for our 3.0.0 Arrow release. We had previously
said that we wanted to be release-ready by the end of this week, but that
seems unlikely. There are a number of challenges in front of us, and we
need to step up and address them. Updating on the points I sent out 3 weeks
ago (see below):

* Release blockers: per
https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release we
are up to 6 blockers, and that's not a complete list. We have failing
nightly builds, and we don't have any macOS crossbow builds due to
Travis-CI limits, so that means no mac wheels at the moment. So we are not
releasable today.
* Backlog: I did some pushing of issues to 4.0 today, so we're down to
180ish open issues tagged for 3.0. Please review your own backlogs and bump
anything you aren't going to get done for this release out.
* Pull requests: https://github.com/apache/arrow/pulls shows 118 open PRs
right now. Some of that is probably a holiday backup, but please do spend
some time reviewing and merging (or closing, if appropriate) so we have
fewer things hanging on past this release.
* Release process: despite the burst of interest a while back, there
doesn't seem to have been any movement on the proposed improvements that
would make it less expensive for us to release, and thus be able to release
more frequently. Nevertheless, we still need to release now, and we will
need someone (I believe from the PMC) to volunteer to be release manager
for 3.0.

If you think you can help on any of these issues, please do! This release
won't happen without some collective effort.

Thanks, and happy 2021 to you all.

Neal

On Mon, Dec 14, 2020 at 11:36 AM Neal Richardson <
neal.p.richardson@gmail.com> wrote:

> Hi all,
> I've created
> https://cwiki.apache.org/confluence/display/ARROW/Arrow+3.0.0+Release,
> cloned from our previous release dashboards, for our upcoming release. A
> few things I'd like to draw your attention to:
>
> * Blockers: there are 5 currently. I'm not certain that they all are
> blockers, nor am I sure that there aren't other blockers. I know we've had
> some issues lately with python wheel builds, and I've added a couple of
> known issues, but there may be others. If you know of other release
> blockers, please note them.
> * There are over 300 unstarted issues tagged for 3.0.0. Given holiday
> schedules and the release target in the first week of January, that's at
> least 200 too many. Please review your backlogs and start bumping things
> out of scope. I've added a 4.0.0 version that you can move things to, if
> you want.
> * Release process improvements: there was some discussion a few weeks ago
> about what could be done to make it easier to cut releases (
> https://lists.apache.org/thread.html/r2257603c91336c042633f2bc480f34f58c02d9c67ff1ee1a212933b5%40%3Cdev.arrow.apache.org%3E).
> A few tasks were mentioned in that thread. If anyone is going to take
> action, now would be a good time.
>
> Thanks,
> Neal
>
>