You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Jorge Cardoso Leitão <jo...@gmail.com> on 2021/06/06 04:39:08 UTC
Re: post-release tasks (4.0.1)
Hi,
Sorry for the delay on this, but it is not being easy to build the docs
[1-5], which is why this is taking some time. It seems that our CI is
caching docker layers when testing, which causes it to miss new errors
happening during those layers that are only triggered when the image is
built from scratch.
Best,
Jorge
[1] https://issues.apache.org/jira/browse/ARROW-12971
[2] https://issues.apache.org/jira/browse/ARROW-12846
[3] https://issues.apache.org/jira/browse/ARROW-12909
[4] https://issues.apache.org/jira/browse/ARROW-12915
[5] https://issues.apache.org/jira/browse/ARROW-12954
On Mon, May 31, 2021 at 1:03 PM Jorge Cardoso Leitão <
jorgecarleitao@gmail.com> wrote:
> Thanks a lot, both.
>
> Accepted. Will upload this evening.
>
> Best,
> Jorge
>
>
> On Mon, May 31, 2021 at 12:55 PM Krisztián Szűcs <
> szucs.krisztian@gmail.com> wrote:
>
>> On Sun, May 30, 2021 at 7:37 PM Jorge Cardoso Leitão
>> <jo...@gmail.com> wrote:
>> >
>> > Hi,
>> >
>> > Sorry for the delay here.
>> >
>> > Below is the list of post-release tasks:
>> >
>> 1. [Krisztian] open a pull request to bump the version numbers in the
>> source code
>> 2. [x] upload source
>> 3. [x] upload binaries
>> 4. [x] update website
>> 5. [x] upload ruby gems
>> 6. [Jorge] upload js packages
>> 8. [x] upload C# packages
>> 9. [Won't do] upload rust crates
>> 10. [x] update conda recipes
>> 11. [x] upload wheels/sdist to pypi
>> 12. [x] update homebrew packages
>> 13. [x] update maven artifacts
>> 14. [x] update msys2
>> 15. [x] update R packages
>> 16. [Jorge] update docs (in progress, Jorge)
>> >
>> > * Could someone add me to npmjs so that I can publish it there
>> > (jorgecarleitao [1])?
>> Sent you an invite, could you please check it?
>> >
>> > Thank you for your patience,
>> > Jorge
>> >
>> > [1] https://www.npmjs.com/~jorgecarleitao
>>
>
Re: post-release tasks (4.0.1)
Posted by Sutou Kouhei <ko...@clear-code.com>.
Hi,
Thanks! I've merged the post.
We usually announce this to announce@apache.org and
dev@arrow.apache.org:
https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide#ReleaseManagementGuide-Announcingrelease
Note that we need to use @apache.org e-mail address to send
an e-mail to announce@apache.org.
Thanks,
--
kou
In <CA...@mail.gmail.com>
"Re: post-release tasks (4.0.1)" on Sat, 19 Jun 2021 07:07:16 +0200,
Jorge Cardoso Leitão <jo...@gmail.com> wrote:
> Sutou was able to push them (we needed to login via yarn, not npm).
>
> I think that we are all good; the last item was done. I have created a
> short post [1] for it.
>
> Do we usually announce it anywhere else?
>
> Best,
> Jorge
>
>
> [1] https://github.com/apache/arrow-site/pull/122
>
>
>
>
> On Sat, Jun 12, 2021 at 5:57 AM Jorge Cardoso Leitão
> <jo...@gmail.com> wrote:
>>
>> Thanks a lot, Krisztian.
>>
>> The JS packages are still missing. I already have access to npm (thanks Sutou). As part of the npm-release.sh in 4.0.1, we require all tests to pass [1]. However, there are tests failing on my computer [2], which blocks the release.
>>
>> What is the procedure when this happens? We have voted on the release and we have shipped other packages, so my feeling is that this should not block an in-progress release; imo we should not run the tests prior to publication, as there is nothing we can do at that point in time.
>>
>> One idea is to manually comment the "running the tests during this release" and open an issue to not run the tests prior to the "publish" script, since at that point it is too late to gate the release; that should have been done before we reached this point.
>>
>> [1] https://github.com/apache/arrow/blob/release-4.0.1/js/npm-release.sh#L23
>> [2] https://issues.apache.org/jira/browse/ARROW-13046
>>
>> Best,
>> Jorge
>>
>>
>> On Thu, Jun 10, 2021 at 1:15 PM Krisztián Szűcs <sz...@gmail.com> wrote:
>>>
>>> On Thu, Jun 10, 2021 at 6:57 AM Jorge Cardoso Leitão
>>> <jo...@gmail.com> wrote:
>>> >
>>> > I have been unable to generate the docs from any of my two machines (my
>>> > macbook and a VM on azure), and I do not think we should delay this
>>> > further. Could someone kindly create a PR with the generated docs to the
>>> > website?
>>> Hi!
>>>
>>> I'm going to update the docs.
>>> Are there any remaining post-release tasks?
>>>
>>> Thanks, Krisztian
>>> >
>>> > I think that the command amounts to "dev/release/post-09-docs.sh 4.0.1".
>>> >
>>> > Best,
>>> > Jorge
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > On Sun, Jun 6, 2021 at 6:39 AM Jorge Cardoso Leitão <
>>> > jorgecarleitao@gmail.com> wrote:
>>> >
>>> > > Hi,
>>> > >
>>> > > Sorry for the delay on this, but it is not being easy to build the docs
>>> > > [1-5], which is why this is taking some time. It seems that our CI is
>>> > > caching docker layers when testing, which causes it to miss new errors
>>> > > happening during those layers that are only triggered when the image is
>>> > > built from scratch.
>>> > >
>>> > > Best,
>>> > > Jorge
>>> > >
>>> > > [1] https://issues.apache.org/jira/browse/ARROW-12971
>>> > > [2] https://issues.apache.org/jira/browse/ARROW-12846
>>> > > [3] https://issues.apache.org/jira/browse/ARROW-12909
>>> > > [4] https://issues.apache.org/jira/browse/ARROW-12915
>>> > > [5] https://issues.apache.org/jira/browse/ARROW-12954
>>> > >
>>> > >
>>> > >
>>> > >
>>> > > On Mon, May 31, 2021 at 1:03 PM Jorge Cardoso Leitão <
>>> > > jorgecarleitao@gmail.com> wrote:
>>> > >
>>> > >> Thanks a lot, both.
>>> > >>
>>> > >> Accepted. Will upload this evening.
>>> > >>
>>> > >> Best,
>>> > >> Jorge
>>> > >>
>>> > >>
>>> > >> On Mon, May 31, 2021 at 12:55 PM Krisztián Szűcs <
>>> > >> szucs.krisztian@gmail.com> wrote:
>>> > >>
>>> > >>> On Sun, May 30, 2021 at 7:37 PM Jorge Cardoso Leitão
>>> > >>> <jo...@gmail.com> wrote:
>>> > >>> >
>>> > >>> > Hi,
>>> > >>> >
>>> > >>> > Sorry for the delay here.
>>> > >>> >
>>> > >>> > Below is the list of post-release tasks:
>>> > >>> >
>>> > >>> 1. [Krisztian] open a pull request to bump the version numbers in the
>>> > >>> source code
>>> > >>> 2. [x] upload source
>>> > >>> 3. [x] upload binaries
>>> > >>> 4. [x] update website
>>> > >>> 5. [x] upload ruby gems
>>> > >>> 6. [Jorge] upload js packages
>>> > >>> 8. [x] upload C# packages
>>> > >>> 9. [Won't do] upload rust crates
>>> > >>> 10. [x] update conda recipes
>>> > >>> 11. [x] upload wheels/sdist to pypi
>>> > >>> 12. [x] update homebrew packages
>>> > >>> 13. [x] update maven artifacts
>>> > >>> 14. [x] update msys2
>>> > >>> 15. [x] update R packages
>>> > >>> 16. [Jorge] update docs (in progress, Jorge)
>>> > >>> >
>>> > >>> > * Could someone add me to npmjs so that I can publish it there
>>> > >>> > (jorgecarleitao [1])?
>>> > >>> Sent you an invite, could you please check it?
>>> > >>> >
>>> > >>> > Thank you for your patience,
>>> > >>> > Jorge
>>> > >>> >
>>> > >>> > [1] https://www.npmjs.com/~jorgecarleitao
>>> > >>>
>>> > >>
Re: post-release tasks (4.0.1)
Posted by Jorge Cardoso Leitão <jo...@gmail.com>.
Sutou was able to push them (we needed to login via yarn, not npm).
I think that we are all good; the last item was done. I have created a
short post [1] for it.
Do we usually announce it anywhere else?
Best,
Jorge
[1] https://github.com/apache/arrow-site/pull/122
On Sat, Jun 12, 2021 at 5:57 AM Jorge Cardoso Leitão
<jo...@gmail.com> wrote:
>
> Thanks a lot, Krisztian.
>
> The JS packages are still missing. I already have access to npm (thanks Sutou). As part of the npm-release.sh in 4.0.1, we require all tests to pass [1]. However, there are tests failing on my computer [2], which blocks the release.
>
> What is the procedure when this happens? We have voted on the release and we have shipped other packages, so my feeling is that this should not block an in-progress release; imo we should not run the tests prior to publication, as there is nothing we can do at that point in time.
>
> One idea is to manually comment the "running the tests during this release" and open an issue to not run the tests prior to the "publish" script, since at that point it is too late to gate the release; that should have been done before we reached this point.
>
> [1] https://github.com/apache/arrow/blob/release-4.0.1/js/npm-release.sh#L23
> [2] https://issues.apache.org/jira/browse/ARROW-13046
>
> Best,
> Jorge
>
>
> On Thu, Jun 10, 2021 at 1:15 PM Krisztián Szűcs <sz...@gmail.com> wrote:
>>
>> On Thu, Jun 10, 2021 at 6:57 AM Jorge Cardoso Leitão
>> <jo...@gmail.com> wrote:
>> >
>> > I have been unable to generate the docs from any of my two machines (my
>> > macbook and a VM on azure), and I do not think we should delay this
>> > further. Could someone kindly create a PR with the generated docs to the
>> > website?
>> Hi!
>>
>> I'm going to update the docs.
>> Are there any remaining post-release tasks?
>>
>> Thanks, Krisztian
>> >
>> > I think that the command amounts to "dev/release/post-09-docs.sh 4.0.1".
>> >
>> > Best,
>> > Jorge
>> >
>> >
>> >
>> >
>> >
>> > On Sun, Jun 6, 2021 at 6:39 AM Jorge Cardoso Leitão <
>> > jorgecarleitao@gmail.com> wrote:
>> >
>> > > Hi,
>> > >
>> > > Sorry for the delay on this, but it is not being easy to build the docs
>> > > [1-5], which is why this is taking some time. It seems that our CI is
>> > > caching docker layers when testing, which causes it to miss new errors
>> > > happening during those layers that are only triggered when the image is
>> > > built from scratch.
>> > >
>> > > Best,
>> > > Jorge
>> > >
>> > > [1] https://issues.apache.org/jira/browse/ARROW-12971
>> > > [2] https://issues.apache.org/jira/browse/ARROW-12846
>> > > [3] https://issues.apache.org/jira/browse/ARROW-12909
>> > > [4] https://issues.apache.org/jira/browse/ARROW-12915
>> > > [5] https://issues.apache.org/jira/browse/ARROW-12954
>> > >
>> > >
>> > >
>> > >
>> > > On Mon, May 31, 2021 at 1:03 PM Jorge Cardoso Leitão <
>> > > jorgecarleitao@gmail.com> wrote:
>> > >
>> > >> Thanks a lot, both.
>> > >>
>> > >> Accepted. Will upload this evening.
>> > >>
>> > >> Best,
>> > >> Jorge
>> > >>
>> > >>
>> > >> On Mon, May 31, 2021 at 12:55 PM Krisztián Szűcs <
>> > >> szucs.krisztian@gmail.com> wrote:
>> > >>
>> > >>> On Sun, May 30, 2021 at 7:37 PM Jorge Cardoso Leitão
>> > >>> <jo...@gmail.com> wrote:
>> > >>> >
>> > >>> > Hi,
>> > >>> >
>> > >>> > Sorry for the delay here.
>> > >>> >
>> > >>> > Below is the list of post-release tasks:
>> > >>> >
>> > >>> 1. [Krisztian] open a pull request to bump the version numbers in the
>> > >>> source code
>> > >>> 2. [x] upload source
>> > >>> 3. [x] upload binaries
>> > >>> 4. [x] update website
>> > >>> 5. [x] upload ruby gems
>> > >>> 6. [Jorge] upload js packages
>> > >>> 8. [x] upload C# packages
>> > >>> 9. [Won't do] upload rust crates
>> > >>> 10. [x] update conda recipes
>> > >>> 11. [x] upload wheels/sdist to pypi
>> > >>> 12. [x] update homebrew packages
>> > >>> 13. [x] update maven artifacts
>> > >>> 14. [x] update msys2
>> > >>> 15. [x] update R packages
>> > >>> 16. [Jorge] update docs (in progress, Jorge)
>> > >>> >
>> > >>> > * Could someone add me to npmjs so that I can publish it there
>> > >>> > (jorgecarleitao [1])?
>> > >>> Sent you an invite, could you please check it?
>> > >>> >
>> > >>> > Thank you for your patience,
>> > >>> > Jorge
>> > >>> >
>> > >>> > [1] https://www.npmjs.com/~jorgecarleitao
>> > >>>
>> > >>
Re: post-release tasks (4.0.1)
Posted by Jorge Cardoso Leitão <jo...@gmail.com>.
Thanks a lot, Krisztian.
The JS packages are still missing. I already have access to npm (thanks
Sutou). As part of the npm-release.sh in 4.0.1, we require all tests to
pass [1]. However, there are tests failing on my computer [2], which blocks
the release.
What is the procedure when this happens? We have voted on the release and
we have shipped other packages, so my feeling is that this should not block
an in-progress release; imo we should not run the tests prior to
publication, as there is nothing we can do at that point in time.
One idea is to manually comment the "running the tests during this release"
and open an issue to not run the tests prior to the "publish" script, since
at that point it is too late to gate the release; that should have been
done before we reached this point.
[1] https://github.com/apache/arrow/blob/release-4.0.1/js/npm-release.sh#L23
[2] https://issues.apache.org/jira/browse/ARROW-13046
Best,
Jorge
On Thu, Jun 10, 2021 at 1:15 PM Krisztián Szűcs <sz...@gmail.com>
wrote:
> On Thu, Jun 10, 2021 at 6:57 AM Jorge Cardoso Leitão
> <jo...@gmail.com> wrote:
> >
> > I have been unable to generate the docs from any of my two machines (my
> > macbook and a VM on azure), and I do not think we should delay this
> > further. Could someone kindly create a PR with the generated docs to the
> > website?
> Hi!
>
> I'm going to update the docs.
> Are there any remaining post-release tasks?
>
> Thanks, Krisztian
> >
> > I think that the command amounts to "dev/release/post-09-docs.sh 4.0.1".
> >
> > Best,
> > Jorge
> >
> >
> >
> >
> >
> > On Sun, Jun 6, 2021 at 6:39 AM Jorge Cardoso Leitão <
> > jorgecarleitao@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > Sorry for the delay on this, but it is not being easy to build the docs
> > > [1-5], which is why this is taking some time. It seems that our CI is
> > > caching docker layers when testing, which causes it to miss new errors
> > > happening during those layers that are only triggered when the image is
> > > built from scratch.
> > >
> > > Best,
> > > Jorge
> > >
> > > [1] https://issues.apache.org/jira/browse/ARROW-12971
> > > [2] https://issues.apache.org/jira/browse/ARROW-12846
> > > [3] https://issues.apache.org/jira/browse/ARROW-12909
> > > [4] https://issues.apache.org/jira/browse/ARROW-12915
> > > [5] https://issues.apache.org/jira/browse/ARROW-12954
> > >
> > >
> > >
> > >
> > > On Mon, May 31, 2021 at 1:03 PM Jorge Cardoso Leitão <
> > > jorgecarleitao@gmail.com> wrote:
> > >
> > >> Thanks a lot, both.
> > >>
> > >> Accepted. Will upload this evening.
> > >>
> > >> Best,
> > >> Jorge
> > >>
> > >>
> > >> On Mon, May 31, 2021 at 12:55 PM Krisztián Szűcs <
> > >> szucs.krisztian@gmail.com> wrote:
> > >>
> > >>> On Sun, May 30, 2021 at 7:37 PM Jorge Cardoso Leitão
> > >>> <jo...@gmail.com> wrote:
> > >>> >
> > >>> > Hi,
> > >>> >
> > >>> > Sorry for the delay here.
> > >>> >
> > >>> > Below is the list of post-release tasks:
> > >>> >
> > >>> 1. [Krisztian] open a pull request to bump the version numbers in
> the
> > >>> source code
> > >>> 2. [x] upload source
> > >>> 3. [x] upload binaries
> > >>> 4. [x] update website
> > >>> 5. [x] upload ruby gems
> > >>> 6. [Jorge] upload js packages
> > >>> 8. [x] upload C# packages
> > >>> 9. [Won't do] upload rust crates
> > >>> 10. [x] update conda recipes
> > >>> 11. [x] upload wheels/sdist to pypi
> > >>> 12. [x] update homebrew packages
> > >>> 13. [x] update maven artifacts
> > >>> 14. [x] update msys2
> > >>> 15. [x] update R packages
> > >>> 16. [Jorge] update docs (in progress, Jorge)
> > >>> >
> > >>> > * Could someone add me to npmjs so that I can publish it there
> > >>> > (jorgecarleitao [1])?
> > >>> Sent you an invite, could you please check it?
> > >>> >
> > >>> > Thank you for your patience,
> > >>> > Jorge
> > >>> >
> > >>> > [1] https://www.npmjs.com/~jorgecarleitao
> > >>>
> > >>
>
Re: post-release tasks (4.0.1)
Posted by Krisztián Szűcs <sz...@gmail.com>.
On Thu, Jun 10, 2021 at 6:57 AM Jorge Cardoso Leitão
<jo...@gmail.com> wrote:
>
> I have been unable to generate the docs from any of my two machines (my
> macbook and a VM on azure), and I do not think we should delay this
> further. Could someone kindly create a PR with the generated docs to the
> website?
Hi!
I'm going to update the docs.
Are there any remaining post-release tasks?
Thanks, Krisztian
>
> I think that the command amounts to "dev/release/post-09-docs.sh 4.0.1".
>
> Best,
> Jorge
>
>
>
>
>
> On Sun, Jun 6, 2021 at 6:39 AM Jorge Cardoso Leitão <
> jorgecarleitao@gmail.com> wrote:
>
> > Hi,
> >
> > Sorry for the delay on this, but it is not being easy to build the docs
> > [1-5], which is why this is taking some time. It seems that our CI is
> > caching docker layers when testing, which causes it to miss new errors
> > happening during those layers that are only triggered when the image is
> > built from scratch.
> >
> > Best,
> > Jorge
> >
> > [1] https://issues.apache.org/jira/browse/ARROW-12971
> > [2] https://issues.apache.org/jira/browse/ARROW-12846
> > [3] https://issues.apache.org/jira/browse/ARROW-12909
> > [4] https://issues.apache.org/jira/browse/ARROW-12915
> > [5] https://issues.apache.org/jira/browse/ARROW-12954
> >
> >
> >
> >
> > On Mon, May 31, 2021 at 1:03 PM Jorge Cardoso Leitão <
> > jorgecarleitao@gmail.com> wrote:
> >
> >> Thanks a lot, both.
> >>
> >> Accepted. Will upload this evening.
> >>
> >> Best,
> >> Jorge
> >>
> >>
> >> On Mon, May 31, 2021 at 12:55 PM Krisztián Szűcs <
> >> szucs.krisztian@gmail.com> wrote:
> >>
> >>> On Sun, May 30, 2021 at 7:37 PM Jorge Cardoso Leitão
> >>> <jo...@gmail.com> wrote:
> >>> >
> >>> > Hi,
> >>> >
> >>> > Sorry for the delay here.
> >>> >
> >>> > Below is the list of post-release tasks:
> >>> >
> >>> 1. [Krisztian] open a pull request to bump the version numbers in the
> >>> source code
> >>> 2. [x] upload source
> >>> 3. [x] upload binaries
> >>> 4. [x] update website
> >>> 5. [x] upload ruby gems
> >>> 6. [Jorge] upload js packages
> >>> 8. [x] upload C# packages
> >>> 9. [Won't do] upload rust crates
> >>> 10. [x] update conda recipes
> >>> 11. [x] upload wheels/sdist to pypi
> >>> 12. [x] update homebrew packages
> >>> 13. [x] update maven artifacts
> >>> 14. [x] update msys2
> >>> 15. [x] update R packages
> >>> 16. [Jorge] update docs (in progress, Jorge)
> >>> >
> >>> > * Could someone add me to npmjs so that I can publish it there
> >>> > (jorgecarleitao [1])?
> >>> Sent you an invite, could you please check it?
> >>> >
> >>> > Thank you for your patience,
> >>> > Jorge
> >>> >
> >>> > [1] https://www.npmjs.com/~jorgecarleitao
> >>>
> >>
Re: post-release tasks (4.0.1)
Posted by Jorge Cardoso Leitão <jo...@gmail.com>.
I have been unable to generate the docs from any of my two machines (my
macbook and a VM on azure), and I do not think we should delay this
further. Could someone kindly create a PR with the generated docs to the
website?
I think that the command amounts to "dev/release/post-09-docs.sh 4.0.1".
Best,
Jorge
On Sun, Jun 6, 2021 at 6:39 AM Jorge Cardoso Leitão <
jorgecarleitao@gmail.com> wrote:
> Hi,
>
> Sorry for the delay on this, but it is not being easy to build the docs
> [1-5], which is why this is taking some time. It seems that our CI is
> caching docker layers when testing, which causes it to miss new errors
> happening during those layers that are only triggered when the image is
> built from scratch.
>
> Best,
> Jorge
>
> [1] https://issues.apache.org/jira/browse/ARROW-12971
> [2] https://issues.apache.org/jira/browse/ARROW-12846
> [3] https://issues.apache.org/jira/browse/ARROW-12909
> [4] https://issues.apache.org/jira/browse/ARROW-12915
> [5] https://issues.apache.org/jira/browse/ARROW-12954
>
>
>
>
> On Mon, May 31, 2021 at 1:03 PM Jorge Cardoso Leitão <
> jorgecarleitao@gmail.com> wrote:
>
>> Thanks a lot, both.
>>
>> Accepted. Will upload this evening.
>>
>> Best,
>> Jorge
>>
>>
>> On Mon, May 31, 2021 at 12:55 PM Krisztián Szűcs <
>> szucs.krisztian@gmail.com> wrote:
>>
>>> On Sun, May 30, 2021 at 7:37 PM Jorge Cardoso Leitão
>>> <jo...@gmail.com> wrote:
>>> >
>>> > Hi,
>>> >
>>> > Sorry for the delay here.
>>> >
>>> > Below is the list of post-release tasks:
>>> >
>>> 1. [Krisztian] open a pull request to bump the version numbers in the
>>> source code
>>> 2. [x] upload source
>>> 3. [x] upload binaries
>>> 4. [x] update website
>>> 5. [x] upload ruby gems
>>> 6. [Jorge] upload js packages
>>> 8. [x] upload C# packages
>>> 9. [Won't do] upload rust crates
>>> 10. [x] update conda recipes
>>> 11. [x] upload wheels/sdist to pypi
>>> 12. [x] update homebrew packages
>>> 13. [x] update maven artifacts
>>> 14. [x] update msys2
>>> 15. [x] update R packages
>>> 16. [Jorge] update docs (in progress, Jorge)
>>> >
>>> > * Could someone add me to npmjs so that I can publish it there
>>> > (jorgecarleitao [1])?
>>> Sent you an invite, could you please check it?
>>> >
>>> > Thank you for your patience,
>>> > Jorge
>>> >
>>> > [1] https://www.npmjs.com/~jorgecarleitao
>>>
>>