You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Evans Ye <ev...@apache.org> on 2017/10/03 14:11:39 UTC
Re: Releasing 1.2.1
Thanks Olaf!
I see all the slaves images are now back to normal.
I'll have a national holiday tomorrow and I'd like to spend it on Bigtop
1.2.1 release.
Right now, we're blocked by two issues:
Crunch build failed: https://issues.apache.org/jira/browse/BIGTOP-2900
GPDB build failed: https://issues.apache.org/jira/browse/BIGTOP-2901
I've provided a workaround patch in BIGTOP-2900, however I have completely
no idea for BIGTOP-2901.
Since I've raised the problem few days ago, if no one has time to fix it,
I'd like to propose to disable GPDB in 1.2.1 release.
That means in 1.2.1 release there is no GPDB binary artifact available, but
we can still refine GPDB's quality in the master branch.
How do you think?
2017-09-26 5:16 GMT+08:00 Roman Shaposhnik <rv...@apache.org>:
> Let me take a look today
>
> On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik <co...@apache.org>
> wrote:
> > Explicitly adding Rvs in the loop
> > --
> > With regards,
> > Konstantin (Cos) Boudnik
> > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
> >
> > Disclaimer: Opinions expressed in this email are those of the author,
> > and do not necessarily represent the views of any company the author
> > might be affiliated with at the moment of writing.
> >
> >
> > On Sat, Sep 23, 2017 at 12:24 PM, Evans Ye <ev...@apache.org> wrote:
> >> Hi Bigtoper,
> >>
> >> I'm working on the 1.2.1 release. Hopefully we can get it to the finish
> >> line by the end on Sept.
> >>
> >> Right now we still have a few issues blocking:
> >>
> >> 1. GPDB build failed on OpenSuSE 42.1[1]
> >> 2. Toolchain build failed on PPC64LE platform[2]
> >>
> >> I'll update more down the path. But right now I'd like to seek for some
> >> helps on GPDB and PPC64LE side ;)
> >>
> >>
> >> [1]. https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1/
> >> [2]. https://ci.bigtop.apache.org/view/Docker/job/Docker-
> Toolchain-1.2.1/
> >>
> >>
> >> 2017-07-26 11:24 GMT+08:00 Evans Ye <ev...@apache.org>:
> >>
> >>> Thanks, Arnaud
> >>>
> >>> [jenkins@ip bigtop-ubuntu-16.04]$ docker run -ti --rm
> >>> bigtop/slaves:1.2.1-$OS bash -l
> >>> root@596ef2c638de:/# java -version
> >>> openjdk version "1.8.0_131"
> >>> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-0ubuntu1.
> >>> 16.04.2-b11)
> >>> OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
> >>>
> >>> Looks linked!
> >>>
> >>>
> >>> 2017-07-26 3:02 GMT+08:00 Arnaud Launay <as...@launay.org>:
> >>>
> >>>> Le Wed, Jul 26, 2017 at 12:45:50AM +0800, Evans Ye a écrit:
> >>>> > 1. Somehow packages on centos and debian changed. If we rebuild
> >>>> > bigtop/slaves for trunk, then Solr will fail the same as what we
> faced
> >>>> > building with 1.2.1 images.
> >>>> > 2. We've special tweaks for bigtop/slaves trunk images.
> >>>> > Any thoughts?
> >>>>
> >>>> Check the java version, somehow the java docs whatever stuff
> >>>> changed in 8.131, and solr doesn't compile anymore with java8 >=131 .
> >>>> Might be linked.
> >>>>
> >>>> Arnaud.
> >>>>
> >>>
> >>>
>
Re: Releasing 1.2.1
Posted by Evans Ye <ev...@apache.org>.
Hi all,
I'm slowly finalizing 1.2.1 release. Please hang on.
Will do an announcement when everything is ready.
Best,
Evans
2017-10-14 17:23 GMT+08:00 Evans Ye <ev...@apache.org>:
> More test have been done for 1.2.1 release.
>
> https://ci.bigtop.apache.org/job/Bigtop-1.2.1-installation
>
> This job tests whether packages can be installed cleanly with pgp
> verification
>
> Though not all the packages can be successfully installed due to
> conflicts, most of them are good.
>
> Following are packages failed to install:
>
> CentOS, Fedora:
> qfs-python.x86_64
>
> OpenSuSE:
> Hue, Oozie
>
> Debian, Ubuntu:
> Hue, Oozie, Phoenix, QFS
>
>
>
>
> 2017-10-13 3:39 GMT+08:00 Evans Ye <ev...@apache.org>:
>
>> AFAIK, the build slave for arm is offline in our CI:
>>
>> docker-slave-arm-1
>> <https://ci.bigtop.apache.org/computer/docker-slave-arm-1/> (offline)
>>
>> If you can get it back into business, then there's no reason not to
>> include it as long as it's in good shape.
>>
>> 2017-10-13 3:31 GMT+08:00 Ganesh Raju <ga...@linaro.org>:
>>
>>> Evans
>>>
>>> What is needed to reestablish the CI builds for Aarch? We are ready to
>>> help
>>> that getting setup as well
>>> We have setup CI builds internally in Linaro which has been working fine.
>>>
>>> Do you need access to the two arm systems for builds?
>>>
>>>
>>> Thanks,
>>> Ganesh
>>>
>>> On Thu, Oct 12, 2017 at 1:56 PM, Evans Ye <ev...@apache.org> wrote:
>>>
>>> > Thanks Kevin for doing the investigation. That is addressed in
>>> BIGTOP-2904.
>>> >
>>> > Regarding to 1.2.1 release. I've finally crossed the finish line and
>>> have
>>> > put it up for a vote.
>>> > Let me share some of the details here:
>>> >
>>> > * All the signed repos are on repos.bigtop.apache.org, which is
>>> backed by
>>> > our new S3 directory
>>> > * Deployment evaluated by
>>> > https://ci.bigtop.apache.org/view/Provisioner/job/Bigtop-1.
>>> > 2.1-deployments/,
>>> > which installs packages from repos.bigtop.apache.org. Surely we've
>>> some
>>> > red
>>> > dots, but those problems are also in 1.2.0 as well. 1.2.1 actually
>>> > improves/fixes things that was broken in 1.2.0.
>>> > * Binary convenient artifacts are not available for PPC64LE, but we can
>>> > still put them up afterwards.
>>> >
>>> > Thanks for everyone who helped making this release happening.
>>> > The release stuffs are in the [VOTE] mailing thread. If you've time.
>>> Please
>>> > give it try and provide your feedback.
>>> >
>>> >
>>> > Evans
>>> >
>>> >
>>> >
>>> > 2017-10-10 2:02 GMT+08:00 Kevin Monroe <ke...@canonical.com>:
>>> >
>>> > > Hey Evans, ubuntu 16.04 seems ok from your CI link, but fedora 25
>>> has a
>>> > > problem:
>>> > >
>>> > > https://ci.bigtop.apache.org/job/Bigtop-1.2.1-ppc64le/OS=
>>> > > fedora-25-ppc64le/lastFailedBuild/console
>>> > >
>>> > > I *think* I've tracked this down to the location of protobuf. Note
>>> the
>>> > URL
>>> > > for rpm-based ppc64le distros:
>>> > >
>>> > > https://github.com/apache/bigtop/blob/master/bigtop_
>>> > > toolchain/manifests/protobuf.pp#L54
>>> > >
>>> > > Those fedora-22 URLs are no longer valid:
>>> > >
>>> > > https://dl.fedoraproject.org/pub/fedora-secondary/releases/
>>> > > 22/Everything/ppc64le/
>>> > >
>>> > > It seems in late September, fedora 22 moved to fedora archives, so I
>>> > think
>>> > > we just need those URLs changed to:
>>> > >
>>> > > http://archives.fedoraproject.org/pub/archive/fedora-
>>> > > secondary/releases/22/Everything/ppc64le/
>>> > >
>>> > > I don't have the capacity to test fedora on a ppc64le machine, but it
>>> > seems
>>> > > like simple fix on paper ;)
>>> > >
>>> > > -Kevin
>>> > >
>>> > > On Sun, Oct 8, 2017 at 3:29 PM, Evans Ye <ev...@apache.org> wrote:
>>> > >
>>> > > > Okay, heading down the path to 1.2.1 release.
>>> > > > I'm on the journey to prepare the repos on S3...
>>> > > >
>>> > > > PROGRESS
>>> > > > [V] Build 1.2.1 Docker slave images
>>> > > > [V] Build 1.2.1 RPM/DEB packages
>>> > > > [V] Sign packages
>>> > > > [X] Upload artifacts to S3
>>> > > > [X] Run through deployment test
>>> > > > [X] Vote for RC -> release
>>> > > >
>>> > > > Finally I'm able to produce all x86_64 artifacts:
>>> > > > https://ci.bigtop.apache.org/job/Bigtop-1.2.1
>>> > > > (Actually I've to keep retrying to get these builds done. Don't
>>> know
>>> > why
>>> > > > sometimes entering infinite loop though...)
>>> > > > and their corresponding signed repos for S3 uploading.
>>> > > >
>>> > > > However, I got some problems with PPC64LE.
>>> > > > We can build arch independent artifacts on other machines for
>>> sure, but
>>> > > > hadoop,
>>> > > > qfs, bigtop-jsvc, zookeeper, hue need to be built on PPC machines.
>>> And
>>> > > that
>>> > > > is currently failing on ubuntu 16.04:
>>> > > > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1-
>>> ppc64le/
>>> > > >
>>> > > > At a glance I guess something need to be fixed for PPC docker
>>> slaves
>>> > > image.
>>> > > > I can give it a look, but if some one can help it would be
>>> appreciated.
>>> > > > It is indeed tons of work for getting a release out ;)
>>> > > >
>>> > > >
>>> > > > 2017-10-03 23:22 GMT+08:00 Olaf Flebbe <of...@oflebbe.de>:
>>> > > >
>>> > > > > Hi,
>>> > > > >
>>> > > > > The failure of gpdb looks like a serious problem to me, see
>>> > BIGTOP-2901
>>> > > > > I am too for an +1 to disable this for 1.2.1
>>> > > > >
>>> > > > > Thank you Evans for being still on track to release.
>>> > > > >
>>> > > > > Olaf
>>> > > > >
>>> > > > >
>>> > > > > > Am 03.10.2017 um 16:20 schrieb Konstantin Boudnik <
>>> cos@apache.org
>>> > >:
>>> > > > > >
>>> > > > > > Well, if we can't fix it - let's nuke it. +1
>>> > > > > > --
>>> > > > > > With regards,
>>> > > > > > Konstantin (Cos) Boudnik
>>> > > > > > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
>>> > > > > >
>>> > > > > > Disclaimer: Opinions expressed in this email are those of the
>>> > author,
>>> > > > > > and do not necessarily represent the views of any company the
>>> > author
>>> > > > > > might be affiliated with at the moment of writing.
>>> > > > > >
>>> > > > > >
>>> > > > > > On Tue, Oct 3, 2017 at 10:11 AM, Evans Ye <ev...@apache.org>
>>> > > wrote:
>>> > > > > >> Thanks Olaf!
>>> > > > > >> I see all the slaves images are now back to normal.
>>> > > > > >>
>>> > > > > >> I'll have a national holiday tomorrow and I'd like to spend
>>> it on
>>> > > > Bigtop
>>> > > > > >> 1.2.1 release.
>>> > > > > >> Right now, we're blocked by two issues:
>>> > > > > >>
>>> > > > > >> Crunch build failed: https://issues.apache.org/
>>> > > > jira/browse/BIGTOP-2900
>>> > > > > >> GPDB build failed: https://issues.apache.org/
>>> > > jira/browse/BIGTOP-2901
>>> > > > > >>
>>> > > > > >> I've provided a workaround patch in BIGTOP-2900, however I
>>> have
>>> > > > > completely
>>> > > > > >> no idea for BIGTOP-2901.
>>> > > > > >> Since I've raised the problem few days ago, if no one has
>>> time to
>>> > > fix
>>> > > > > it,
>>> > > > > >> I'd like to propose to disable GPDB in 1.2.1 release.
>>> > > > > >> That means in 1.2.1 release there is no GPDB binary artifact
>>> > > > available,
>>> > > > > but
>>> > > > > >> we can still refine GPDB's quality in the master branch.
>>> > > > > >>
>>> > > > > >> How do you think?
>>> > > > > >>
>>> > > > > >>
>>> > > > > >> 2017-09-26 5:16 GMT+08:00 Roman Shaposhnik <rv...@apache.org>:
>>> > > > > >>
>>> > > > > >>> Let me take a look today
>>> > > > > >>>
>>> > > > > >>> On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik <
>>> > > cos@apache.org>
>>> > > > > >>> wrote:
>>> > > > > >>>> Explicitly adding Rvs in the loop
>>> > > > > >>>> --
>>> > > > > >>>> With regards,
>>> > > > > >>>> Konstantin (Cos) Boudnik
>>> > > > > >>>> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
>>> > > > > >>>>
>>> > > > > >>>> Disclaimer: Opinions expressed in this email are those of
>>> the
>>> > > > author,
>>> > > > > >>>> and do not necessarily represent the views of any company
>>> the
>>> > > author
>>> > > > > >>>> might be affiliated with at the moment of writing.
>>> > > > > >>>>
>>> > > > > >>>>
>>> > > > > >>>> On Sat, Sep 23, 2017 at 12:24 PM, Evans Ye <
>>> evansye@apache.org>
>>> > > > > wrote:
>>> > > > > >>>>> Hi Bigtoper,
>>> > > > > >>>>>
>>> > > > > >>>>> I'm working on the 1.2.1 release. Hopefully we can get it
>>> to
>>> > the
>>> > > > > finish
>>> > > > > >>>>> line by the end on Sept.
>>> > > > > >>>>>
>>> > > > > >>>>> Right now we still have a few issues blocking:
>>> > > > > >>>>>
>>> > > > > >>>>> 1. GPDB build failed on OpenSuSE 42.1[1]
>>> > > > > >>>>> 2. Toolchain build failed on PPC64LE platform[2]
>>> > > > > >>>>>
>>> > > > > >>>>> I'll update more down the path. But right now I'd like to
>>> seek
>>> > > for
>>> > > > > some
>>> > > > > >>>>> helps on GPDB and PPC64LE side ;)
>>> > > > > >>>>>
>>> > > > > >>>>>
>>> > > > > >>>>> [1]. https://ci.bigtop.apache.org/v
>>> iew/Releases/job/Bigtop-1.2
>>> > .
>>> > > 1/
>>> > > > > >>>>> [2]. https://ci.bigtop.apache.org/view/Docker/job/Docker-
>>> > > > > >>> Toolchain-1.2.1/
>>> > > > > >>>>>
>>> > > > > >>>>>
>>> > > > > >>>>> 2017-07-26 11:24 GMT+08:00 Evans Ye <ev...@apache.org>:
>>> > > > > >>>>>
>>> > > > > >>>>>> Thanks, Arnaud
>>> > > > > >>>>>>
>>> > > > > >>>>>> [jenkins@ip bigtop-ubuntu-16.04]$ docker run -ti --rm
>>> > > > > >>>>>> bigtop/slaves:1.2.1-$OS bash -l
>>> > > > > >>>>>> root@596ef2c638de:/# java -version
>>> > > > > >>>>>> openjdk version "1.8.0_131"
>>> > > > > >>>>>> OpenJDK Runtime Environment (build
>>> > 1.8.0_131-8u131-b11-0ubuntu1.
>>> > > > > >>>>>> 16.04.2-b11)
>>> > > > > >>>>>> OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
>>> > > > > >>>>>>
>>> > > > > >>>>>> Looks linked!
>>> > > > > >>>>>>
>>> > > > > >>>>>>
>>> > > > > >>>>>> 2017-07-26 3:02 GMT+08:00 Arnaud Launay <as...@launay.org>:
>>> > > > > >>>>>>
>>> > > > > >>>>>>> Le Wed, Jul 26, 2017 at 12:45:50AM +0800, Evans Ye a
>>> écrit:
>>> > > > > >>>>>>>> 1. Somehow packages on centos and debian changed. If we
>>> > > rebuild
>>> > > > > >>>>>>>> bigtop/slaves for trunk, then Solr will fail the same as
>>> > what
>>> > > we
>>> > > > > >>> faced
>>> > > > > >>>>>>>> building with 1.2.1 images.
>>> > > > > >>>>>>>> 2. We've special tweaks for bigtop/slaves trunk images.
>>> > > > > >>>>>>>> Any thoughts?
>>> > > > > >>>>>>>
>>> > > > > >>>>>>> Check the java version, somehow the java docs whatever
>>> stuff
>>> > > > > >>>>>>> changed in 8.131, and solr doesn't compile anymore with
>>> java8
>>> > > > > >=131 .
>>> > > > > >>>>>>> Might be linked.
>>> > > > > >>>>>>>
>>> > > > > >>>>>>> Arnaud.
>>> > > > > >>>>>>>
>>> > > > > >>>>>>
>>> > > > > >>>>>>
>>> > > > > >>>
>>> > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>>
>>>
>>>
>>> --
>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>>>
>>
>>
>
Re: Releasing 1.2.1
Posted by Evans Ye <ev...@apache.org>.
More test have been done for 1.2.1 release.
https://ci.bigtop.apache.org/job/Bigtop-1.2.1-installation
This job tests whether packages can be installed cleanly with pgp
verification
Though not all the packages can be successfully installed due to conflicts,
most of them are good.
Following are packages failed to install:
CentOS, Fedora:
qfs-python.x86_64
OpenSuSE:
Hue, Oozie
Debian, Ubuntu:
Hue, Oozie, Phoenix, QFS
2017-10-13 3:39 GMT+08:00 Evans Ye <ev...@apache.org>:
> AFAIK, the build slave for arm is offline in our CI:
>
> docker-slave-arm-1
> <https://ci.bigtop.apache.org/computer/docker-slave-arm-1/> (offline)
>
> If you can get it back into business, then there's no reason not to
> include it as long as it's in good shape.
>
> 2017-10-13 3:31 GMT+08:00 Ganesh Raju <ga...@linaro.org>:
>
>> Evans
>>
>> What is needed to reestablish the CI builds for Aarch? We are ready to
>> help
>> that getting setup as well
>> We have setup CI builds internally in Linaro which has been working fine.
>>
>> Do you need access to the two arm systems for builds?
>>
>>
>> Thanks,
>> Ganesh
>>
>> On Thu, Oct 12, 2017 at 1:56 PM, Evans Ye <ev...@apache.org> wrote:
>>
>> > Thanks Kevin for doing the investigation. That is addressed in
>> BIGTOP-2904.
>> >
>> > Regarding to 1.2.1 release. I've finally crossed the finish line and
>> have
>> > put it up for a vote.
>> > Let me share some of the details here:
>> >
>> > * All the signed repos are on repos.bigtop.apache.org, which is backed
>> by
>> > our new S3 directory
>> > * Deployment evaluated by
>> > https://ci.bigtop.apache.org/view/Provisioner/job/Bigtop-1.
>> > 2.1-deployments/,
>> > which installs packages from repos.bigtop.apache.org. Surely we've some
>> > red
>> > dots, but those problems are also in 1.2.0 as well. 1.2.1 actually
>> > improves/fixes things that was broken in 1.2.0.
>> > * Binary convenient artifacts are not available for PPC64LE, but we can
>> > still put them up afterwards.
>> >
>> > Thanks for everyone who helped making this release happening.
>> > The release stuffs are in the [VOTE] mailing thread. If you've time.
>> Please
>> > give it try and provide your feedback.
>> >
>> >
>> > Evans
>> >
>> >
>> >
>> > 2017-10-10 2:02 GMT+08:00 Kevin Monroe <ke...@canonical.com>:
>> >
>> > > Hey Evans, ubuntu 16.04 seems ok from your CI link, but fedora 25 has
>> a
>> > > problem:
>> > >
>> > > https://ci.bigtop.apache.org/job/Bigtop-1.2.1-ppc64le/OS=
>> > > fedora-25-ppc64le/lastFailedBuild/console
>> > >
>> > > I *think* I've tracked this down to the location of protobuf. Note
>> the
>> > URL
>> > > for rpm-based ppc64le distros:
>> > >
>> > > https://github.com/apache/bigtop/blob/master/bigtop_
>> > > toolchain/manifests/protobuf.pp#L54
>> > >
>> > > Those fedora-22 URLs are no longer valid:
>> > >
>> > > https://dl.fedoraproject.org/pub/fedora-secondary/releases/
>> > > 22/Everything/ppc64le/
>> > >
>> > > It seems in late September, fedora 22 moved to fedora archives, so I
>> > think
>> > > we just need those URLs changed to:
>> > >
>> > > http://archives.fedoraproject.org/pub/archive/fedora-
>> > > secondary/releases/22/Everything/ppc64le/
>> > >
>> > > I don't have the capacity to test fedora on a ppc64le machine, but it
>> > seems
>> > > like simple fix on paper ;)
>> > >
>> > > -Kevin
>> > >
>> > > On Sun, Oct 8, 2017 at 3:29 PM, Evans Ye <ev...@apache.org> wrote:
>> > >
>> > > > Okay, heading down the path to 1.2.1 release.
>> > > > I'm on the journey to prepare the repos on S3...
>> > > >
>> > > > PROGRESS
>> > > > [V] Build 1.2.1 Docker slave images
>> > > > [V] Build 1.2.1 RPM/DEB packages
>> > > > [V] Sign packages
>> > > > [X] Upload artifacts to S3
>> > > > [X] Run through deployment test
>> > > > [X] Vote for RC -> release
>> > > >
>> > > > Finally I'm able to produce all x86_64 artifacts:
>> > > > https://ci.bigtop.apache.org/job/Bigtop-1.2.1
>> > > > (Actually I've to keep retrying to get these builds done. Don't know
>> > why
>> > > > sometimes entering infinite loop though...)
>> > > > and their corresponding signed repos for S3 uploading.
>> > > >
>> > > > However, I got some problems with PPC64LE.
>> > > > We can build arch independent artifacts on other machines for sure,
>> but
>> > > > hadoop,
>> > > > qfs, bigtop-jsvc, zookeeper, hue need to be built on PPC machines.
>> And
>> > > that
>> > > > is currently failing on ubuntu 16.04:
>> > > > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1-
>> ppc64le/
>> > > >
>> > > > At a glance I guess something need to be fixed for PPC docker slaves
>> > > image.
>> > > > I can give it a look, but if some one can help it would be
>> appreciated.
>> > > > It is indeed tons of work for getting a release out ;)
>> > > >
>> > > >
>> > > > 2017-10-03 23:22 GMT+08:00 Olaf Flebbe <of...@oflebbe.de>:
>> > > >
>> > > > > Hi,
>> > > > >
>> > > > > The failure of gpdb looks like a serious problem to me, see
>> > BIGTOP-2901
>> > > > > I am too for an +1 to disable this for 1.2.1
>> > > > >
>> > > > > Thank you Evans for being still on track to release.
>> > > > >
>> > > > > Olaf
>> > > > >
>> > > > >
>> > > > > > Am 03.10.2017 um 16:20 schrieb Konstantin Boudnik <
>> cos@apache.org
>> > >:
>> > > > > >
>> > > > > > Well, if we can't fix it - let's nuke it. +1
>> > > > > > --
>> > > > > > With regards,
>> > > > > > Konstantin (Cos) Boudnik
>> > > > > > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
>> > > > > >
>> > > > > > Disclaimer: Opinions expressed in this email are those of the
>> > author,
>> > > > > > and do not necessarily represent the views of any company the
>> > author
>> > > > > > might be affiliated with at the moment of writing.
>> > > > > >
>> > > > > >
>> > > > > > On Tue, Oct 3, 2017 at 10:11 AM, Evans Ye <ev...@apache.org>
>> > > wrote:
>> > > > > >> Thanks Olaf!
>> > > > > >> I see all the slaves images are now back to normal.
>> > > > > >>
>> > > > > >> I'll have a national holiday tomorrow and I'd like to spend it
>> on
>> > > > Bigtop
>> > > > > >> 1.2.1 release.
>> > > > > >> Right now, we're blocked by two issues:
>> > > > > >>
>> > > > > >> Crunch build failed: https://issues.apache.org/
>> > > > jira/browse/BIGTOP-2900
>> > > > > >> GPDB build failed: https://issues.apache.org/
>> > > jira/browse/BIGTOP-2901
>> > > > > >>
>> > > > > >> I've provided a workaround patch in BIGTOP-2900, however I have
>> > > > > completely
>> > > > > >> no idea for BIGTOP-2901.
>> > > > > >> Since I've raised the problem few days ago, if no one has time
>> to
>> > > fix
>> > > > > it,
>> > > > > >> I'd like to propose to disable GPDB in 1.2.1 release.
>> > > > > >> That means in 1.2.1 release there is no GPDB binary artifact
>> > > > available,
>> > > > > but
>> > > > > >> we can still refine GPDB's quality in the master branch.
>> > > > > >>
>> > > > > >> How do you think?
>> > > > > >>
>> > > > > >>
>> > > > > >> 2017-09-26 5:16 GMT+08:00 Roman Shaposhnik <rv...@apache.org>:
>> > > > > >>
>> > > > > >>> Let me take a look today
>> > > > > >>>
>> > > > > >>> On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik <
>> > > cos@apache.org>
>> > > > > >>> wrote:
>> > > > > >>>> Explicitly adding Rvs in the loop
>> > > > > >>>> --
>> > > > > >>>> With regards,
>> > > > > >>>> Konstantin (Cos) Boudnik
>> > > > > >>>> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
>> > > > > >>>>
>> > > > > >>>> Disclaimer: Opinions expressed in this email are those of the
>> > > > author,
>> > > > > >>>> and do not necessarily represent the views of any company the
>> > > author
>> > > > > >>>> might be affiliated with at the moment of writing.
>> > > > > >>>>
>> > > > > >>>>
>> > > > > >>>> On Sat, Sep 23, 2017 at 12:24 PM, Evans Ye <
>> evansye@apache.org>
>> > > > > wrote:
>> > > > > >>>>> Hi Bigtoper,
>> > > > > >>>>>
>> > > > > >>>>> I'm working on the 1.2.1 release. Hopefully we can get it to
>> > the
>> > > > > finish
>> > > > > >>>>> line by the end on Sept.
>> > > > > >>>>>
>> > > > > >>>>> Right now we still have a few issues blocking:
>> > > > > >>>>>
>> > > > > >>>>> 1. GPDB build failed on OpenSuSE 42.1[1]
>> > > > > >>>>> 2. Toolchain build failed on PPC64LE platform[2]
>> > > > > >>>>>
>> > > > > >>>>> I'll update more down the path. But right now I'd like to
>> seek
>> > > for
>> > > > > some
>> > > > > >>>>> helps on GPDB and PPC64LE side ;)
>> > > > > >>>>>
>> > > > > >>>>>
>> > > > > >>>>> [1]. https://ci.bigtop.apache.org/v
>> iew/Releases/job/Bigtop-1.2
>> > .
>> > > 1/
>> > > > > >>>>> [2]. https://ci.bigtop.apache.org/view/Docker/job/Docker-
>> > > > > >>> Toolchain-1.2.1/
>> > > > > >>>>>
>> > > > > >>>>>
>> > > > > >>>>> 2017-07-26 11:24 GMT+08:00 Evans Ye <ev...@apache.org>:
>> > > > > >>>>>
>> > > > > >>>>>> Thanks, Arnaud
>> > > > > >>>>>>
>> > > > > >>>>>> [jenkins@ip bigtop-ubuntu-16.04]$ docker run -ti --rm
>> > > > > >>>>>> bigtop/slaves:1.2.1-$OS bash -l
>> > > > > >>>>>> root@596ef2c638de:/# java -version
>> > > > > >>>>>> openjdk version "1.8.0_131"
>> > > > > >>>>>> OpenJDK Runtime Environment (build
>> > 1.8.0_131-8u131-b11-0ubuntu1.
>> > > > > >>>>>> 16.04.2-b11)
>> > > > > >>>>>> OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
>> > > > > >>>>>>
>> > > > > >>>>>> Looks linked!
>> > > > > >>>>>>
>> > > > > >>>>>>
>> > > > > >>>>>> 2017-07-26 3:02 GMT+08:00 Arnaud Launay <as...@launay.org>:
>> > > > > >>>>>>
>> > > > > >>>>>>> Le Wed, Jul 26, 2017 at 12:45:50AM +0800, Evans Ye a
>> écrit:
>> > > > > >>>>>>>> 1. Somehow packages on centos and debian changed. If we
>> > > rebuild
>> > > > > >>>>>>>> bigtop/slaves for trunk, then Solr will fail the same as
>> > what
>> > > we
>> > > > > >>> faced
>> > > > > >>>>>>>> building with 1.2.1 images.
>> > > > > >>>>>>>> 2. We've special tweaks for bigtop/slaves trunk images.
>> > > > > >>>>>>>> Any thoughts?
>> > > > > >>>>>>>
>> > > > > >>>>>>> Check the java version, somehow the java docs whatever
>> stuff
>> > > > > >>>>>>> changed in 8.131, and solr doesn't compile anymore with
>> java8
>> > > > > >=131 .
>> > > > > >>>>>>> Might be linked.
>> > > > > >>>>>>>
>> > > > > >>>>>>> Arnaud.
>> > > > > >>>>>>>
>> > > > > >>>>>>
>> > > > > >>>>>>
>> > > > > >>>
>> > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>>
>>
>> --
>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>>
>
>
Re: Releasing 1.2.1
Posted by Evans Ye <ev...@apache.org>.
AFAIK, the build slave for arm is offline in our CI:
docker-slave-arm-1
<https://ci.bigtop.apache.org/computer/docker-slave-arm-1/> (offline)
If you can get it back into business, then there's no reason not to include
it as long as it's in good shape.
2017-10-13 3:31 GMT+08:00 Ganesh Raju <ga...@linaro.org>:
> Evans
>
> What is needed to reestablish the CI builds for Aarch? We are ready to help
> that getting setup as well
> We have setup CI builds internally in Linaro which has been working fine.
>
> Do you need access to the two arm systems for builds?
>
>
> Thanks,
> Ganesh
>
> On Thu, Oct 12, 2017 at 1:56 PM, Evans Ye <ev...@apache.org> wrote:
>
> > Thanks Kevin for doing the investigation. That is addressed in
> BIGTOP-2904.
> >
> > Regarding to 1.2.1 release. I've finally crossed the finish line and have
> > put it up for a vote.
> > Let me share some of the details here:
> >
> > * All the signed repos are on repos.bigtop.apache.org, which is backed
> by
> > our new S3 directory
> > * Deployment evaluated by
> > https://ci.bigtop.apache.org/view/Provisioner/job/Bigtop-1.
> > 2.1-deployments/,
> > which installs packages from repos.bigtop.apache.org. Surely we've some
> > red
> > dots, but those problems are also in 1.2.0 as well. 1.2.1 actually
> > improves/fixes things that was broken in 1.2.0.
> > * Binary convenient artifacts are not available for PPC64LE, but we can
> > still put them up afterwards.
> >
> > Thanks for everyone who helped making this release happening.
> > The release stuffs are in the [VOTE] mailing thread. If you've time.
> Please
> > give it try and provide your feedback.
> >
> >
> > Evans
> >
> >
> >
> > 2017-10-10 2:02 GMT+08:00 Kevin Monroe <ke...@canonical.com>:
> >
> > > Hey Evans, ubuntu 16.04 seems ok from your CI link, but fedora 25 has a
> > > problem:
> > >
> > > https://ci.bigtop.apache.org/job/Bigtop-1.2.1-ppc64le/OS=
> > > fedora-25-ppc64le/lastFailedBuild/console
> > >
> > > I *think* I've tracked this down to the location of protobuf. Note the
> > URL
> > > for rpm-based ppc64le distros:
> > >
> > > https://github.com/apache/bigtop/blob/master/bigtop_
> > > toolchain/manifests/protobuf.pp#L54
> > >
> > > Those fedora-22 URLs are no longer valid:
> > >
> > > https://dl.fedoraproject.org/pub/fedora-secondary/releases/
> > > 22/Everything/ppc64le/
> > >
> > > It seems in late September, fedora 22 moved to fedora archives, so I
> > think
> > > we just need those URLs changed to:
> > >
> > > http://archives.fedoraproject.org/pub/archive/fedora-
> > > secondary/releases/22/Everything/ppc64le/
> > >
> > > I don't have the capacity to test fedora on a ppc64le machine, but it
> > seems
> > > like simple fix on paper ;)
> > >
> > > -Kevin
> > >
> > > On Sun, Oct 8, 2017 at 3:29 PM, Evans Ye <ev...@apache.org> wrote:
> > >
> > > > Okay, heading down the path to 1.2.1 release.
> > > > I'm on the journey to prepare the repos on S3...
> > > >
> > > > PROGRESS
> > > > [V] Build 1.2.1 Docker slave images
> > > > [V] Build 1.2.1 RPM/DEB packages
> > > > [V] Sign packages
> > > > [X] Upload artifacts to S3
> > > > [X] Run through deployment test
> > > > [X] Vote for RC -> release
> > > >
> > > > Finally I'm able to produce all x86_64 artifacts:
> > > > https://ci.bigtop.apache.org/job/Bigtop-1.2.1
> > > > (Actually I've to keep retrying to get these builds done. Don't know
> > why
> > > > sometimes entering infinite loop though...)
> > > > and their corresponding signed repos for S3 uploading.
> > > >
> > > > However, I got some problems with PPC64LE.
> > > > We can build arch independent artifacts on other machines for sure,
> but
> > > > hadoop,
> > > > qfs, bigtop-jsvc, zookeeper, hue need to be built on PPC machines.
> And
> > > that
> > > > is currently failing on ubuntu 16.04:
> > > > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1-ppc64le/
> > > >
> > > > At a glance I guess something need to be fixed for PPC docker slaves
> > > image.
> > > > I can give it a look, but if some one can help it would be
> appreciated.
> > > > It is indeed tons of work for getting a release out ;)
> > > >
> > > >
> > > > 2017-10-03 23:22 GMT+08:00 Olaf Flebbe <of...@oflebbe.de>:
> > > >
> > > > > Hi,
> > > > >
> > > > > The failure of gpdb looks like a serious problem to me, see
> > BIGTOP-2901
> > > > > I am too for an +1 to disable this for 1.2.1
> > > > >
> > > > > Thank you Evans for being still on track to release.
> > > > >
> > > > > Olaf
> > > > >
> > > > >
> > > > > > Am 03.10.2017 um 16:20 schrieb Konstantin Boudnik <
> cos@apache.org
> > >:
> > > > > >
> > > > > > Well, if we can't fix it - let's nuke it. +1
> > > > > > --
> > > > > > With regards,
> > > > > > Konstantin (Cos) Boudnik
> > > > > > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
> > > > > >
> > > > > > Disclaimer: Opinions expressed in this email are those of the
> > author,
> > > > > > and do not necessarily represent the views of any company the
> > author
> > > > > > might be affiliated with at the moment of writing.
> > > > > >
> > > > > >
> > > > > > On Tue, Oct 3, 2017 at 10:11 AM, Evans Ye <ev...@apache.org>
> > > wrote:
> > > > > >> Thanks Olaf!
> > > > > >> I see all the slaves images are now back to normal.
> > > > > >>
> > > > > >> I'll have a national holiday tomorrow and I'd like to spend it
> on
> > > > Bigtop
> > > > > >> 1.2.1 release.
> > > > > >> Right now, we're blocked by two issues:
> > > > > >>
> > > > > >> Crunch build failed: https://issues.apache.org/
> > > > jira/browse/BIGTOP-2900
> > > > > >> GPDB build failed: https://issues.apache.org/
> > > jira/browse/BIGTOP-2901
> > > > > >>
> > > > > >> I've provided a workaround patch in BIGTOP-2900, however I have
> > > > > completely
> > > > > >> no idea for BIGTOP-2901.
> > > > > >> Since I've raised the problem few days ago, if no one has time
> to
> > > fix
> > > > > it,
> > > > > >> I'd like to propose to disable GPDB in 1.2.1 release.
> > > > > >> That means in 1.2.1 release there is no GPDB binary artifact
> > > > available,
> > > > > but
> > > > > >> we can still refine GPDB's quality in the master branch.
> > > > > >>
> > > > > >> How do you think?
> > > > > >>
> > > > > >>
> > > > > >> 2017-09-26 5:16 GMT+08:00 Roman Shaposhnik <rv...@apache.org>:
> > > > > >>
> > > > > >>> Let me take a look today
> > > > > >>>
> > > > > >>> On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik <
> > > cos@apache.org>
> > > > > >>> wrote:
> > > > > >>>> Explicitly adding Rvs in the loop
> > > > > >>>> --
> > > > > >>>> With regards,
> > > > > >>>> Konstantin (Cos) Boudnik
> > > > > >>>> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
> > > > > >>>>
> > > > > >>>> Disclaimer: Opinions expressed in this email are those of the
> > > > author,
> > > > > >>>> and do not necessarily represent the views of any company the
> > > author
> > > > > >>>> might be affiliated with at the moment of writing.
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> On Sat, Sep 23, 2017 at 12:24 PM, Evans Ye <
> evansye@apache.org>
> > > > > wrote:
> > > > > >>>>> Hi Bigtoper,
> > > > > >>>>>
> > > > > >>>>> I'm working on the 1.2.1 release. Hopefully we can get it to
> > the
> > > > > finish
> > > > > >>>>> line by the end on Sept.
> > > > > >>>>>
> > > > > >>>>> Right now we still have a few issues blocking:
> > > > > >>>>>
> > > > > >>>>> 1. GPDB build failed on OpenSuSE 42.1[1]
> > > > > >>>>> 2. Toolchain build failed on PPC64LE platform[2]
> > > > > >>>>>
> > > > > >>>>> I'll update more down the path. But right now I'd like to
> seek
> > > for
> > > > > some
> > > > > >>>>> helps on GPDB and PPC64LE side ;)
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> [1]. https://ci.bigtop.apache.org/
> view/Releases/job/Bigtop-1.2
> > .
> > > 1/
> > > > > >>>>> [2]. https://ci.bigtop.apache.org/view/Docker/job/Docker-
> > > > > >>> Toolchain-1.2.1/
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> 2017-07-26 11:24 GMT+08:00 Evans Ye <ev...@apache.org>:
> > > > > >>>>>
> > > > > >>>>>> Thanks, Arnaud
> > > > > >>>>>>
> > > > > >>>>>> [jenkins@ip bigtop-ubuntu-16.04]$ docker run -ti --rm
> > > > > >>>>>> bigtop/slaves:1.2.1-$OS bash -l
> > > > > >>>>>> root@596ef2c638de:/# java -version
> > > > > >>>>>> openjdk version "1.8.0_131"
> > > > > >>>>>> OpenJDK Runtime Environment (build
> > 1.8.0_131-8u131-b11-0ubuntu1.
> > > > > >>>>>> 16.04.2-b11)
> > > > > >>>>>> OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
> > > > > >>>>>>
> > > > > >>>>>> Looks linked!
> > > > > >>>>>>
> > > > > >>>>>>
> > > > > >>>>>> 2017-07-26 3:02 GMT+08:00 Arnaud Launay <as...@launay.org>:
> > > > > >>>>>>
> > > > > >>>>>>> Le Wed, Jul 26, 2017 at 12:45:50AM +0800, Evans Ye a écrit:
> > > > > >>>>>>>> 1. Somehow packages on centos and debian changed. If we
> > > rebuild
> > > > > >>>>>>>> bigtop/slaves for trunk, then Solr will fail the same as
> > what
> > > we
> > > > > >>> faced
> > > > > >>>>>>>> building with 1.2.1 images.
> > > > > >>>>>>>> 2. We've special tweaks for bigtop/slaves trunk images.
> > > > > >>>>>>>> Any thoughts?
> > > > > >>>>>>>
> > > > > >>>>>>> Check the java version, somehow the java docs whatever
> stuff
> > > > > >>>>>>> changed in 8.131, and solr doesn't compile anymore with
> java8
> > > > > >=131 .
> > > > > >>>>>>> Might be linked.
> > > > > >>>>>>>
> > > > > >>>>>>> Arnaud.
> > > > > >>>>>>>
> > > > > >>>>>>
> > > > > >>>>>>
> > > > > >>>
> > > > >
> > > > >
> > > >
> > >
> >
>
>
>
> --
> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>
Re: Releasing 1.2.1
Posted by Ganesh Raju <ga...@linaro.org>.
Evans
What is needed to reestablish the CI builds for Aarch? We are ready to help
that getting setup as well
We have setup CI builds internally in Linaro which has been working fine.
Do you need access to the two arm systems for builds?
Thanks,
Ganesh
On Thu, Oct 12, 2017 at 1:56 PM, Evans Ye <ev...@apache.org> wrote:
> Thanks Kevin for doing the investigation. That is addressed in BIGTOP-2904.
>
> Regarding to 1.2.1 release. I've finally crossed the finish line and have
> put it up for a vote.
> Let me share some of the details here:
>
> * All the signed repos are on repos.bigtop.apache.org, which is backed by
> our new S3 directory
> * Deployment evaluated by
> https://ci.bigtop.apache.org/view/Provisioner/job/Bigtop-1.
> 2.1-deployments/,
> which installs packages from repos.bigtop.apache.org. Surely we've some
> red
> dots, but those problems are also in 1.2.0 as well. 1.2.1 actually
> improves/fixes things that was broken in 1.2.0.
> * Binary convenient artifacts are not available for PPC64LE, but we can
> still put them up afterwards.
>
> Thanks for everyone who helped making this release happening.
> The release stuffs are in the [VOTE] mailing thread. If you've time. Please
> give it try and provide your feedback.
>
>
> Evans
>
>
>
> 2017-10-10 2:02 GMT+08:00 Kevin Monroe <ke...@canonical.com>:
>
> > Hey Evans, ubuntu 16.04 seems ok from your CI link, but fedora 25 has a
> > problem:
> >
> > https://ci.bigtop.apache.org/job/Bigtop-1.2.1-ppc64le/OS=
> > fedora-25-ppc64le/lastFailedBuild/console
> >
> > I *think* I've tracked this down to the location of protobuf. Note the
> URL
> > for rpm-based ppc64le distros:
> >
> > https://github.com/apache/bigtop/blob/master/bigtop_
> > toolchain/manifests/protobuf.pp#L54
> >
> > Those fedora-22 URLs are no longer valid:
> >
> > https://dl.fedoraproject.org/pub/fedora-secondary/releases/
> > 22/Everything/ppc64le/
> >
> > It seems in late September, fedora 22 moved to fedora archives, so I
> think
> > we just need those URLs changed to:
> >
> > http://archives.fedoraproject.org/pub/archive/fedora-
> > secondary/releases/22/Everything/ppc64le/
> >
> > I don't have the capacity to test fedora on a ppc64le machine, but it
> seems
> > like simple fix on paper ;)
> >
> > -Kevin
> >
> > On Sun, Oct 8, 2017 at 3:29 PM, Evans Ye <ev...@apache.org> wrote:
> >
> > > Okay, heading down the path to 1.2.1 release.
> > > I'm on the journey to prepare the repos on S3...
> > >
> > > PROGRESS
> > > [V] Build 1.2.1 Docker slave images
> > > [V] Build 1.2.1 RPM/DEB packages
> > > [V] Sign packages
> > > [X] Upload artifacts to S3
> > > [X] Run through deployment test
> > > [X] Vote for RC -> release
> > >
> > > Finally I'm able to produce all x86_64 artifacts:
> > > https://ci.bigtop.apache.org/job/Bigtop-1.2.1
> > > (Actually I've to keep retrying to get these builds done. Don't know
> why
> > > sometimes entering infinite loop though...)
> > > and their corresponding signed repos for S3 uploading.
> > >
> > > However, I got some problems with PPC64LE.
> > > We can build arch independent artifacts on other machines for sure, but
> > > hadoop,
> > > qfs, bigtop-jsvc, zookeeper, hue need to be built on PPC machines. And
> > that
> > > is currently failing on ubuntu 16.04:
> > > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1-ppc64le/
> > >
> > > At a glance I guess something need to be fixed for PPC docker slaves
> > image.
> > > I can give it a look, but if some one can help it would be appreciated.
> > > It is indeed tons of work for getting a release out ;)
> > >
> > >
> > > 2017-10-03 23:22 GMT+08:00 Olaf Flebbe <of...@oflebbe.de>:
> > >
> > > > Hi,
> > > >
> > > > The failure of gpdb looks like a serious problem to me, see
> BIGTOP-2901
> > > > I am too for an +1 to disable this for 1.2.1
> > > >
> > > > Thank you Evans for being still on track to release.
> > > >
> > > > Olaf
> > > >
> > > >
> > > > > Am 03.10.2017 um 16:20 schrieb Konstantin Boudnik <cos@apache.org
> >:
> > > > >
> > > > > Well, if we can't fix it - let's nuke it. +1
> > > > > --
> > > > > With regards,
> > > > > Konstantin (Cos) Boudnik
> > > > > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
> > > > >
> > > > > Disclaimer: Opinions expressed in this email are those of the
> author,
> > > > > and do not necessarily represent the views of any company the
> author
> > > > > might be affiliated with at the moment of writing.
> > > > >
> > > > >
> > > > > On Tue, Oct 3, 2017 at 10:11 AM, Evans Ye <ev...@apache.org>
> > wrote:
> > > > >> Thanks Olaf!
> > > > >> I see all the slaves images are now back to normal.
> > > > >>
> > > > >> I'll have a national holiday tomorrow and I'd like to spend it on
> > > Bigtop
> > > > >> 1.2.1 release.
> > > > >> Right now, we're blocked by two issues:
> > > > >>
> > > > >> Crunch build failed: https://issues.apache.org/
> > > jira/browse/BIGTOP-2900
> > > > >> GPDB build failed: https://issues.apache.org/
> > jira/browse/BIGTOP-2901
> > > > >>
> > > > >> I've provided a workaround patch in BIGTOP-2900, however I have
> > > > completely
> > > > >> no idea for BIGTOP-2901.
> > > > >> Since I've raised the problem few days ago, if no one has time to
> > fix
> > > > it,
> > > > >> I'd like to propose to disable GPDB in 1.2.1 release.
> > > > >> That means in 1.2.1 release there is no GPDB binary artifact
> > > available,
> > > > but
> > > > >> we can still refine GPDB's quality in the master branch.
> > > > >>
> > > > >> How do you think?
> > > > >>
> > > > >>
> > > > >> 2017-09-26 5:16 GMT+08:00 Roman Shaposhnik <rv...@apache.org>:
> > > > >>
> > > > >>> Let me take a look today
> > > > >>>
> > > > >>> On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik <
> > cos@apache.org>
> > > > >>> wrote:
> > > > >>>> Explicitly adding Rvs in the loop
> > > > >>>> --
> > > > >>>> With regards,
> > > > >>>> Konstantin (Cos) Boudnik
> > > > >>>> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
> > > > >>>>
> > > > >>>> Disclaimer: Opinions expressed in this email are those of the
> > > author,
> > > > >>>> and do not necessarily represent the views of any company the
> > author
> > > > >>>> might be affiliated with at the moment of writing.
> > > > >>>>
> > > > >>>>
> > > > >>>> On Sat, Sep 23, 2017 at 12:24 PM, Evans Ye <ev...@apache.org>
> > > > wrote:
> > > > >>>>> Hi Bigtoper,
> > > > >>>>>
> > > > >>>>> I'm working on the 1.2.1 release. Hopefully we can get it to
> the
> > > > finish
> > > > >>>>> line by the end on Sept.
> > > > >>>>>
> > > > >>>>> Right now we still have a few issues blocking:
> > > > >>>>>
> > > > >>>>> 1. GPDB build failed on OpenSuSE 42.1[1]
> > > > >>>>> 2. Toolchain build failed on PPC64LE platform[2]
> > > > >>>>>
> > > > >>>>> I'll update more down the path. But right now I'd like to seek
> > for
> > > > some
> > > > >>>>> helps on GPDB and PPC64LE side ;)
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> [1]. https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2
> .
> > 1/
> > > > >>>>> [2]. https://ci.bigtop.apache.org/view/Docker/job/Docker-
> > > > >>> Toolchain-1.2.1/
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> 2017-07-26 11:24 GMT+08:00 Evans Ye <ev...@apache.org>:
> > > > >>>>>
> > > > >>>>>> Thanks, Arnaud
> > > > >>>>>>
> > > > >>>>>> [jenkins@ip bigtop-ubuntu-16.04]$ docker run -ti --rm
> > > > >>>>>> bigtop/slaves:1.2.1-$OS bash -l
> > > > >>>>>> root@596ef2c638de:/# java -version
> > > > >>>>>> openjdk version "1.8.0_131"
> > > > >>>>>> OpenJDK Runtime Environment (build
> 1.8.0_131-8u131-b11-0ubuntu1.
> > > > >>>>>> 16.04.2-b11)
> > > > >>>>>> OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
> > > > >>>>>>
> > > > >>>>>> Looks linked!
> > > > >>>>>>
> > > > >>>>>>
> > > > >>>>>> 2017-07-26 3:02 GMT+08:00 Arnaud Launay <as...@launay.org>:
> > > > >>>>>>
> > > > >>>>>>> Le Wed, Jul 26, 2017 at 12:45:50AM +0800, Evans Ye a écrit:
> > > > >>>>>>>> 1. Somehow packages on centos and debian changed. If we
> > rebuild
> > > > >>>>>>>> bigtop/slaves for trunk, then Solr will fail the same as
> what
> > we
> > > > >>> faced
> > > > >>>>>>>> building with 1.2.1 images.
> > > > >>>>>>>> 2. We've special tweaks for bigtop/slaves trunk images.
> > > > >>>>>>>> Any thoughts?
> > > > >>>>>>>
> > > > >>>>>>> Check the java version, somehow the java docs whatever stuff
> > > > >>>>>>> changed in 8.131, and solr doesn't compile anymore with java8
> > > > >=131 .
> > > > >>>>>>> Might be linked.
> > > > >>>>>>>
> > > > >>>>>>> Arnaud.
> > > > >>>>>>>
> > > > >>>>>>
> > > > >>>>>>
> > > > >>>
> > > >
> > > >
> > >
> >
>
--
IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
Re: Releasing 1.2.1
Posted by Evans Ye <ev...@apache.org>.
Thanks Kevin for doing the investigation. That is addressed in BIGTOP-2904.
Regarding to 1.2.1 release. I've finally crossed the finish line and have
put it up for a vote.
Let me share some of the details here:
* All the signed repos are on repos.bigtop.apache.org, which is backed by
our new S3 directory
* Deployment evaluated by
https://ci.bigtop.apache.org/view/Provisioner/job/Bigtop-1.2.1-deployments/,
which installs packages from repos.bigtop.apache.org. Surely we've some red
dots, but those problems are also in 1.2.0 as well. 1.2.1 actually
improves/fixes things that was broken in 1.2.0.
* Binary convenient artifacts are not available for PPC64LE, but we can
still put them up afterwards.
Thanks for everyone who helped making this release happening.
The release stuffs are in the [VOTE] mailing thread. If you've time. Please
give it try and provide your feedback.
Evans
2017-10-10 2:02 GMT+08:00 Kevin Monroe <ke...@canonical.com>:
> Hey Evans, ubuntu 16.04 seems ok from your CI link, but fedora 25 has a
> problem:
>
> https://ci.bigtop.apache.org/job/Bigtop-1.2.1-ppc64le/OS=
> fedora-25-ppc64le/lastFailedBuild/console
>
> I *think* I've tracked this down to the location of protobuf. Note the URL
> for rpm-based ppc64le distros:
>
> https://github.com/apache/bigtop/blob/master/bigtop_
> toolchain/manifests/protobuf.pp#L54
>
> Those fedora-22 URLs are no longer valid:
>
> https://dl.fedoraproject.org/pub/fedora-secondary/releases/
> 22/Everything/ppc64le/
>
> It seems in late September, fedora 22 moved to fedora archives, so I think
> we just need those URLs changed to:
>
> http://archives.fedoraproject.org/pub/archive/fedora-
> secondary/releases/22/Everything/ppc64le/
>
> I don't have the capacity to test fedora on a ppc64le machine, but it seems
> like simple fix on paper ;)
>
> -Kevin
>
> On Sun, Oct 8, 2017 at 3:29 PM, Evans Ye <ev...@apache.org> wrote:
>
> > Okay, heading down the path to 1.2.1 release.
> > I'm on the journey to prepare the repos on S3...
> >
> > PROGRESS
> > [V] Build 1.2.1 Docker slave images
> > [V] Build 1.2.1 RPM/DEB packages
> > [V] Sign packages
> > [X] Upload artifacts to S3
> > [X] Run through deployment test
> > [X] Vote for RC -> release
> >
> > Finally I'm able to produce all x86_64 artifacts:
> > https://ci.bigtop.apache.org/job/Bigtop-1.2.1
> > (Actually I've to keep retrying to get these builds done. Don't know why
> > sometimes entering infinite loop though...)
> > and their corresponding signed repos for S3 uploading.
> >
> > However, I got some problems with PPC64LE.
> > We can build arch independent artifacts on other machines for sure, but
> > hadoop,
> > qfs, bigtop-jsvc, zookeeper, hue need to be built on PPC machines. And
> that
> > is currently failing on ubuntu 16.04:
> > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1-ppc64le/
> >
> > At a glance I guess something need to be fixed for PPC docker slaves
> image.
> > I can give it a look, but if some one can help it would be appreciated.
> > It is indeed tons of work for getting a release out ;)
> >
> >
> > 2017-10-03 23:22 GMT+08:00 Olaf Flebbe <of...@oflebbe.de>:
> >
> > > Hi,
> > >
> > > The failure of gpdb looks like a serious problem to me, see BIGTOP-2901
> > > I am too for an +1 to disable this for 1.2.1
> > >
> > > Thank you Evans for being still on track to release.
> > >
> > > Olaf
> > >
> > >
> > > > Am 03.10.2017 um 16:20 schrieb Konstantin Boudnik <co...@apache.org>:
> > > >
> > > > Well, if we can't fix it - let's nuke it. +1
> > > > --
> > > > With regards,
> > > > Konstantin (Cos) Boudnik
> > > > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
> > > >
> > > > Disclaimer: Opinions expressed in this email are those of the author,
> > > > and do not necessarily represent the views of any company the author
> > > > might be affiliated with at the moment of writing.
> > > >
> > > >
> > > > On Tue, Oct 3, 2017 at 10:11 AM, Evans Ye <ev...@apache.org>
> wrote:
> > > >> Thanks Olaf!
> > > >> I see all the slaves images are now back to normal.
> > > >>
> > > >> I'll have a national holiday tomorrow and I'd like to spend it on
> > Bigtop
> > > >> 1.2.1 release.
> > > >> Right now, we're blocked by two issues:
> > > >>
> > > >> Crunch build failed: https://issues.apache.org/
> > jira/browse/BIGTOP-2900
> > > >> GPDB build failed: https://issues.apache.org/
> jira/browse/BIGTOP-2901
> > > >>
> > > >> I've provided a workaround patch in BIGTOP-2900, however I have
> > > completely
> > > >> no idea for BIGTOP-2901.
> > > >> Since I've raised the problem few days ago, if no one has time to
> fix
> > > it,
> > > >> I'd like to propose to disable GPDB in 1.2.1 release.
> > > >> That means in 1.2.1 release there is no GPDB binary artifact
> > available,
> > > but
> > > >> we can still refine GPDB's quality in the master branch.
> > > >>
> > > >> How do you think?
> > > >>
> > > >>
> > > >> 2017-09-26 5:16 GMT+08:00 Roman Shaposhnik <rv...@apache.org>:
> > > >>
> > > >>> Let me take a look today
> > > >>>
> > > >>> On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik <
> cos@apache.org>
> > > >>> wrote:
> > > >>>> Explicitly adding Rvs in the loop
> > > >>>> --
> > > >>>> With regards,
> > > >>>> Konstantin (Cos) Boudnik
> > > >>>> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
> > > >>>>
> > > >>>> Disclaimer: Opinions expressed in this email are those of the
> > author,
> > > >>>> and do not necessarily represent the views of any company the
> author
> > > >>>> might be affiliated with at the moment of writing.
> > > >>>>
> > > >>>>
> > > >>>> On Sat, Sep 23, 2017 at 12:24 PM, Evans Ye <ev...@apache.org>
> > > wrote:
> > > >>>>> Hi Bigtoper,
> > > >>>>>
> > > >>>>> I'm working on the 1.2.1 release. Hopefully we can get it to the
> > > finish
> > > >>>>> line by the end on Sept.
> > > >>>>>
> > > >>>>> Right now we still have a few issues blocking:
> > > >>>>>
> > > >>>>> 1. GPDB build failed on OpenSuSE 42.1[1]
> > > >>>>> 2. Toolchain build failed on PPC64LE platform[2]
> > > >>>>>
> > > >>>>> I'll update more down the path. But right now I'd like to seek
> for
> > > some
> > > >>>>> helps on GPDB and PPC64LE side ;)
> > > >>>>>
> > > >>>>>
> > > >>>>> [1]. https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.
> 1/
> > > >>>>> [2]. https://ci.bigtop.apache.org/view/Docker/job/Docker-
> > > >>> Toolchain-1.2.1/
> > > >>>>>
> > > >>>>>
> > > >>>>> 2017-07-26 11:24 GMT+08:00 Evans Ye <ev...@apache.org>:
> > > >>>>>
> > > >>>>>> Thanks, Arnaud
> > > >>>>>>
> > > >>>>>> [jenkins@ip bigtop-ubuntu-16.04]$ docker run -ti --rm
> > > >>>>>> bigtop/slaves:1.2.1-$OS bash -l
> > > >>>>>> root@596ef2c638de:/# java -version
> > > >>>>>> openjdk version "1.8.0_131"
> > > >>>>>> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-0ubuntu1.
> > > >>>>>> 16.04.2-b11)
> > > >>>>>> OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
> > > >>>>>>
> > > >>>>>> Looks linked!
> > > >>>>>>
> > > >>>>>>
> > > >>>>>> 2017-07-26 3:02 GMT+08:00 Arnaud Launay <as...@launay.org>:
> > > >>>>>>
> > > >>>>>>> Le Wed, Jul 26, 2017 at 12:45:50AM +0800, Evans Ye a écrit:
> > > >>>>>>>> 1. Somehow packages on centos and debian changed. If we
> rebuild
> > > >>>>>>>> bigtop/slaves for trunk, then Solr will fail the same as what
> we
> > > >>> faced
> > > >>>>>>>> building with 1.2.1 images.
> > > >>>>>>>> 2. We've special tweaks for bigtop/slaves trunk images.
> > > >>>>>>>> Any thoughts?
> > > >>>>>>>
> > > >>>>>>> Check the java version, somehow the java docs whatever stuff
> > > >>>>>>> changed in 8.131, and solr doesn't compile anymore with java8
> > > >=131 .
> > > >>>>>>> Might be linked.
> > > >>>>>>>
> > > >>>>>>> Arnaud.
> > > >>>>>>>
> > > >>>>>>
> > > >>>>>>
> > > >>>
> > >
> > >
> >
>
Re: Releasing 1.2.1
Posted by Kevin Monroe <ke...@canonical.com>.
Hey Evans, ubuntu 16.04 seems ok from your CI link, but fedora 25 has a
problem:
https://ci.bigtop.apache.org/job/Bigtop-1.2.1-ppc64le/OS=fedora-25-ppc64le/lastFailedBuild/console
I *think* I've tracked this down to the location of protobuf. Note the URL
for rpm-based ppc64le distros:
https://github.com/apache/bigtop/blob/master/bigtop_toolchain/manifests/protobuf.pp#L54
Those fedora-22 URLs are no longer valid:
https://dl.fedoraproject.org/pub/fedora-secondary/releases/22/Everything/ppc64le/
It seems in late September, fedora 22 moved to fedora archives, so I think
we just need those URLs changed to:
http://archives.fedoraproject.org/pub/archive/fedora-secondary/releases/22/Everything/ppc64le/
I don't have the capacity to test fedora on a ppc64le machine, but it seems
like simple fix on paper ;)
-Kevin
On Sun, Oct 8, 2017 at 3:29 PM, Evans Ye <ev...@apache.org> wrote:
> Okay, heading down the path to 1.2.1 release.
> I'm on the journey to prepare the repos on S3...
>
> PROGRESS
> [V] Build 1.2.1 Docker slave images
> [V] Build 1.2.1 RPM/DEB packages
> [V] Sign packages
> [X] Upload artifacts to S3
> [X] Run through deployment test
> [X] Vote for RC -> release
>
> Finally I'm able to produce all x86_64 artifacts:
> https://ci.bigtop.apache.org/job/Bigtop-1.2.1
> (Actually I've to keep retrying to get these builds done. Don't know why
> sometimes entering infinite loop though...)
> and their corresponding signed repos for S3 uploading.
>
> However, I got some problems with PPC64LE.
> We can build arch independent artifacts on other machines for sure, but
> hadoop,
> qfs, bigtop-jsvc, zookeeper, hue need to be built on PPC machines. And that
> is currently failing on ubuntu 16.04:
> https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1-ppc64le/
>
> At a glance I guess something need to be fixed for PPC docker slaves image.
> I can give it a look, but if some one can help it would be appreciated.
> It is indeed tons of work for getting a release out ;)
>
>
> 2017-10-03 23:22 GMT+08:00 Olaf Flebbe <of...@oflebbe.de>:
>
> > Hi,
> >
> > The failure of gpdb looks like a serious problem to me, see BIGTOP-2901
> > I am too for an +1 to disable this for 1.2.1
> >
> > Thank you Evans for being still on track to release.
> >
> > Olaf
> >
> >
> > > Am 03.10.2017 um 16:20 schrieb Konstantin Boudnik <co...@apache.org>:
> > >
> > > Well, if we can't fix it - let's nuke it. +1
> > > --
> > > With regards,
> > > Konstantin (Cos) Boudnik
> > > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
> > >
> > > Disclaimer: Opinions expressed in this email are those of the author,
> > > and do not necessarily represent the views of any company the author
> > > might be affiliated with at the moment of writing.
> > >
> > >
> > > On Tue, Oct 3, 2017 at 10:11 AM, Evans Ye <ev...@apache.org> wrote:
> > >> Thanks Olaf!
> > >> I see all the slaves images are now back to normal.
> > >>
> > >> I'll have a national holiday tomorrow and I'd like to spend it on
> Bigtop
> > >> 1.2.1 release.
> > >> Right now, we're blocked by two issues:
> > >>
> > >> Crunch build failed: https://issues.apache.org/
> jira/browse/BIGTOP-2900
> > >> GPDB build failed: https://issues.apache.org/jira/browse/BIGTOP-2901
> > >>
> > >> I've provided a workaround patch in BIGTOP-2900, however I have
> > completely
> > >> no idea for BIGTOP-2901.
> > >> Since I've raised the problem few days ago, if no one has time to fix
> > it,
> > >> I'd like to propose to disable GPDB in 1.2.1 release.
> > >> That means in 1.2.1 release there is no GPDB binary artifact
> available,
> > but
> > >> we can still refine GPDB's quality in the master branch.
> > >>
> > >> How do you think?
> > >>
> > >>
> > >> 2017-09-26 5:16 GMT+08:00 Roman Shaposhnik <rv...@apache.org>:
> > >>
> > >>> Let me take a look today
> > >>>
> > >>> On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik <co...@apache.org>
> > >>> wrote:
> > >>>> Explicitly adding Rvs in the loop
> > >>>> --
> > >>>> With regards,
> > >>>> Konstantin (Cos) Boudnik
> > >>>> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
> > >>>>
> > >>>> Disclaimer: Opinions expressed in this email are those of the
> author,
> > >>>> and do not necessarily represent the views of any company the author
> > >>>> might be affiliated with at the moment of writing.
> > >>>>
> > >>>>
> > >>>> On Sat, Sep 23, 2017 at 12:24 PM, Evans Ye <ev...@apache.org>
> > wrote:
> > >>>>> Hi Bigtoper,
> > >>>>>
> > >>>>> I'm working on the 1.2.1 release. Hopefully we can get it to the
> > finish
> > >>>>> line by the end on Sept.
> > >>>>>
> > >>>>> Right now we still have a few issues blocking:
> > >>>>>
> > >>>>> 1. GPDB build failed on OpenSuSE 42.1[1]
> > >>>>> 2. Toolchain build failed on PPC64LE platform[2]
> > >>>>>
> > >>>>> I'll update more down the path. But right now I'd like to seek for
> > some
> > >>>>> helps on GPDB and PPC64LE side ;)
> > >>>>>
> > >>>>>
> > >>>>> [1]. https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1/
> > >>>>> [2]. https://ci.bigtop.apache.org/view/Docker/job/Docker-
> > >>> Toolchain-1.2.1/
> > >>>>>
> > >>>>>
> > >>>>> 2017-07-26 11:24 GMT+08:00 Evans Ye <ev...@apache.org>:
> > >>>>>
> > >>>>>> Thanks, Arnaud
> > >>>>>>
> > >>>>>> [jenkins@ip bigtop-ubuntu-16.04]$ docker run -ti --rm
> > >>>>>> bigtop/slaves:1.2.1-$OS bash -l
> > >>>>>> root@596ef2c638de:/# java -version
> > >>>>>> openjdk version "1.8.0_131"
> > >>>>>> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-0ubuntu1.
> > >>>>>> 16.04.2-b11)
> > >>>>>> OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
> > >>>>>>
> > >>>>>> Looks linked!
> > >>>>>>
> > >>>>>>
> > >>>>>> 2017-07-26 3:02 GMT+08:00 Arnaud Launay <as...@launay.org>:
> > >>>>>>
> > >>>>>>> Le Wed, Jul 26, 2017 at 12:45:50AM +0800, Evans Ye a écrit:
> > >>>>>>>> 1. Somehow packages on centos and debian changed. If we rebuild
> > >>>>>>>> bigtop/slaves for trunk, then Solr will fail the same as what we
> > >>> faced
> > >>>>>>>> building with 1.2.1 images.
> > >>>>>>>> 2. We've special tweaks for bigtop/slaves trunk images.
> > >>>>>>>> Any thoughts?
> > >>>>>>>
> > >>>>>>> Check the java version, somehow the java docs whatever stuff
> > >>>>>>> changed in 8.131, and solr doesn't compile anymore with java8
> > >=131 .
> > >>>>>>> Might be linked.
> > >>>>>>>
> > >>>>>>> Arnaud.
> > >>>>>>>
> > >>>>>>
> > >>>>>>
> > >>>
> >
> >
>
Re: Releasing 1.2.1
Posted by Evans Ye <ev...@apache.org>.
Okay, heading down the path to 1.2.1 release.
I'm on the journey to prepare the repos on S3...
PROGRESS
[V] Build 1.2.1 Docker slave images
[V] Build 1.2.1 RPM/DEB packages
[V] Sign packages
[X] Upload artifacts to S3
[X] Run through deployment test
[X] Vote for RC -> release
Finally I'm able to produce all x86_64 artifacts:
https://ci.bigtop.apache.org/job/Bigtop-1.2.1
(Actually I've to keep retrying to get these builds done. Don't know why
sometimes entering infinite loop though...)
and their corresponding signed repos for S3 uploading.
However, I got some problems with PPC64LE.
We can build arch independent artifacts on other machines for sure, but hadoop,
qfs, bigtop-jsvc, zookeeper, hue need to be built on PPC machines. And that
is currently failing on ubuntu 16.04:
https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1-ppc64le/
At a glance I guess something need to be fixed for PPC docker slaves image.
I can give it a look, but if some one can help it would be appreciated.
It is indeed tons of work for getting a release out ;)
2017-10-03 23:22 GMT+08:00 Olaf Flebbe <of...@oflebbe.de>:
> Hi,
>
> The failure of gpdb looks like a serious problem to me, see BIGTOP-2901
> I am too for an +1 to disable this for 1.2.1
>
> Thank you Evans for being still on track to release.
>
> Olaf
>
>
> > Am 03.10.2017 um 16:20 schrieb Konstantin Boudnik <co...@apache.org>:
> >
> > Well, if we can't fix it - let's nuke it. +1
> > --
> > With regards,
> > Konstantin (Cos) Boudnik
> > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
> >
> > Disclaimer: Opinions expressed in this email are those of the author,
> > and do not necessarily represent the views of any company the author
> > might be affiliated with at the moment of writing.
> >
> >
> > On Tue, Oct 3, 2017 at 10:11 AM, Evans Ye <ev...@apache.org> wrote:
> >> Thanks Olaf!
> >> I see all the slaves images are now back to normal.
> >>
> >> I'll have a national holiday tomorrow and I'd like to spend it on Bigtop
> >> 1.2.1 release.
> >> Right now, we're blocked by two issues:
> >>
> >> Crunch build failed: https://issues.apache.org/jira/browse/BIGTOP-2900
> >> GPDB build failed: https://issues.apache.org/jira/browse/BIGTOP-2901
> >>
> >> I've provided a workaround patch in BIGTOP-2900, however I have
> completely
> >> no idea for BIGTOP-2901.
> >> Since I've raised the problem few days ago, if no one has time to fix
> it,
> >> I'd like to propose to disable GPDB in 1.2.1 release.
> >> That means in 1.2.1 release there is no GPDB binary artifact available,
> but
> >> we can still refine GPDB's quality in the master branch.
> >>
> >> How do you think?
> >>
> >>
> >> 2017-09-26 5:16 GMT+08:00 Roman Shaposhnik <rv...@apache.org>:
> >>
> >>> Let me take a look today
> >>>
> >>> On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik <co...@apache.org>
> >>> wrote:
> >>>> Explicitly adding Rvs in the loop
> >>>> --
> >>>> With regards,
> >>>> Konstantin (Cos) Boudnik
> >>>> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
> >>>>
> >>>> Disclaimer: Opinions expressed in this email are those of the author,
> >>>> and do not necessarily represent the views of any company the author
> >>>> might be affiliated with at the moment of writing.
> >>>>
> >>>>
> >>>> On Sat, Sep 23, 2017 at 12:24 PM, Evans Ye <ev...@apache.org>
> wrote:
> >>>>> Hi Bigtoper,
> >>>>>
> >>>>> I'm working on the 1.2.1 release. Hopefully we can get it to the
> finish
> >>>>> line by the end on Sept.
> >>>>>
> >>>>> Right now we still have a few issues blocking:
> >>>>>
> >>>>> 1. GPDB build failed on OpenSuSE 42.1[1]
> >>>>> 2. Toolchain build failed on PPC64LE platform[2]
> >>>>>
> >>>>> I'll update more down the path. But right now I'd like to seek for
> some
> >>>>> helps on GPDB and PPC64LE side ;)
> >>>>>
> >>>>>
> >>>>> [1]. https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1/
> >>>>> [2]. https://ci.bigtop.apache.org/view/Docker/job/Docker-
> >>> Toolchain-1.2.1/
> >>>>>
> >>>>>
> >>>>> 2017-07-26 11:24 GMT+08:00 Evans Ye <ev...@apache.org>:
> >>>>>
> >>>>>> Thanks, Arnaud
> >>>>>>
> >>>>>> [jenkins@ip bigtop-ubuntu-16.04]$ docker run -ti --rm
> >>>>>> bigtop/slaves:1.2.1-$OS bash -l
> >>>>>> root@596ef2c638de:/# java -version
> >>>>>> openjdk version "1.8.0_131"
> >>>>>> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-0ubuntu1.
> >>>>>> 16.04.2-b11)
> >>>>>> OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
> >>>>>>
> >>>>>> Looks linked!
> >>>>>>
> >>>>>>
> >>>>>> 2017-07-26 3:02 GMT+08:00 Arnaud Launay <as...@launay.org>:
> >>>>>>
> >>>>>>> Le Wed, Jul 26, 2017 at 12:45:50AM +0800, Evans Ye a écrit:
> >>>>>>>> 1. Somehow packages on centos and debian changed. If we rebuild
> >>>>>>>> bigtop/slaves for trunk, then Solr will fail the same as what we
> >>> faced
> >>>>>>>> building with 1.2.1 images.
> >>>>>>>> 2. We've special tweaks for bigtop/slaves trunk images.
> >>>>>>>> Any thoughts?
> >>>>>>>
> >>>>>>> Check the java version, somehow the java docs whatever stuff
> >>>>>>> changed in 8.131, and solr doesn't compile anymore with java8
> >=131 .
> >>>>>>> Might be linked.
> >>>>>>>
> >>>>>>> Arnaud.
> >>>>>>>
> >>>>>>
> >>>>>>
> >>>
>
>
Re: Releasing 1.2.1
Posted by Olaf Flebbe <of...@oflebbe.de>.
Hi,
The failure of gpdb looks like a serious problem to me, see BIGTOP-2901
I am too for an +1 to disable this for 1.2.1
Thank you Evans for being still on track to release.
Olaf
> Am 03.10.2017 um 16:20 schrieb Konstantin Boudnik <co...@apache.org>:
>
> Well, if we can't fix it - let's nuke it. +1
> --
> With regards,
> Konstantin (Cos) Boudnik
> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
>
> Disclaimer: Opinions expressed in this email are those of the author,
> and do not necessarily represent the views of any company the author
> might be affiliated with at the moment of writing.
>
>
> On Tue, Oct 3, 2017 at 10:11 AM, Evans Ye <ev...@apache.org> wrote:
>> Thanks Olaf!
>> I see all the slaves images are now back to normal.
>>
>> I'll have a national holiday tomorrow and I'd like to spend it on Bigtop
>> 1.2.1 release.
>> Right now, we're blocked by two issues:
>>
>> Crunch build failed: https://issues.apache.org/jira/browse/BIGTOP-2900
>> GPDB build failed: https://issues.apache.org/jira/browse/BIGTOP-2901
>>
>> I've provided a workaround patch in BIGTOP-2900, however I have completely
>> no idea for BIGTOP-2901.
>> Since I've raised the problem few days ago, if no one has time to fix it,
>> I'd like to propose to disable GPDB in 1.2.1 release.
>> That means in 1.2.1 release there is no GPDB binary artifact available, but
>> we can still refine GPDB's quality in the master branch.
>>
>> How do you think?
>>
>>
>> 2017-09-26 5:16 GMT+08:00 Roman Shaposhnik <rv...@apache.org>:
>>
>>> Let me take a look today
>>>
>>> On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik <co...@apache.org>
>>> wrote:
>>>> Explicitly adding Rvs in the loop
>>>> --
>>>> With regards,
>>>> Konstantin (Cos) Boudnik
>>>> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
>>>>
>>>> Disclaimer: Opinions expressed in this email are those of the author,
>>>> and do not necessarily represent the views of any company the author
>>>> might be affiliated with at the moment of writing.
>>>>
>>>>
>>>> On Sat, Sep 23, 2017 at 12:24 PM, Evans Ye <ev...@apache.org> wrote:
>>>>> Hi Bigtoper,
>>>>>
>>>>> I'm working on the 1.2.1 release. Hopefully we can get it to the finish
>>>>> line by the end on Sept.
>>>>>
>>>>> Right now we still have a few issues blocking:
>>>>>
>>>>> 1. GPDB build failed on OpenSuSE 42.1[1]
>>>>> 2. Toolchain build failed on PPC64LE platform[2]
>>>>>
>>>>> I'll update more down the path. But right now I'd like to seek for some
>>>>> helps on GPDB and PPC64LE side ;)
>>>>>
>>>>>
>>>>> [1]. https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1/
>>>>> [2]. https://ci.bigtop.apache.org/view/Docker/job/Docker-
>>> Toolchain-1.2.1/
>>>>>
>>>>>
>>>>> 2017-07-26 11:24 GMT+08:00 Evans Ye <ev...@apache.org>:
>>>>>
>>>>>> Thanks, Arnaud
>>>>>>
>>>>>> [jenkins@ip bigtop-ubuntu-16.04]$ docker run -ti --rm
>>>>>> bigtop/slaves:1.2.1-$OS bash -l
>>>>>> root@596ef2c638de:/# java -version
>>>>>> openjdk version "1.8.0_131"
>>>>>> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-0ubuntu1.
>>>>>> 16.04.2-b11)
>>>>>> OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
>>>>>>
>>>>>> Looks linked!
>>>>>>
>>>>>>
>>>>>> 2017-07-26 3:02 GMT+08:00 Arnaud Launay <as...@launay.org>:
>>>>>>
>>>>>>> Le Wed, Jul 26, 2017 at 12:45:50AM +0800, Evans Ye a écrit:
>>>>>>>> 1. Somehow packages on centos and debian changed. If we rebuild
>>>>>>>> bigtop/slaves for trunk, then Solr will fail the same as what we
>>> faced
>>>>>>>> building with 1.2.1 images.
>>>>>>>> 2. We've special tweaks for bigtop/slaves trunk images.
>>>>>>>> Any thoughts?
>>>>>>>
>>>>>>> Check the java version, somehow the java docs whatever stuff
>>>>>>> changed in 8.131, and solr doesn't compile anymore with java8 >=131 .
>>>>>>> Might be linked.
>>>>>>>
>>>>>>> Arnaud.
>>>>>>>
>>>>>>
>>>>>>
>>>
Re: Releasing 1.2.1
Posted by Konstantin Boudnik <co...@apache.org>.
Well, if we can't fix it - let's nuke it. +1
--
With regards,
Konstantin (Cos) Boudnik
2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
Disclaimer: Opinions expressed in this email are those of the author,
and do not necessarily represent the views of any company the author
might be affiliated with at the moment of writing.
On Tue, Oct 3, 2017 at 10:11 AM, Evans Ye <ev...@apache.org> wrote:
> Thanks Olaf!
> I see all the slaves images are now back to normal.
>
> I'll have a national holiday tomorrow and I'd like to spend it on Bigtop
> 1.2.1 release.
> Right now, we're blocked by two issues:
>
> Crunch build failed: https://issues.apache.org/jira/browse/BIGTOP-2900
> GPDB build failed: https://issues.apache.org/jira/browse/BIGTOP-2901
>
> I've provided a workaround patch in BIGTOP-2900, however I have completely
> no idea for BIGTOP-2901.
> Since I've raised the problem few days ago, if no one has time to fix it,
> I'd like to propose to disable GPDB in 1.2.1 release.
> That means in 1.2.1 release there is no GPDB binary artifact available, but
> we can still refine GPDB's quality in the master branch.
>
> How do you think?
>
>
> 2017-09-26 5:16 GMT+08:00 Roman Shaposhnik <rv...@apache.org>:
>
>> Let me take a look today
>>
>> On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik <co...@apache.org>
>> wrote:
>> > Explicitly adding Rvs in the loop
>> > --
>> > With regards,
>> > Konstantin (Cos) Boudnik
>> > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622
>> >
>> > Disclaimer: Opinions expressed in this email are those of the author,
>> > and do not necessarily represent the views of any company the author
>> > might be affiliated with at the moment of writing.
>> >
>> >
>> > On Sat, Sep 23, 2017 at 12:24 PM, Evans Ye <ev...@apache.org> wrote:
>> >> Hi Bigtoper,
>> >>
>> >> I'm working on the 1.2.1 release. Hopefully we can get it to the finish
>> >> line by the end on Sept.
>> >>
>> >> Right now we still have a few issues blocking:
>> >>
>> >> 1. GPDB build failed on OpenSuSE 42.1[1]
>> >> 2. Toolchain build failed on PPC64LE platform[2]
>> >>
>> >> I'll update more down the path. But right now I'd like to seek for some
>> >> helps on GPDB and PPC64LE side ;)
>> >>
>> >>
>> >> [1]. https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1/
>> >> [2]. https://ci.bigtop.apache.org/view/Docker/job/Docker-
>> Toolchain-1.2.1/
>> >>
>> >>
>> >> 2017-07-26 11:24 GMT+08:00 Evans Ye <ev...@apache.org>:
>> >>
>> >>> Thanks, Arnaud
>> >>>
>> >>> [jenkins@ip bigtop-ubuntu-16.04]$ docker run -ti --rm
>> >>> bigtop/slaves:1.2.1-$OS bash -l
>> >>> root@596ef2c638de:/# java -version
>> >>> openjdk version "1.8.0_131"
>> >>> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-0ubuntu1.
>> >>> 16.04.2-b11)
>> >>> OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)
>> >>>
>> >>> Looks linked!
>> >>>
>> >>>
>> >>> 2017-07-26 3:02 GMT+08:00 Arnaud Launay <as...@launay.org>:
>> >>>
>> >>>> Le Wed, Jul 26, 2017 at 12:45:50AM +0800, Evans Ye a écrit:
>> >>>> > 1. Somehow packages on centos and debian changed. If we rebuild
>> >>>> > bigtop/slaves for trunk, then Solr will fail the same as what we
>> faced
>> >>>> > building with 1.2.1 images.
>> >>>> > 2. We've special tweaks for bigtop/slaves trunk images.
>> >>>> > Any thoughts?
>> >>>>
>> >>>> Check the java version, somehow the java docs whatever stuff
>> >>>> changed in 8.131, and solr doesn't compile anymore with java8 >=131 .
>> >>>> Might be linked.
>> >>>>
>> >>>> Arnaud.
>> >>>>
>> >>>
>> >>>
>>