You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Guodong Xu <gu...@linaro.org> on 2018/05/31 09:55:56 UTC
What is the procedure to update bigtop/slaves images in docker hub?
Hi,
May I know what is the procedure to update bigtop/slaves images in docker
hub? (https://hub.docker.com/r/bigtop/slaves/tags/)
As I checked today, the image for bigtop/slaves:trunk-ubuntu-16.04 was
uploaded 5 months ago, and in it, some component version was quite 'old'.
Eg. puppetlabs-apt v2.2.0
# puppet module list
/etc/puppet/modules
└── bigtop_toolchain (???)
/usr/share/puppet/modules
├── puppetlabs-apt (v2.2.0)
While BIGTOP-2774. gradlew toolchain does not work on Ubuntu 16.04.2/Puppet
3.8.5 #214
has updated it to at lease v2.4.0
Sorry if I am asking something stupid. I cann't find clue from what I read
https://cwiki.apache.org/confluence/display/BIGTOP/Index.
Thank you.
Best regards,
Guodong Xu
Re: What is the procedure to update bigtop/slaves images in docker hub?
Posted by Jun HE <ju...@apache.org>.
To use latest image you may try to build it locally.
See https://github.com/apache/bigtop/blob/master/build.gradle#L411 and
https://github.com/apache/bigtop/blob/master/build.gradle#L426
2018-05-31 19:06 GMT+08:00 Olaf Flebbe <of...@oflebbe.de>:
> The recommended way is to run the job https://ci.bigtop.apache.
> org/job/Docker-Toolchain-Trunk/
>
> I am merging a different report today, will trigger this job for testing
> and surely will surely trip over the inconsistencies you are mentioning.
>
> Olaf
>
> Am 31.05.2018 um 11:55 schrieb Guodong Xu guodong.xu@linaro.org>:
>
> Hi,
>
> May I know what is the procedure to update bigtop/slaves images in docker
> hub? (https://hub.docker.com/r/bigtop/slaves/tags/)
>
> As I checked today, the image for bigtop/slaves:trunk-ubuntu-16.04 was
> uploaded 5 months ago, and in it, some component version was quite 'old'.
> Eg. puppetlabs-apt v2.2.0
>
> # puppet module list
> /etc/puppet/modules
> └── bigtop_toolchain (???)
> /usr/share/puppet/modules
> ├── puppetlabs-apt (v2.2.0)
>
>
> While BIGTOP-2774. gradlew toolchain does not work on Ubuntu 16.04.2/Puppet
> 3.8.5 #214
> has updated it to at lease v2.4.0
>
> Sorry if I am asking something stupid. I cann't find clue from what I read
> https://cwiki.apache.org/confluence/display/BIGTOP/Index.
>
> Thank you.
>
> Best regards,
> Guodong Xu
>
>
>
Re: What is the procedure to update bigtop/slaves images in docker
hub?
Posted by Olaf Flebbe <of...@oflebbe.de>.
The recommended way is to run the job https://ci.bigtop.apache.org/job/Docker-Toolchain-Trunk/ <https://ci.bigtop.apache.org/job/Docker-Toolchain-Trunk/>
I am merging a different report today, will trigger this job for testing and surely will surely trip over the inconsistencies you are mentioning.
Olaf
> Am 31.05.2018 um 11:55 schrieb Guodong Xu guodong.xu@linaro.org>:
>
> Hi,
>
> May I know what is the procedure to update bigtop/slaves images in docker
> hub? (https://hub.docker.com/r/bigtop/slaves/tags/)
>
> As I checked today, the image for bigtop/slaves:trunk-ubuntu-16.04 was
> uploaded 5 months ago, and in it, some component version was quite 'old'.
> Eg. puppetlabs-apt v2.2.0
>
> # puppet module list
> /etc/puppet/modules
> └── bigtop_toolchain (???)
> /usr/share/puppet/modules
> ├── puppetlabs-apt (v2.2.0)
>
>
> While BIGTOP-2774. gradlew toolchain does not work on Ubuntu 16.04.2/Puppet
> 3.8.5 #214
> has updated it to at lease v2.4.0
>
> Sorry if I am asking something stupid. I cann't find clue from what I read
> https://cwiki.apache.org/confluence/display/BIGTOP/Index.
>
> Thank you.
>
> Best regards,
> Guodong Xu
Re: What is the procedure to update bigtop/slaves images in docker hub?
Posted by Guodong Xu <gu...@linaro.org>.
On Fri, Jun 1, 2018 at 1:30 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
>
> Hi,
>
> The procedure is to run the jobs
>
> https://ci.bigtop.apache.org/job/Docker-Puppet/
> which is essentially:
> cd docker/bigtop-puppet; ./build.sh trunk-$OS
> docker push bigtop/puppet:trunk-$OS
>
> and both
>
> https://ci.bigtop.apache.org/job/Docker-Toolchain-Trunk/
> https://ci.bigtop.apache.org/job/Docker-Toolchain-Trunk-Aarch64/
>
> Which are essentially doing
> ./gradlew -POS=$OS bigtop-slaves
> docker push bigtop/slaves:trunk-$OS
>
> I just did this.
>
> So what is exactly your problem ?
My concern is: should we have a routine procedure to upload (docker
push) bigtop/puppet and bigtop/slaves images to docker hub? Bigtop
master branch gets new commits almost every day, but docker images
were not updated at the same speed.
> Regarding puppetlabs-apt : We install this module in puppetize.sh for ubuntu from the ubuntu repository.
> So it staying on the version 2.2.0
>
I am new to Bigtop development. Apology for mistakes I made. I read
BIGTOP-2774 where Kengo modified puppet-modules.pp to enforce
puppetlabs-apt version 2.4.0 for Bigtop __deployment__ on Ubuntu
16.04. This makes me thought 2.4.0 was required to run 'gradlew
toolchain' too.
However, when building bigtop/puppet:trunk-ubuntu-16.04, and
bigtop/slaves:trunk-ubuntu-16.04, apt 2.4.0 is not necessary, the
default 2.2.0 works just well (As you pointed out).
> What is breaking what ?
>
So that's not a real issue. Sorry.
> There are obsolete pieceses in gradle (for instance gradle toolchain). I like to see patches to get this target removed ;-)
>
To remove this target, also we need to remove these mentioning of
'gradlew toolchain' in cwiki:
1. https://cwiki.apache.org/confluence/display/BIGTOP/How+to+build+Bigtop-trunk
2. https://cwiki.apache.org/confluence/display/BIGTOP/How+to+build+Bigtop-1.1
3. https://cwiki.apache.org/confluence/display/BIGTOP/How+to+build+Bigtop-1.0
Any other places to clean up?
-Guodong
> Regards,
> Olaf
>
>
>
> Am 31.05.2018 um 11:55 schrieb Guodong Xu <gu...@linaro.org>:
>
> Hi,
>
> May I know what is the procedure to update bigtop/slaves images in docker
> hub? (https://hub.docker.com/r/bigtop/slaves/tags/)
>
> As I checked today, the image for bigtop/slaves:trunk-ubuntu-16.04 was
> uploaded 5 months ago, and in it, some component version was quite 'old'.
> Eg. puppetlabs-apt v2.2.0
>
> # puppet module list
> /etc/puppet/modules
> └── bigtop_toolchain (???)
> /usr/share/puppet/modules
> ├── puppetlabs-apt (v2.2.0)
>
>
> While BIGTOP-2774. gradlew toolchain does not work on Ubuntu 16.04.2/Puppet
> 3.8.5 #214
> has updated it to at lease v2.4.0
>
> Sorry if I am asking something stupid. I cann't find clue from what I read
> https://cwiki.apache.org/confluence/display/BIGTOP/Index.
>
> Thank you.
>
> Best regards,
> Guodong Xu
>
>
Re: What is the procedure to update bigtop/slaves images in docker
hub?
Posted by Olaf Flebbe <of...@oflebbe.de>.
Hi,
The procedure is to run the jobs
https://ci.bigtop.apache.org/job/Docker-Puppet/ <https://ci.bigtop.apache.org/job/Docker-Puppet/>
which is essentially:
cd docker/bigtop-puppet; ./build.sh trunk-$OS
docker push bigtop/puppet:trunk-$OS
and both
https://ci.bigtop.apache.org/job/Docker-Toolchain-Trunk/ <https://ci.bigtop.apache.org/job/Docker-Toolchain-Trunk/>
https://ci.bigtop.apache.org/job/Docker-Toolchain-Trunk-Aarch64/
Which are essentially doing
./gradlew -POS=$OS bigtop-slaves
docker push bigtop/slaves:trunk-$OS
I just did this.
So what is exactly your problem ?
Regarding puppetlabs-apt : We install this module in puppetize.sh for ubuntu from the ubuntu repository.
So it staying on the version 2.2.0
What is breaking what ?
There are obsolete pieceses in gradle (for instance gradle toolchain). I like to see patches to get this target removed ;-)
Regards,
Olaf
> Am 31.05.2018 um 11:55 schrieb Guodong Xu <gu...@linaro.org>:
>
> Hi,
>
> May I know what is the procedure to update bigtop/slaves images in docker
> hub? (https://hub.docker.com/r/bigtop/slaves/tags/)
>
> As I checked today, the image for bigtop/slaves:trunk-ubuntu-16.04 was
> uploaded 5 months ago, and in it, some component version was quite 'old'.
> Eg. puppetlabs-apt v2.2.0
>
> # puppet module list
> /etc/puppet/modules
> └── bigtop_toolchain (???)
> /usr/share/puppet/modules
> ├── puppetlabs-apt (v2.2.0)
>
>
> While BIGTOP-2774. gradlew toolchain does not work on Ubuntu 16.04.2/Puppet
> 3.8.5 #214
> has updated it to at lease v2.4.0
>
> Sorry if I am asking something stupid. I cann't find clue from what I read
> https://cwiki.apache.org/confluence/display/BIGTOP/Index.
>
> Thank you.
>
> Best regards,
> Guodong Xu