You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Evans Ye <ev...@apache.org> on 2015/01/08 10:58:43 UTC
Dockerfiles to deliver BigTop build environment images
Hi BigTop,
Thanks for having bigtop_toolchain, now we can setup a bigtop build
environment by simply applying puppet manifests.
I think it will be great if we can provide build environment Docker image
for users.
The Dockerfile can leverage bigtop_toolchain to create the docker images
for different OS.
With this users will find that building their own Hadoop distro is so easy.
This can also be beneficial to our CI system without having every OS to
be prepared.
But this is just my thought, welcome yours.
Evans
Re: Dockerfiles to deliver BigTop build environment images
Posted by Konstantin Boudnik <co...@apache.org>.
On Mon, Jan 12, 2015 at 12:55AM, Evans Ye wrote:
> Oh, yes. I know.
> But I was assuming that the slaves are built by Dockerfiles.
> If so, we should have Dockerfiles in our repo.
+1 - having them checked in would benefit bigtop dev@ if not end-users.
Roman, would you be able to commit them to the source tree?
Cos
> Its reasonable for users to get build slaves from BigTop's dockerhub
> instead of to build them from Dockerfiles.
> So I'm ok with it if we don't provide Dockerfiles.
> I just want to make sure my understanding wasn't wrong :)
>
> Thanks,
> Evans
>
> 2015-01-10 5:46 GMT+08:00 Konstantin Boudnik <co...@apache.org>:
>
> > What Roman said. I am using these images on my laptop when I need to
> > quickly
> > spin-off a clean environment and not to care about soiling my own system.
> >
> > Cos
> >
> > On Thu, Jan 08, 2015 at 05:58PM, Evans Ye wrote:
> > > Hi BigTop,
> > >
> > > Thanks for having bigtop_toolchain, now we can setup a bigtop build
> > > environment by simply applying puppet manifests.
> > > I think it will be great if we can provide build environment Docker image
> > > for users.
> > > The Dockerfile can leverage bigtop_toolchain to create the docker images
> > > for different OS.
> > > With this users will find that building their own Hadoop distro is so
> > easy.
> > > This can also be beneficial to our CI system without having every OS to
> > > be prepared.
> > > But this is just my thought, welcome yours.
> > >
> > > Evans
> >
Re: Dockerfiles to deliver BigTop build environment images
Posted by Evans Ye <ev...@apache.org>.
Oh, yes. I know.
But I was assuming that the slaves are built by Dockerfiles.
If so, we should have Dockerfiles in our repo.
Its reasonable for users to get build slaves from BigTop's dockerhub
instead of to build them from Dockerfiles.
So I'm ok with it if we don't provide Dockerfiles.
I just want to make sure my understanding wasn't wrong :)
Thanks,
Evans
2015-01-10 5:46 GMT+08:00 Konstantin Boudnik <co...@apache.org>:
> What Roman said. I am using these images on my laptop when I need to
> quickly
> spin-off a clean environment and not to care about soiling my own system.
>
> Cos
>
> On Thu, Jan 08, 2015 at 05:58PM, Evans Ye wrote:
> > Hi BigTop,
> >
> > Thanks for having bigtop_toolchain, now we can setup a bigtop build
> > environment by simply applying puppet manifests.
> > I think it will be great if we can provide build environment Docker image
> > for users.
> > The Dockerfile can leverage bigtop_toolchain to create the docker images
> > for different OS.
> > With this users will find that building their own Hadoop distro is so
> easy.
> > This can also be beneficial to our CI system without having every OS to
> > be prepared.
> > But this is just my thought, welcome yours.
> >
> > Evans
>
Re: Dockerfiles to deliver BigTop build environment images
Posted by Konstantin Boudnik <co...@apache.org>.
What Roman said. I am using these images on my laptop when I need to quickly
spin-off a clean environment and not to care about soiling my own system.
Cos
On Thu, Jan 08, 2015 at 05:58PM, Evans Ye wrote:
> Hi BigTop,
>
> Thanks for having bigtop_toolchain, now we can setup a bigtop build
> environment by simply applying puppet manifests.
> I think it will be great if we can provide build environment Docker image
> for users.
> The Dockerfile can leverage bigtop_toolchain to create the docker images
> for different OS.
> With this users will find that building their own Hadoop distro is so easy.
> This can also be beneficial to our CI system without having every OS to
> be prepared.
> But this is just my thought, welcome yours.
>
> Evans
Re: Dockerfiles to deliver BigTop build environment images
Posted by Evans Ye <ev...@apache.org>.
Oh, that would be fantastic!
I guess I was missing on the party.
The jira seems to be pretty much ready instead of being formed as a patch,
right?
I would be happy to have it, or doing the test.
Look forward to the awesome feature!
2015-01-08 22:49 GMT+08:00 Roman Shaposhnik <ro...@shaposhnik.org>:
> We actually already have that:
> https://registry.hub.docker.com/u/bigtop/slaves/tags/manage/
>
> And the the discussion and attachment to:
> https://issues.apache.org/jira/browse/BIGTOP-1323
>
> I still need to hook the images builds to our CI, but I should
> be able to do this shortly.
>
> All, in all, the following totally works:
>
> https://issues.apache.org/jira/browse/BIGTOP-1323?focusedCommentId=14055731&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14055731
>
> Thanks,
> Roman.
>
> On Thu, Jan 8, 2015 at 1:58 AM, Evans Ye <ev...@apache.org> wrote:
> > Hi BigTop,
> >
> > Thanks for having bigtop_toolchain, now we can setup a bigtop build
> > environment by simply applying puppet manifests.
> > I think it will be great if we can provide build environment Docker image
> > for users.
> > The Dockerfile can leverage bigtop_toolchain to create the docker images
> > for different OS.
> > With this users will find that building their own Hadoop distro is so
> easy.
> > This can also be beneficial to our CI system without having every OS to
> > be prepared.
> > But this is just my thought, welcome yours.
> >
> > Evans
>
Re: Dockerfiles to deliver BigTop build environment images
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
We actually already have that:
https://registry.hub.docker.com/u/bigtop/slaves/tags/manage/
And the the discussion and attachment to:
https://issues.apache.org/jira/browse/BIGTOP-1323
I still need to hook the images builds to our CI, but I should
be able to do this shortly.
All, in all, the following totally works:
https://issues.apache.org/jira/browse/BIGTOP-1323?focusedCommentId=14055731&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14055731
Thanks,
Roman.
On Thu, Jan 8, 2015 at 1:58 AM, Evans Ye <ev...@apache.org> wrote:
> Hi BigTop,
>
> Thanks for having bigtop_toolchain, now we can setup a bigtop build
> environment by simply applying puppet manifests.
> I think it will be great if we can provide build environment Docker image
> for users.
> The Dockerfile can leverage bigtop_toolchain to create the docker images
> for different OS.
> With this users will find that building their own Hadoop distro is so easy.
> This can also be beneficial to our CI system without having every OS to
> be prepared.
> But this is just my thought, welcome yours.
>
> Evans