You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@apache.org by Thomas Bouron <tb...@apache.org> on 2017/10/30 09:27:22 UTC
Jenkins slave able to build BED & RPM
Hi.
I'm looking to enable DEB & RPM package builds for SNAPSHOT versions of Apache Brooklyn. We currently build only the DEB (on an ubuntu slave) but I couldn't find any other slave running debian-like distro with RPM installed
Are you aware of any?
Thanks.
Best.
Re: Jenkins slave able to build BED & RPM
Posted by Thomas Bouron <tb...@apache.org>.
Thanks for all your replies. Created custom docker images with freestyle job on Jenkins and it works great. It was actually easier than I expected.
I now need to do this for all our builds.
Cheers.
On 2017-10-30 17:58, Allen Wittenauer <aw...@effectivemachines.com> wrote:
>
> > On Oct 30, 2017, at 4:33 AM, Dominik Psenner <dp...@gmail.com> wrote:
> >
> >
> > On 2017-10-30 11:57, Thomas Bouron wrote:
> >> Thanks for the reply and links. Went already to [1] but it wasn't clear to me what distro each node was (unless going through every one of them but... there are a lot) As you said, it seems there isn't a centos or Red Hat slave, I'll file a request to INFRA for this then.
> >
> > You also have the option to run the build with docker on ubuntu using a centos docker image. I think it would be wise to evaluate that option before filing a request to INFRA. The great benefit is that you can build an rpm and test a built rpm on all the rhel flavored docker images that you would like to support without the requirement to add additional operating systems or hardware to the zoo of build slaves.
>
> +1
>
> Despite the issues[*], Iâm looking forward to a day when INFRA brings the hammer down and requires everyone to use Docker on the Linux machines. Iâve spent the past week looking at why the Jenkins bits have become so unstable on the âHadoopâ nodes. One thing that is obvious is that the jobs running in containers are way easier to manage from the outside. They donât leave processes hanging about and provides enough hooks to make sure jobs are getting a âfair shareâ of the nodeâs resources. Bad actor? Kill the entire container. Bam, gone. Thatâs before even removing the need to ask for software to be installed. [No need for 900 different versions of Java installed if everyone manages their ownâ¦]
>
> * - mainly, disk space management and docker-compose creating a complete mess of things.
Re: Jenkins slave able to build BED & RPM
Posted by Allen Wittenauer <aw...@effectivemachines.com>.
> On Oct 30, 2017, at 4:33 AM, Dominik Psenner <dp...@gmail.com> wrote:
>
>
> On 2017-10-30 11:57, Thomas Bouron wrote:
>> Thanks for the reply and links. Went already to [1] but it wasn't clear to me what distro each node was (unless going through every one of them but... there are a lot) As you said, it seems there isn't a centos or Red Hat slave, I'll file a request to INFRA for this then.
>
> You also have the option to run the build with docker on ubuntu using a centos docker image. I think it would be wise to evaluate that option before filing a request to INFRA. The great benefit is that you can build an rpm and test a built rpm on all the rhel flavored docker images that you would like to support without the requirement to add additional operating systems or hardware to the zoo of build slaves.
+1
Despite the issues[*], I’m looking forward to a day when INFRA brings the hammer down and requires everyone to use Docker on the Linux machines. I’ve spent the past week looking at why the Jenkins bits have become so unstable on the ‘Hadoop’ nodes. One thing that is obvious is that the jobs running in containers are way easier to manage from the outside. They don’t leave processes hanging about and provides enough hooks to make sure jobs are getting a ‘fair share’ of the node’s resources. Bad actor? Kill the entire container. Bam, gone. That’s before even removing the need to ask for software to be installed. [No need for 900 different versions of Java installed if everyone manages their own…]
* - mainly, disk space management and docker-compose creating a complete mess of things.
Re: Jenkins slave able to build BED & RPM
Posted by Dominik Psenner <dp...@gmail.com>.
On 2017-10-30 11:57, Thomas Bouron wrote:
> Hi Dominik
>
> Thanks for the reply and links. Went already to [1] but it wasn't clear to me what distro each node was (unless going through every one of them but... there are a lot) As you said, it seems there isn't a centos or Red Hat slave, I'll file a request to INFRA for this then.
You also have the option to run the build with docker on ubuntu using a
centos docker image. I think it would be wise to evaluate that option
before filing a request to INFRA. The great benefit is that you can
build an rpm and test a built rpm on all the rhel flavored docker images
that you would like to support without the requirement to add additional
operating systems or hardware to the zoo of build slaves.
>
> PS: I'm asking the RPM binary to build RPM only, not use RPM packages on Debian (that would be mad indeed) and for ease of use: would be simpler for us to build everything in one go rather than having a special jenkins jobs to build only the RPM.
My preference is to split targets into different stages and to run the
build of those stages on the targeted operating system along with the
tests for the targeted operating system. Jenkins makes the development
of such build pipelines rather easy.
>
> Best.
>
> On 2017-10-30 10:27, Dominik Psenner <dp...@gmail.com> wrote:
>> Hi Thomas,
>>
>> RPM is a red hat package manager package and in my eyes it is a bad idea
>> to install such packages on a debian flavored distribution.
>>
>> There seems to be no red hat flavored linux distribution (fedora,
>> centos, rhel, mandriva, ..) in the row of build slaves, probably because
>> you are the first who needs it [1]. I assume you would have to file an
>> INFRA ticket to get such a build slave. Alternatively you could try to
>> run a red hat flavored distribution docker image on an ubuntu build
>> slave. There are for instance official centos docker images on docker
>> hub [2].
>>
>> Cheers,
>> Dominik
>>
>> [1] https://builds.apache.org/computer/
>> [2] https://hub.docker.com/_/centos/
>>
>> On 2017-10-30 10:27, Thomas Bouron wrote:
>>> Hi.
>>>
>>> I'm looking to enable DEB & RPM package builds for SNAPSHOT versions of Apache Brooklyn. We currently build only the DEB (on an ubuntu slave) but I couldn't find any other slave running debian-like distro with RPM installed
>>>
>>> Are you aware of any?
>>>
>>> Thanks.
>>>
>>> Best.
>>
Re: Jenkins slave able to build BED & RPM
Posted by Thomas Bouron <tb...@apache.org>.
Hi Dominik
Thanks for the reply and links. Went already to [1] but it wasn't clear to me what distro each node was (unless going through every one of them but... there are a lot) As you said, it seems there isn't a centos or Red Hat slave, I'll file a request to INFRA for this then.
PS: I'm asking the RPM binary to build RPM only, not use RPM packages on Debian (that would be mad indeed) and for ease of use: would be simpler for us to build everything in one go rather than having a special jenkins jobs to build only the RPM.
Best.
On 2017-10-30 10:27, Dominik Psenner <dp...@gmail.com> wrote:
> Hi Thomas,
>
> RPM is a red hat package manager package and in my eyes it is a bad idea
> to install such packages on a debian flavored distribution.
>
> There seems to be no red hat flavored linux distribution (fedora,
> centos, rhel, mandriva, ..) in the row of build slaves, probably because
> you are the first who needs it [1]. I assume you would have to file an
> INFRA ticket to get such a build slave. Alternatively you could try to
> run a red hat flavored distribution docker image on an ubuntu build
> slave. There are for instance official centos docker images on docker
> hub [2].
>
> Cheers,
> Dominik
>
> [1] https://builds.apache.org/computer/
> [2] https://hub.docker.com/_/centos/
>
> On 2017-10-30 10:27, Thomas Bouron wrote:
> > Hi.
> >
> > I'm looking to enable DEB & RPM package builds for SNAPSHOT versions of Apache Brooklyn. We currently build only the DEB (on an ubuntu slave) but I couldn't find any other slave running debian-like distro with RPM installed
> >
> > Are you aware of any?
> >
> > Thanks.
> >
> > Best.
>
>
Re: Jenkins slave able to build BED & RPM
Posted by Dominik Psenner <dp...@gmail.com>.
Hi Thomas,
RPM is a red hat package manager package and in my eyes it is a bad idea
to install such packages on a debian flavored distribution.
There seems to be no red hat flavored linux distribution (fedora,
centos, rhel, mandriva, ..) in the row of build slaves, probably because
you are the first who needs it [1]. I assume you would have to file an
INFRA ticket to get such a build slave. Alternatively you could try to
run a red hat flavored distribution docker image on an ubuntu build
slave. There are for instance official centos docker images on docker
hub [2].
Cheers,
Dominik
[1] https://builds.apache.org/computer/
[2] https://hub.docker.com/_/centos/
On 2017-10-30 10:27, Thomas Bouron wrote:
> Hi.
>
> I'm looking to enable DEB & RPM package builds for SNAPSHOT versions of Apache Brooklyn. We currently build only the DEB (on an ubuntu slave) but I couldn't find any other slave running debian-like distro with RPM installed
>
> Are you aware of any?
>
> Thanks.
>
> Best.