You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@apache.org by Ulrich Stärk <ul...@apache.org> on 2011/02/02 10:24:58 UTC
rsync daemon on hudson slave?
We'd like to copy the maven-generated site and javadocs from our builds to our public website. Right
now the only way to do this is by having a shell account on the slave machine the build is running
on and running rsync over ssh. Since this should be done automatically we'd have to store a private
key for ssh authentication on people.a.o which is something I don't like security-wise.
Would it be possible to set up rsync in daemon mode on the slave so that we can copy the artifacts
without a shell accout on the build slave and without storing private keys on people.a.o? This could
be set up as read-only and only allow connections from people.a.o...
The job in question is tapestry-trunk-docs running on vesta (ubuntu2).
Uli
Re: rsync daemon on hudson slave?
Posted by Joe Schaefer <jo...@yahoo.com>.
----- Original Message ----
> From: Daniel Kulp <dk...@apache.org>
> To: builds@apache.org
> Cc: Joe Schaefer <jo...@yahoo.com>
> Sent: Thu, March 3, 2011 10:36:14 AM
> Subject: Re: rsync daemon on hudson slave?
>
> On Thursday 03 March 2011 10:20:37 AM Joe Schaefer wrote:
> > Why doesn't someone roll up their sleeves and teach maven to
> > build things in a way that's compatible with the CMS builds?
>
> Why doesn't someone roll up their sleeves and teach the CMS to build things in
>
> a way that's compatible with the way Maven builds things? :-)
Because Unix design principles and maven's design have nothing in
common. I meant it when I wrote that bit about there being a full
Unix environment to program the CMS in. Pity that's lost on most
people at Apache.
>
> Dan
>
>
>
>
> >
> >
> >
> > ----- Original Message ----
> >
> > > From: Ulrich Stärk <ul...@apache.org>
> > > To: builds@apache.org
> > > Sent: Thu, March 3, 2011 10:15:13 AM
> > > Subject: Re: rsync daemon on hudson slave?
> > >
> > > Yet another tool just for some special aspect of our builds...
> > >
> > > Uli
> > >
> > > On 03.03.2011 16:00, Jukka Zitting wrote:
> > > > Hi,
> > > >
> > > > 2011/3/3 Niklas Gustavsson <ni...@protocol7.com>:
> > > >> Not sure how we would restrict anyone with access to Jenkins from
> > > >>
> > > >> running any job on such a slave. We would need to find a way for
> > > >> only
> > > >>
> > > >> Jenkins admins to tie jobs to that slave.
> > > >
> > > > One alternative would be to run such site build jobs only on Buildbot,
> > > > as there the commit account setup has already been done. AFAIUI the
> > > > site builds are fairly straightforward, so there should be no need
for
> > > > all the extra features Jenkins has over Buildbot.
> > > >
> > > > BR,
> > > >
> > > > Jukka Zitting
>
> --
> Daniel Kulp
> dkulp@apache.org
> http://dankulp.com/blog
> Talend - http://www.talend.com
>
Re: rsync daemon on hudson slave?
Posted by Daniel Kulp <dk...@apache.org>.
On Thursday 03 March 2011 10:20:37 AM Joe Schaefer wrote:
> Why doesn't someone roll up their sleeves and teach maven to
> build things in a way that's compatible with the CMS builds?
Why doesn't someone roll up their sleeves and teach the CMS to build things in
a way that's compatible with the way Maven builds things? :-)
Dan
>
>
>
> ----- Original Message ----
>
> > From: Ulrich Stärk <ul...@apache.org>
> > To: builds@apache.org
> > Sent: Thu, March 3, 2011 10:15:13 AM
> > Subject: Re: rsync daemon on hudson slave?
> >
> > Yet another tool just for some special aspect of our builds...
> >
> > Uli
> >
> > On 03.03.2011 16:00, Jukka Zitting wrote:
> > > Hi,
> > >
> > > 2011/3/3 Niklas Gustavsson <ni...@protocol7.com>:
> > >> Not sure how we would restrict anyone with access to Jenkins from
> > >>
> > >> running any job on such a slave. We would need to find a way for
> > >> only
> > >>
> > >> Jenkins admins to tie jobs to that slave.
> > >
> > > One alternative would be to run such site build jobs only on Buildbot,
> > > as there the commit account setup has already been done. AFAIUI the
> > > site builds are fairly straightforward, so there should be no need for
> > > all the extra features Jenkins has over Buildbot.
> > >
> > > BR,
> > >
> > > Jukka Zitting
--
Daniel Kulp
dkulp@apache.org
http://dankulp.com/blog
Talend - http://www.talend.com
Re: rsync daemon on hudson slave?
Posted by Joe Schaefer <jo...@yahoo.com>.
Well then just write the corresponding perl glue (in view.pm),
tell me what ports you need installing on the cms, and bingo
you get maven integration with the cms. No building .pdf
next to .html files, but that's the only restriction I see
from http://www.apache.org/dev/cms.html
----- Original Message ----
> From: Scott O'Bryan <da...@gmail.com>
> To: "builds@apache.org" <bu...@apache.org>
> Cc: Niklas Gustavsson <ni...@protocol7.com>
> Sent: Thu, March 3, 2011 10:32:37 AM
> Subject: Re: rsync daemon on hudson slave?
>
> It is..
>
> On Mar 3, 2011, at 8:30 AM, Joe Schaefer <jo...@yahoo.com> wrote:
>
> > It needs to be capable of building individual files.
> > That's it.
> >
> >
> >
> > ----- Original Message ----
> >> From: Niklas Gustavsson <ni...@protocol7.com>
> >> To: builds@apache.org
> >> Cc: Joe Schaefer <jo...@yahoo.com>
> >> Sent: Thu, March 3, 2011 10:27:22 AM
> >> Subject: Re: rsync daemon on hudson slave?
> >>
> >> On Thu, Mar 3, 2011 at 4:20 PM, Joe Schaefer <jo...@yahoo.com>
>wrote:
> >>> Why doesn't someone roll up their sleeves and teach maven to
> >>> build things in a way that's compatible with the CMS builds?
> >>
> >> What would be needed?
> >>
> >> /niklas
> >>
> >
> >
> >
>
Re: rsync daemon on hudson slave?
Posted by Scott O'Bryan <da...@gmail.com>.
It is..
On Mar 3, 2011, at 8:30 AM, Joe Schaefer <jo...@yahoo.com> wrote:
> It needs to be capable of building individual files.
> That's it.
>
>
>
> ----- Original Message ----
>> From: Niklas Gustavsson <ni...@protocol7.com>
>> To: builds@apache.org
>> Cc: Joe Schaefer <jo...@yahoo.com>
>> Sent: Thu, March 3, 2011 10:27:22 AM
>> Subject: Re: rsync daemon on hudson slave?
>>
>> On Thu, Mar 3, 2011 at 4:20 PM, Joe Schaefer <jo...@yahoo.com> wrote:
>>> Why doesn't someone roll up their sleeves and teach maven to
>>> build things in a way that's compatible with the CMS builds?
>>
>> What would be needed?
>>
>> /niklas
>>
>
>
>
Re: rsync daemon on hudson slave?
Posted by Joe Schaefer <jo...@yahoo.com>.
It needs to be capable of building individual files.
That's it.
----- Original Message ----
> From: Niklas Gustavsson <ni...@protocol7.com>
> To: builds@apache.org
> Cc: Joe Schaefer <jo...@yahoo.com>
> Sent: Thu, March 3, 2011 10:27:22 AM
> Subject: Re: rsync daemon on hudson slave?
>
> On Thu, Mar 3, 2011 at 4:20 PM, Joe Schaefer <jo...@yahoo.com> wrote:
> > Why doesn't someone roll up their sleeves and teach maven to
> > build things in a way that's compatible with the CMS builds?
>
> What would be needed?
>
> /niklas
>
Re: rsync daemon on hudson slave?
Posted by Niklas Gustavsson <ni...@protocol7.com>.
On Thu, Mar 3, 2011 at 4:20 PM, Joe Schaefer <jo...@yahoo.com> wrote:
> Why doesn't someone roll up their sleeves and teach maven to
> build things in a way that's compatible with the CMS builds?
What would be needed?
/niklas
Re: rsync daemon on hudson slave?
Posted by Joe Schaefer <jo...@yahoo.com>.
Why doesn't someone roll up their sleeves and teach maven to
build things in a way that's compatible with the CMS builds?
----- Original Message ----
> From: Ulrich Stärk <ul...@apache.org>
> To: builds@apache.org
> Sent: Thu, March 3, 2011 10:15:13 AM
> Subject: Re: rsync daemon on hudson slave?
>
> Yet another tool just for some special aspect of our builds...
>
> Uli
>
> On 03.03.2011 16:00, Jukka Zitting wrote:
> > Hi,
> >
> > 2011/3/3 Niklas Gustavsson <ni...@protocol7.com>:
> >> Not sure how we would restrict anyone with access to Jenkins from
> >> running any job on such a slave. We would need to find a way for only
> >> Jenkins admins to tie jobs to that slave.
> >
> > One alternative would be to run such site build jobs only on Buildbot,
> > as there the commit account setup has already been done. AFAIUI the
> > site builds are fairly straightforward, so there should be no need for
> > all the extra features Jenkins has over Buildbot.
> >
> > BR,
> >
> > Jukka Zitting
>
Re: rsync daemon on hudson slave?
Posted by Ulrich Stärk <ul...@apache.org>.
Yet another tool just for some special aspect of our builds...
Uli
On 03.03.2011 16:00, Jukka Zitting wrote:
> Hi,
>
> 2011/3/3 Niklas Gustavsson <ni...@protocol7.com>:
>> Not sure how we would restrict anyone with access to Jenkins from
>> running any job on such a slave. We would need to find a way for only
>> Jenkins admins to tie jobs to that slave.
>
> One alternative would be to run such site build jobs only on Buildbot,
> as there the commit account setup has already been done. AFAIUI the
> site builds are fairly straightforward, so there should be no need for
> all the extra features Jenkins has over Buildbot.
>
> BR,
>
> Jukka Zitting
Re: rsync daemon on hudson slave?
Posted by Jukka Zitting <ju...@gmail.com>.
Hi,
2011/3/3 Niklas Gustavsson <ni...@protocol7.com>:
> Not sure how we would restrict anyone with access to Jenkins from
> running any job on such a slave. We would need to find a way for only
> Jenkins admins to tie jobs to that slave.
One alternative would be to run such site build jobs only on Buildbot,
as there the commit account setup has already been done. AFAIUI the
site builds are fairly straightforward, so there should be no need for
all the extra features Jenkins has over Buildbot.
BR,
Jukka Zitting
Re: rsync daemon on hudson slave?
Posted by Niklas Gustavsson <ni...@protocol7.com>.
On Thu, Mar 3, 2011 at 3:42 PM, Daniel Kulp <dk...@apache.org> wrote:
> Basically, buildbot is setup like this, I'm just asking what it would take to
> get a Jenkins slave to be setup as well.
Not sure how we would restrict anyone with access to Jenkins from
running any job on such a slave. We would need to find a way for only
Jenkins admins to tie jobs to that slave.
/niklas
Re: rsync daemon on hudson slave?
Posted by Daniel Kulp <dk...@apache.org>.
On Thursday 03 March 2011 9:35:00 AM Ulrich Stärk wrote:
> I always had the impression that stored credentials, be it cached SVN
> credentials or private keys in people's home dirs, was strongly
> discouraged.
I didn't say in the home dirs on p.a.o. I'm talking about a fairly locked
down build slave that really only has a single "user" account: the jenkins
build account. It would be a unique user id (like buildbots) that can be
locked down in svn to only be able to commit to very particular locations
(like the exported site area, not to any code locations, not even the site
source locations).
Basically, buildbot is setup like this, I'm just asking what it would take to
get a Jenkins slave to be setup as well.
Dan
> Otherwise I could just have requested an account on vesta and
> copied the stuff over to people with a private key stored in my home dir
> on people (see my mail from 2011/02/02). This is why I started this whole
> thread in the first place...
>
> Uli
>
> On 03.03.2011 15:23, Daniel Kulp wrote:
> > On Thursday 03 March 2011 8:33:21 AM Jukka Zitting wrote:
> >> Hi,
> >>
> >> On Thu, Mar 3, 2011 at 2:30 PM, Ulrich Stärk <ul...@apache.org> wrote:
> >>> The only thing that seems reasonable apart from having an rsync daemon
> >>> is doing a recursive wget on the generated site every hour or so. This
> >>> will however fetch all 4000 files and I don't know how much load it
> >>> puts on Jenkins. Is this OK?
> >>
> >> Doesn't sound like a very good approach.
> >>
> >> The Apache CMS setup running on Buildbot simply commits the generated
> >> site to svn from where it's picked up by the public web servers. I
> >> guess a similar setup could be done also with Maven site builds
> >> running in Hudson.
> >
> > That's kind of what I was thinking. If buildbot has creds stored
> > someplace to be able to run "svn commit", could one of the Jenkins build
> > slaves (doesn't need to be all of them) also have svn installed with
> > stored creds?
> >
> > I don't even think it needs to be built into Jenkins itself. If svn is
> > installed, the build itself (exec plugin or something) could run "svn
> > commit - m 'Web site update'" or something.
> >
> > I think a bunch of projects might be willing to flip to more of a
> > svnpubsub publish if we could get Jenkins builds to do it. That could
> > reduce some load on the rsyncs on p.a.o.
--
Daniel Kulp
dkulp@apache.org
http://dankulp.com/blog
Talend - http://www.talend.com
Re: rsync daemon on hudson slave?
Posted by Ulrich Stärk <ul...@apache.org>.
I always had the impression that stored credentials, be it cached SVN credentials or private keys in
people's home dirs, was strongly discouraged. Otherwise I could just have requested an account on
vesta and copied the stuff over to people with a private key stored in my home dir on people (see my
mail from 2011/02/02). This is why I started this whole thread in the first place...
Uli
On 03.03.2011 15:23, Daniel Kulp wrote:
> On Thursday 03 March 2011 8:33:21 AM Jukka Zitting wrote:
>> Hi,
>>
>> On Thu, Mar 3, 2011 at 2:30 PM, Ulrich Stärk <ul...@apache.org> wrote:
>>> The only thing that seems reasonable apart from having an rsync daemon is
>>> doing a recursive wget on the generated site every hour or so. This will
>>> however fetch all 4000 files and I don't know how much load it puts on
>>> Jenkins. Is this OK?
>>
>> Doesn't sound like a very good approach.
>>
>> The Apache CMS setup running on Buildbot simply commits the generated
>> site to svn from where it's picked up by the public web servers. I
>> guess a similar setup could be done also with Maven site builds
>> running in Hudson.
>
> That's kind of what I was thinking. If buildbot has creds stored someplace
> to be able to run "svn commit", could one of the Jenkins build slaves (doesn't
> need to be all of them) also have svn installed with stored creds?
>
> I don't even think it needs to be built into Jenkins itself. If svn is
> installed, the build itself (exec plugin or something) could run "svn commit -
> m 'Web site update'" or something.
>
> I think a bunch of projects might be willing to flip to more of a svnpubsub
> publish if we could get Jenkins builds to do it. That could reduce some load
> on the rsyncs on p.a.o.
>
>
Re: rsync daemon on hudson slave?
Posted by Daniel Kulp <dk...@apache.org>.
On Thursday 03 March 2011 8:33:21 AM Jukka Zitting wrote:
> Hi,
>
> On Thu, Mar 3, 2011 at 2:30 PM, Ulrich Stärk <ul...@apache.org> wrote:
> > The only thing that seems reasonable apart from having an rsync daemon is
> > doing a recursive wget on the generated site every hour or so. This will
> > however fetch all 4000 files and I don't know how much load it puts on
> > Jenkins. Is this OK?
>
> Doesn't sound like a very good approach.
>
> The Apache CMS setup running on Buildbot simply commits the generated
> site to svn from where it's picked up by the public web servers. I
> guess a similar setup could be done also with Maven site builds
> running in Hudson.
That's kind of what I was thinking. If buildbot has creds stored someplace
to be able to run "svn commit", could one of the Jenkins build slaves (doesn't
need to be all of them) also have svn installed with stored creds?
I don't even think it needs to be built into Jenkins itself. If svn is
installed, the build itself (exec plugin or something) could run "svn commit -
m 'Web site update'" or something.
I think a bunch of projects might be willing to flip to more of a svnpubsub
publish if we could get Jenkins builds to do it. That could reduce some load
on the rsyncs on p.a.o.
--
Daniel Kulp
dkulp@apache.org
http://dankulp.com/blog
Talend - http://www.talend.com
Re: rsync daemon on hudson slave?
Posted by Scott O'Bryan <da...@gmail.com>.
Sorry, to be clear it uses post-build targets to create the archive.
On Mar 3, 2011, at 6:41 AM, Scott O'Bryan <da...@gmail.com> wrote:
> Well, mine isn't completely done yet (the tar.gz is not correct and
> some other things) but the myfaces-trinidad-site job has a working
> principal for downloading as a cron job. It pulls the sites source
> into a staging directory and packages it up during the build. It then
> stores the tar.gz as an artifact so it's always available and only
> updated on a successful build.
>
> I hope to have it done and generating a valid archive soon, but feel
> free to take a look at it if you like. I figured a gzipped archive
> was convenient enough to wget.
>
> Scott
>
> On Mar 3, 2011, at 6:34 AM, Jukka Zitting <ju...@gmail.com> wrote:
>
>> Hi,
>>
>> On Thu, Mar 3, 2011 at 2:30 PM, Ulrich Stärk <ul...@apache.org> wrote:
>>> The only thing that seems reasonable apart from having an rsync daemon is doing a recursive wget on
>>> the generated site every hour or so. This will however fetch all 4000 files and I don't know how
>>> much load it puts on Jenkins. Is this OK?
>>
>> Doesn't sound like a very good approach.
>>
>> The Apache CMS setup running on Buildbot simply commits the generated
>> site to svn from where it's picked up by the public web servers. I
>> guess a similar setup could be done also with Maven site builds
>> running in Hudson.
>>
>> BR,
>>
>> Jukka Zitting
Re: rsync daemon on hudson slave?
Posted by Scott O'Bryan <da...@gmail.com>.
Well, mine isn't completely done yet (the tar.gz is not correct and
some other things) but the myfaces-trinidad-site job has a working
principal for downloading as a cron job. It pulls the sites source
into a staging directory and packages it up during the build. It then
stores the tar.gz as an artifact so it's always available and only
updated on a successful build.
I hope to have it done and generating a valid archive soon, but feel
free to take a look at it if you like. I figured a gzipped archive
was convenient enough to wget.
Scott
On Mar 3, 2011, at 6:34 AM, Jukka Zitting <ju...@gmail.com> wrote:
> Hi,
>
> On Thu, Mar 3, 2011 at 2:30 PM, Ulrich Stärk <ul...@apache.org> wrote:
>> The only thing that seems reasonable apart from having an rsync daemon is doing a recursive wget on
>> the generated site every hour or so. This will however fetch all 4000 files and I don't know how
>> much load it puts on Jenkins. Is this OK?
>
> Doesn't sound like a very good approach.
>
> The Apache CMS setup running on Buildbot simply commits the generated
> site to svn from where it's picked up by the public web servers. I
> guess a similar setup could be done also with Maven site builds
> running in Hudson.
>
> BR,
>
> Jukka Zitting
Re: rsync daemon on hudson slave?
Posted by Ulrich Stärk <ul...@apache.org>.
How would that work? Have Jenkins commit the generated site to SVN and have the webservers pick it
up with svnpubsub from there? Is there support for committing the site back to SVN in Jenkins?
Uli
On 03.03.2011 14:33, Jukka Zitting wrote:
> Hi,
>
> On Thu, Mar 3, 2011 at 2:30 PM, Ulrich Stärk <ul...@apache.org> wrote:
>> The only thing that seems reasonable apart from having an rsync daemon is doing a recursive wget on
>> the generated site every hour or so. This will however fetch all 4000 files and I don't know how
>> much load it puts on Jenkins. Is this OK?
>
> Doesn't sound like a very good approach.
>
> The Apache CMS setup running on Buildbot simply commits the generated
> site to svn from where it's picked up by the public web servers. I
> guess a similar setup could be done also with Maven site builds
> running in Hudson.
>
> BR,
>
> Jukka Zitting
Re: rsync daemon on hudson slave?
Posted by Jukka Zitting <ju...@gmail.com>.
Hi,
On Thu, Mar 3, 2011 at 2:30 PM, Ulrich Stärk <ul...@apache.org> wrote:
> The only thing that seems reasonable apart from having an rsync daemon is doing a recursive wget on
> the generated site every hour or so. This will however fetch all 4000 files and I don't know how
> much load it puts on Jenkins. Is this OK?
Doesn't sound like a very good approach.
The Apache CMS setup running on Buildbot simply commits the generated
site to svn from where it's picked up by the public web servers. I
guess a similar setup could be done also with Maven site builds
running in Hudson.
BR,
Jukka Zitting
Re: rsync daemon on hudson slave?
Posted by Ulrich Stärk <ul...@apache.org>.
The only thing that seems reasonable apart from having an rsync daemon is doing a recursive wget on
the generated site every hour or so. This will however fetch all 4000 files and I don't know how
much load it puts on Jenkins. Is this OK?
Uli
On 02.02.2011 19:52, Scott O'Bryan wrote:
> Yeah. I agree with the rsync.. I would like a way to allow Hudson to PUSH after a build of a
> website, but I don't think people are to keen on that. If you find a solution, please post it here..
>
> On 02/02/2011 07:52 AM, Ulrich Stärk wrote:
>> Basically yes, although using rsync feels more naturally to me.
>>
>> I just tried downloading the workspace as a zip file but it takes ages. So practically this isn't
>> going to work.
>>
>> Uli
>>
>> On 02.02.2011 11:34, Scott O'Bryan wrote:
>>> Hey Uli,
>>>
>>> I've been tinkering with an idea for the myfaces Portlet Bridge
>>> project. The Hudson UI will allow you to retrieve a set of artifacts
>>> in zip format using a well defined URL. I was toying with the idea of
>>> using a script to wget the data as an archive, unarchiving it, and
>>> then moving it to the right directories.
>>>
>>> Would something like that work?
>>>
>>> On Feb 2, 2011, at 2:25 AM, "Ulrich Stärk"<ul...@apache.org> wrote:
>>>
>>>> We'd like to copy the maven-generated site and javadocs from our builds to our public website.
>>>> Right now the only way to do this is by having a shell account on the slave machine the build is
>>>> running on and running rsync over ssh. Since this should be done automatically we'd have to
>>>> store a private key for ssh authentication on people.a.o which is something I don't like
>>>> security-wise.
>>>>
>>>> Would it be possible to set up rsync in daemon mode on the slave so that we can copy the
>>>> artifacts without a shell accout on the build slave and without storing private keys on
>>>> people.a.o? This could be set up as read-only and only allow connections from people.a.o...
>>>>
>>>> The job in question is tapestry-trunk-docs running on vesta (ubuntu2).
>>>>
>>>> Uli
>
Re: rsync daemon on hudson slave?
Posted by Scott O'Bryan <da...@gmail.com>.
Yeah. I agree with the rsync.. I would like a way to allow Hudson to
PUSH after a build of a website, but I don't think people are to keen on
that. If you find a solution, please post it here..
On 02/02/2011 07:52 AM, Ulrich Stärk wrote:
> Basically yes, although using rsync feels more naturally to me.
>
> I just tried downloading the workspace as a zip file but it takes
> ages. So practically this isn't going to work.
>
> Uli
>
> On 02.02.2011 11:34, Scott O'Bryan wrote:
>> Hey Uli,
>>
>> I've been tinkering with an idea for the myfaces Portlet Bridge
>> project. The Hudson UI will allow you to retrieve a set of artifacts
>> in zip format using a well defined URL. I was toying with the idea of
>> using a script to wget the data as an archive, unarchiving it, and
>> then moving it to the right directories.
>>
>> Would something like that work?
>>
>> On Feb 2, 2011, at 2:25 AM, "Ulrich Stärk"<ul...@apache.org> wrote:
>>
>>> We'd like to copy the maven-generated site and javadocs from our
>>> builds to our public website. Right now the only way to do this is
>>> by having a shell account on the slave machine the build is running
>>> on and running rsync over ssh. Since this should be done
>>> automatically we'd have to store a private key for ssh
>>> authentication on people.a.o which is something I don't like
>>> security-wise.
>>>
>>> Would it be possible to set up rsync in daemon mode on the slave so
>>> that we can copy the artifacts without a shell accout on the build
>>> slave and without storing private keys on people.a.o? This could be
>>> set up as read-only and only allow connections from people.a.o...
>>>
>>> The job in question is tapestry-trunk-docs running on vesta (ubuntu2).
>>>
>>> Uli
Re: rsync daemon on hudson slave?
Posted by Niklas Gustavsson <ni...@protocol7.com>.
On Wed, Feb 2, 2011 at 3:52 PM, Ulrich Stärk <ul...@apache.org> wrote:
> I just tried downloading the workspace as a zip file but it takes ages. So
> practically this isn't going to work.
It will grab the workspace from a client, via the master which takes
ages (and uses a lot of CPU on master).
With regards to rsync, I'll wait for one of the infra guys to reply as
I'm not familiar enough with the pros and cons.
/niklas
Re: rsync daemon on hudson slave?
Posted by Ulrich Stärk <ul...@apache.org>.
Basically yes, although using rsync feels more naturally to me.
I just tried downloading the workspace as a zip file but it takes ages. So practically this isn't
going to work.
Uli
On 02.02.2011 11:34, Scott O'Bryan wrote:
> Hey Uli,
>
> I've been tinkering with an idea for the myfaces Portlet Bridge
> project. The Hudson UI will allow you to retrieve a set of artifacts
> in zip format using a well defined URL. I was toying with the idea of
> using a script to wget the data as an archive, unarchiving it, and
> then moving it to the right directories.
>
> Would something like that work?
>
> On Feb 2, 2011, at 2:25 AM, "Ulrich Stärk"<ul...@apache.org> wrote:
>
>> We'd like to copy the maven-generated site and javadocs from our builds to our public website. Right now the only way to do this is by having a shell account on the slave machine the build is running on and running rsync over ssh. Since this should be done automatically we'd have to store a private key for ssh authentication on people.a.o which is something I don't like security-wise.
>>
>> Would it be possible to set up rsync in daemon mode on the slave so that we can copy the artifacts without a shell accout on the build slave and without storing private keys on people.a.o? This could be set up as read-only and only allow connections from people.a.o...
>>
>> The job in question is tapestry-trunk-docs running on vesta (ubuntu2).
>>
>> Uli
Re: rsync daemon on hudson slave?
Posted by Scott O'Bryan <da...@gmail.com>.
Hey Uli,
I've been tinkering with an idea for the myfaces Portlet Bridge
project. The Hudson UI will allow you to retrieve a set of artifacts
in zip format using a well defined URL. I was toying with the idea of
using a script to wget the data as an archive, unarchiving it, and
then moving it to the right directories.
Would something like that work?
On Feb 2, 2011, at 2:25 AM, "Ulrich Stärk" <ul...@apache.org> wrote:
> We'd like to copy the maven-generated site and javadocs from our builds to our public website. Right now the only way to do this is by having a shell account on the slave machine the build is running on and running rsync over ssh. Since this should be done automatically we'd have to store a private key for ssh authentication on people.a.o which is something I don't like security-wise.
>
> Would it be possible to set up rsync in daemon mode on the slave so that we can copy the artifacts without a shell accout on the build slave and without storing private keys on people.a.o? This could be set up as read-only and only allow connections from people.a.o...
>
> The job in question is tapestry-trunk-docs running on vesta (ubuntu2).
>
> Uli