You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@apache.org by sebb <se...@gmail.com> on 2010/01/09 15:30:44 UTC

What is the host config for Continuum?

Commons DBCP is getting some test failures, but so far these only
appear when using Continuum.

I don't get them on my WinXP system, nor on Hudson (tried master &
Ubuntu & Windows).

So it would be useful to know what the Continuum host is.

Re: What is the host config for Continuum?

Posted by sebb <se...@gmail.com>.
On 12/01/2010, Phil Steitz <ph...@gmail.com> wrote:
> sebb wrote:
>  > On 12/01/2010, Brett Porter <br...@apache.org> wrote:
>  >>  On 12/01/2010, at 6:03 AM, sebb wrote:
>  >>
>  >>  > Which version of Ubuntu?
>  >>
>  >>  8.04 LTS. Some of the JDKs are a bit older, which may be a cause.
>  >>
>  >>
>  >>  >
>  >>  > Is there perhaps a VMWare image I could use to try to debug the problem?
>  >>
>  >>
>  >> Only to copy the current one - though getting you a shell account with limited access might be better if that's necessary.
>  >>
>  >
>  > If that would allow running mvn and ant, and svn update, that might be
>  > a way forward. Ideally need to test using Java 1.6 and 1.5/1.4
>  >
>  >>  >
>  >>  > The slow turn-round on the Continuum server makes debugging it rather tedious.
>  >>
>  >>
>  >> Which aspect is slow - waiting for the default hourly schedule, or some other aspect?
>  >
>  > Waiting for the build to occur - it takes at least 3 hours for the
>  > build to turn round, even if the build is triggered manually. It's
>  > also really difficult to tell if the build has been triggered OK
>  > (though the email will show this).
>  >
>  >>  Which build result email are you concerned about? I can at least gather some more details first and see if we can narrow down the cause.
>  >>
>  >
>  > Unfortunately, the last 2 builds succeeded (just after I added a bit
>  > more debug!), but there have been several earlier failures, see:
>  >
>  > http://vmbuild.apache.org/continuum/buildResults.action?projectId=22&projectGroupId=22
>  >
>  > Note that the change in build 135 was very minor, and only affected a
>  > debug statement processed after the test completes, so cannot have
>  > fixed the problem:
>  >
>  > URL: http://svn.apache.org/viewvc?rev=897906&view=rev
>  > Log:
>  > More debug for Continuum fail
>
>
> As mentioned on Commons-dev, joes re-enabled NTP on the guest
>  (vmbuild) this weekend.  I don't know the details of how time
>  measurement gets messed up on loaded vmware guests, but it is
>  conceivable that this had something to do with it.

However, the following build failed:

http://vmbuild.apache.org/continuum/buildResult.action?projectId=22&projectGroupId=22&projectName=&buildId=267564

and this has

Start Time:  	 Jan 10, 2010 03:13:35 PM PST

which I think is after the NTP fix?

> >
>  > BTW, Phil Steitz has been trying to get an Ant Java 1.5 build going
>  > for Commons DBCP, but not having much luck so far.
>
>
> What it appears I am going to have to do for that is create a new
>  project group, as it seems
>
>  1) commons builds all inherit a maven build that is impossible to
>  selectively disable
>  2) having a maven build environment for one build and an Ant build
>  environment for a second build does not work.
>
>  So I guess I need Continuum karma to create a new project group to
>  house the ant build.
>
>
>  >
>  >>  - Brett
>  >>
>  >>
>  >>  --
>  >>  Brett Porter
>  >>  brett@apache.org
>  >>  http://brettporter.wordpress.com/
>  >>
>  >>
>  >>
>  >>
>  >>
>
>

Re: What is the host config for Continuum?

Posted by Brett Porter <br...@apache.org>.
Sorry for the delayed response to this.

On 12/01/2010, at 10:38 PM, Phil Steitz wrote:

>> 
>> BTW, Phil Steitz has been trying to get an Ant Java 1.5 build going
>> for Commons DBCP, but not having much luck so far.
> 
> What it appears I am going to have to do for that is create a new
> project group, as it seems
> 
> 1) commons builds all inherit a maven build that is impossible to
> selectively disable
> 2) having a maven build environment for one build and an Ant build
> environment for a second build does not work.
> 
> So I guess I need Continuum karma to create a new project group to
> house the ant build.

You should have that karma now. Let me know if there's anything I can do to help!

Cheers,
Brett

--
Brett Porter
brett@apache.org
http://brettporter.wordpress.com/





Re: What is the host config for Continuum?

Posted by Phil Steitz <ph...@gmail.com>.
sebb wrote:
> On 12/01/2010, Brett Porter <br...@apache.org> wrote:
>>  On 12/01/2010, at 6:03 AM, sebb wrote:
>>
>>  > Which version of Ubuntu?
>>
>>  8.04 LTS. Some of the JDKs are a bit older, which may be a cause.
>>
>>
>>  >
>>  > Is there perhaps a VMWare image I could use to try to debug the problem?
>>
>>
>> Only to copy the current one - though getting you a shell account with limited access might be better if that's necessary.
>>
> 
> If that would allow running mvn and ant, and svn update, that might be
> a way forward. Ideally need to test using Java 1.6 and 1.5/1.4
> 
>>  >
>>  > The slow turn-round on the Continuum server makes debugging it rather tedious.
>>
>>
>> Which aspect is slow - waiting for the default hourly schedule, or some other aspect?
> 
> Waiting for the build to occur - it takes at least 3 hours for the
> build to turn round, even if the build is triggered manually. It's
> also really difficult to tell if the build has been triggered OK
> (though the email will show this).
> 
>>  Which build result email are you concerned about? I can at least gather some more details first and see if we can narrow down the cause.
>>
> 
> Unfortunately, the last 2 builds succeeded (just after I added a bit
> more debug!), but there have been several earlier failures, see:
> 
> http://vmbuild.apache.org/continuum/buildResults.action?projectId=22&projectGroupId=22
> 
> Note that the change in build 135 was very minor, and only affected a
> debug statement processed after the test completes, so cannot have
> fixed the problem:
> 
> URL: http://svn.apache.org/viewvc?rev=897906&view=rev
> Log:
> More debug for Continuum fail

As mentioned on Commons-dev, joes re-enabled NTP on the guest
(vmbuild) this weekend.  I don't know the details of how time
measurement gets messed up on loaded vmware guests, but it is
conceivable that this had something to do with it.
> 
> BTW, Phil Steitz has been trying to get an Ant Java 1.5 build going
> for Commons DBCP, but not having much luck so far.

What it appears I am going to have to do for that is create a new
project group, as it seems

1) commons builds all inherit a maven build that is impossible to
selectively disable
2) having a maven build environment for one build and an Ant build
environment for a second build does not work.

So I guess I need Continuum karma to create a new project group to
house the ant build.

> 
>>  - Brett
>>
>>
>>  --
>>  Brett Porter
>>  brett@apache.org
>>  http://brettporter.wordpress.com/
>>
>>
>>
>>
>>


Re: What is the host config for Continuum?

Posted by sebb <se...@gmail.com>.
On 13/01/2010, Wendy Smoak <ws...@gmail.com> wrote:
> On Tue, Jan 12, 2010 at 5:04 PM, sebb <se...@gmail.com> wrote:
>  > I tried triggering Commons DBCP twice just now. It was already in the
>  > DEFAULT_BUILD_QUEUE, so I expected at least 1 other build to be added
>  > at the end of the queue, but there is no sign of another entry.
>
>
> If the project is already queued to build, a second entry for the same
>  project will not be added.
>
>  I've just tested it locally and not only is there nothing on the
>  screen when this happens, the log file is not informative either, you
>  just get a bunch of:
>  2010-01-12 17:31:23,638 [btpool0-9] INFO
>  org.apache.continuum.buildmanager.ParallelBuildsManager  - Project 1
>  is currently building in DEFAULT_BUILD_QUEUE .  I'll go open an issue
>  to complain...

I already opened CONTINUUM-2433 as I thnk you have seen.

>  You should, however, see a UI change for the *first* forced build.
>  The icon should change to 'queued build'.  I wouldn't object if
>  someone wanted to add a text confirmation though.

I don't see any icon change on the Project page.
This applies both when I use the "Build Now" button and when I use the
"Build" icon at the RHS of the Build Definitions list entry.

For some reason there are currently no builds active (a few minutes
ago there were loads).
So the icon (if any) should be "Building", not "Queued build", but
that does not appear on the Project page.

I do see the new entry on the "Build Results" page, which does have a
"Building" icon.

Now there is a huge queue again.

I tried Build Now again; DBCP it appears on the Queue page, but I
could not see a difference to the Project page - is the "Build" icon
supposed to change? - and of course it does not appear on the "Build
Results" page.


>  --
>
> Wendy
>

Re: What is the host config for Continuum?

Posted by Wendy Smoak <ws...@gmail.com>.
On Tue, Jan 12, 2010 at 5:04 PM, sebb <se...@gmail.com> wrote:
> I tried triggering Commons DBCP twice just now. It was already in the
> DEFAULT_BUILD_QUEUE, so I expected at least 1 other build to be added
> at the end of the queue, but there is no sign of another entry.

If the project is already queued to build, a second entry for the same
project will not be added.

I've just tested it locally and not only is there nothing on the
screen when this happens, the log file is not informative either, you
just get a bunch of:
2010-01-12 17:31:23,638 [btpool0-9] INFO
org.apache.continuum.buildmanager.ParallelBuildsManager  - Project 1
is currently building in DEFAULT_BUILD_QUEUE .  I'll go open an issue
to complain...

You should, however, see a UI change for the *first* forced build.
The icon should change to 'queued build'.  I wouldn't object if
someone wanted to add a text confirmation though.

-- 
Wendy

Re: What is the host config for Continuum?

Posted by sebb <se...@gmail.com>.
On 12/01/2010, Brett Porter <br...@apache.org> wrote:
>
>  On 12/01/2010, at 10:16 PM, sebb wrote:
>
>  >
>  > Waiting for the build to occur - it takes at least 3 hours for the
>  > build to turn round, even if the build is triggered manually.
>
>
> This should be alleviated as we remove projects no longer building on there, and upgrade to better distribute / parallelise the load.
>
>
>  > It's
>  > also really difficult to tell if the build has been triggered OK
>  > (though the email will show this)
>
>
> Not sure what you mean here - it should show queued until it gets its turn to run?
>

There is no confirmation from clicking the "Build Now" button.

It's not clear from the queue listing if the entry in the queue is
there because it was scheduled or because it was manually triggered.

I tried triggering Commons DBCP twice just now. It was already in the
DEFAULT_BUILD_QUEUE, so I expected at least 1 other build to be added
at the end of the queue, but there is no sign of another entry.

Clicking on a build entry in the queue takes one to the build results
for the project which is not all that useful.

The e-mailed result (if there is one) will show if the build was
scheduled or manually triggered.

>  >
>  >> Which build result email are you concerned about? I can at least gather some more details first and see if we can narrow down the cause.
>  >>
>  >
>  > Unfortunately, the last 2 builds succeeded (just after I added a bit
>  > more debug!), but there have been several earlier failures, see:
>
>
> So far it seems to be a timing issue related either to the clock skew or maybe load on the box at the time. Let's keep an eye on it and take a look if it fails in the same test again.
>
>
>  > BTW, Phil Steitz has been trying to get an Ant Java 1.5 build going
>  > for Commons DBCP, but not having much luck so far.
>
>
> I'll add that to the list once we get the projects cleaned up...
>
>
>  - Brett
>
>  --
>  Brett Porter
>  brett@apache.org
>  http://brettporter.wordpress.com/
>
>
>
>
>

Re: What is the host config for Continuum?

Posted by Brett Porter <br...@apache.org>.
On 12/01/2010, at 10:16 PM, sebb wrote:

> 
> Waiting for the build to occur - it takes at least 3 hours for the
> build to turn round, even if the build is triggered manually.

This should be alleviated as we remove projects no longer building on there, and upgrade to better distribute / parallelise the load.

> It's
> also really difficult to tell if the build has been triggered OK
> (though the email will show this)

Not sure what you mean here - it should show queued until it gets its turn to run?

> 
>> Which build result email are you concerned about? I can at least gather some more details first and see if we can narrow down the cause.
>> 
> 
> Unfortunately, the last 2 builds succeeded (just after I added a bit
> more debug!), but there have been several earlier failures, see:

So far it seems to be a timing issue related either to the clock skew or maybe load on the box at the time. Let's keep an eye on it and take a look if it fails in the same test again.

> BTW, Phil Steitz has been trying to get an Ant Java 1.5 build going
> for Commons DBCP, but not having much luck so far.

I'll add that to the list once we get the projects cleaned up...

- Brett

--
Brett Porter
brett@apache.org
http://brettporter.wordpress.com/





Re: What is the host config for Continuum?

Posted by sebb <se...@gmail.com>.
On 12/01/2010, Brett Porter <br...@apache.org> wrote:
>
>  On 12/01/2010, at 6:03 AM, sebb wrote:
>
>  > Which version of Ubuntu?
>
>  8.04 LTS. Some of the JDKs are a bit older, which may be a cause.
>
>
>  >
>  > Is there perhaps a VMWare image I could use to try to debug the problem?
>
>
> Only to copy the current one - though getting you a shell account with limited access might be better if that's necessary.
>

If that would allow running mvn and ant, and svn update, that might be
a way forward. Ideally need to test using Java 1.6 and 1.5/1.4

>  >
>  > The slow turn-round on the Continuum server makes debugging it rather tedious.
>
>
> Which aspect is slow - waiting for the default hourly schedule, or some other aspect?

Waiting for the build to occur - it takes at least 3 hours for the
build to turn round, even if the build is triggered manually. It's
also really difficult to tell if the build has been triggered OK
(though the email will show this).

>  Which build result email are you concerned about? I can at least gather some more details first and see if we can narrow down the cause.
>

Unfortunately, the last 2 builds succeeded (just after I added a bit
more debug!), but there have been several earlier failures, see:

http://vmbuild.apache.org/continuum/buildResults.action?projectId=22&projectGroupId=22

Note that the change in build 135 was very minor, and only affected a
debug statement processed after the test completes, so cannot have
fixed the problem:

URL: http://svn.apache.org/viewvc?rev=897906&view=rev
Log:
More debug for Continuum fail

BTW, Phil Steitz has been trying to get an Ant Java 1.5 build going
for Commons DBCP, but not having much luck so far.

>  - Brett
>
>
>  --
>  Brett Porter
>  brett@apache.org
>  http://brettporter.wordpress.com/
>
>
>
>
>

Re: What is the host config for Continuum?

Posted by Brett Porter <br...@apache.org>.
On 12/01/2010, at 6:03 AM, sebb wrote:

> Which version of Ubuntu?

8.04 LTS. Some of the JDKs are a bit older, which may be a cause.

> 
> Is there perhaps a VMWare image I could use to try to debug the problem?

Only to copy the current one - though getting you a shell account with limited access might be better if that's necessary.

> 
> The slow turn-round on the Continuum server makes debugging it rather tedious.

Which aspect is slow - waiting for the default hourly schedule, or some other aspect?

Which build result email are you concerned about? I can at least gather some more details first and see if we can narrow down the cause.

- Brett

--
Brett Porter
brett@apache.org
http://brettporter.wordpress.com/





Re: What is the host config for Continuum?

Posted by sebb <se...@gmail.com>.
Which version of Ubuntu?

Is there perhaps a VMWare image I could use to try to debug the problem?

The slow turn-round on the Continuum server makes debugging it rather tedious.
I've tried using Hudson but that does not fail.

On 10/01/2010, Brett Porter <br...@apache.org> wrote:
> It's Ubuntu as well. Let me know if I can help resolve them.
>
>
>  On 10/01/2010, at 1:30 AM, sebb wrote:
>
>  > Commons DBCP is getting some test failures, but so far these only
>  > appear when using Continuum.
>  >
>  > I don't get them on my WinXP system, nor on Hudson (tried master &
>  > Ubuntu & Windows).
>  >
>  > So it would be useful to know what the Continuum host is.
>
>
> --
>  Brett Porter
>  brett@apache.org
>  http://brettporter.wordpress.com/
>
>
>
>
>

Re: What is the host config for Continuum?

Posted by sebb <se...@gmail.com>.
Thanks!

Looks like the problem is due to timer resolution and/or scheduling;
I'm in the process of adding more debug timers to try and narrow down
the problem.

On 10/01/2010, Brett Porter <br...@apache.org> wrote:
> It's Ubuntu as well. Let me know if I can help resolve them.
>
>
>  On 10/01/2010, at 1:30 AM, sebb wrote:
>
>  > Commons DBCP is getting some test failures, but so far these only
>  > appear when using Continuum.
>  >
>  > I don't get them on my WinXP system, nor on Hudson (tried master &
>  > Ubuntu & Windows).
>  >
>  > So it would be useful to know what the Continuum host is.
>
>
> --
>  Brett Porter
>  brett@apache.org
>  http://brettporter.wordpress.com/
>
>
>
>
>

Re: What is the host config for Continuum?

Posted by Brett Porter <br...@apache.org>.
It's Ubuntu as well. Let me know if I can help resolve them.

On 10/01/2010, at 1:30 AM, sebb wrote:

> Commons DBCP is getting some test failures, but so far these only
> appear when using Continuum.
> 
> I don't get them on my WinXP system, nor on Hudson (tried master &
> Ubuntu & Windows).
> 
> So it would be useful to know what the Continuum host is.

--
Brett Porter
brett@apache.org
http://brettporter.wordpress.com/