You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@subversion.apache.org by Gavin McDonald <gm...@apache.org> on 2022/01/16 11:53:53 UTC

Re: Re: Buildbot Migration

Please note I have closed https://issues.apache.org/jira/browse/INFRA-22277 as Incomplete.

When you are ready to connect new nodes to ci2.apache.org please open a new INFRA ticket 

Gav...

On 2021/12/28 16:04:03 Gavin McDonald wrote:
> Hi All,
> 
> Seems the config subversion.conf on the old ci.apache.org has been broken since August. Rather than fix, I have disabled all jobs on ci.apache.org so we can concentrate on this migration effort of enabling subversion.py for ci2.apache.org.
> 
> HTH
> 
> On 2021/11/10 18:32:53 Gavin McDonald wrote:
> > Great thanks, let me know if I can help
> > 
> > On 2021/11/10 13:18:42 Bert Huijben wrote:
> > > Hi Gavin,
> > > 
> > > I will see what I can do for the win32 Subversion bots. I recently upgraded
> > > them to a new VM, but it took some effort to get the old buildbot scripts
> > > up and running again.
> > > 
> > > 
> > > On Tue, Nov 9, 2021 at 12:07 PM Gavin McDonald <gm...@apache.org> wrote:
> > > 
> > > > Hi All.
> > > >
> > > > Getting back to this : https://issues.apache.org/jira/browse/INFRA-22277
> > > >
> > > > I'd like for the owner(s) of the mentioned nodes to upgrade and then
> > > > contact me so we can get them hooked up to the new controller.
> > > >
> > > > TY
> > > >
> > > 
> > 
>

RE: Buildbot Migration

Posted by Gavin McDonald <gm...@apache.org>.


On 2022/04/22 08:52:14 Gavin McDonald wrote:
> This is great, thank you
> 
> I'll work on enabling your builds and the ubuntu ones today.
> 
> That leaves mac
> 
> I see in our logs that svn-x64-macosx-dgvrs is trying to connect to ci2.apache.org - who owns that ? I thought it was dead. I can send creds to the owner of that - if it is running a recent Buildbot version.

Does anyone admit to owning this? It is really making our logs very noisy trying to connect every few seconds.


> 
> Gav...
> 
> 
> On 2022/04/22 07:48:12 Bert Huijben wrote:
> > 	Hi Gavin,
> > 
> > Thanks. The buildbots report that they are attached now:
> > 
> > [[
> > 2022-04-22 09:43:03+0200 [-] recording hostname in twistd.hostname
> > 2022-04-22 09:43:03+0200 [-] Starting factory <buildbot_worker.pb.BotFactory object at 0x0000021A74600EB0>
> > 2022-04-22 09:43:03+0200 [Broker,client] message from master: attached
> > 2022-04-22 09:43:03+0200 [Broker,client] I have a leftover directory 'svn-local' that is not being used by the buildmaster: you can delete it now
> > 2022-04-22 09:43:03+0200 [Broker,client] I have a leftover directory 'svn-test-run' that is not being used by the buildmaster: you can delete it now
> > 2022-04-22 09:43:03+0200 [Broker,client] Connected to buildmaster; worker is ready
> > 2022-04-22 09:43:03+0200 [Broker,client] sending application-level keepalives every 600 seconds
> > ]]
> > 
> > Looks like the next step would be to re-enable the builds in the Subversion config. 
> > 
> > Nathan do you want to look at that? Or anybody else?
> > (I see that the Subversion config is renamed to .disabled and I assume quite a few builds don't apply any more)
> > 
> > Otherwise I will look into this, next weekend.
> > 
> > Thanks,
> > 	Bert!
> > 
> > -----Original Message-----
> > From: Gavin McDonald <gm...@apache.org> 
> > Sent: Thursday, April 21, 2022 10:18 PM
> > To: dev@subversion.apache.org
> > Subject: RE: Buildbot Migration
> > 
> > Hi Bert,
> > 
> > I emailed you some new connection details a few hours ago, let me know if your workers can connect and I'll see about enabling those jobs.
> > 
> > I have also changed the config for the ubuntu jobs to use asf hardware.
> > 
> > That leaves the mac builds - if nobody can source a mac I'll see what I can do my end
> > 
> > Gav...
> > 
> > 
> > On 2022/04/14 11:08:40 Bert Huijben wrote:
> > > I upgraded the win32 buildbots to python 3.10 and new buildbot and they now try to connect to buildbot using the old credentials, but fail as the server doesn't expect the bot to connect.
> > > 
> > > Can somebody try to obtain new credentials for or re-enable the old credentials, so I can continue getting this SlikSvn sponsored bot back up.
> > > 
> > > 
> > > 
> > > Thanks,
> > > 	Bert
> > > 
> > > -----Original Message-----
> > > From: Nathan Hartman <ha...@gmail.com>
> > > Sent: Sunday, April 10, 2022 5:33 PM
> > > To: Subversion Developers <de...@subversion.apache.org>
> > > Subject: Re: Buildbot Migration
> > > 
> > > On Tue, Jan 18, 2022 at 10:52 AM Nathan Hartman <ha...@gmail.com> wrote:
> > > >
> > > > On Tue, Jan 18, 2022 at 10:45 AM Nathan Hartman 
> > > > <ha...@gmail.com> wrote:
> > > > >
> > > > > On Sun, Jan 16, 2022 at 3:56 PM Branko Čibej <br...@apache.org> wrote:
> > > > > >
> > > > > > On 16.01.2022 18:33, Nathan Hartman wrote:
> > > > > (snip)
> > > > > > > Are "svn-w2k3-local" and "svn-x64-macosx-dgvrs" currently the 
> > > > > > > only nonexistent nodes referenced by this script?
> > > > > >
> > > > > > Existent but not upgraded, at least in the case of the mac mini.
> > > > > >
> > > > > > Someday ...
> > > > >
> > > > > All the more reason to activate whatever is ready now and add 
> > > > > others back if/when they are ready. I'll go ahead and request to do that...
> > > >
> > > > That's filed under INFRA-22761...
> > > 
> > > 
> > > As part of the recent migration from buildbot 0.8 to 3.2 and ci.a.o to ci2.a.o, we have had no buildbots since late last year.
> > > 
> > > I think most of our buildbot configs should be able to run on 3.2, except for svn-w2k3-local and svn-x64-macosx-dgvrs, so as a stopgap measure, I tried commenting the aforementioned two and activating the config by renaming [3] to remove the "-disabled" suffix.
> > > 
> > > However, Gavin McDonald comments on INFRA-22761: "I'm afraid we still can not activate this config. There are no agents in which any of the builders can use at this point."
> > > 
> > > Any ideas what we should do to get some buildbots back online?
> > > 
> > > [1] https://issues.apache.org/jira/browse/INFRA-22277
> > > 
> > > [2] https://issues.apache.org/jira/browse/INFRA-22761
> > > 
> > > [3] 
> > > https://svn.apache.org/repos/infra/infrastructure/buildbot2/projects/s
> > > ubversion.py
> > > 
> > > Cheers,
> > > Nathan
> > > 
> > > 
> > 
> > 
>

RE: Buildbot Migration

Posted by Gavin McDonald <gm...@apache.org>.

backport builds are passing now.

https://ci2.apache.org/#/builders/109/builds/5

https://ci2.apache.org/#/builders/107/builds/5

On 2022/04/22 12:29:09 Gavin McDonald wrote:
> Is there a list of software somewhere I need to install on the Ubuntu workers?
> 
> 
> 
> On 2022/04/22 10:35:12 Gavin McDonald wrote:
> > I have enabled all but the mac jobs, you can see them listed here.
> > 
> > https://ci2.apache.org/#/builders
> > 
> > I still need to enable the uploading to nightlies.apache.org , will do that a bit later.
> > 
> > Gav...
> > 
> > 
> > On 2022/04/22 08:52:14 Gavin McDonald wrote:
> > > This is great, thank you
> > > 
> > > I'll work on enabling your builds and the ubuntu ones today.
> > > 
> > > That leaves mac
> > > 
> > > I see in our logs that svn-x64-macosx-dgvrs is trying to connect to ci2.apache.org - who owns that ? I thought it was dead. I can send creds to the owner of that - if it is running a recent Buildbot version.
> > > 
> > > Gav...
> > > 
> > > 
> > > On 2022/04/22 07:48:12 Bert Huijben wrote:
> > > > 	Hi Gavin,
> > > > 
> > > > Thanks. The buildbots report that they are attached now:
> > > > 
> > > > [[
> > > > 2022-04-22 09:43:03+0200 [-] recording hostname in twistd.hostname
> > > > 2022-04-22 09:43:03+0200 [-] Starting factory <buildbot_worker.pb.BotFactory object at 0x0000021A74600EB0>
> > > > 2022-04-22 09:43:03+0200 [Broker,client] message from master: attached
> > > > 2022-04-22 09:43:03+0200 [Broker,client] I have a leftover directory 'svn-local' that is not being used by the buildmaster: you can delete it now
> > > > 2022-04-22 09:43:03+0200 [Broker,client] I have a leftover directory 'svn-test-run' that is not being used by the buildmaster: you can delete it now
> > > > 2022-04-22 09:43:03+0200 [Broker,client] Connected to buildmaster; worker is ready
> > > > 2022-04-22 09:43:03+0200 [Broker,client] sending application-level keepalives every 600 seconds
> > > > ]]
> > > > 
> > > > Looks like the next step would be to re-enable the builds in the Subversion config. 
> > > > 
> > > > Nathan do you want to look at that? Or anybody else?
> > > > (I see that the Subversion config is renamed to .disabled and I assume quite a few builds don't apply any more)
> > > > 
> > > > Otherwise I will look into this, next weekend.
> > > > 
> > > > Thanks,
> > > > 	Bert!
> > > > 
> > > > -----Original Message-----
> > > > From: Gavin McDonald <gm...@apache.org> 
> > > > Sent: Thursday, April 21, 2022 10:18 PM
> > > > To: dev@subversion.apache.org
> > > > Subject: RE: Buildbot Migration
> > > > 
> > > > Hi Bert,
> > > > 
> > > > I emailed you some new connection details a few hours ago, let me know if your workers can connect and I'll see about enabling those jobs.
> > > > 
> > > > I have also changed the config for the ubuntu jobs to use asf hardware.
> > > > 
> > > > That leaves the mac builds - if nobody can source a mac I'll see what I can do my end
> > > > 
> > > > Gav...
> > > > 
> > > > 
> > > > On 2022/04/14 11:08:40 Bert Huijben wrote:
> > > > > I upgraded the win32 buildbots to python 3.10 and new buildbot and they now try to connect to buildbot using the old credentials, but fail as the server doesn't expect the bot to connect.
> > > > > 
> > > > > Can somebody try to obtain new credentials for or re-enable the old credentials, so I can continue getting this SlikSvn sponsored bot back up.
> > > > > 
> > > > > 
> > > > > 
> > > > > Thanks,
> > > > > 	Bert
> > > > > 
> > > > > -----Original Message-----
> > > > > From: Nathan Hartman <ha...@gmail.com>
> > > > > Sent: Sunday, April 10, 2022 5:33 PM
> > > > > To: Subversion Developers <de...@subversion.apache.org>
> > > > > Subject: Re: Buildbot Migration
> > > > > 
> > > > > On Tue, Jan 18, 2022 at 10:52 AM Nathan Hartman <ha...@gmail.com> wrote:
> > > > > >
> > > > > > On Tue, Jan 18, 2022 at 10:45 AM Nathan Hartman 
> > > > > > <ha...@gmail.com> wrote:
> > > > > > >
> > > > > > > On Sun, Jan 16, 2022 at 3:56 PM Branko Čibej <br...@apache.org> wrote:
> > > > > > > >
> > > > > > > > On 16.01.2022 18:33, Nathan Hartman wrote:
> > > > > > > (snip)
> > > > > > > > > Are "svn-w2k3-local" and "svn-x64-macosx-dgvrs" currently the 
> > > > > > > > > only nonexistent nodes referenced by this script?
> > > > > > > >
> > > > > > > > Existent but not upgraded, at least in the case of the mac mini.
> > > > > > > >
> > > > > > > > Someday ...
> > > > > > >
> > > > > > > All the more reason to activate whatever is ready now and add 
> > > > > > > others back if/when they are ready. I'll go ahead and request to do that...
> > > > > >
> > > > > > That's filed under INFRA-22761...
> > > > > 
> > > > > 
> > > > > As part of the recent migration from buildbot 0.8 to 3.2 and ci.a.o to ci2.a.o, we have had no buildbots since late last year.
> > > > > 
> > > > > I think most of our buildbot configs should be able to run on 3.2, except for svn-w2k3-local and svn-x64-macosx-dgvrs, so as a stopgap measure, I tried commenting the aforementioned two and activating the config by renaming [3] to remove the "-disabled" suffix.
> > > > > 
> > > > > However, Gavin McDonald comments on INFRA-22761: "I'm afraid we still can not activate this config. There are no agents in which any of the builders can use at this point."
> > > > > 
> > > > > Any ideas what we should do to get some buildbots back online?
> > > > > 
> > > > > [1] https://issues.apache.org/jira/browse/INFRA-22277
> > > > > 
> > > > > [2] https://issues.apache.org/jira/browse/INFRA-22761
> > > > > 
> > > > > [3] 
> > > > > https://svn.apache.org/repos/infra/infrastructure/buildbot2/projects/s
> > > > > ubversion.py
> > > > > 
> > > > > Cheers,
> > > > > Nathan
> > > > > 
> > > > > 
> > > > 
> > > > 
> > > 
> > 
>

RE: Buildbot Migration

Posted by Gavin McDonald <gm...@apache.org>.

Is there a list of software somewhere I need to install on the Ubuntu workers?



On 2022/04/22 10:35:12 Gavin McDonald wrote:
> I have enabled all but the mac jobs, you can see them listed here.
> 
> https://ci2.apache.org/#/builders
> 
> I still need to enable the uploading to nightlies.apache.org , will do that a bit later.
> 
> Gav...
> 
> 
> On 2022/04/22 08:52:14 Gavin McDonald wrote:
> > This is great, thank you
> > 
> > I'll work on enabling your builds and the ubuntu ones today.
> > 
> > That leaves mac
> > 
> > I see in our logs that svn-x64-macosx-dgvrs is trying to connect to ci2.apache.org - who owns that ? I thought it was dead. I can send creds to the owner of that - if it is running a recent Buildbot version.
> > 
> > Gav...
> > 
> > 
> > On 2022/04/22 07:48:12 Bert Huijben wrote:
> > > 	Hi Gavin,
> > > 
> > > Thanks. The buildbots report that they are attached now:
> > > 
> > > [[
> > > 2022-04-22 09:43:03+0200 [-] recording hostname in twistd.hostname
> > > 2022-04-22 09:43:03+0200 [-] Starting factory <buildbot_worker.pb.BotFactory object at 0x0000021A74600EB0>
> > > 2022-04-22 09:43:03+0200 [Broker,client] message from master: attached
> > > 2022-04-22 09:43:03+0200 [Broker,client] I have a leftover directory 'svn-local' that is not being used by the buildmaster: you can delete it now
> > > 2022-04-22 09:43:03+0200 [Broker,client] I have a leftover directory 'svn-test-run' that is not being used by the buildmaster: you can delete it now
> > > 2022-04-22 09:43:03+0200 [Broker,client] Connected to buildmaster; worker is ready
> > > 2022-04-22 09:43:03+0200 [Broker,client] sending application-level keepalives every 600 seconds
> > > ]]
> > > 
> > > Looks like the next step would be to re-enable the builds in the Subversion config. 
> > > 
> > > Nathan do you want to look at that? Or anybody else?
> > > (I see that the Subversion config is renamed to .disabled and I assume quite a few builds don't apply any more)
> > > 
> > > Otherwise I will look into this, next weekend.
> > > 
> > > Thanks,
> > > 	Bert!
> > > 
> > > -----Original Message-----
> > > From: Gavin McDonald <gm...@apache.org> 
> > > Sent: Thursday, April 21, 2022 10:18 PM
> > > To: dev@subversion.apache.org
> > > Subject: RE: Buildbot Migration
> > > 
> > > Hi Bert,
> > > 
> > > I emailed you some new connection details a few hours ago, let me know if your workers can connect and I'll see about enabling those jobs.
> > > 
> > > I have also changed the config for the ubuntu jobs to use asf hardware.
> > > 
> > > That leaves the mac builds - if nobody can source a mac I'll see what I can do my end
> > > 
> > > Gav...
> > > 
> > > 
> > > On 2022/04/14 11:08:40 Bert Huijben wrote:
> > > > I upgraded the win32 buildbots to python 3.10 and new buildbot and they now try to connect to buildbot using the old credentials, but fail as the server doesn't expect the bot to connect.
> > > > 
> > > > Can somebody try to obtain new credentials for or re-enable the old credentials, so I can continue getting this SlikSvn sponsored bot back up.
> > > > 
> > > > 
> > > > 
> > > > Thanks,
> > > > 	Bert
> > > > 
> > > > -----Original Message-----
> > > > From: Nathan Hartman <ha...@gmail.com>
> > > > Sent: Sunday, April 10, 2022 5:33 PM
> > > > To: Subversion Developers <de...@subversion.apache.org>
> > > > Subject: Re: Buildbot Migration
> > > > 
> > > > On Tue, Jan 18, 2022 at 10:52 AM Nathan Hartman <ha...@gmail.com> wrote:
> > > > >
> > > > > On Tue, Jan 18, 2022 at 10:45 AM Nathan Hartman 
> > > > > <ha...@gmail.com> wrote:
> > > > > >
> > > > > > On Sun, Jan 16, 2022 at 3:56 PM Branko Čibej <br...@apache.org> wrote:
> > > > > > >
> > > > > > > On 16.01.2022 18:33, Nathan Hartman wrote:
> > > > > > (snip)
> > > > > > > > Are "svn-w2k3-local" and "svn-x64-macosx-dgvrs" currently the 
> > > > > > > > only nonexistent nodes referenced by this script?
> > > > > > >
> > > > > > > Existent but not upgraded, at least in the case of the mac mini.
> > > > > > >
> > > > > > > Someday ...
> > > > > >
> > > > > > All the more reason to activate whatever is ready now and add 
> > > > > > others back if/when they are ready. I'll go ahead and request to do that...
> > > > >
> > > > > That's filed under INFRA-22761...
> > > > 
> > > > 
> > > > As part of the recent migration from buildbot 0.8 to 3.2 and ci.a.o to ci2.a.o, we have had no buildbots since late last year.
> > > > 
> > > > I think most of our buildbot configs should be able to run on 3.2, except for svn-w2k3-local and svn-x64-macosx-dgvrs, so as a stopgap measure, I tried commenting the aforementioned two and activating the config by renaming [3] to remove the "-disabled" suffix.
> > > > 
> > > > However, Gavin McDonald comments on INFRA-22761: "I'm afraid we still can not activate this config. There are no agents in which any of the builders can use at this point."
> > > > 
> > > > Any ideas what we should do to get some buildbots back online?
> > > > 
> > > > [1] https://issues.apache.org/jira/browse/INFRA-22277
> > > > 
> > > > [2] https://issues.apache.org/jira/browse/INFRA-22761
> > > > 
> > > > [3] 
> > > > https://svn.apache.org/repos/infra/infrastructure/buildbot2/projects/s
> > > > ubversion.py
> > > > 
> > > > Cheers,
> > > > Nathan
> > > > 
> > > > 
> > > 
> > > 
> > 
>

RE: Buildbot Migration

Posted by Gavin McDonald <gm...@apache.org>.

I have enabled all but the mac jobs, you can see them listed here.

https://ci2.apache.org/#/builders

I still need to enable the uploading to nightlies.apache.org , will do that a bit later.

Gav...


On 2022/04/22 08:52:14 Gavin McDonald wrote:
> This is great, thank you
> 
> I'll work on enabling your builds and the ubuntu ones today.
> 
> That leaves mac
> 
> I see in our logs that svn-x64-macosx-dgvrs is trying to connect to ci2.apache.org - who owns that ? I thought it was dead. I can send creds to the owner of that - if it is running a recent Buildbot version.
> 
> Gav...
> 
> 
> On 2022/04/22 07:48:12 Bert Huijben wrote:
> > 	Hi Gavin,
> > 
> > Thanks. The buildbots report that they are attached now:
> > 
> > [[
> > 2022-04-22 09:43:03+0200 [-] recording hostname in twistd.hostname
> > 2022-04-22 09:43:03+0200 [-] Starting factory <buildbot_worker.pb.BotFactory object at 0x0000021A74600EB0>
> > 2022-04-22 09:43:03+0200 [Broker,client] message from master: attached
> > 2022-04-22 09:43:03+0200 [Broker,client] I have a leftover directory 'svn-local' that is not being used by the buildmaster: you can delete it now
> > 2022-04-22 09:43:03+0200 [Broker,client] I have a leftover directory 'svn-test-run' that is not being used by the buildmaster: you can delete it now
> > 2022-04-22 09:43:03+0200 [Broker,client] Connected to buildmaster; worker is ready
> > 2022-04-22 09:43:03+0200 [Broker,client] sending application-level keepalives every 600 seconds
> > ]]
> > 
> > Looks like the next step would be to re-enable the builds in the Subversion config. 
> > 
> > Nathan do you want to look at that? Or anybody else?
> > (I see that the Subversion config is renamed to .disabled and I assume quite a few builds don't apply any more)
> > 
> > Otherwise I will look into this, next weekend.
> > 
> > Thanks,
> > 	Bert!
> > 
> > -----Original Message-----
> > From: Gavin McDonald <gm...@apache.org> 
> > Sent: Thursday, April 21, 2022 10:18 PM
> > To: dev@subversion.apache.org
> > Subject: RE: Buildbot Migration
> > 
> > Hi Bert,
> > 
> > I emailed you some new connection details a few hours ago, let me know if your workers can connect and I'll see about enabling those jobs.
> > 
> > I have also changed the config for the ubuntu jobs to use asf hardware.
> > 
> > That leaves the mac builds - if nobody can source a mac I'll see what I can do my end
> > 
> > Gav...
> > 
> > 
> > On 2022/04/14 11:08:40 Bert Huijben wrote:
> > > I upgraded the win32 buildbots to python 3.10 and new buildbot and they now try to connect to buildbot using the old credentials, but fail as the server doesn't expect the bot to connect.
> > > 
> > > Can somebody try to obtain new credentials for or re-enable the old credentials, so I can continue getting this SlikSvn sponsored bot back up.
> > > 
> > > 
> > > 
> > > Thanks,
> > > 	Bert
> > > 
> > > -----Original Message-----
> > > From: Nathan Hartman <ha...@gmail.com>
> > > Sent: Sunday, April 10, 2022 5:33 PM
> > > To: Subversion Developers <de...@subversion.apache.org>
> > > Subject: Re: Buildbot Migration
> > > 
> > > On Tue, Jan 18, 2022 at 10:52 AM Nathan Hartman <ha...@gmail.com> wrote:
> > > >
> > > > On Tue, Jan 18, 2022 at 10:45 AM Nathan Hartman 
> > > > <ha...@gmail.com> wrote:
> > > > >
> > > > > On Sun, Jan 16, 2022 at 3:56 PM Branko Čibej <br...@apache.org> wrote:
> > > > > >
> > > > > > On 16.01.2022 18:33, Nathan Hartman wrote:
> > > > > (snip)
> > > > > > > Are "svn-w2k3-local" and "svn-x64-macosx-dgvrs" currently the 
> > > > > > > only nonexistent nodes referenced by this script?
> > > > > >
> > > > > > Existent but not upgraded, at least in the case of the mac mini.
> > > > > >
> > > > > > Someday ...
> > > > >
> > > > > All the more reason to activate whatever is ready now and add 
> > > > > others back if/when they are ready. I'll go ahead and request to do that...
> > > >
> > > > That's filed under INFRA-22761...
> > > 
> > > 
> > > As part of the recent migration from buildbot 0.8 to 3.2 and ci.a.o to ci2.a.o, we have had no buildbots since late last year.
> > > 
> > > I think most of our buildbot configs should be able to run on 3.2, except for svn-w2k3-local and svn-x64-macosx-dgvrs, so as a stopgap measure, I tried commenting the aforementioned two and activating the config by renaming [3] to remove the "-disabled" suffix.
> > > 
> > > However, Gavin McDonald comments on INFRA-22761: "I'm afraid we still can not activate this config. There are no agents in which any of the builders can use at this point."
> > > 
> > > Any ideas what we should do to get some buildbots back online?
> > > 
> > > [1] https://issues.apache.org/jira/browse/INFRA-22277
> > > 
> > > [2] https://issues.apache.org/jira/browse/INFRA-22761
> > > 
> > > [3] 
> > > https://svn.apache.org/repos/infra/infrastructure/buildbot2/projects/s
> > > ubversion.py
> > > 
> > > Cheers,
> > > Nathan
> > > 
> > > 
> > 
> > 
>

RE: Buildbot Migration

Posted by Gavin McDonald <gm...@apache.org>.

This is great, thank you

I'll work on enabling your builds and the ubuntu ones today.

That leaves mac

I see in our logs that svn-x64-macosx-dgvrs is trying to connect to ci2.apache.org - who owns that ? I thought it was dead. I can send creds to the owner of that - if it is running a recent Buildbot version.

Gav...


On 2022/04/22 07:48:12 Bert Huijben wrote:
> 	Hi Gavin,
> 
> Thanks. The buildbots report that they are attached now:
> 
> [[
> 2022-04-22 09:43:03+0200 [-] recording hostname in twistd.hostname
> 2022-04-22 09:43:03+0200 [-] Starting factory <buildbot_worker.pb.BotFactory object at 0x0000021A74600EB0>
> 2022-04-22 09:43:03+0200 [Broker,client] message from master: attached
> 2022-04-22 09:43:03+0200 [Broker,client] I have a leftover directory 'svn-local' that is not being used by the buildmaster: you can delete it now
> 2022-04-22 09:43:03+0200 [Broker,client] I have a leftover directory 'svn-test-run' that is not being used by the buildmaster: you can delete it now
> 2022-04-22 09:43:03+0200 [Broker,client] Connected to buildmaster; worker is ready
> 2022-04-22 09:43:03+0200 [Broker,client] sending application-level keepalives every 600 seconds
> ]]
> 
> Looks like the next step would be to re-enable the builds in the Subversion config. 
> 
> Nathan do you want to look at that? Or anybody else?
> (I see that the Subversion config is renamed to .disabled and I assume quite a few builds don't apply any more)
> 
> Otherwise I will look into this, next weekend.
> 
> Thanks,
> 	Bert!
> 
> -----Original Message-----
> From: Gavin McDonald <gm...@apache.org> 
> Sent: Thursday, April 21, 2022 10:18 PM
> To: dev@subversion.apache.org
> Subject: RE: Buildbot Migration
> 
> Hi Bert,
> 
> I emailed you some new connection details a few hours ago, let me know if your workers can connect and I'll see about enabling those jobs.
> 
> I have also changed the config for the ubuntu jobs to use asf hardware.
> 
> That leaves the mac builds - if nobody can source a mac I'll see what I can do my end
> 
> Gav...
> 
> 
> On 2022/04/14 11:08:40 Bert Huijben wrote:
> > I upgraded the win32 buildbots to python 3.10 and new buildbot and they now try to connect to buildbot using the old credentials, but fail as the server doesn't expect the bot to connect.
> > 
> > Can somebody try to obtain new credentials for or re-enable the old credentials, so I can continue getting this SlikSvn sponsored bot back up.
> > 
> > 
> > 
> > Thanks,
> > 	Bert
> > 
> > -----Original Message-----
> > From: Nathan Hartman <ha...@gmail.com>
> > Sent: Sunday, April 10, 2022 5:33 PM
> > To: Subversion Developers <de...@subversion.apache.org>
> > Subject: Re: Buildbot Migration
> > 
> > On Tue, Jan 18, 2022 at 10:52 AM Nathan Hartman <ha...@gmail.com> wrote:
> > >
> > > On Tue, Jan 18, 2022 at 10:45 AM Nathan Hartman 
> > > <ha...@gmail.com> wrote:
> > > >
> > > > On Sun, Jan 16, 2022 at 3:56 PM Branko Čibej <br...@apache.org> wrote:
> > > > >
> > > > > On 16.01.2022 18:33, Nathan Hartman wrote:
> > > > (snip)
> > > > > > Are "svn-w2k3-local" and "svn-x64-macosx-dgvrs" currently the 
> > > > > > only nonexistent nodes referenced by this script?
> > > > >
> > > > > Existent but not upgraded, at least in the case of the mac mini.
> > > > >
> > > > > Someday ...
> > > >
> > > > All the more reason to activate whatever is ready now and add 
> > > > others back if/when they are ready. I'll go ahead and request to do that...
> > >
> > > That's filed under INFRA-22761...
> > 
> > 
> > As part of the recent migration from buildbot 0.8 to 3.2 and ci.a.o to ci2.a.o, we have had no buildbots since late last year.
> > 
> > I think most of our buildbot configs should be able to run on 3.2, except for svn-w2k3-local and svn-x64-macosx-dgvrs, so as a stopgap measure, I tried commenting the aforementioned two and activating the config by renaming [3] to remove the "-disabled" suffix.
> > 
> > However, Gavin McDonald comments on INFRA-22761: "I'm afraid we still can not activate this config. There are no agents in which any of the builders can use at this point."
> > 
> > Any ideas what we should do to get some buildbots back online?
> > 
> > [1] https://issues.apache.org/jira/browse/INFRA-22277
> > 
> > [2] https://issues.apache.org/jira/browse/INFRA-22761
> > 
> > [3] 
> > https://svn.apache.org/repos/infra/infrastructure/buildbot2/projects/s
> > ubversion.py
> > 
> > Cheers,
> > Nathan
> > 
> > 
> 
>

RE: Buildbot Migration

Posted by Bert Huijben <be...@qqmail.nl>.

	Hi Gavin,

Thanks. The buildbots report that they are attached now:

[[
2022-04-22 09:43:03+0200 [-] recording hostname in twistd.hostname
2022-04-22 09:43:03+0200 [-] Starting factory <buildbot_worker.pb.BotFactory object at 0x0000021A74600EB0>
2022-04-22 09:43:03+0200 [Broker,client] message from master: attached
2022-04-22 09:43:03+0200 [Broker,client] I have a leftover directory 'svn-local' that is not being used by the buildmaster: you can delete it now
2022-04-22 09:43:03+0200 [Broker,client] I have a leftover directory 'svn-test-run' that is not being used by the buildmaster: you can delete it now
2022-04-22 09:43:03+0200 [Broker,client] Connected to buildmaster; worker is ready
2022-04-22 09:43:03+0200 [Broker,client] sending application-level keepalives every 600 seconds
]]

Looks like the next step would be to re-enable the builds in the Subversion config. 

Nathan do you want to look at that? Or anybody else?
(I see that the Subversion config is renamed to .disabled and I assume quite a few builds don't apply any more)

Otherwise I will look into this, next weekend.

Thanks,
	Bert!

-----Original Message-----
From: Gavin McDonald <gm...@apache.org> 
Sent: Thursday, April 21, 2022 10:18 PM
To: dev@subversion.apache.org
Subject: RE: Buildbot Migration

Hi Bert,

I emailed you some new connection details a few hours ago, let me know if your workers can connect and I'll see about enabling those jobs.

I have also changed the config for the ubuntu jobs to use asf hardware.

That leaves the mac builds - if nobody can source a mac I'll see what I can do my end

Gav...


On 2022/04/14 11:08:40 Bert Huijben wrote:
> I upgraded the win32 buildbots to python 3.10 and new buildbot and they now try to connect to buildbot using the old credentials, but fail as the server doesn't expect the bot to connect.
> 
> Can somebody try to obtain new credentials for or re-enable the old credentials, so I can continue getting this SlikSvn sponsored bot back up.
> 
> 
> 
> Thanks,
> 	Bert
> 
> -----Original Message-----
> From: Nathan Hartman <ha...@gmail.com>
> Sent: Sunday, April 10, 2022 5:33 PM
> To: Subversion Developers <de...@subversion.apache.org>
> Subject: Re: Buildbot Migration
> 
> On Tue, Jan 18, 2022 at 10:52 AM Nathan Hartman <ha...@gmail.com> wrote:
> >
> > On Tue, Jan 18, 2022 at 10:45 AM Nathan Hartman 
> > <ha...@gmail.com> wrote:
> > >
> > > On Sun, Jan 16, 2022 at 3:56 PM Branko Čibej <br...@apache.org> wrote:
> > > >
> > > > On 16.01.2022 18:33, Nathan Hartman wrote:
> > > (snip)
> > > > > Are "svn-w2k3-local" and "svn-x64-macosx-dgvrs" currently the 
> > > > > only nonexistent nodes referenced by this script?
> > > >
> > > > Existent but not upgraded, at least in the case of the mac mini.
> > > >
> > > > Someday ...
> > >
> > > All the more reason to activate whatever is ready now and add 
> > > others back if/when they are ready. I'll go ahead and request to do that...
> >
> > That's filed under INFRA-22761...
> 
> 
> As part of the recent migration from buildbot 0.8 to 3.2 and ci.a.o to ci2.a.o, we have had no buildbots since late last year.
> 
> I think most of our buildbot configs should be able to run on 3.2, except for svn-w2k3-local and svn-x64-macosx-dgvrs, so as a stopgap measure, I tried commenting the aforementioned two and activating the config by renaming [3] to remove the "-disabled" suffix.
> 
> However, Gavin McDonald comments on INFRA-22761: "I'm afraid we still can not activate this config. There are no agents in which any of the builders can use at this point."
> 
> Any ideas what we should do to get some buildbots back online?
> 
> [1] https://issues.apache.org/jira/browse/INFRA-22277
> 
> [2] https://issues.apache.org/jira/browse/INFRA-22761
> 
> [3] 
> https://svn.apache.org/repos/infra/infrastructure/buildbot2/projects/s
> ubversion.py
> 
> Cheers,
> Nathan
> 
>

RE: Buildbot Migration

Posted by Gavin McDonald <gm...@apache.org>.

Hi Bert,

I emailed you some new connection details a few hours ago, let me know if your workers can connect and I'll see about enabling those jobs.

I have also changed the config for the ubuntu jobs to use asf hardware.

That leaves the mac builds - if nobody can source a mac I'll see what I can do my end

Gav...


On 2022/04/14 11:08:40 Bert Huijben wrote:
> I upgraded the win32 buildbots to python 3.10 and new buildbot and they now try to connect to buildbot using the old credentials, but fail as the server doesn't expect the bot to connect.
> 
> Can somebody try to obtain new credentials for or re-enable the old credentials, so I can continue getting this SlikSvn sponsored bot back up.
> 
> 
> 
> Thanks,
> 	Bert
> 
> -----Original Message-----
> From: Nathan Hartman <ha...@gmail.com> 
> Sent: Sunday, April 10, 2022 5:33 PM
> To: Subversion Developers <de...@subversion.apache.org>
> Subject: Re: Buildbot Migration
> 
> On Tue, Jan 18, 2022 at 10:52 AM Nathan Hartman <ha...@gmail.com> wrote:
> >
> > On Tue, Jan 18, 2022 at 10:45 AM Nathan Hartman 
> > <ha...@gmail.com> wrote:
> > >
> > > On Sun, Jan 16, 2022 at 3:56 PM Branko Čibej <br...@apache.org> wrote:
> > > >
> > > > On 16.01.2022 18:33, Nathan Hartman wrote:
> > > (snip)
> > > > > Are "svn-w2k3-local" and "svn-x64-macosx-dgvrs" currently the 
> > > > > only nonexistent nodes referenced by this script?
> > > >
> > > > Existent but not upgraded, at least in the case of the mac mini.
> > > >
> > > > Someday ...
> > >
> > > All the more reason to activate whatever is ready now and add others 
> > > back if/when they are ready. I'll go ahead and request to do that...
> >
> > That's filed under INFRA-22761...
> 
> 
> As part of the recent migration from buildbot 0.8 to 3.2 and ci.a.o to ci2.a.o, we have had no buildbots since late last year.
> 
> I think most of our buildbot configs should be able to run on 3.2, except for svn-w2k3-local and svn-x64-macosx-dgvrs, so as a stopgap measure, I tried commenting the aforementioned two and activating the config by renaming [3] to remove the "-disabled" suffix.
> 
> However, Gavin McDonald comments on INFRA-22761: "I'm afraid we still can not activate this config. There are no agents in which any of the builders can use at this point."
> 
> Any ideas what we should do to get some buildbots back online?
> 
> [1] https://issues.apache.org/jira/browse/INFRA-22277
> 
> [2] https://issues.apache.org/jira/browse/INFRA-22761
> 
> [3] https://svn.apache.org/repos/infra/infrastructure/buildbot2/projects/subversion.py
> 
> Cheers,
> Nathan
> 
>

RE: Buildbot Migration

Posted by Bert Huijben <be...@qqmail.nl>.

I upgraded the win32 buildbots to python 3.10 and new buildbot and they now try to connect to buildbot using the old credentials, but fail as the server doesn't expect the bot to connect.

Can somebody try to obtain new credentials for or re-enable the old credentials, so I can continue getting this SlikSvn sponsored bot back up.

Thanks,
	Bert

-----Original Message-----
From: Nathan Hartman <ha...@gmail.com> 
Sent: Sunday, April 10, 2022 5:33 PM
To: Subversion Developers <de...@subversion.apache.org>
Subject: Re: Buildbot Migration

On Tue, Jan 18, 2022 at 10:52 AM Nathan Hartman <ha...@gmail.com> wrote:
>
> On Tue, Jan 18, 2022 at 10:45 AM Nathan Hartman 
> <ha...@gmail.com> wrote:
> >
> > On Sun, Jan 16, 2022 at 3:56 PM Branko Čibej <br...@apache.org> wrote:
> > >
> > > On 16.01.2022 18:33, Nathan Hartman wrote:
> > (snip)
> > > > Are "svn-w2k3-local" and "svn-x64-macosx-dgvrs" currently the 
> > > > only nonexistent nodes referenced by this script?
> > >
> > > Existent but not upgraded, at least in the case of the mac mini.
> > >
> > > Someday ...
> >
> > All the more reason to activate whatever is ready now and add others 
> > back if/when they are ready. I'll go ahead and request to do that...
>
> That's filed under INFRA-22761...

As part of the recent migration from buildbot 0.8 to 3.2 and ci.a.o to ci2.a.o, we have had no buildbots since late last year.

I think most of our buildbot configs should be able to run on 3.2, except for svn-w2k3-local and svn-x64-macosx-dgvrs, so as a stopgap measure, I tried commenting the aforementioned two and activating the config by renaming [3] to remove the "-disabled" suffix.

However, Gavin McDonald comments on INFRA-22761: "I'm afraid we still can not activate this config. There are no agents in which any of the builders can use at this point."

Any ideas what we should do to get some buildbots back online?

[1] https://issues.apache.org/jira/browse/INFRA-22277

[2] https://issues.apache.org/jira/browse/INFRA-22761

[3] https://svn.apache.org/repos/infra/infrastructure/buildbot2/projects/subversion.py

Cheers,
Nathan

Re: Buildbot Migration

Posted by Nathan Hartman <ha...@gmail.com>.

On Tue, Jan 18, 2022 at 10:52 AM Nathan Hartman
<ha...@gmail.com> wrote:
>
> On Tue, Jan 18, 2022 at 10:45 AM Nathan Hartman
> <ha...@gmail.com> wrote:
> >
> > On Sun, Jan 16, 2022 at 3:56 PM Branko Čibej <br...@apache.org> wrote:
> > >
> > > On 16.01.2022 18:33, Nathan Hartman wrote:
> > (snip)
> > > > Are "svn-w2k3-local" and "svn-x64-macosx-dgvrs" currently the only
> > > > nonexistent nodes referenced by this script?
> > >
> > > Existent but not upgraded, at least in the case of the mac mini.
> > >
> > > Someday ...
> >
> > All the more reason to activate whatever is ready now and add others
> > back if/when they are ready. I'll go ahead and request to do that...
>
> That's filed under INFRA-22761...

As part of the recent migration from buildbot 0.8 to 3.2 and ci.a.o to
ci2.a.o, we have had no buildbots since late last year.

I think most of our buildbot configs should be able to run on 3.2,
except for svn-w2k3-local and svn-x64-macosx-dgvrs, so as a stopgap
measure, I tried commenting the aforementioned two and activating the
config by renaming [3] to remove the "-disabled" suffix.

However, Gavin McDonald comments on INFRA-22761: "I'm afraid we still
can not activate this config. There are no agents in which any of the
builders can use at this point."

Any ideas what we should do to get some buildbots back online?

[1] https://issues.apache.org/jira/browse/INFRA-22277

[2] https://issues.apache.org/jira/browse/INFRA-22761

[3] https://svn.apache.org/repos/infra/infrastructure/buildbot2/projects/subversion.py

Cheers,
Nathan

Re: Buildbot Migration

Posted by Nathan Hartman <ha...@gmail.com>.

On Tue, Jan 18, 2022 at 10:45 AM Nathan Hartman
<ha...@gmail.com> wrote:
>
> On Sun, Jan 16, 2022 at 3:56 PM Branko Čibej <br...@apache.org> wrote:
> >
> > On 16.01.2022 18:33, Nathan Hartman wrote:
> (snip)
> > > Are "svn-w2k3-local" and "svn-x64-macosx-dgvrs" currently the only
> > > nonexistent nodes referenced by this script?
> >
> > Existent but not upgraded, at least in the case of the mac mini.
> >
> > Someday ...
>
> All the more reason to activate whatever is ready now and add others
> back if/when they are ready. I'll go ahead and request to do that...

That's filed under INFRA-22761...

Cheers,
Nathan

Re: Buildbot Migration

Posted by Nathan Hartman <ha...@gmail.com>.

On Sun, Jan 16, 2022 at 3:56 PM Branko Čibej <br...@apache.org> wrote:
>
> On 16.01.2022 18:33, Nathan Hartman wrote:
(snip)
> > Are "svn-w2k3-local" and "svn-x64-macosx-dgvrs" currently the only
> > nonexistent nodes referenced by this script?
>
> Existent but not upgraded, at least in the case of the mac mini.
>
> Someday ...

All the more reason to activate whatever is ready now and add others
back if/when they are ready. I'll go ahead and request to do that...

Cheers,
Nathan

Re: Buildbot Migration

Posted by Branko Čibej <br...@apache.org>.

On 16.01.2022 18:33, Nathan Hartman wrote:
> On Sun, Jan 16, 2022 at 9:51 AM Gavin McDonald <gm...@apache.org> 
> wrote:
>
>     Hi,
>
>     On Sun, Jan 16, 2022 at 2:56 PM Nathan Hartman
>     <ha...@gmail.com> wrote:
>
>         On Sun, Jan 16, 2022 at 6:53 AM Gavin McDonald
>         <gm...@apache.org> wrote:
>
>             Please note I have closed
>             https://issues.apache.org/jira/browse/INFRA-22277 as
>             Incomplete.
>
>             When you are ready to connect new nodes to ci2.apache.org
>             <http://ci2.apache.org> please open a new INFRA ticket
>
>             Gav...
>
>
>
>         Does this mean that we have no buildbots at this time?
>
>
>     That is correct yes.
>
>
>
> Are "svn-w2k3-local" and "svn-x64-macosx-dgvrs" currently the only 
> nonexistent nodes referenced by this script?

Existent but not upgraded, at least in the case of the mac mini.

Someday ...

-- Brane

P.S.: I almost wrote "existential" but that might have lead down a 
rabbit hole of nuanced meanings.