You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@subversion.apache.org by Lieven Govaerts <lg...@mobsol.be> on 2006/03/26 20:56:11 UTC
Update: Subversion build and test farm with Buildbot.
Hi,
last week I send a email to this list presenting a Buildbot setup.
Based on the reactions and my own todo-list I made some enhancements to the
setup, and this is the current status:
- Buildbot is available here: http://www.mobsol.be/buildbot/ (uses apache
reverse proxy)
- The buildmaster receives mails from the svn commit list, and parses thoses
mails to get the changes in the repository.
- Two buildslaves are now up and running: FC1/Intel and a Mac OS X/Intel.
While their configuration has not been completed, most issues have been
solved.
- The build process is now standardized in 5 steps (update, build, check,
publish log and clean). For each of the steps buildslave scripts are
available.
- Detailed log files (tests.log) can be FTP'ed from the buildslave to the
buildmaster server.
- The buildmaster can send emails indicating succes or failure of the build.
I've rewritten some of the Buildbot mail code to support the use of a
template for the mailsubject and body. An email will be send after each
individual build. That code is complete now, but needs some cleaning up.
- I had some problems with updating an existing working copy, but that issue
has been solved in svn r19040.
- Some private data has been extracted from the buildmaster configuration
file so I could publish that file (master.cfg).
I've put all the information online in my svn repository for your
information and possible reuse:
- Customized version of buildbot (only needed for the buildmaster), based on
buildbot 0.7.2:
http://www.mobsol.be/svn/public/buildbot/trunk/
(I'll send these patches to the buildbot project, but need to cleanup first)
- The buildmaster configuration + code to parse commit emails:
http://www.mobsol.be/svn/public/buildbot/trunk/config/masterdir/
- My buildslaves configuration:
http://www.mobsol.be/svn/public/buildbot/trunk/config/fc1-gcc3.3.2-ia32/
http://www.mobsol.be/svn/public/buildbot/trunk/config/osx10.4-gcc4.0.1-ia32/
If you want to setup a buildslave, here are my notes concerning
installation, configuration and integration with the buildmaster (+'buildbot
try'):
http://www.mobsol.be/svn/public/buildbot/trunk/config/README
If you have any questions, please let me know.
regards,
Lieven.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: Update: Subversion build and test farm with Buildbot.
Posted by Julian Foad <ju...@btopenworld.com>.
Ivan Zhakov wrote:
>
> Actually there is already script for automate Windows build:
> build/win32/vc6-build.bat.in
This batch file may need the test directory name to be fixed, as in the patch I
have just sent (Subject: "[PATCH] Remove obsolete test files; fix test dir name").
Here is the relevant part of that patch. Please let me know if this is
correct. If it is, feel free to commit this fix yourself, and I will commit
the rest of my patch (which mainly removes a directory containing two test
files) separately. I should probably have presented this as a separate patch
anyway.
Index: build/win32/vc6-build.bat.in
===================================================================
--- build/win32/vc6-build.bat.in (revision 19040)
+++ build/win32/vc6-build.bat.in (working copy)
@@ -91,8 +91,8 @@
rem ====== Subversion
cd src-%DIR%
msdev subversion_msvc.dsw /USEENV /MAKE "__ALL_TESTS__ - Win32 Release"
-mkdir Release\subversion\tests\svn
-xcopy /S /Y subversion\tests\svn Release\subversion\tests\svn
+mkdir Release\subversion\tests\cmdline
+xcopy /S /Y subversion\tests\cmdline Release\subversion\tests\cmdline
copy Release\subversion\mod_dav_svn\mod_dav_svn.so "%APACHEDIR%"\modules
copy Release\subversion\mod_authz_svn\mod_authz_svn.so "%APACHEDIR%"\modules
cd ..
Index: INSTALL
===================================================================
--- INSTALL (revision 19040)
+++ INSTALL (working copy)
@@ -851,8 +851,8 @@
copy the client tests into the release test area.
C:>cd src-%DIR%
- C:>mkdir Release\subversion\tests\svn
- C:>xcopy /S /Y subversion\tests\svn Release\subversion\tests\svn
+ C:>mkdir Release\subversion\tests\cmdline
+ C:>xcopy /S /Y subversion\tests\cmdline Release\subversion\tests\cmdline
If the server dso modules have been built then copy the dso files and
dlls into the Apache modules directory.
- Julian
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: Update: Subversion build and test farm with Buildbot.
Posted by Ivan Zhakov <ch...@gmail.com>.
On 3/27/06, Lieven Govaerts <lg...@mobsol.be> wrote:
>
>
> > -----Original Message-----
> > From: Ivan Zhakov [mailto:chemodax@gmail.com]
> [..]
> > Good job, I am going to find some time to try setup buildbot
> > slave on Windows. Did you try this?
>
> I have a buildbot running on Windows as you can see on the waterfall
> (the graphical view), but the only thing it does now is svn checkout/
> svn update. The most difficult part there for me is to automate the
> windows build. If you have a script to automate that, I can try to
> finish my Windows test-buildbot and send you the details.
Actually there is already script for automate Windows build:
build/win32/vc6-build.bat.in
--
Ivan Zhakov
RE: Update: Subversion build and test farm with Buildbot.
Posted by Lieven Govaerts <lg...@mobsol.be>.
> -----Original Message-----
> From: Ivan Zhakov [mailto:chemodax@gmail.com]
[..]
> Good job, I am going to find some time to try setup buildbot
> slave on Windows. Did you try this?
I have a buildbot running on Windows as you can see on the waterfall
(the graphical view), but the only thing it does now is svn checkout/
svn update. The most difficult part there for me is to automate the
windows build. If you have a script to automate that, I can try to
finish my Windows test-buildbot and send you the details.
> > - Detailed log files (tests.log) can be FTP'ed from the
> buildslave to
> > the buildmaster server.
> I have idea about detailed log file: As I saw buildbot keeps
> log files for all commands, so we can add special command,
> like svn-detailedlog which should 'cat' contests of detailed
> log file to stdout, so buildbot can catch it and keep. Is it
> possible? I think it's better than ftping log files.
Nice idea indeed, definitely easier the FTPing. I think I'm gonna
implement a compressed storage for those log files then, they tend
to get pretty large.
Lieven.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Re: Update: Subversion build and test farm with Buildbot.
Posted by Ivan Zhakov <ch...@gmail.com>.
On 3/27/06, Lieven Govaerts <lg...@mobsol.be> wrote:
> Hi,
>
>
> last week I send a email to this list presenting a Buildbot setup.
Good job, I am going to find some time to try setup buildbot slave on
Windows. Did you try this?
>
> Based on the reactions and my own todo-list I made some enhancements to the
> setup, and this is the current status:
>
> - Buildbot is available here: http://www.mobsol.be/buildbot/ (uses apache
> reverse proxy)
[..]
> - Detailed log files (tests.log) can be FTP'ed from the buildslave to the
> buildmaster server.
I have idea about detailed log file: As I saw buildbot keeps log files
for all commands, so we can add special command, like svn-detailedlog
which should 'cat' contests of detailed log file to stdout, so
buildbot can catch it and keep. Is it possible? I think it's better
than ftping log files.
[..]
--
Ivan Zhakov
Re: Update: Subversion build and test farm with Buildbot.
Posted by kfogel <kf...@collab.net>.
Thank you for setting this up, Lieven (and see r19088).
-Karl
"Lieven Govaerts" <lg...@mobsol.be> writes:
> last week I send a email to this list presenting a Buildbot setup.
>
> Based on the reactions and my own todo-list I made some enhancements to the
> setup, and this is the current status:
>
> - Buildbot is available here: http://www.mobsol.be/buildbot/ (uses apache
> reverse proxy)
> - The buildmaster receives mails from the svn commit list, and parses thoses
> mails to get the changes in the repository.
> - Two buildslaves are now up and running: FC1/Intel and a Mac OS X/Intel.
> While their configuration has not been completed, most issues have been
> solved.
> - The build process is now standardized in 5 steps (update, build, check,
> publish log and clean). For each of the steps buildslave scripts are
> available.
> - Detailed log files (tests.log) can be FTP'ed from the buildslave to the
> buildmaster server.
> - The buildmaster can send emails indicating succes or failure of the build.
> I've rewritten some of the Buildbot mail code to support the use of a
> template for the mailsubject and body. An email will be send after each
> individual build. That code is complete now, but needs some cleaning up.
> - I had some problems with updating an existing working copy, but that issue
> has been solved in svn r19040.
> - Some private data has been extracted from the buildmaster configuration
> file so I could publish that file (master.cfg).
>
> I've put all the information online in my svn repository for your
> information and possible reuse:
> - Customized version of buildbot (only needed for the buildmaster), based on
> buildbot 0.7.2:
> http://www.mobsol.be/svn/public/buildbot/trunk/
> (I'll send these patches to the buildbot project, but need to cleanup first)
>
> - The buildmaster configuration + code to parse commit emails:
> http://www.mobsol.be/svn/public/buildbot/trunk/config/masterdir/
>
> - My buildslaves configuration:
> http://www.mobsol.be/svn/public/buildbot/trunk/config/fc1-gcc3.3.2-ia32/
> http://www.mobsol.be/svn/public/buildbot/trunk/config/osx10.4-gcc4.0.1-ia32/
>
> If you want to setup a buildslave, here are my notes concerning
> installation, configuration and integration with the buildmaster (+'buildbot
> try'):
> http://www.mobsol.be/svn/public/buildbot/trunk/config/README
>
> If you have any questions, please let me know.
>
> regards,
>
> Lieven.
>
>
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: dev-help@subversion.tigris.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org