[jira] [Commented] (INFRA-7807) Fix Buildbot configuration for Tomcat (Upload goes to wrong directories)

["Konstantin Kolinko (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/INFRA-7807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14051455#comment-14051455 ] 

Konstantin Kolinko commented on INFRA-7807:
-------------------------------------------

> I have just cleaned out http://ci.apache.org/projects/tomcat/tomcat8/ so that should be back to normal. 

Good.

1) The Tomcat 7 directory needs the same clean up.

> The RAT HTML output still needs to be fixed. 

2) There are links to projects that have successfully created RAT reports at the bottom of this page:
http://ci.apache.org/projects/#reports

The latest two of them are from April 15th. Some are from year 2012 and 2010.
So I think other projects have this problem as well.
(I hoped that we could look somewhere for a working example).

3) The logs cleanup (if it was configured in crontab) is not working.
The oldest of Tomcat 8 logs here are from May 8th (~2 months worth of logs). There are 155 log directories there.
:http://ci.apache.org/projects/tomcat/tomcat8/logs/

The oldest of Tomcat 7 logs here are from May 26th. There are 74 log directories there.
http://ci.apache.org/projects/tomcat/tomcat7/logs/

(As bb-vm_ubuntu slave is currently out of disk space, it may be good time to do some cleanup
 http://ci.apache.org/builders/tomcat-7-trunk/builds/159/steps/compile/logs/stdio

BUILD FAILED
(...)/build.xml:2164: Failed to copy
(...)/output/embed/apache-tomcat-7.0.55-dev-embed.zip to
(...)/output/release/v7.0.55-dev/bin/embed/apache-tomcat-7.0.55-dev-embed.zip
due to No space left on device
)

> Fix Buildbot configuration for Tomcat (Upload goes to wrong directories)
> ------------------------------------------------------------------------
>
>                 Key: INFRA-7807
>                 URL: https://issues.apache.org/jira/browse/INFRA-7807
>             Project: Infrastructure
>          Issue Type: Bug
>          Components: Buildbot
>            Reporter: Konstantin Kolinko
>
> Thank you to everyone who recreated buildbot configuration for Tomcat after buildbot server crash in April. It works, but not quite as expected.
> Expected configuration:
> [1] http://tomcat.apache.org/ci.html#Buildbot
> There are the following builders, for Tomcat trunk, Tomcat 7 and Tomcat
> 6 respectively:
> http://ci.apache.org/builders/tomcat-trunk
> http://ci.apache.org/builders/tomcat-7-trunk
> http://ci.apache.org/builders/tomcat-6-trunk
> The "tomcat-trunk" builder publishes documentation, RAT report, JUnit logs and coverage report.
> The "tomcat-7-trunk" builder does the same minus coverage.
> The "tomcat-6-trunk" builder publishes documentation only.
> They upload the files to
> http://ci.apache.org/projects/tomcat/tomcat8/docs/
> http://ci.apache.org/projects/tomcat/tomcat8/rat-output.html
> http://ci.apache.org/projects/tomcat/tomcat8/logs/$SVNREVISION/
> http://ci.apache.org/projects/tomcat/tomcat8/coverage/
> http://ci.apache.org/projects/tomcat/tomcat7/docs/
> http://ci.apache.org/projects/tomcat/tomcat7/rat-output.html
> http://ci.apache.org/projects/tomcat/tomcat7/logs/$SVNREVISION/
> http://ci.apache.org/projects/tomcat/tomcat6/docs/
> That is how the things worked before April.
> The actual current behaviour is that the files are uploaded to the same top directory. The "/docs/", "/logs/" and "/coverage/" parts are missing from the URLs.
> For example,
> Build for revision 1597264:
> http://ci.apache.org/builders/tomcat-trunk/builds/107
> The logs are expected to be here:
> http://ci.apache.org/projects/tomcat/tomcat8/logs/1597264/
> They are actually here:
> http://ci.apache.org/projects/tomcat/tomcat8/1597264/
> This also means that Documentation and Coverage are uploaded into the same directory,
> http://ci.apache.org/projects/tomcat/tomcat8/
> The Documentation is uploaded before tests are run, Coverage report is uploaded after the tests have finished, so there is a several hours gap when documentation is visible. After that the coverage report overwrites it.
> Second issue is that the RAT HTML reports (rat-output.html) are missing. Only "rat-output.xml" files are available.
> Looking at "MasterShellCommand" commands output in the build log,
> http://ci.apache.org/builders/tomcat-trunk/builds/107/steps/MasterShellCommand/logs/stdio
> 1) Why does it use "cp" instead of "mv"?
> 2) Probably it needs "mkdir" command to create target directory.
> 3) There is no command to copy "rat-output.html" file.
> Third issue, there shall be some procedure to purge old junit logs. In INFRA-3948 I asked to keep the logs for 7 days. It was probably configured as a cron task.
> I do not know whether it is actually configured currently.
> As an alternative solution, maybe cleanup of old logs can be added as a step to the build configuration.



--
This message was sent by Atlassian JIRA
(v6.2#6252)