You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@apache.org by Chris Lambertus <cm...@apache.org> on 2018/12/27 00:36:25 UTC
workspace cleanups needed on jenkins master
All,
The Jenkins master needs to be cleaned up. Could the following projects please reduce your usage significantly by 5 January. After 5 Jan Infra will be purging more aggressively and updating job configurations as needed. As a rule of thumb, we’d like to see projects retain no more than 1 week or 7 builds worth of historical data at the absolute maximum. Larger projects should retain less to avoid using up a disproportionate amount of space on the master.
Some workspaces without any identifiable associated Project will be removed.
3911 GB .
275 GB ./incubator-netbeans-linux
270 GB ./pulsar-website-build
249 GB ./pulsar-master
199 GB ./Packaging
127 GB ./HBase
121 GB ./PreCommit-ZOOKEEPER-github-pr-build
107 GB ./Any23-trunk
102 GB ./incubator-netbeans-release
79 GB ./incubator-netbeans-linux-experiment
77 GB ./beam_PostCommit_Java_PVR_Flink_Batch
76 GB ./HBase-1.3-JDK8
70 GB ./Jackrabbit-Oak-Windows
70 GB ./stanbol-0.12
59 GB ./HBase-Find-Flaky-Tests
54 GB ./CouchDB
51 GB ./beam_PostCommit_Java_PVR_Flink_Streaming
48 GB ./incubator-netbeans-windows
47 GB ./FlexJS
42 GB ./HBase
41 GB ./pulsar-pull-request
37 GB ./ZooKeeper_branch35_jdk8
32 GB ./HBase-Flaky-Tests
32 GB ./Atlas-master-NoTests
31 GB ./Atlas-1.0-NoTests
31 GB ./beam_PreCommit_Java_Commit
30 GB ./Zookeeper_UT_Java18
29 GB ./Phoenix-4.x-HBase-1.4
28 GB ./HBase-2.0-hadoop3-tests
27 GB ./flink-github-ci
27 GB ./ZooKeeper_branch35_jdk7
27 GB ./oodt-trunk
25 GB ./opennlp
25 GB ./Trinidad
22 GB ./Phoenix-4.x-HBase-1.3
21 GB ./ZooKeeper_Flaky_StressTest
21 GB ./Atlas-master-AllTests
21 GB ./beam_PostCommit_Java_ValidatesRunner_Flink
20 GB ./HBase-1.3-JDK7
20 GB ./PreCommit-HBASE-Build
18 GB ./hadoop-trunk-win
18 GB ./HBase-1.2-JDK7
18 GB ./HBASE-14070.HLC
18 GB ./maven-box
17 GB ./Atlas-1.0-AllTests
17 GB ./Archiva-TLP-Gitbox
17 GB ./Apache
17 GB ./Phoenix-5.x-HBase-2.0
17 GB ./Phoenix-omid2
16 GB ./Lucene-Solr-BadApples-NightlyTests-7.x
15 GB ./HBase-2.0
14 GB ./flume-trunk
14 GB ./beam_PostCommit_Java_ValidatesRunner_Samza
14 GB ./HBase-Trunk_matrix
13 GB ./commons-csv
13 GB ./HBase-Flaky-Tests-old-just-master
13 GB ./oodt-coverage
12 GB ./incubator-rya-master-with-optionals
12 GB ./Syncope-master-deploy
11 GB ./PreCommit-PHOENIX-Build
11 GB ./Stratos-Master-Nightly-Build
11 GB ./Phoenix-master
11 GB ./Hadoop-trunk-JACC
10 GB ./ctakes-trunk-package
10 GB ./FlexJS
10 GB ./Atlas-1.0-IntegrationTests
9 GB ./incubator-rya-master
9 GB ./Atlas-master-IntegrationTests
9 GB ./beam_PostCommit_Java_ValidatesRunner_Spark
9 GB ./ZooKeeper_UT_Java7
9 GB ./Qpid-Broker-J-7.0.x-TestMatrix
9 GB ./oodt-dependency-update
9 GB ./Apache
8 GB ./Struts-examples-JDK8-master
8 GB ./Phoenix-4.x-HBase-1.2
8 GB ./flume-github-pull-request
8 GB ./HBase-HBASE-14614
8 GB ./tika-trunk-jdk1.7
8 GB ./HBase-1.2-JDK8
8 GB ./HBase-1.5
7 GB ./Atlas-master-UnitTests
7 GB ./tika-2.x-windows
7 GB ./incubator-rya-master-with-optionals-pull-requests
7 GB ./Hive-trunk
7 GB ./beam_PreCommit_Java_Cron
7 GB ./Atlas-1.0-UnitTests
6 GB ./Jackrabbit
6 GB ./beam_PostCommit_Java_PVR_Flink_PR
6 GB ./Lucene-Solr-Clover-master
6 GB ./Syncope-2_0_X-deploy
6 GB ./beam_PostCommit_Java_ValidatesRunner_Apex
6 GB ./Tika-trunk
6 GB ./pirk
6 GB ./Syncope-2_1_X-deploy
6 GB ./PLC4X
6 GB ./myfaces-current-2.0-integration-tests
5 GB ./commons-lang
5 GB ./Nemo
5 GB ./Mesos-Buildbot
5 GB ./Qpid-Broker-J-7.1.x-TestMatrix
5 GB ./beam_PostCommit_Java_Nexmark_Flink
5 GB ./Qpid-Broker-J-TestMatrix
5 GB ./ZooKeeper-Hammer
5 GB ./Camel
5 GB ./Royale
5 GB ./tika-branch-1x
5 GB ./ManifoldCF-ant
5 GB ./PreCommit-SQOOP-Build
5 GB ./HBase-1.4
5 GB ./ZooKeeper_UT_Stress
4 GB ./beam_PreCommit_Java_Phrase
4 GB ./dir-studio
4 GB ./Camel.trunk.notest
4 GB ./pulsar-release-binaries
4 GB ./Qpid-Java-Java-6.1.x-TestMatrix
4 GB ./Oak-Win
4 GB ./Mesos-Websitebot
4 GB ./incubator-rya-fork
4 GB ./Knox-master-verify
4 GB ./Syncope-Release-Docker
4 GB ./Lucene-Solr-Clover-7.x
4 GB ./openmeetings
4 GB ./Mesos
4 GB ./apache-atlas-nightly
4 GB ./Pig-trunk
4 GB ./beam_PostCommit_Java_ValidatesRunner_Dataflow
4 GB ./Camel.2.20.x.notest
3 GB ./PreCommit-HDFS-Build
3 GB ./airavata-master
3 GB ./Stratos-41x-Nightly-Build
3 GB ./oodt-2.0-development
3 GB ./hadoop-qbt-branch2-java7-linux-x86-jhung
3 GB ./incubator-rya-fork-with-optionals
3 GB ./CXF-trunk-deploy
3 GB ./Camel.trunk.notest.java9
3 GB ./Lens-Commit
3 GB ./commons-imaging
3 GB ./Giraph-trunk-site
3 GB ./Zookeeper-trunk-single-thread
3 GB ./brooklyn-dist-master
3 GB ./ZooKeeper-trunk
3 GB ./Mesos-Buildbot-Test
3 GB ./cloudstack-pr-analysis
3 GB ./Knox-master-daily
2 GB ./incubator-netbeans-javadoc
2 GB ./ZooKeeper-trunk-java10
2 GB ./beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow
2 GB ./mailbox
2 GB ./ODFToolkit
2 GB ./beam_PostCommit_Java_ValidatesRunner_Gearpump
2 GB ./Curator
2 GB ./beam_PreCommit_JavaPortabilityApi_Commit
2 GB ./ODFToolkit-windows
2 GB ./Log4jCore
2 GB ./Apache-Falcon-Distributed-Assembly
2 GB ./ZooKeeper-trunk-openjdk10
2 GB ./Stratos-Master-Commit-Build
2 GB ./mahout-nightly
2 GB ./Stratos-41x-Commit-Build
2 GB ./tika-2.x
2 GB ./james-server-trunk
2 GB ./ZooKeeper-trunk-java9
2 GB ./OpenMeetings
2 GB ./Solr-Artifacts-master
2 GB ./isis
2 GB ./Solr-Artifacts-7.x
2 GB ./Lucene-Solr-Tests-5.5
2 GB ./Solr-Artifacts-7.6
2 GB ./ZooKeeper-trunk-clover
2 GB ./airavata-dev
2 GB ./HBASE-16264
2 GB ./ZooKeeper-trunk-java11
2 GB ./Camel.2.19.x.notest
2 GB ./drill-scm
2 GB ./HBase-Trunk-IT
2 GB ./sling-site
2 GB ./HBase-0.98-matrix
2 GB ./Chemistry
Re: workspace cleanups needed on jenkins master
Posted by Adina Crainiceanu <ad...@usna.edu>.
For Rya on builds.apache.org, I now changed the "Discard old builds"
settings to specify a value of 5 or 7 for all of "Days to keep build", "Max
# of builds to keep", "Days to keep artifacts", and "Max # of builds to
keep with artifacts". Before we only had "Max # of builds to keep" set. If
this still does not work. please let us know what settings to change and
how.
Thanks,
Adina
On Fri, Dec 28, 2018 at 7:48 AM Christofer Dutz <ch...@c-ware.de>
wrote:
> Ok ...
>
> so it seems that the option "Days to keep old items" (I set it to "1")
> when I setup the job quite some time ago isn't what's controlling this.
> I just updated the Jenkinsfile to set the buildDiscarder in it's option
> section ... hopefully it will work.
>
> Chris
>
>
> Am 28.12.18, 12:22 schrieb "Olivier Lamy" <ol...@apache.org>:
>
> Looking at https://builds.apache.org/job/PLC4X/job/PLC4X/job/develop/
> the history is 30 builds for only one branch (same for others)
> this history is consuming space
>
> On Fri, 28 Dec 2018 at 19:58, Christofer Dutz <
> christofer.dutz@c-ware.de>
> wrote:
>
> > Hi all,
> >
> > seeing PLC4X consuming 6 GB ... being a quite small project, that's
> > clearly too much.
> > Even if I have an idea why this is probably the reason. Could you
> please
> > also share what's consuming that much space?
> >
> > Chris
> >
> >
> >
> > Am 27.12.18, 20:05 schrieb "Karl Heinz Marbaise" <khmarbaise@gmx.de
> >:
> >
> > Hi Chris,
> >
> > On 27/12/18 19:27, Chris Lambertus wrote:
> > >
> > >
> > >> On Dec 27, 2018, at 4:36 AM, Karl Heinz Marbaise <
> khmarbaise@gmx.de>
> > wrote:
> > >>
> > >> Hi Gavin,
> > >>
> > >> On 27/12/18 13:00, Gavin McDonald wrote:
> > >>> On Thu, Dec 27, 2018 at 10:27 AM Karl Heinz Marbaise <
> > khmarbaise@gmx.de <ma...@gmx.de>> wrote:
> > >>> <snip>
> > >>> Furthermore I'm a little bit astonished that jobs consume
> > space on
> > >>> Master cause If I'm correct no job should run on
> Master...
> > >>> Right, they dont, but artifacts etc are stored there.
> > >>
> > >> Oups ? Which one ...Can you show a more detailed list in
> maven-box
> > directory...? Maybe we can tweak the configuration a little bit to
> suppress
> > storing artifacts there ? Sounds strange to me…
> > >
> > > As Robert mentioned, this is a multibranch build, so the actual
> > artifacts are deep in the tree. Here is an example
> > >
> > > root@jenkins02
> :/x1/jenkins/jenkins-home/jobs/maven-box/jobs/maven-surefire/branches/master/builds#
> > du -sh *
> > > 416M 105
> > > 490M 106
> > > 419M 107
> > > 491M 108
> > > 16K 109
> > > 48K 110
> > > 499M 111
> > > 481M 112
> > > 515M 113
> > > 495M 114
> > >
> > > As you can see, there are 10 stored builds dating back to 15
> > December. This could be adjusted to only store 5 builds or 7 days
> worth and
> > reduce the usage of this particular branch/job by nearly 50%.
> > >
> > > Build 105 contains hundreds of log files, including one 48MB
> log, as
> > well as zipped archives of what appear to be built releases. I can’t
> see a
> > need for these to be kept, so perhaps your build could be adjusted
> to purge
> > these:
> > >
> > >
> >
> /x1/jenkins/jenkins-home/jobs/maven-box/jobs/maven-surefire/branches/master/builds/105/archive
> > >
> > > [ .. ]
> > > -rw-r----- 1 jenkins jenkins 20370694 Dec 15 06:47
> > surefire-its--windows-jdk11-maven3.2.x.zip
> > > -rw-r----- 1 jenkins jenkins 20211112 Dec 15 06:54
> > surefire-its--windows-jdk11-maven3.3.x.zip
> > > -rw-r----- 1 jenkins jenkins 20250674 Dec 15 07:00
> > surefire-its--windows-jdk11-maven3.5.x.zip
> > > -rw-r----- 1 jenkins jenkins 17077193 Dec 15 06:52
> > surefire-its--windows-jdk7-maven3.2.x.zip
> > >
> > >
> > > -Chris
> > >
> > >
> > >
> > >>
> > >> But let us investigate that...
> > >>
> >
> > That is what I expected so there is room for improvement...
> >
> > Thank Chris...
> >
> > I will take a deeper look into this..
> >
> > Kind regards
> > Karl Heinz Marbaise
> >
> >
> >
>
> --
> Olivier Lamy
> http://twitter.com/olamy | http://linkedin.com/in/olamy
>
>
>
Re: workspace cleanups needed on jenkins master
Posted by Christofer Dutz <ch...@c-ware.de>.
Ok ...
so it seems that the option "Days to keep old items" (I set it to "1") when I setup the job quite some time ago isn't what's controlling this.
I just updated the Jenkinsfile to set the buildDiscarder in it's option section ... hopefully it will work.
Chris
Am 28.12.18, 12:22 schrieb "Olivier Lamy" <ol...@apache.org>:
Looking at https://builds.apache.org/job/PLC4X/job/PLC4X/job/develop/
the history is 30 builds for only one branch (same for others)
this history is consuming space
On Fri, 28 Dec 2018 at 19:58, Christofer Dutz <ch...@c-ware.de>
wrote:
> Hi all,
>
> seeing PLC4X consuming 6 GB ... being a quite small project, that's
> clearly too much.
> Even if I have an idea why this is probably the reason. Could you please
> also share what's consuming that much space?
>
> Chris
>
>
>
> Am 27.12.18, 20:05 schrieb "Karl Heinz Marbaise" <kh...@gmx.de>:
>
> Hi Chris,
>
> On 27/12/18 19:27, Chris Lambertus wrote:
> >
> >
> >> On Dec 27, 2018, at 4:36 AM, Karl Heinz Marbaise <kh...@gmx.de>
> wrote:
> >>
> >> Hi Gavin,
> >>
> >> On 27/12/18 13:00, Gavin McDonald wrote:
> >>> On Thu, Dec 27, 2018 at 10:27 AM Karl Heinz Marbaise <
> khmarbaise@gmx.de <ma...@gmx.de>> wrote:
> >>> <snip>
> >>> Furthermore I'm a little bit astonished that jobs consume
> space on
> >>> Master cause If I'm correct no job should run on Master...
> >>> Right, they dont, but artifacts etc are stored there.
> >>
> >> Oups ? Which one ...Can you show a more detailed list in maven-box
> directory...? Maybe we can tweak the configuration a little bit to suppress
> storing artifacts there ? Sounds strange to me…
> >
> > As Robert mentioned, this is a multibranch build, so the actual
> artifacts are deep in the tree. Here is an example
> >
> > root@jenkins02:/x1/jenkins/jenkins-home/jobs/maven-box/jobs/maven-surefire/branches/master/builds#
> du -sh *
> > 416M 105
> > 490M 106
> > 419M 107
> > 491M 108
> > 16K 109
> > 48K 110
> > 499M 111
> > 481M 112
> > 515M 113
> > 495M 114
> >
> > As you can see, there are 10 stored builds dating back to 15
> December. This could be adjusted to only store 5 builds or 7 days worth and
> reduce the usage of this particular branch/job by nearly 50%.
> >
> > Build 105 contains hundreds of log files, including one 48MB log, as
> well as zipped archives of what appear to be built releases. I can’t see a
> need for these to be kept, so perhaps your build could be adjusted to purge
> these:
> >
> >
> /x1/jenkins/jenkins-home/jobs/maven-box/jobs/maven-surefire/branches/master/builds/105/archive
> >
> > [ .. ]
> > -rw-r----- 1 jenkins jenkins 20370694 Dec 15 06:47
> surefire-its--windows-jdk11-maven3.2.x.zip
> > -rw-r----- 1 jenkins jenkins 20211112 Dec 15 06:54
> surefire-its--windows-jdk11-maven3.3.x.zip
> > -rw-r----- 1 jenkins jenkins 20250674 Dec 15 07:00
> surefire-its--windows-jdk11-maven3.5.x.zip
> > -rw-r----- 1 jenkins jenkins 17077193 Dec 15 06:52
> surefire-its--windows-jdk7-maven3.2.x.zip
> >
> >
> > -Chris
> >
> >
> >
> >>
> >> But let us investigate that...
> >>
>
> That is what I expected so there is room for improvement...
>
> Thank Chris...
>
> I will take a deeper look into this..
>
> Kind regards
> Karl Heinz Marbaise
>
>
>
--
Olivier Lamy
http://twitter.com/olamy | http://linkedin.com/in/olamy
Re: workspace cleanups needed on jenkins master
Posted by Olivier Lamy <ol...@apache.org>.
Looking at https://builds.apache.org/job/PLC4X/job/PLC4X/job/develop/
the history is 30 builds for only one branch (same for others)
this history is consuming space
On Fri, 28 Dec 2018 at 19:58, Christofer Dutz <ch...@c-ware.de>
wrote:
> Hi all,
>
> seeing PLC4X consuming 6 GB ... being a quite small project, that's
> clearly too much.
> Even if I have an idea why this is probably the reason. Could you please
> also share what's consuming that much space?
>
> Chris
>
>
>
> Am 27.12.18, 20:05 schrieb "Karl Heinz Marbaise" <kh...@gmx.de>:
>
> Hi Chris,
>
> On 27/12/18 19:27, Chris Lambertus wrote:
> >
> >
> >> On Dec 27, 2018, at 4:36 AM, Karl Heinz Marbaise <kh...@gmx.de>
> wrote:
> >>
> >> Hi Gavin,
> >>
> >> On 27/12/18 13:00, Gavin McDonald wrote:
> >>> On Thu, Dec 27, 2018 at 10:27 AM Karl Heinz Marbaise <
> khmarbaise@gmx.de <ma...@gmx.de>> wrote:
> >>> <snip>
> >>> Furthermore I'm a little bit astonished that jobs consume
> space on
> >>> Master cause If I'm correct no job should run on Master...
> >>> Right, they dont, but artifacts etc are stored there.
> >>
> >> Oups ? Which one ...Can you show a more detailed list in maven-box
> directory...? Maybe we can tweak the configuration a little bit to suppress
> storing artifacts there ? Sounds strange to me…
> >
> > As Robert mentioned, this is a multibranch build, so the actual
> artifacts are deep in the tree. Here is an example
> >
> > root@jenkins02:/x1/jenkins/jenkins-home/jobs/maven-box/jobs/maven-surefire/branches/master/builds#
> du -sh *
> > 416M 105
> > 490M 106
> > 419M 107
> > 491M 108
> > 16K 109
> > 48K 110
> > 499M 111
> > 481M 112
> > 515M 113
> > 495M 114
> >
> > As you can see, there are 10 stored builds dating back to 15
> December. This could be adjusted to only store 5 builds or 7 days worth and
> reduce the usage of this particular branch/job by nearly 50%.
> >
> > Build 105 contains hundreds of log files, including one 48MB log, as
> well as zipped archives of what appear to be built releases. I can’t see a
> need for these to be kept, so perhaps your build could be adjusted to purge
> these:
> >
> >
> /x1/jenkins/jenkins-home/jobs/maven-box/jobs/maven-surefire/branches/master/builds/105/archive
> >
> > [ .. ]
> > -rw-r----- 1 jenkins jenkins 20370694 Dec 15 06:47
> surefire-its--windows-jdk11-maven3.2.x.zip
> > -rw-r----- 1 jenkins jenkins 20211112 Dec 15 06:54
> surefire-its--windows-jdk11-maven3.3.x.zip
> > -rw-r----- 1 jenkins jenkins 20250674 Dec 15 07:00
> surefire-its--windows-jdk11-maven3.5.x.zip
> > -rw-r----- 1 jenkins jenkins 17077193 Dec 15 06:52
> surefire-its--windows-jdk7-maven3.2.x.zip
> >
> >
> > -Chris
> >
> >
> >
> >>
> >> But let us investigate that...
> >>
>
> That is what I expected so there is room for improvement...
>
> Thank Chris...
>
> I will take a deeper look into this..
>
> Kind regards
> Karl Heinz Marbaise
>
>
>
--
Olivier Lamy
http://twitter.com/olamy | http://linkedin.com/in/olamy
Re: workspace cleanups needed on jenkins master
Posted by Christofer Dutz <ch...@c-ware.de>.
Hi all,
seeing PLC4X consuming 6 GB ... being a quite small project, that's clearly too much.
Even if I have an idea why this is probably the reason. Could you please also share what's consuming that much space?
Chris
Am 27.12.18, 20:05 schrieb "Karl Heinz Marbaise" <kh...@gmx.de>:
Hi Chris,
On 27/12/18 19:27, Chris Lambertus wrote:
>
>
>> On Dec 27, 2018, at 4:36 AM, Karl Heinz Marbaise <kh...@gmx.de> wrote:
>>
>> Hi Gavin,
>>
>> On 27/12/18 13:00, Gavin McDonald wrote:
>>> On Thu, Dec 27, 2018 at 10:27 AM Karl Heinz Marbaise <khmarbaise@gmx.de <ma...@gmx.de>> wrote:
>>> <snip>
>>> Furthermore I'm a little bit astonished that jobs consume space on
>>> Master cause If I'm correct no job should run on Master...
>>> Right, they dont, but artifacts etc are stored there.
>>
>> Oups ? Which one ...Can you show a more detailed list in maven-box directory...? Maybe we can tweak the configuration a little bit to suppress storing artifacts there ? Sounds strange to me…
>
> As Robert mentioned, this is a multibranch build, so the actual artifacts are deep in the tree. Here is an example
>
> root@jenkins02:/x1/jenkins/jenkins-home/jobs/maven-box/jobs/maven-surefire/branches/master/builds# du -sh *
> 416M 105
> 490M 106
> 419M 107
> 491M 108
> 16K 109
> 48K 110
> 499M 111
> 481M 112
> 515M 113
> 495M 114
>
> As you can see, there are 10 stored builds dating back to 15 December. This could be adjusted to only store 5 builds or 7 days worth and reduce the usage of this particular branch/job by nearly 50%.
>
> Build 105 contains hundreds of log files, including one 48MB log, as well as zipped archives of what appear to be built releases. I can’t see a need for these to be kept, so perhaps your build could be adjusted to purge these:
>
> /x1/jenkins/jenkins-home/jobs/maven-box/jobs/maven-surefire/branches/master/builds/105/archive
>
> [ .. ]
> -rw-r----- 1 jenkins jenkins 20370694 Dec 15 06:47 surefire-its--windows-jdk11-maven3.2.x.zip
> -rw-r----- 1 jenkins jenkins 20211112 Dec 15 06:54 surefire-its--windows-jdk11-maven3.3.x.zip
> -rw-r----- 1 jenkins jenkins 20250674 Dec 15 07:00 surefire-its--windows-jdk11-maven3.5.x.zip
> -rw-r----- 1 jenkins jenkins 17077193 Dec 15 06:52 surefire-its--windows-jdk7-maven3.2.x.zip
>
>
> -Chris
>
>
>
>>
>> But let us investigate that...
>>
That is what I expected so there is room for improvement...
Thank Chris...
I will take a deeper look into this..
Kind regards
Karl Heinz Marbaise
Re: workspace cleanups needed on jenkins master
Posted by Karl Heinz Marbaise <kh...@gmx.de>.
Hi Chris,
On 27/12/18 19:27, Chris Lambertus wrote:
>
>
>> On Dec 27, 2018, at 4:36 AM, Karl Heinz Marbaise <kh...@gmx.de> wrote:
>>
>> Hi Gavin,
>>
>> On 27/12/18 13:00, Gavin McDonald wrote:
>>> On Thu, Dec 27, 2018 at 10:27 AM Karl Heinz Marbaise <khmarbaise@gmx.de <ma...@gmx.de>> wrote:
>>> <snip>
>>> Furthermore I'm a little bit astonished that jobs consume space on
>>> Master cause If I'm correct no job should run on Master...
>>> Right, they dont, but artifacts etc are stored there.
>>
>> Oups ? Which one ...Can you show a more detailed list in maven-box directory...? Maybe we can tweak the configuration a little bit to suppress storing artifacts there ? Sounds strange to me…
>
> As Robert mentioned, this is a multibranch build, so the actual artifacts are deep in the tree. Here is an example
>
> root@jenkins02:/x1/jenkins/jenkins-home/jobs/maven-box/jobs/maven-surefire/branches/master/builds# du -sh *
> 416M 105
> 490M 106
> 419M 107
> 491M 108
> 16K 109
> 48K 110
> 499M 111
> 481M 112
> 515M 113
> 495M 114
>
> As you can see, there are 10 stored builds dating back to 15 December. This could be adjusted to only store 5 builds or 7 days worth and reduce the usage of this particular branch/job by nearly 50%.
>
> Build 105 contains hundreds of log files, including one 48MB log, as well as zipped archives of what appear to be built releases. I can’t see a need for these to be kept, so perhaps your build could be adjusted to purge these:
>
> /x1/jenkins/jenkins-home/jobs/maven-box/jobs/maven-surefire/branches/master/builds/105/archive
>
> [ .. ]
> -rw-r----- 1 jenkins jenkins 20370694 Dec 15 06:47 surefire-its--windows-jdk11-maven3.2.x.zip
> -rw-r----- 1 jenkins jenkins 20211112 Dec 15 06:54 surefire-its--windows-jdk11-maven3.3.x.zip
> -rw-r----- 1 jenkins jenkins 20250674 Dec 15 07:00 surefire-its--windows-jdk11-maven3.5.x.zip
> -rw-r----- 1 jenkins jenkins 17077193 Dec 15 06:52 surefire-its--windows-jdk7-maven3.2.x.zip
>
>
> -Chris
>
>
>
>>
>> But let us investigate that...
>>
That is what I expected so there is room for improvement...
Thank Chris...
I will take a deeper look into this..
Kind regards
Karl Heinz Marbaise
Re: workspace cleanups needed on jenkins master
Posted by Chris Lambertus <cm...@apache.org>.
> On Dec 27, 2018, at 4:36 AM, Karl Heinz Marbaise <kh...@gmx.de> wrote:
>
> Hi Gavin,
>
> On 27/12/18 13:00, Gavin McDonald wrote:
>> On Thu, Dec 27, 2018 at 10:27 AM Karl Heinz Marbaise <khmarbaise@gmx.de <ma...@gmx.de>> wrote:
>> <snip>
>> Furthermore I'm a little bit astonished that jobs consume space on
>> Master cause If I'm correct no job should run on Master...
>> Right, they dont, but artifacts etc are stored there.
>
> Oups ? Which one ...Can you show a more detailed list in maven-box directory...? Maybe we can tweak the configuration a little bit to suppress storing artifacts there ? Sounds strange to me…
As Robert mentioned, this is a multibranch build, so the actual artifacts are deep in the tree. Here is an example
root@jenkins02:/x1/jenkins/jenkins-home/jobs/maven-box/jobs/maven-surefire/branches/master/builds# du -sh *
416M 105
490M 106
419M 107
491M 108
16K 109
48K 110
499M 111
481M 112
515M 113
495M 114
As you can see, there are 10 stored builds dating back to 15 December. This could be adjusted to only store 5 builds or 7 days worth and reduce the usage of this particular branch/job by nearly 50%.
Build 105 contains hundreds of log files, including one 48MB log, as well as zipped archives of what appear to be built releases. I can’t see a need for these to be kept, so perhaps your build could be adjusted to purge these:
/x1/jenkins/jenkins-home/jobs/maven-box/jobs/maven-surefire/branches/master/builds/105/archive
[ .. ]
-rw-r----- 1 jenkins jenkins 20370694 Dec 15 06:47 surefire-its--windows-jdk11-maven3.2.x.zip
-rw-r----- 1 jenkins jenkins 20211112 Dec 15 06:54 surefire-its--windows-jdk11-maven3.3.x.zip
-rw-r----- 1 jenkins jenkins 20250674 Dec 15 07:00 surefire-its--windows-jdk11-maven3.5.x.zip
-rw-r----- 1 jenkins jenkins 17077193 Dec 15 06:52 surefire-its--windows-jdk7-maven3.2.x.zip
-Chris
>
> But let us investigate that...
>
> Kind regards
> Karl Heinz Marbaise
>> Gav...
>> Kind regards
>> Karl Heinz Marbaise
>> Apache Maven PMC
>> --
>> Gav...
Re: workspace cleanups needed on jenkins master
Posted by Karl Heinz Marbaise <kh...@gmx.de>.
Hi Gavin,
On 27/12/18 13:00, Gavin McDonald wrote:
>
>
> On Thu, Dec 27, 2018 at 10:27 AM Karl Heinz Marbaise <khmarbaise@gmx.de
> <ma...@gmx.de>> wrote:
>
> <snip>
>
>
> Furthermore I'm a little bit astonished that jobs consume space on
> Master cause If I'm correct no job should run on Master...
>
>
> Right, they dont, but artifacts etc are stored there.
Oups ? Which one ...Can you show a more detailed list in maven-box
directory...? Maybe we can tweak the configuration a little bit to
suppress storing artifacts there ? Sounds strange to me...
But let us investigate that...
Kind regards
Karl Heinz Marbaise
>
> Gav...
>
>
>
> Kind regards
> Karl Heinz Marbaise
> Apache Maven PMC
>
>
>
> --
> Gav...
Re: workspace cleanups needed on jenkins master
Posted by Gavin McDonald <ip...@gmail.com>.
On Thu, Dec 27, 2018 at 10:27 AM Karl Heinz Marbaise <kh...@gmx.de>
wrote:
> <snip>
>
>
> Furthermore I'm a little bit astonished that jobs consume space on
> Master cause If I'm correct no job should run on Master...
>
Right, they dont, but artifacts etc are stored there.
Gav...
>
> Kind regards
> Karl Heinz Marbaise
> Apache Maven PMC
>
>
--
Gav...
Re: workspace cleanups needed on jenkins master
Posted by Greg Stein <gs...@gmail.com>.
On Thu, Dec 27, 2018 at 4:35 AM Robert Scholte <rf...@apache.org> wrote:
> maven-box[1] is actually our multibranch(?) job for all our ~100
> repositories, which means the 18Gb is quite a good number.
> With this in mind I believe maven-box should not be on the list for
> cleanup.
>
Chris' note wasn't about "justification" and/or "remove me from the list"
... but more "this is a shared resource. what can each community do, to
help?"
Your answer appears to be "we cannot do anything, as it seems we're already
rockin' it out low numbers for our 100 repositories." Alrighty then.
We shall look to other communities to reduce the amount of shared disk
usage.
Regards,
Greg Stein
InfraAdmin, ASF
Re: workspace cleanups needed on jenkins master
Posted by Maxim Solodovnik <so...@gmail.com>.
Just have updated OpenMeetings jobs to have
Days to keep old item: 7
Max # of old items to keep: 3
local workspace consumes 1.5Gb, so I guess 4Gb includes .m2/repository
Are there any options to perform clean-up after the build?
On Thu, 27 Dec 2018 at 17:35, Robert Scholte <rf...@apache.org> wrote:
> maven-box[1] is actually our multibranch(?) job for all our ~100
> repositories, which means the 18Gb is quite a good number.
> With this in mind I believe maven-box should not be on the list for
> cleanup.
>
> thanks,
> Robert
>
> [1] https://builds.apache.org/job/maven-box/
>
>
> On Thu, 27 Dec 2018 11:27:31 +0100, Karl Heinz Marbaise
> <kh...@gmx.de> wrote:
>
> > Hi Chris,
> >
> > I've seen that maven-box consumes 18 GB size...
> >
> > Can you please make a more detailed analysis of the maven-box directory
> > to see what is consuming up so much space?...
> >
> > I've already checked the configuration for that job
> >
> > Days to keep old item: 7
> > Max # of old items to keep: 5
> >
> >
> > Furthermore I'm a little bit astonished that jobs consume space on
> > Master cause If I'm correct no job should run on Master...
> >
> >
> > Kind regards
> > Karl Heinz Marbaise
> > Apache Maven PMC
>
--
WBR
Maxim aka solomax
Re: workspace cleanups needed on jenkins master
Posted by Robert Scholte <rf...@apache.org>.
maven-box[1] is actually our multibranch(?) job for all our ~100
repositories, which means the 18Gb is quite a good number.
With this in mind I believe maven-box should not be on the list for
cleanup.
thanks,
Robert
[1] https://builds.apache.org/job/maven-box/
On Thu, 27 Dec 2018 11:27:31 +0100, Karl Heinz Marbaise
<kh...@gmx.de> wrote:
> Hi Chris,
>
> I've seen that maven-box consumes 18 GB size...
>
> Can you please make a more detailed analysis of the maven-box directory
> to see what is consuming up so much space?...
>
> I've already checked the configuration for that job
>
> Days to keep old item: 7
> Max # of old items to keep: 5
>
>
> Furthermore I'm a little bit astonished that jobs consume space on
> Master cause If I'm correct no job should run on Master...
>
>
> Kind regards
> Karl Heinz Marbaise
> Apache Maven PMC
Re: workspace cleanups needed on jenkins master
Posted by Karl Heinz Marbaise <kh...@gmx.de>.
Hi Chris,
I've seen that maven-box consumes 18 GB size...
Can you please make a more detailed analysis of the maven-box directory
to see what is consuming up so much space?...
I've already checked the configuration for that job
Days to keep old item: 7
Max # of old items to keep: 5
Furthermore I'm a little bit astonished that jobs consume space on
Master cause If I'm correct no job should run on Master...
Kind regards
Karl Heinz Marbaise
Apache Maven PMC
Re: workspace cleanups needed on jenkins master
Posted by Udi Meiri <eh...@google.com>.
Alan, Mikhail, feel free to merge https://github.com/apache/beam/pull/7410
when ready.
On Thu, Jan 3, 2019 at 5:39 PM Mikhail Gryzykhin <mi...@google.com> wrote:
> It is not required for https://s.apache.org/beam-community-metrics .
>
> I believe that's main dash we have atm.
>
> @Alan Myrvold <am...@google.com> Can you confirm?
>
> --Mikhail
>
> Have feedback <http://go/migryz-feedback>?
>
>
> On Thu, Jan 3, 2019 at 1:59 PM Udi Meiri <eh...@google.com> wrote:
>
>>
>>
>> On Thu, Dec 27, 2018 at 11:02 AM Ismaël Mejía <ie...@gmail.com> wrote:
>>
>>> Bringing this subject for awareness to dev@
>>> We are sadly part of this top.
>>> Does somebody know what this data is? And if we can clean it
>>> periodically?
>>> Can somebody with more sysadmin super powers take a look and act on this.
>>>
>>> ---------- Forwarded message ---------
>>> From: Chris Lambertus <cm...@apache.org>
>>> Date: Thu, Dec 27, 2018 at 1:36 AM
>>> Subject: workspace cleanups needed on jenkins master
>>> To: <bu...@apache.org>
>>>
>>>
>>> All,
>>>
>>> The Jenkins master needs to be cleaned up. Could the following
>>> projects please reduce your usage significantly by 5 January. After 5
>>> Jan Infra will be purging more aggressively and updating job
>>> configurations as needed. As a rule of thumb, we’d like to see
>>> projects retain no more than 1 week or 7 builds worth of historical
>>> data at the absolute maximum. Larger projects should retain less to
>>> avoid using up a disproportionate amount of space on the master.
>>>
>>> Some workspaces without any identifiable associated Project will be
>>> removed.
>>>
>>>
>>>
>>> 3911 GB .
>>> 275 GB ./incubator-netbeans-linux
>>> 270 GB ./pulsar-website-build
>>> 249 GB ./pulsar-master
>>> 199 GB ./Packaging
>>> 127 GB ./HBase
>>> 121 GB ./PreCommit-ZOOKEEPER-github-pr-build
>>> 107 GB ./Any23-trunk
>>> 102 GB ./incubator-netbeans-release
>>> 79 GB ./incubator-netbeans-linux-experiment
>>> 77 GB ./beam_PostCommit_Java_PVR_Flink_Batch
>>>
>>
>> Wow, this job has huge logs (400MB+).
>> https://builds.apache.org/view/A-D/view/Beam/view/PostCommit/job/beam_PostCommit_Java_PVR_Flink_Batch/330/console
>> A few weeks back I suggested removing the --info flag passed to Gradle.
>> I haven't done that yet, but it might help reduce the size of logs.
>> (which I assume are all stored on master?)
>>
>> Short-term, we could reduce retention back down to 14 instead of the current
>> 30
>> <https://github.com/apache/beam/blob/5716dba6d10f32dfa8ab807ffacc2e68f9267225/.test-infra/jenkins/CommonJobProperties.groovy#L46>
>> .
>> +Alan Myrvold <am...@google.com> +Mikhail Gryzykhin
>> <mi...@google.com> we don't need 30 days retention any longer for test
>> dashboards, right?
>>
>>
>>> 76 GB ./HBase-1.3-JDK8
>>> 70 GB ./Jackrabbit-Oak-Windows
>>> 70 GB ./stanbol-0.12
>>> 59 GB ./HBase-Find-Flaky-Tests
>>> 54 GB ./CouchDB
>>> 51 GB ./beam_PostCommit_Java_PVR_Flink_Streaming
>>> 48 GB ./incubator-netbeans-windows
>>> 47 GB ./FlexJS
>>> 42 GB ./HBase
>>> 41 GB ./pulsar-pull-request
>>> 37 GB ./ZooKeeper_branch35_jdk8
>>> 32 GB ./HBase-Flaky-Tests
>>> 32 GB ./Atlas-master-NoTests
>>> 31 GB ./Atlas-1.0-NoTests
>>> 31 GB ./beam_PreCommit_Java_Commit
>>> 30 GB ./Zookeeper_UT_Java18
>>> 29 GB ./Phoenix-4.x-HBase-1.4
>>> 28 GB ./HBase-2.0-hadoop3-tests
>>> 27 GB ./flink-github-ci
>>> 27 GB ./ZooKeeper_branch35_jdk7
>>> 27 GB ./oodt-trunk
>>> 25 GB ./opennlp
>>> 25 GB ./Trinidad
>>> 22 GB ./Phoenix-4.x-HBase-1.3
>>> 21 GB ./ZooKeeper_Flaky_StressTest
>>> 21 GB ./Atlas-master-AllTests
>>> 21 GB ./beam_PostCommit_Java_ValidatesRunner_Flink
>>> 20 GB ./HBase-1.3-JDK7
>>> 20 GB ./PreCommit-HBASE-Build
>>> 18 GB ./hadoop-trunk-win
>>> 18 GB ./HBase-1.2-JDK7
>>> 18 GB ./HBASE-14070.HLC
>>> 18 GB ./maven-box
>>> 17 GB ./Atlas-1.0-AllTests
>>> 17 GB ./Archiva-TLP-Gitbox
>>> 17 GB ./Apache
>>> 17 GB ./Phoenix-5.x-HBase-2.0
>>> 17 GB ./Phoenix-omid2
>>> 16 GB ./Lucene-Solr-BadApples-NightlyTests-7.x
>>> 15 GB ./HBase-2.0
>>> 14 GB ./flume-trunk
>>> 14 GB ./beam_PostCommit_Java_ValidatesRunner_Samza
>>> 14 GB ./HBase-Trunk_matrix
>>> 13 GB ./commons-csv
>>> 13 GB ./HBase-Flaky-Tests-old-just-master
>>> 13 GB ./oodt-coverage
>>> 12 GB ./incubator-rya-master-with-optionals
>>> 12 GB ./Syncope-master-deploy
>>> 11 GB ./PreCommit-PHOENIX-Build
>>> 11 GB ./Stratos-Master-Nightly-Build
>>> 11 GB ./Phoenix-master
>>> 11 GB ./Hadoop-trunk-JACC
>>> 10 GB ./ctakes-trunk-package
>>> 10 GB ./FlexJS
>>> 10 GB ./Atlas-1.0-IntegrationTests
>>> 9 GB ./incubator-rya-master
>>> 9 GB ./Atlas-master-IntegrationTests
>>> 9 GB ./beam_PostCommit_Java_ValidatesRunner_Spark
>>> 9 GB ./ZooKeeper_UT_Java7
>>> 9 GB ./Qpid-Broker-J-7.0.x-TestMatrix
>>> 9 GB ./oodt-dependency-update
>>> 9 GB ./Apache
>>> 8 GB ./Struts-examples-JDK8-master
>>> 8 GB ./Phoenix-4.x-HBase-1.2
>>> 8 GB ./flume-github-pull-request
>>> 8 GB ./HBase-HBASE-14614
>>> 8 GB ./tika-trunk-jdk1.7
>>> 8 GB ./HBase-1.2-JDK8
>>> 8 GB ./HBase-1.5
>>> 7 GB ./Atlas-master-UnitTests
>>> 7 GB ./tika-2.x-windows
>>> 7 GB ./incubator-rya-master-with-optionals-pull-requests
>>> 7 GB ./Hive-trunk
>>> 7 GB ./beam_PreCommit_Java_Cron
>>> 7 GB ./Atlas-1.0-UnitTests
>>> 6 GB ./Jackrabbit
>>> 6 GB ./beam_PostCommit_Java_PVR_Flink_PR
>>> 6 GB ./Lucene-Solr-Clover-master
>>> 6 GB ./Syncope-2_0_X-deploy
>>> 6 GB ./beam_PostCommit_Java_ValidatesRunner_Apex
>>> 6 GB ./Tika-trunk
>>> 6 GB ./pirk
>>> 6 GB ./Syncope-2_1_X-deploy
>>> 6 GB ./PLC4X
>>> 6 GB ./myfaces-current-2.0-integration-tests
>>> 5 GB ./commons-lang
>>> 5 GB ./Nemo
>>> 5 GB ./Mesos-Buildbot
>>> 5 GB ./Qpid-Broker-J-7.1.x-TestMatrix
>>> 5 GB ./beam_PostCommit_Java_Nexmark_Flink
>>> 5 GB ./Qpid-Broker-J-TestMatrix
>>> 5 GB ./ZooKeeper-Hammer
>>> 5 GB ./Camel
>>> 5 GB ./Royale
>>> 5 GB ./tika-branch-1x
>>> 5 GB ./ManifoldCF-ant
>>> 5 GB ./PreCommit-SQOOP-Build
>>> 5 GB ./HBase-1.4
>>> 5 GB ./ZooKeeper_UT_Stress
>>> 4 GB ./beam_PreCommit_Java_Phrase
>>> 4 GB ./dir-studio
>>> 4 GB ./Camel.trunk.notest
>>> 4 GB ./pulsar-release-binaries
>>> 4 GB ./Qpid-Java-Java-6.1.x-TestMatrix
>>> 4 GB ./Oak-Win
>>> 4 GB ./Mesos-Websitebot
>>> 4 GB ./incubator-rya-fork
>>> 4 GB ./Knox-master-verify
>>> 4 GB ./Syncope-Release-Docker
>>> 4 GB ./Lucene-Solr-Clover-7.x
>>> 4 GB ./openmeetings
>>> 4 GB ./Mesos
>>> 4 GB ./apache-atlas-nightly
>>> 4 GB ./Pig-trunk
>>> 4 GB ./beam_PostCommit_Java_ValidatesRunner_Dataflow
>>> 4 GB ./Camel.2.20.x.notest
>>> 3 GB ./PreCommit-HDFS-Build
>>> 3 GB ./airavata-master
>>> 3 GB ./Stratos-41x-Nightly-Build
>>> 3 GB ./oodt-2.0-development
>>> 3 GB ./hadoop-qbt-branch2-java7-linux-x86-jhung
>>> 3 GB ./incubator-rya-fork-with-optionals
>>> 3 GB ./CXF-trunk-deploy
>>> 3 GB ./Camel.trunk.notest.java9
>>> 3 GB ./Lens-Commit
>>> 3 GB ./commons-imaging
>>> 3 GB ./Giraph-trunk-site
>>> 3 GB ./Zookeeper-trunk-single-thread
>>> 3 GB ./brooklyn-dist-master
>>> 3 GB ./ZooKeeper-trunk
>>> 3 GB ./Mesos-Buildbot-Test
>>> 3 GB ./cloudstack-pr-analysis
>>> 3 GB ./Knox-master-daily
>>> 2 GB ./incubator-netbeans-javadoc
>>> 2 GB ./ZooKeeper-trunk-java10
>>> 2 GB ./beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow
>>> 2 GB ./mailbox
>>> 2 GB ./ODFToolkit
>>> 2 GB ./beam_PostCommit_Java_ValidatesRunner_Gearpump
>>> 2 GB ./Curator
>>> 2 GB ./beam_PreCommit_JavaPortabilityApi_Commit
>>> 2 GB ./ODFToolkit-windows
>>> 2 GB ./Log4jCore
>>> 2 GB ./Apache-Falcon-Distributed-Assembly
>>> 2 GB ./ZooKeeper-trunk-openjdk10
>>> 2 GB ./Stratos-Master-Commit-Build
>>> 2 GB ./mahout-nightly
>>> 2 GB ./Stratos-41x-Commit-Build
>>> 2 GB ./tika-2.x
>>> 2 GB ./james-server-trunk
>>> 2 GB ./ZooKeeper-trunk-java9
>>> 2 GB ./OpenMeetings
>>> 2 GB ./Solr-Artifacts-master
>>> 2 GB ./isis
>>> 2 GB ./Solr-Artifacts-7.x
>>> 2 GB ./Lucene-Solr-Tests-5.5
>>> 2 GB ./Solr-Artifacts-7.6
>>> 2 GB ./ZooKeeper-trunk-clover
>>> 2 GB ./airavata-dev
>>> 2 GB ./HBASE-16264
>>> 2 GB ./ZooKeeper-trunk-java11
>>> 2 GB ./Camel.2.19.x.notest
>>> 2 GB ./drill-scm
>>> 2 GB ./HBase-Trunk-IT
>>> 2 GB ./sling-site
>>> 2 GB ./HBase-0.98-matrix
>>> 2 GB ./Chemistry
>>>
>>
Re: workspace cleanups needed on jenkins master
Posted by Mikhail Gryzykhin <mi...@google.com>.
It is not required for https://s.apache.org/beam-community-metrics .
I believe that's main dash we have atm.
@Alan Myrvold <am...@google.com> Can you confirm?
--Mikhail
Have feedback <http://go/migryz-feedback>?
On Thu, Jan 3, 2019 at 1:59 PM Udi Meiri <eh...@google.com> wrote:
>
>
> On Thu, Dec 27, 2018 at 11:02 AM Ismaël Mejía <ie...@gmail.com> wrote:
>
>> Bringing this subject for awareness to dev@
>> We are sadly part of this top.
>> Does somebody know what this data is? And if we can clean it periodically?
>> Can somebody with more sysadmin super powers take a look and act on this.
>>
>> ---------- Forwarded message ---------
>> From: Chris Lambertus <cm...@apache.org>
>> Date: Thu, Dec 27, 2018 at 1:36 AM
>> Subject: workspace cleanups needed on jenkins master
>> To: <bu...@apache.org>
>>
>>
>> All,
>>
>> The Jenkins master needs to be cleaned up. Could the following
>> projects please reduce your usage significantly by 5 January. After 5
>> Jan Infra will be purging more aggressively and updating job
>> configurations as needed. As a rule of thumb, we’d like to see
>> projects retain no more than 1 week or 7 builds worth of historical
>> data at the absolute maximum. Larger projects should retain less to
>> avoid using up a disproportionate amount of space on the master.
>>
>> Some workspaces without any identifiable associated Project will be
>> removed.
>>
>>
>>
>> 3911 GB .
>> 275 GB ./incubator-netbeans-linux
>> 270 GB ./pulsar-website-build
>> 249 GB ./pulsar-master
>> 199 GB ./Packaging
>> 127 GB ./HBase
>> 121 GB ./PreCommit-ZOOKEEPER-github-pr-build
>> 107 GB ./Any23-trunk
>> 102 GB ./incubator-netbeans-release
>> 79 GB ./incubator-netbeans-linux-experiment
>> 77 GB ./beam_PostCommit_Java_PVR_Flink_Batch
>>
>
> Wow, this job has huge logs (400MB+).
> https://builds.apache.org/view/A-D/view/Beam/view/PostCommit/job/beam_PostCommit_Java_PVR_Flink_Batch/330/console
> A few weeks back I suggested removing the --info flag passed to Gradle.
> I haven't done that yet, but it might help reduce the size of logs. (which
> I assume are all stored on master?)
>
> Short-term, we could reduce retention back down to 14 instead of the current
> 30
> <https://github.com/apache/beam/blob/5716dba6d10f32dfa8ab807ffacc2e68f9267225/.test-infra/jenkins/CommonJobProperties.groovy#L46>
> .
> +Alan Myrvold <am...@google.com> +Mikhail Gryzykhin <mi...@google.com> we
> don't need 30 days retention any longer for test dashboards, right?
>
>
>> 76 GB ./HBase-1.3-JDK8
>> 70 GB ./Jackrabbit-Oak-Windows
>> 70 GB ./stanbol-0.12
>> 59 GB ./HBase-Find-Flaky-Tests
>> 54 GB ./CouchDB
>> 51 GB ./beam_PostCommit_Java_PVR_Flink_Streaming
>> 48 GB ./incubator-netbeans-windows
>> 47 GB ./FlexJS
>> 42 GB ./HBase
>> 41 GB ./pulsar-pull-request
>> 37 GB ./ZooKeeper_branch35_jdk8
>> 32 GB ./HBase-Flaky-Tests
>> 32 GB ./Atlas-master-NoTests
>> 31 GB ./Atlas-1.0-NoTests
>> 31 GB ./beam_PreCommit_Java_Commit
>> 30 GB ./Zookeeper_UT_Java18
>> 29 GB ./Phoenix-4.x-HBase-1.4
>> 28 GB ./HBase-2.0-hadoop3-tests
>> 27 GB ./flink-github-ci
>> 27 GB ./ZooKeeper_branch35_jdk7
>> 27 GB ./oodt-trunk
>> 25 GB ./opennlp
>> 25 GB ./Trinidad
>> 22 GB ./Phoenix-4.x-HBase-1.3
>> 21 GB ./ZooKeeper_Flaky_StressTest
>> 21 GB ./Atlas-master-AllTests
>> 21 GB ./beam_PostCommit_Java_ValidatesRunner_Flink
>> 20 GB ./HBase-1.3-JDK7
>> 20 GB ./PreCommit-HBASE-Build
>> 18 GB ./hadoop-trunk-win
>> 18 GB ./HBase-1.2-JDK7
>> 18 GB ./HBASE-14070.HLC
>> 18 GB ./maven-box
>> 17 GB ./Atlas-1.0-AllTests
>> 17 GB ./Archiva-TLP-Gitbox
>> 17 GB ./Apache
>> 17 GB ./Phoenix-5.x-HBase-2.0
>> 17 GB ./Phoenix-omid2
>> 16 GB ./Lucene-Solr-BadApples-NightlyTests-7.x
>> 15 GB ./HBase-2.0
>> 14 GB ./flume-trunk
>> 14 GB ./beam_PostCommit_Java_ValidatesRunner_Samza
>> 14 GB ./HBase-Trunk_matrix
>> 13 GB ./commons-csv
>> 13 GB ./HBase-Flaky-Tests-old-just-master
>> 13 GB ./oodt-coverage
>> 12 GB ./incubator-rya-master-with-optionals
>> 12 GB ./Syncope-master-deploy
>> 11 GB ./PreCommit-PHOENIX-Build
>> 11 GB ./Stratos-Master-Nightly-Build
>> 11 GB ./Phoenix-master
>> 11 GB ./Hadoop-trunk-JACC
>> 10 GB ./ctakes-trunk-package
>> 10 GB ./FlexJS
>> 10 GB ./Atlas-1.0-IntegrationTests
>> 9 GB ./incubator-rya-master
>> 9 GB ./Atlas-master-IntegrationTests
>> 9 GB ./beam_PostCommit_Java_ValidatesRunner_Spark
>> 9 GB ./ZooKeeper_UT_Java7
>> 9 GB ./Qpid-Broker-J-7.0.x-TestMatrix
>> 9 GB ./oodt-dependency-update
>> 9 GB ./Apache
>> 8 GB ./Struts-examples-JDK8-master
>> 8 GB ./Phoenix-4.x-HBase-1.2
>> 8 GB ./flume-github-pull-request
>> 8 GB ./HBase-HBASE-14614
>> 8 GB ./tika-trunk-jdk1.7
>> 8 GB ./HBase-1.2-JDK8
>> 8 GB ./HBase-1.5
>> 7 GB ./Atlas-master-UnitTests
>> 7 GB ./tika-2.x-windows
>> 7 GB ./incubator-rya-master-with-optionals-pull-requests
>> 7 GB ./Hive-trunk
>> 7 GB ./beam_PreCommit_Java_Cron
>> 7 GB ./Atlas-1.0-UnitTests
>> 6 GB ./Jackrabbit
>> 6 GB ./beam_PostCommit_Java_PVR_Flink_PR
>> 6 GB ./Lucene-Solr-Clover-master
>> 6 GB ./Syncope-2_0_X-deploy
>> 6 GB ./beam_PostCommit_Java_ValidatesRunner_Apex
>> 6 GB ./Tika-trunk
>> 6 GB ./pirk
>> 6 GB ./Syncope-2_1_X-deploy
>> 6 GB ./PLC4X
>> 6 GB ./myfaces-current-2.0-integration-tests
>> 5 GB ./commons-lang
>> 5 GB ./Nemo
>> 5 GB ./Mesos-Buildbot
>> 5 GB ./Qpid-Broker-J-7.1.x-TestMatrix
>> 5 GB ./beam_PostCommit_Java_Nexmark_Flink
>> 5 GB ./Qpid-Broker-J-TestMatrix
>> 5 GB ./ZooKeeper-Hammer
>> 5 GB ./Camel
>> 5 GB ./Royale
>> 5 GB ./tika-branch-1x
>> 5 GB ./ManifoldCF-ant
>> 5 GB ./PreCommit-SQOOP-Build
>> 5 GB ./HBase-1.4
>> 5 GB ./ZooKeeper_UT_Stress
>> 4 GB ./beam_PreCommit_Java_Phrase
>> 4 GB ./dir-studio
>> 4 GB ./Camel.trunk.notest
>> 4 GB ./pulsar-release-binaries
>> 4 GB ./Qpid-Java-Java-6.1.x-TestMatrix
>> 4 GB ./Oak-Win
>> 4 GB ./Mesos-Websitebot
>> 4 GB ./incubator-rya-fork
>> 4 GB ./Knox-master-verify
>> 4 GB ./Syncope-Release-Docker
>> 4 GB ./Lucene-Solr-Clover-7.x
>> 4 GB ./openmeetings
>> 4 GB ./Mesos
>> 4 GB ./apache-atlas-nightly
>> 4 GB ./Pig-trunk
>> 4 GB ./beam_PostCommit_Java_ValidatesRunner_Dataflow
>> 4 GB ./Camel.2.20.x.notest
>> 3 GB ./PreCommit-HDFS-Build
>> 3 GB ./airavata-master
>> 3 GB ./Stratos-41x-Nightly-Build
>> 3 GB ./oodt-2.0-development
>> 3 GB ./hadoop-qbt-branch2-java7-linux-x86-jhung
>> 3 GB ./incubator-rya-fork-with-optionals
>> 3 GB ./CXF-trunk-deploy
>> 3 GB ./Camel.trunk.notest.java9
>> 3 GB ./Lens-Commit
>> 3 GB ./commons-imaging
>> 3 GB ./Giraph-trunk-site
>> 3 GB ./Zookeeper-trunk-single-thread
>> 3 GB ./brooklyn-dist-master
>> 3 GB ./ZooKeeper-trunk
>> 3 GB ./Mesos-Buildbot-Test
>> 3 GB ./cloudstack-pr-analysis
>> 3 GB ./Knox-master-daily
>> 2 GB ./incubator-netbeans-javadoc
>> 2 GB ./ZooKeeper-trunk-java10
>> 2 GB ./beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow
>> 2 GB ./mailbox
>> 2 GB ./ODFToolkit
>> 2 GB ./beam_PostCommit_Java_ValidatesRunner_Gearpump
>> 2 GB ./Curator
>> 2 GB ./beam_PreCommit_JavaPortabilityApi_Commit
>> 2 GB ./ODFToolkit-windows
>> 2 GB ./Log4jCore
>> 2 GB ./Apache-Falcon-Distributed-Assembly
>> 2 GB ./ZooKeeper-trunk-openjdk10
>> 2 GB ./Stratos-Master-Commit-Build
>> 2 GB ./mahout-nightly
>> 2 GB ./Stratos-41x-Commit-Build
>> 2 GB ./tika-2.x
>> 2 GB ./james-server-trunk
>> 2 GB ./ZooKeeper-trunk-java9
>> 2 GB ./OpenMeetings
>> 2 GB ./Solr-Artifacts-master
>> 2 GB ./isis
>> 2 GB ./Solr-Artifacts-7.x
>> 2 GB ./Lucene-Solr-Tests-5.5
>> 2 GB ./Solr-Artifacts-7.6
>> 2 GB ./ZooKeeper-trunk-clover
>> 2 GB ./airavata-dev
>> 2 GB ./HBASE-16264
>> 2 GB ./ZooKeeper-trunk-java11
>> 2 GB ./Camel.2.19.x.notest
>> 2 GB ./drill-scm
>> 2 GB ./HBase-Trunk-IT
>> 2 GB ./sling-site
>> 2 GB ./HBase-0.98-matrix
>> 2 GB ./Chemistry
>>
>
Re: workspace cleanups needed on jenkins master
Posted by Udi Meiri <eh...@google.com>.
On Thu, Dec 27, 2018 at 11:02 AM Ismaël Mejía <ie...@gmail.com> wrote:
> Bringing this subject for awareness to dev@
> We are sadly part of this top.
> Does somebody know what this data is? And if we can clean it periodically?
> Can somebody with more sysadmin super powers take a look and act on this.
>
> ---------- Forwarded message ---------
> From: Chris Lambertus <cm...@apache.org>
> Date: Thu, Dec 27, 2018 at 1:36 AM
> Subject: workspace cleanups needed on jenkins master
> To: <bu...@apache.org>
>
>
> All,
>
> The Jenkins master needs to be cleaned up. Could the following
> projects please reduce your usage significantly by 5 January. After 5
> Jan Infra will be purging more aggressively and updating job
> configurations as needed. As a rule of thumb, we’d like to see
> projects retain no more than 1 week or 7 builds worth of historical
> data at the absolute maximum. Larger projects should retain less to
> avoid using up a disproportionate amount of space on the master.
>
> Some workspaces without any identifiable associated Project will be
> removed.
>
>
>
> 3911 GB .
> 275 GB ./incubator-netbeans-linux
> 270 GB ./pulsar-website-build
> 249 GB ./pulsar-master
> 199 GB ./Packaging
> 127 GB ./HBase
> 121 GB ./PreCommit-ZOOKEEPER-github-pr-build
> 107 GB ./Any23-trunk
> 102 GB ./incubator-netbeans-release
> 79 GB ./incubator-netbeans-linux-experiment
> 77 GB ./beam_PostCommit_Java_PVR_Flink_Batch
>
Wow, this job has huge logs (400MB+).
https://builds.apache.org/view/A-D/view/Beam/view/PostCommit/job/beam_PostCommit_Java_PVR_Flink_Batch/330/console
A few weeks back I suggested removing the --info flag passed to Gradle.
I haven't done that yet, but it might help reduce the size of logs. (which
I assume are all stored on master?)
Short-term, we could reduce retention back down to 14 instead of the current
30
<https://github.com/apache/beam/blob/5716dba6d10f32dfa8ab807ffacc2e68f9267225/.test-infra/jenkins/CommonJobProperties.groovy#L46>
.
+Alan Myrvold <am...@google.com> +Mikhail Gryzykhin <mi...@google.com> we
don't need 30 days retention any longer for test dashboards, right?
> 76 GB ./HBase-1.3-JDK8
> 70 GB ./Jackrabbit-Oak-Windows
> 70 GB ./stanbol-0.12
> 59 GB ./HBase-Find-Flaky-Tests
> 54 GB ./CouchDB
> 51 GB ./beam_PostCommit_Java_PVR_Flink_Streaming
> 48 GB ./incubator-netbeans-windows
> 47 GB ./FlexJS
> 42 GB ./HBase
> 41 GB ./pulsar-pull-request
> 37 GB ./ZooKeeper_branch35_jdk8
> 32 GB ./HBase-Flaky-Tests
> 32 GB ./Atlas-master-NoTests
> 31 GB ./Atlas-1.0-NoTests
> 31 GB ./beam_PreCommit_Java_Commit
> 30 GB ./Zookeeper_UT_Java18
> 29 GB ./Phoenix-4.x-HBase-1.4
> 28 GB ./HBase-2.0-hadoop3-tests
> 27 GB ./flink-github-ci
> 27 GB ./ZooKeeper_branch35_jdk7
> 27 GB ./oodt-trunk
> 25 GB ./opennlp
> 25 GB ./Trinidad
> 22 GB ./Phoenix-4.x-HBase-1.3
> 21 GB ./ZooKeeper_Flaky_StressTest
> 21 GB ./Atlas-master-AllTests
> 21 GB ./beam_PostCommit_Java_ValidatesRunner_Flink
> 20 GB ./HBase-1.3-JDK7
> 20 GB ./PreCommit-HBASE-Build
> 18 GB ./hadoop-trunk-win
> 18 GB ./HBase-1.2-JDK7
> 18 GB ./HBASE-14070.HLC
> 18 GB ./maven-box
> 17 GB ./Atlas-1.0-AllTests
> 17 GB ./Archiva-TLP-Gitbox
> 17 GB ./Apache
> 17 GB ./Phoenix-5.x-HBase-2.0
> 17 GB ./Phoenix-omid2
> 16 GB ./Lucene-Solr-BadApples-NightlyTests-7.x
> 15 GB ./HBase-2.0
> 14 GB ./flume-trunk
> 14 GB ./beam_PostCommit_Java_ValidatesRunner_Samza
> 14 GB ./HBase-Trunk_matrix
> 13 GB ./commons-csv
> 13 GB ./HBase-Flaky-Tests-old-just-master
> 13 GB ./oodt-coverage
> 12 GB ./incubator-rya-master-with-optionals
> 12 GB ./Syncope-master-deploy
> 11 GB ./PreCommit-PHOENIX-Build
> 11 GB ./Stratos-Master-Nightly-Build
> 11 GB ./Phoenix-master
> 11 GB ./Hadoop-trunk-JACC
> 10 GB ./ctakes-trunk-package
> 10 GB ./FlexJS
> 10 GB ./Atlas-1.0-IntegrationTests
> 9 GB ./incubator-rya-master
> 9 GB ./Atlas-master-IntegrationTests
> 9 GB ./beam_PostCommit_Java_ValidatesRunner_Spark
> 9 GB ./ZooKeeper_UT_Java7
> 9 GB ./Qpid-Broker-J-7.0.x-TestMatrix
> 9 GB ./oodt-dependency-update
> 9 GB ./Apache
> 8 GB ./Struts-examples-JDK8-master
> 8 GB ./Phoenix-4.x-HBase-1.2
> 8 GB ./flume-github-pull-request
> 8 GB ./HBase-HBASE-14614
> 8 GB ./tika-trunk-jdk1.7
> 8 GB ./HBase-1.2-JDK8
> 8 GB ./HBase-1.5
> 7 GB ./Atlas-master-UnitTests
> 7 GB ./tika-2.x-windows
> 7 GB ./incubator-rya-master-with-optionals-pull-requests
> 7 GB ./Hive-trunk
> 7 GB ./beam_PreCommit_Java_Cron
> 7 GB ./Atlas-1.0-UnitTests
> 6 GB ./Jackrabbit
> 6 GB ./beam_PostCommit_Java_PVR_Flink_PR
> 6 GB ./Lucene-Solr-Clover-master
> 6 GB ./Syncope-2_0_X-deploy
> 6 GB ./beam_PostCommit_Java_ValidatesRunner_Apex
> 6 GB ./Tika-trunk
> 6 GB ./pirk
> 6 GB ./Syncope-2_1_X-deploy
> 6 GB ./PLC4X
> 6 GB ./myfaces-current-2.0-integration-tests
> 5 GB ./commons-lang
> 5 GB ./Nemo
> 5 GB ./Mesos-Buildbot
> 5 GB ./Qpid-Broker-J-7.1.x-TestMatrix
> 5 GB ./beam_PostCommit_Java_Nexmark_Flink
> 5 GB ./Qpid-Broker-J-TestMatrix
> 5 GB ./ZooKeeper-Hammer
> 5 GB ./Camel
> 5 GB ./Royale
> 5 GB ./tika-branch-1x
> 5 GB ./ManifoldCF-ant
> 5 GB ./PreCommit-SQOOP-Build
> 5 GB ./HBase-1.4
> 5 GB ./ZooKeeper_UT_Stress
> 4 GB ./beam_PreCommit_Java_Phrase
> 4 GB ./dir-studio
> 4 GB ./Camel.trunk.notest
> 4 GB ./pulsar-release-binaries
> 4 GB ./Qpid-Java-Java-6.1.x-TestMatrix
> 4 GB ./Oak-Win
> 4 GB ./Mesos-Websitebot
> 4 GB ./incubator-rya-fork
> 4 GB ./Knox-master-verify
> 4 GB ./Syncope-Release-Docker
> 4 GB ./Lucene-Solr-Clover-7.x
> 4 GB ./openmeetings
> 4 GB ./Mesos
> 4 GB ./apache-atlas-nightly
> 4 GB ./Pig-trunk
> 4 GB ./beam_PostCommit_Java_ValidatesRunner_Dataflow
> 4 GB ./Camel.2.20.x.notest
> 3 GB ./PreCommit-HDFS-Build
> 3 GB ./airavata-master
> 3 GB ./Stratos-41x-Nightly-Build
> 3 GB ./oodt-2.0-development
> 3 GB ./hadoop-qbt-branch2-java7-linux-x86-jhung
> 3 GB ./incubator-rya-fork-with-optionals
> 3 GB ./CXF-trunk-deploy
> 3 GB ./Camel.trunk.notest.java9
> 3 GB ./Lens-Commit
> 3 GB ./commons-imaging
> 3 GB ./Giraph-trunk-site
> 3 GB ./Zookeeper-trunk-single-thread
> 3 GB ./brooklyn-dist-master
> 3 GB ./ZooKeeper-trunk
> 3 GB ./Mesos-Buildbot-Test
> 3 GB ./cloudstack-pr-analysis
> 3 GB ./Knox-master-daily
> 2 GB ./incubator-netbeans-javadoc
> 2 GB ./ZooKeeper-trunk-java10
> 2 GB ./beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow
> 2 GB ./mailbox
> 2 GB ./ODFToolkit
> 2 GB ./beam_PostCommit_Java_ValidatesRunner_Gearpump
> 2 GB ./Curator
> 2 GB ./beam_PreCommit_JavaPortabilityApi_Commit
> 2 GB ./ODFToolkit-windows
> 2 GB ./Log4jCore
> 2 GB ./Apache-Falcon-Distributed-Assembly
> 2 GB ./ZooKeeper-trunk-openjdk10
> 2 GB ./Stratos-Master-Commit-Build
> 2 GB ./mahout-nightly
> 2 GB ./Stratos-41x-Commit-Build
> 2 GB ./tika-2.x
> 2 GB ./james-server-trunk
> 2 GB ./ZooKeeper-trunk-java9
> 2 GB ./OpenMeetings
> 2 GB ./Solr-Artifacts-master
> 2 GB ./isis
> 2 GB ./Solr-Artifacts-7.x
> 2 GB ./Lucene-Solr-Tests-5.5
> 2 GB ./Solr-Artifacts-7.6
> 2 GB ./ZooKeeper-trunk-clover
> 2 GB ./airavata-dev
> 2 GB ./HBASE-16264
> 2 GB ./ZooKeeper-trunk-java11
> 2 GB ./Camel.2.19.x.notest
> 2 GB ./drill-scm
> 2 GB ./HBase-Trunk-IT
> 2 GB ./sling-site
> 2 GB ./HBase-0.98-matrix
> 2 GB ./Chemistry
>
Fwd: workspace cleanups needed on jenkins master
Posted by Ismaël Mejía <ie...@gmail.com>.
Bringing this subject for awareness to dev@
We are sadly part of this top.
Does somebody know what this data is? And if we can clean it periodically?
Can somebody with more sysadmin super powers take a look and act on this.
---------- Forwarded message ---------
From: Chris Lambertus <cm...@apache.org>
Date: Thu, Dec 27, 2018 at 1:36 AM
Subject: workspace cleanups needed on jenkins master
To: <bu...@apache.org>
All,
The Jenkins master needs to be cleaned up. Could the following
projects please reduce your usage significantly by 5 January. After 5
Jan Infra will be purging more aggressively and updating job
configurations as needed. As a rule of thumb, we’d like to see
projects retain no more than 1 week or 7 builds worth of historical
data at the absolute maximum. Larger projects should retain less to
avoid using up a disproportionate amount of space on the master.
Some workspaces without any identifiable associated Project will be removed.
3911 GB .
275 GB ./incubator-netbeans-linux
270 GB ./pulsar-website-build
249 GB ./pulsar-master
199 GB ./Packaging
127 GB ./HBase
121 GB ./PreCommit-ZOOKEEPER-github-pr-build
107 GB ./Any23-trunk
102 GB ./incubator-netbeans-release
79 GB ./incubator-netbeans-linux-experiment
77 GB ./beam_PostCommit_Java_PVR_Flink_Batch
76 GB ./HBase-1.3-JDK8
70 GB ./Jackrabbit-Oak-Windows
70 GB ./stanbol-0.12
59 GB ./HBase-Find-Flaky-Tests
54 GB ./CouchDB
51 GB ./beam_PostCommit_Java_PVR_Flink_Streaming
48 GB ./incubator-netbeans-windows
47 GB ./FlexJS
42 GB ./HBase
41 GB ./pulsar-pull-request
37 GB ./ZooKeeper_branch35_jdk8
32 GB ./HBase-Flaky-Tests
32 GB ./Atlas-master-NoTests
31 GB ./Atlas-1.0-NoTests
31 GB ./beam_PreCommit_Java_Commit
30 GB ./Zookeeper_UT_Java18
29 GB ./Phoenix-4.x-HBase-1.4
28 GB ./HBase-2.0-hadoop3-tests
27 GB ./flink-github-ci
27 GB ./ZooKeeper_branch35_jdk7
27 GB ./oodt-trunk
25 GB ./opennlp
25 GB ./Trinidad
22 GB ./Phoenix-4.x-HBase-1.3
21 GB ./ZooKeeper_Flaky_StressTest
21 GB ./Atlas-master-AllTests
21 GB ./beam_PostCommit_Java_ValidatesRunner_Flink
20 GB ./HBase-1.3-JDK7
20 GB ./PreCommit-HBASE-Build
18 GB ./hadoop-trunk-win
18 GB ./HBase-1.2-JDK7
18 GB ./HBASE-14070.HLC
18 GB ./maven-box
17 GB ./Atlas-1.0-AllTests
17 GB ./Archiva-TLP-Gitbox
17 GB ./Apache
17 GB ./Phoenix-5.x-HBase-2.0
17 GB ./Phoenix-omid2
16 GB ./Lucene-Solr-BadApples-NightlyTests-7.x
15 GB ./HBase-2.0
14 GB ./flume-trunk
14 GB ./beam_PostCommit_Java_ValidatesRunner_Samza
14 GB ./HBase-Trunk_matrix
13 GB ./commons-csv
13 GB ./HBase-Flaky-Tests-old-just-master
13 GB ./oodt-coverage
12 GB ./incubator-rya-master-with-optionals
12 GB ./Syncope-master-deploy
11 GB ./PreCommit-PHOENIX-Build
11 GB ./Stratos-Master-Nightly-Build
11 GB ./Phoenix-master
11 GB ./Hadoop-trunk-JACC
10 GB ./ctakes-trunk-package
10 GB ./FlexJS
10 GB ./Atlas-1.0-IntegrationTests
9 GB ./incubator-rya-master
9 GB ./Atlas-master-IntegrationTests
9 GB ./beam_PostCommit_Java_ValidatesRunner_Spark
9 GB ./ZooKeeper_UT_Java7
9 GB ./Qpid-Broker-J-7.0.x-TestMatrix
9 GB ./oodt-dependency-update
9 GB ./Apache
8 GB ./Struts-examples-JDK8-master
8 GB ./Phoenix-4.x-HBase-1.2
8 GB ./flume-github-pull-request
8 GB ./HBase-HBASE-14614
8 GB ./tika-trunk-jdk1.7
8 GB ./HBase-1.2-JDK8
8 GB ./HBase-1.5
7 GB ./Atlas-master-UnitTests
7 GB ./tika-2.x-windows
7 GB ./incubator-rya-master-with-optionals-pull-requests
7 GB ./Hive-trunk
7 GB ./beam_PreCommit_Java_Cron
7 GB ./Atlas-1.0-UnitTests
6 GB ./Jackrabbit
6 GB ./beam_PostCommit_Java_PVR_Flink_PR
6 GB ./Lucene-Solr-Clover-master
6 GB ./Syncope-2_0_X-deploy
6 GB ./beam_PostCommit_Java_ValidatesRunner_Apex
6 GB ./Tika-trunk
6 GB ./pirk
6 GB ./Syncope-2_1_X-deploy
6 GB ./PLC4X
6 GB ./myfaces-current-2.0-integration-tests
5 GB ./commons-lang
5 GB ./Nemo
5 GB ./Mesos-Buildbot
5 GB ./Qpid-Broker-J-7.1.x-TestMatrix
5 GB ./beam_PostCommit_Java_Nexmark_Flink
5 GB ./Qpid-Broker-J-TestMatrix
5 GB ./ZooKeeper-Hammer
5 GB ./Camel
5 GB ./Royale
5 GB ./tika-branch-1x
5 GB ./ManifoldCF-ant
5 GB ./PreCommit-SQOOP-Build
5 GB ./HBase-1.4
5 GB ./ZooKeeper_UT_Stress
4 GB ./beam_PreCommit_Java_Phrase
4 GB ./dir-studio
4 GB ./Camel.trunk.notest
4 GB ./pulsar-release-binaries
4 GB ./Qpid-Java-Java-6.1.x-TestMatrix
4 GB ./Oak-Win
4 GB ./Mesos-Websitebot
4 GB ./incubator-rya-fork
4 GB ./Knox-master-verify
4 GB ./Syncope-Release-Docker
4 GB ./Lucene-Solr-Clover-7.x
4 GB ./openmeetings
4 GB ./Mesos
4 GB ./apache-atlas-nightly
4 GB ./Pig-trunk
4 GB ./beam_PostCommit_Java_ValidatesRunner_Dataflow
4 GB ./Camel.2.20.x.notest
3 GB ./PreCommit-HDFS-Build
3 GB ./airavata-master
3 GB ./Stratos-41x-Nightly-Build
3 GB ./oodt-2.0-development
3 GB ./hadoop-qbt-branch2-java7-linux-x86-jhung
3 GB ./incubator-rya-fork-with-optionals
3 GB ./CXF-trunk-deploy
3 GB ./Camel.trunk.notest.java9
3 GB ./Lens-Commit
3 GB ./commons-imaging
3 GB ./Giraph-trunk-site
3 GB ./Zookeeper-trunk-single-thread
3 GB ./brooklyn-dist-master
3 GB ./ZooKeeper-trunk
3 GB ./Mesos-Buildbot-Test
3 GB ./cloudstack-pr-analysis
3 GB ./Knox-master-daily
2 GB ./incubator-netbeans-javadoc
2 GB ./ZooKeeper-trunk-java10
2 GB ./beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow
2 GB ./mailbox
2 GB ./ODFToolkit
2 GB ./beam_PostCommit_Java_ValidatesRunner_Gearpump
2 GB ./Curator
2 GB ./beam_PreCommit_JavaPortabilityApi_Commit
2 GB ./ODFToolkit-windows
2 GB ./Log4jCore
2 GB ./Apache-Falcon-Distributed-Assembly
2 GB ./ZooKeeper-trunk-openjdk10
2 GB ./Stratos-Master-Commit-Build
2 GB ./mahout-nightly
2 GB ./Stratos-41x-Commit-Build
2 GB ./tika-2.x
2 GB ./james-server-trunk
2 GB ./ZooKeeper-trunk-java9
2 GB ./OpenMeetings
2 GB ./Solr-Artifacts-master
2 GB ./isis
2 GB ./Solr-Artifacts-7.x
2 GB ./Lucene-Solr-Tests-5.5
2 GB ./Solr-Artifacts-7.6
2 GB ./ZooKeeper-trunk-clover
2 GB ./airavata-dev
2 GB ./HBASE-16264
2 GB ./ZooKeeper-trunk-java11
2 GB ./Camel.2.19.x.notest
2 GB ./drill-scm
2 GB ./HBase-Trunk-IT
2 GB ./sling-site
2 GB ./HBase-0.98-matrix
2 GB ./Chemistry