You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mesos.apache.org by "John Sirois (JIRA)" <ji...@apache.org> on 2012/06/30 19:44:43 UTC

[jira] [Commented] (MESOS-228) Memory leak in SchedulerDriver and/or Log by way of libmesos-0.9.0.so

    [ https://issues.apache.org/jira/browse/MESOS-228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404583#comment-13404583 ] 

John Sirois commented on MESOS-228:
-----------------------------------

NB - we have only seen this in the scheduler hosting the log coordinator so far.
                
> Memory leak in SchedulerDriver and/or Log by way of libmesos-0.9.0.so
> ---------------------------------------------------------------------
>
>                 Key: MESOS-228
>                 URL: https://issues.apache.org/jira/browse/MESOS-228
>             Project: Mesos
>          Issue Type: Bug
>            Reporter: John Sirois
>
> We see both historical evidence for this in health-check kills of a java process that uses the scheduler and log jni interfaces:
> {code}
> [UTC Jun 29 10:06:59] error    : 'mesos-scheduler' total mem amount of 12584020kB matches resource limit [total mem amount>12582890kB]
> [UTC Jun 29 10:06:59] info     : 'mesos-scheduler' trying to restart
> [UTC Jun 29 10:06:59] info     : 'mesos-scheduler' stop: /usr/local/bin/cond_pkill.sh
> [UTC Jun 29 10:07:00] info     : 'mesos-scheduler' start: /usr/local/mesos/current/scripts/scheduler.sh
> [UTC Jun 29 10:07:00] error    : 'mesos-scheduler' failed, cannot open a connection to INET[localhost:8081] via TCP
> [UTC Jun 29 10:07:05] info     : 'mesos-scheduler' 'mesos-scheduler' total mem amount check succeeded [current total mem amount=230308kB]
> {code}
> This java process is configured -Xmx8g and here we have ~4g excess.
> Live evidence shows the java process with ~6g rss:
> {code}
>   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                                                                                                                                                                                                         
> 32538 root      20   0 10.8g 6.0g  17m S  2.0 25.3 153:12.72 java
> {code}
> But gc logs at the time show :
> {code}
> 418468.099: [Full GC 1127079K->287893K(8379776K), 0.6542120 secs]
> 418899.228: [GC 3072341K->293077K(8382464K), 0.0067430 secs]
> 419338.239: [GC 3076949K->298101K(8382464K), 0.0247080 secs]
> 419747.782: [GC 3081973K->302669K(8382528K), 0.0096910 secs]
> {code}
> So we see after full GC ~287MB heap for our 8g Xmx process.
> And confirmation that the java process is linked to libmesos-0.9.0
> {code}
> [jsirois@smf1-ajb-35-sr4 ~]$ sudo /usr/sbin/lsof -p 32538 | grep mesos
> java    32538 root  mem    REG                8,1   4128768  62816562 /var/lib/mesos/scheduler_db/mesos_log/036645.log
> java    32538 root  mem    REG                8,1   4122293  62818480 /var/lib/mesos/scheduler_db/mesos_log/035763.sst
> java    32538 root  mem    REG                8,1    595378  62817105 /var/lib/mesos/scheduler_db/mesos_log/035761.sst
> java    32538 root  mem    REG                8,1    646331  62816570 /var/lib/mesos/scheduler_db/mesos_log/036647.sst
> java    32538 root  mem    REG                8,1  43810914  22290579 /usr/local/lib/libmesos-0.9.0.so
> java    32538 root  mem    REG                8,1     65536  62817148 /var/lib/mesos/scheduler_db/mesos_log/MANIFEST-035754
> java    32538 root  mem    REG                8,1    180110  23004661 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.code.gson-gson-2.1.jar
> java    32538 root  mem    REG                8,1    114128  23004663 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.easymock-easymock-3.0.jar
> java    32538 root  mem    REG                8,1    538581  23004677 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.mortbay.jetty-jetty-6.1.25.jar
> java    32538 root  mem    REG                8,1    555410  23004648 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-beans-3.0.5.RELEASE.jar
> java    32538 root  mem    REG                8,1    265348  23004692 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.apache.mesos-mesos-0.9.0-120.jar
> java    32538 root  mem    REG                8,1    391834  23004645 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/log4j-log4j-1.2.15.jar
> java    32538 root  mem    REG                8,1    668861  23004675 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-context-3.0.5.RELEASE.jar
> java    32538 root  mem    REG                8,1     45895  23004662 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.twitter-util-collection-4.0.3.jar
> java    32538 root  mem    REG                8,1     34471  23004679 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.inject.extensions-guice-multibindings-3.0.jar
> java    32538 root  mem    REG                8,1    575389  23004697 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/commons-collections-commons-collections-3.2.1.jar
> java    32538 root  mem    REG                8,1      2497  23004647 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/javax.inject-javax.inject-1.jar
> java    32538 root  mem    REG                8,1    450279  23004668 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.protobuf-protobuf-java-2.4.1.jar
> java    32538 root  mem    REG                8,1     36046  23004660 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.objenesis-objenesis-1.2.jar
> java    32538 root  mem    REG                8,1    710492  23004669 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.inject-guice-3.0.jar
> java    32538 root  mem    REG                8,1    388864  23004654 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/javax.mail-mail-1.4.jar
> java    32538 root  mem    REG                8,1    959322  23004700 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/io.netty-netty-3.4.1.Final.jar
> java    32538 root  mem    REG                8,1     60686  23004686 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/commons-logging-commons-logging-1.1.1.jar
> java    32538 root  mem    REG                8,1    534827  23004666 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/joda-time-joda-time-1.6.jar
> java    32538 root  mem    REG                8,1      4467  23004699 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/aopalliance-aopalliance-1.0.jar
> java    32538 root  mem    REG                8,1    105112  23004671 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/javax.servlet-servlet-api-2.5.jar
> java    32538 root  mem    REG                8,1    148627  23004667 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.antlr-stringtemplate-3.2.1.jar
> java    32538 root  mem    REG                8,1    134133  23004659 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.mortbay.jetty-servlet-api-2.5-20081211.jar
> java    32538 root  mem    REG                8,1    177174  23004674 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.mortbay.jetty-jetty-util-6.1.25.jar
> java    32538 root  mem    REG                8,1   1136402  23004665 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.twitter-finagle-core-4.0.5.jar
> java    32538 root  mem    REG                8,1     36417  23004696 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.twitter-util-hashing-4.0.3.jar
> java    32538 root  mem    REG                8,1      8717  23004702 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/net.sf.opencsv-opencsv-1.8.jar
> java    32538 root  mem    REG                8,1   5648643  23004655 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.ibm.icu-icu4j-4.0.1.jar
> java    32538 root  mem    REG                8,1    445288  23004704 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/antlr-antlr-2.7.7.jar
> java    32538 root  mem    REG                8,1    261809  23004658 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/commons-lang-commons-lang-2.4.jar
> java    32538 root  mem    REG                8,1    278864  23004657 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.sonatype.sisu.inject-cglib-2.2.1-v20090111.jar
> java    32538 root  mem    REG                8,1   1248544  23004690 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.h2database-h2-1.3.158.jar
> java    32538 root  mem    REG                8,1    231922  23004653 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-tx-3.0.5.RELEASE.jar
> java    32538 root  mem    REG                8,1     33015  23004682 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.code.findbugs-jsr305-1.3.9.jar
> java    32538 root  mem    REG                8,1   6496110  23004691 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.scala-lang-scala-library-2.8.1.jar
> java    32538 root  mem    REG                8,1    252570  23004687 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.visualization-visualization-datasource-1.0.2.jar
> java    32538 root  mem    REG                8,1   1795936  23004684 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.guava-guava-12.0.jar
> java    32538 root  mem    REG                8,1    604182  23004650 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.apache.zookeeper-zookeeper-3.3.4.jar
> java    32538 root  mem    REG                8,1    163151  23004683 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/commons-io-commons-io-2.1.jar
> java    32538 root  mem    REG                8,1    184170  23004664 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.twitter-finagle-thrift-4.0.5.jar
> java    32538 root  mem    REG                8,1     10602  23004673 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.testing-test-libraries-for-java-1.1.1.jar
> java    32538 root  mem    REG                8,1     41229  23004680 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.hamcrest-hamcrest-core-1.2.jar
> java    32538 root  mem    REG                8,1    232771  23004681 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/commons-codec-commons-codec-1.6.jar
> java    32538 root  mem    REG                8,1    666578  23004649 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.twitter-util-core-4.0.3.jar
> java    32538 root  mem    REG                8,1     25496  23004678 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.slf4j-slf4j-api-1.6.1.jar
> java    32538 root  mem    REG                8,1    202707  23004676 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/net.lag.jaramiko-jaramiko-151.jar
> java    32538 root  mem    REG                8,1    321190  23004656 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-aop-3.0.5.RELEASE.jar
> java    32538 root  mem    REG                8,1    385712  23004701 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-jdbc-3.0.5.RELEASE.jar
> java    32538 root  mem    REG                8,1    169752  23004694 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-expression-3.0.5.RELEASE.jar
> java    32538 root  mem    REG                8,1    610790  23004689 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/c3p0-c3p0-0.9.1.2.jar
> java    32538 root  mem    REG                8,1     19659  23004670 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/silly-silly-thrift-0.5.0.jar
> java    32538 root  mem    REG                8,1   2323932  22938866 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/mesos-scheduler.jar
> java    32538 root  mem    REG                8,1    382442  23004652 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-core-3.0.5.RELEASE.jar
> java    32538 root  mem    REG                8,1     36091  23004646 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/net.sf.cron4j-cron4j-2.2.3.jar
> java    32538 root  mem    REG                8,1     65012  23004685 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.inject.extensions-guice-servlet-3.0.jar
> java    32538 root  mem    REG                8,1     43033  23004651 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/asm-asm-3.1.jar
> java    32538 root  mem    REG                8,1    234088  23004693 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/junit-junit-dep-4.10.jar
> java    32538 root  mem    REG                8,1    322362  23004672 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/cglib-cglib-nodep-2.2.jar
> java    32538 root  mem    REG                8,1     62983  23004703 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/javax.activation-activation-1.1.jar
> java    32538 root  mem    REG                8,1      8890  23004698 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.slf4j-slf4j-jdk14-1.6.1.jar
> java    32538 root  mem    REG                8,1    262243  23004695 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.apache.thrift-libthrift-0.5.0.jar
> java    32538 root  mem    REG                8,1     53082  23004688 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-asm-3.0.5.RELEASE.jar
> java    32538 root    3u   REG                8,1         6  62817109 /var/run/mesos/mesos-scheduler.pid
> java    32538 root    4w   REG                8,1 104397594  62816934 /var/log/mesos/mesos-scheduler.log
> java    32538 root    5w   REG                8,1 104397594  62816934 /var/log/mesos/mesos-scheduler.log
> java    32538 root    6w   REG                8,1     15850  62816936 /var/log/mesos/mesos-scheduler-gc.log
> java    32538 root    8r   REG                8,1   2323932  22938866 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/mesos-scheduler.jar
> java    32538 root    9r   REG                8,1   2323932  22938866 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/mesos-scheduler.jar
> java    32538 root   10r   REG                8,1    262243  23004695 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.apache.thrift-libthrift-0.5.0.jar
> java    32538 root   11r   REG                8,1      8890  23004698 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.slf4j-slf4j-jdk14-1.6.1.jar
> java    32538 root   12r   REG                8,1     62983  23004703 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/javax.activation-activation-1.1.jar
> java    32538 root   13r   REG                8,1    322362  23004672 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/cglib-cglib-nodep-2.2.jar
> java    32538 root   14r   REG                8,1    234088  23004693 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/junit-junit-dep-4.10.jar
> java    32538 root   15r   REG                8,1     43033  23004651 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/asm-asm-3.1.jar
> java    32538 root   16r   REG                8,1     65012  23004685 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.inject.extensions-guice-servlet-3.0.jar
> java    32538 root   17r   REG                8,1     36091  23004646 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/net.sf.cron4j-cron4j-2.2.3.jar
> java    32538 root   18r   REG                8,1    382442  23004652 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-core-3.0.5.RELEASE.jar
> java    32538 root   19r   REG                8,1     53082  23004688 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-asm-3.0.5.RELEASE.jar
> java    32538 root   20r   REG                8,1     19659  23004670 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/silly-silly-thrift-0.5.0.jar
> java    32538 root   21r   REG                8,1    610790  23004689 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/c3p0-c3p0-0.9.1.2.jar
> java    32538 root   22r   REG                8,1    169752  23004694 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-expression-3.0.5.RELEASE.jar
> java    32538 root   23r   REG                8,1    385712  23004701 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-jdbc-3.0.5.RELEASE.jar
> java    32538 root   24r   REG                8,1    321190  23004656 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-aop-3.0.5.RELEASE.jar
> java    32538 root   25r   REG                8,1    202707  23004676 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/net.lag.jaramiko-jaramiko-151.jar
> java    32538 root   26r   REG                8,1     25496  23004678 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.slf4j-slf4j-api-1.6.1.jar
> java    32538 root   27r   REG                8,1    666578  23004649 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.twitter-util-core-4.0.3.jar
> java    32538 root   28r   REG                8,1   1795936  23004684 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.guava-guava-12.0.jar
> java    32538 root   29r   REG                8,1    232771  23004681 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/commons-codec-commons-codec-1.6.jar
> java    32538 root   30r   REG                8,1     41229  23004680 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.hamcrest-hamcrest-core-1.2.jar
> java    32538 root   31r   REG                8,1     10602  23004673 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.testing-test-libraries-for-java-1.1.1.jar
> java    32538 root   32r   REG                8,1    184170  23004664 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.twitter-finagle-thrift-4.0.5.jar
> java    32538 root   33r   REG                8,1    163151  23004683 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/commons-io-commons-io-2.1.jar
> java    32538 root   34r   REG                8,1    604182  23004650 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.apache.zookeeper-zookeeper-3.3.4.jar
> java    32538 root   35r   REG                8,1    252570  23004687 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.visualization-visualization-datasource-1.0.2.jar
> java    32538 root   36r   REG                8,1   6496110  23004691 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.scala-lang-scala-library-2.8.1.jar
> java    32538 root   37r   REG                8,1     33015  23004682 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.code.findbugs-jsr305-1.3.9.jar
> java    32538 root   38r   REG                8,1    231922  23004653 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-tx-3.0.5.RELEASE.jar
> java    32538 root   39r   REG                8,1   1248544  23004690 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.h2database-h2-1.3.158.jar
> java    32538 root   40r   REG                8,1    278864  23004657 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.sonatype.sisu.inject-cglib-2.2.1-v20090111.jar
> java    32538 root   41r   REG                8,1    261809  23004658 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/commons-lang-commons-lang-2.4.jar
> java    32538 root   42r   REG                8,1    445288  23004704 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/antlr-antlr-2.7.7.jar
> java    32538 root   43r   REG                8,1   5648643  23004655 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.ibm.icu-icu4j-4.0.1.jar
> java    32538 root   44r   REG                8,1      8717  23004702 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/net.sf.opencsv-opencsv-1.8.jar
> java    32538 root   45r   REG                8,1     36417  23004696 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.twitter-util-hashing-4.0.3.jar
> java    32538 root   46r   REG                8,1   1136402  23004665 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.twitter-finagle-core-4.0.5.jar
> java    32538 root   47r   REG                8,1    177174  23004674 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.mortbay.jetty-jetty-util-6.1.25.jar
> java    32538 root   48r   REG                8,1    134133  23004659 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.mortbay.jetty-servlet-api-2.5-20081211.jar
> java    32538 root   49r   REG                8,1    148627  23004667 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.antlr-stringtemplate-3.2.1.jar
> java    32538 root   50r   REG                8,1    105112  23004671 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/javax.servlet-servlet-api-2.5.jar
> java    32538 root   51r   REG                8,1      4467  23004699 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/aopalliance-aopalliance-1.0.jar
> java    32538 root   52r   REG                8,1    534827  23004666 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/joda-time-joda-time-1.6.jar
> java    32538 root   53r   REG                8,1     60686  23004686 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/commons-logging-commons-logging-1.1.1.jar
> java    32538 root   54r   REG                8,1    959322  23004700 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/io.netty-netty-3.4.1.Final.jar
> java    32538 root   55r   REG                8,1    388864  23004654 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/javax.mail-mail-1.4.jar
> java    32538 root   56r   REG                8,1    710492  23004669 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.inject-guice-3.0.jar
> java    32538 root   57r   REG                8,1     36046  23004660 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.objenesis-objenesis-1.2.jar
> java    32538 root   58r   REG                8,1    450279  23004668 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.protobuf-protobuf-java-2.4.1.jar
> java    32538 root   59r   REG                8,1      2497  23004647 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/javax.inject-javax.inject-1.jar
> java    32538 root   60r   REG                8,1    575389  23004697 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/commons-collections-commons-collections-3.2.1.jar
> java    32538 root   61r   REG                8,1     34471  23004679 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.inject.extensions-guice-multibindings-3.0.jar
> java    32538 root   62r   REG                8,1     45895  23004662 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.twitter-util-collection-4.0.3.jar
> java    32538 root   63r   REG                8,1    668861  23004675 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-context-3.0.5.RELEASE.jar
> java    32538 root   64r   REG                8,1    391834  23004645 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/log4j-log4j-1.2.15.jar
> java    32538 root   65r   REG                8,1    265348  23004692 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.apache.mesos-mesos-0.9.0-120.jar
> java    32538 root   66r   REG                8,1    555410  23004648 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.springframework-spring-beans-3.0.5.RELEASE.jar
> java    32538 root   67r   REG                8,1    538581  23004677 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.mortbay.jetty-jetty-6.1.25.jar
> java    32538 root   68r   REG                8,1    114128  23004663 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/org.easymock-easymock-3.0.jar
> java    32538 root   69r   REG                8,1    180110  23004661 /usr/local/mesos/releases/20120625204857-b64ace493f7609ca461f0adb5e3d55a03633cebb/libs/com.google.code.gson-gson-2.1.jar
> java    32538 root   85r   REG                8,1   4128768  62816562 /var/lib/mesos/scheduler_db/mesos_log/036645.log
> java    32538 root   92w   REG                8,1    137632  62816283 /var/lib/mesos/scheduler_db/mesos_log/LOG
> java    32538 root   93uW  REG                8,1         0  62816990 /var/lib/mesos/scheduler_db/mesos_log/LOCK
> java    32538 root   95u   REG                8,1     65536  62817148 /var/lib/mesos/scheduler_db/mesos_log/MANIFEST-035754
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira