You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Roman Grebennikov (JIRA)" <ji...@apache.org> on 2013/08/26 13:57:52 UTC

[jira] [Commented] (GIRAPH-448) orphan process left on DataNode

    [ https://issues.apache.org/jira/browse/GIRAPH-448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750030#comment-13750030 ] 

Roman Grebennikov commented on GIRAPH-448:
------------------------------------------

Got this issue with Giraph 1.0.0 on Hadoop 1.2.1 (Ubuntu 13.04 x64). The thread dump is mostly similar:

2013-08-26 15:50:13
Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.45-b01 mixed mode):

"Attach Listener" daemon prio=10 tid=0x00007f0c48019000 nid=0x1c9 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"DestroyJavaVM" prio=10 tid=0x00007f0c58e82800 nid=0x6fe0 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"metrics-meter-tick-thread-2" daemon prio=10 tid=0x00007f0c58aec800 nid=0x7112 waiting on condition [0x00007f0c4caef000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000007400057f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"metrics-meter-tick-thread-1" daemon prio=10 tid=0x00007f0c58458800 nid=0x7111 waiting on condition [0x00007f0c4cbf0000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000007400057f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-server-exec-7" prio=10 tid=0x00007f0c58afb000 nid=0x710d waiting on condition [0x00007f0c4ccf1000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-client-exec-7" prio=10 tid=0x000000004061c000 nid=0x7108 waiting on condition [0x00007f0c4cdf2000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-server-exec-6" prio=10 tid=0x00007f0c5023f800 nid=0x7107 waiting on condition [0x00007f0c4cef3000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-server-exec-5" prio=10 tid=0x00007f0c50191800 nid=0x7105 waiting on condition [0x00007f0c4cff4000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-client-exec-6" prio=10 tid=0x00007f0c5018f800 nid=0x70f9 waiting on condition [0x00007f0c4d0f5000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-client-exec-5" prio=10 tid=0x00007f0c5067c000 nid=0x70f3 waiting on condition [0x00007f0c4d2f7000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-client-exec-4" prio=10 tid=0x00007f0c58cc3000 nid=0x70f2 waiting on condition [0x00007f0c4d3f8000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-server-exec-4" prio=10 tid=0x00007f0c48050800 nid=0x70f1 waiting on condition [0x00007f0c4d4f9000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-client-exec-3" prio=10 tid=0x00007f0c58a0d000 nid=0x70f0 waiting on condition [0x00007f0c4d5fa000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-server-exec-3" prio=10 tid=0x00007f0c4801a800 nid=0x70ee waiting on condition [0x00007f0c4d7fc000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-client-exec-2" prio=10 tid=0x00007f0c58cfb000 nid=0x70d5 waiting on condition [0x00007f0c4dc00000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-client-exec-1" prio=10 tid=0x00007f0c58d94000 nid=0x70d2 waiting on condition [0x00007f0c4dd01000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-client-exec-0" prio=10 tid=0x00007f0c58baf800 nid=0x70ca waiting on condition [0x00007f0c4df03000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-server-exec-2" prio=10 tid=0x00007f0c58c4f000 nid=0x70c6 waiting on condition [0x00007f0c4e004000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-server-exec-1" prio=10 tid=0x00007f0c59aec000 nid=0x70c4 waiting on condition [0x00007f0c4e105000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"netty-server-exec-0" prio=10 tid=0x00007f0c48017000 nid=0x70bc waiting on condition [0x00007f0c4e307000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:317)
        at org.jboss.netty.util.internal.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:743)
        at org.jboss.netty.util.internal.LinkedTransferQueue.xfer(LinkedTransferQueue.java:645)
        at org.jboss.netty.util.internal.LinkedTransferQueue.poll(LinkedTransferQueue.java:1193)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
        at java.lang.Thread.run(Thread.java:662)

   Locked ownable synchronizers:
        - None

"main-EventThread" daemon prio=10 tid=0x00007f0c58b9e000 nid=0x7088 waiting on condition [0x00007f0c4e90d000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000007401ac418> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)

   Locked ownable synchronizers:
        - None

"main-SendThread(localhost:2181)" daemon prio=10 tid=0x00007f0c58c0e800 nid=0x7087 runnable [0x00007f0c4ea0e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
        - locked <0x00000007401b4c70> (a sun.nio.ch.Util$2)
        - locked <0x00000007401b4c60> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000007401b4858> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1107)

   Locked ownable synchronizers:
        - None

"Thread for syncLogs" daemon prio=10 tid=0x00007f0c588e9800 nid=0x7021 waiting on condition [0x00007f0c4f019000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at org.apache.hadoop.mapred.Child$3.run(Child.java:139)

   Locked ownable synchronizers:
        - None

"Low Memory Detector" daemon prio=10 tid=0x00007f0c580a4000 nid=0x6ff3 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C2 CompilerThread1" daemon prio=10 tid=0x00007f0c5809f000 nid=0x6ff1 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C2 CompilerThread0" daemon prio=10 tid=0x00007f0c5809c800 nid=0x6ff0 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"Signal Dispatcher" daemon prio=10 tid=0x00007f0c5809a800 nid=0x6fee runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"Finalizer" daemon prio=10 tid=0x00007f0c5807e000 nid=0x6fe7 in Object.wait() [0x00007f0c54af9000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000007401b8b68> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
        - locked <0x00000007401b8b68> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:171)

   Locked ownable synchronizers:
        - None

"Reference Handler" daemon prio=10 tid=0x00007f0c58076800 nid=0x6fe6 in Object.wait() [0x00007f0c54bfa000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x0000000740002078> (a java.lang.ref.Reference$Lock)
        at java.lang.Object.wait(Object.java:485)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
        - locked <0x0000000740002078> (a java.lang.ref.Reference$Lock)

   Locked ownable synchronizers:
        - None

"VM Thread" prio=10 tid=0x00007f0c58070000 nid=0x6fe5 runnable 

"GC task thread#0 (ParallelGC)" prio=10 tid=0x00007f0c58025000 nid=0x6fe1 runnable 

"GC task thread#1 (ParallelGC)" prio=10 tid=0x00007f0c58027000 nid=0x6fe2 runnable 

"GC task thread#2 (ParallelGC)" prio=10 tid=0x00007f0c58029000 nid=0x6fe3 runnable 

"GC task thread#3 (ParallelGC)" prio=10 tid=0x00007f0c5802a800 nid=0x6fe4 runnable 

"VM Periodic Task Thread" prio=10 tid=0x00007f0c580c0800 nid=0x6ff4 waiting on condition 

JNI global references: 1453


                
> orphan process left on DataNode
> -------------------------------
>
>                 Key: GIRAPH-448
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-448
>             Project: Giraph
>          Issue Type: Bug
>          Components: mapreduce
>    Affects Versions: 0.1.0
>         Environment: Hadoop 1.0 with Fedora linux OS
>            Reporter: Min Tu
>
> I am able to run some simple Graph job successfully but there is one orphan process left on the data node per job run.
> Please advise.
> Really appreciated your time and help.
> Min
> ----- details ------------------
> My job:
> hadoop jar /usr/local/giraph-0.1/lib/giraph-0.1.jar org.apache.giraph.examples.SimpleShortestPathsVertex -Dgiraph.zkList="10.244.140.108:22181,10.244.141.225:22181,10.244.140.161:22181" -libjars /usr/local/giraph-0.1//lib/guava-r09.jar,/usr/local/giraph-0.1//lib/zookeeper-3.3.3.jar,/home/mitu/jars/commons-io-2.1.jar,/home/mitu/json-20090211.jar,/home/mitu/gson-2.2.2.jar,/usr/local/giraph-0.1/lib/base64-2.3.8.jar -Dquorum=d-sjc-00513560.corp.ebay.com /user/mitu/giraphData/sssp/input  /user/mitu/giraphData/sssp/output 1 2
> --------------
> Process left on the data node after job FINISHED successfully
> mapred   24885 24004  5 16:47 ?        00:00:04 /usr/java/jdk1.6.0_35/jre/bin/java -Djava.library.path=/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/native/Linux-amd64-64:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/attempt_201212101618_0003_m_000001_0/work -Xmx2g -Djava.io.tmpdir=/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/attempt_201212101618_0003_m_000001_0/work/tmp -classpath /usr/local/hadoop-0.20.2-cdh3u4a/conf:/usr/java/default//lib/tools.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/..:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../hadoop-core-0.20.2-cdh3u4a.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/ant-contrib-1.0b3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/aspectjrt-1.6.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-cli-1.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-codec-1.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-daemon-1.0.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-el-1.0.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-httpclient-3.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-lang-2.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-logging-1.0.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-logging-api-1.0.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-net-3.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/core-3.1.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/guava-r09-jarjar.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/hadoop-fairscheduler-0.20.2-cdh3u4a.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/hsqldb-1.8.0.10.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jackson-core-asl-1.7.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jackson-mapper-asl-1.7.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jasper-compiler-5.5.12.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jasper-runtime-5.5.12.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-servlet-tester-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-util-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsch-0.1.42.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/junit-4.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/log4j-1.2.15.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/mockito-all-1.8.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/oro-2.0.8.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/servlet-api-2.5-20081211.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/slf4j-api-1.4.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/xmlenc-0.52.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsp-2.1/jsp-api-2.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/conf/sflowagent.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/jars/classes:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/jars/job.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/-1938241819864817775_-1820091806_124600052/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/guava-r09.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/3379343582640146181_1388448658_124600217/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/zookeeper-3.3.3.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/8554092968028345678_-45346133_124600290/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/commons-io-2.1.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/-8215982196372453677_936989764_124600348/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapre
> mapred   25042 21916  0 16:48 pts/0    00:00:00 grep --color=auto 24885

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira