You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Arpit Gupta (JIRA)" <ji...@apache.org> on 2014/03/22 17:31:44 UTC

[jira] [Commented] (TEZ-969) Hive on Tez job gets stuck as reducers makes no progress

    [ https://issues.apache.org/jira/browse/TEZ-969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13944140#comment-13944140 ] 

Arpit Gupta commented on TEZ-969:
---------------------------------

Thanks to [~sseth] to help debug the issue. Here is the part of the interesting trace

{code}
"ShuffleMergeRunner" daemon prio=10 tid=0x00007fc5f5843800 nid=0x2145 runnable [0x00007fc5d751d000]
   java.lang.Thread.State: RUNNABLE
        at org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.computeBytesInMerges(TezMerger.java:836)
        at org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:593)
        at org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:567)
        at org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:143)
        at org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:126)
        at org.apache.tez.runtime.library.common.shuffle.impl.MergeManager.finalMerge(MergeManager.java:915)
        at org.apache.tez.runtime.library.common.shuffle.impl.MergeManager.close(MergeManager.java:476)
        at org.apache.tez.runtime.library.common.shuffle.impl.Shuffle$RunShuffleCallable.call(Shuffle.java:275)
        at org.apache.tez.runtime.library.common.shuffle.impl.Shuffle$RunShuffleCallable.call(Shuffle.java:234)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.lang.Thread.run(Thread.java:722)
{code}


> Hive on Tez job gets stuck as reducers makes no progress
> --------------------------------------------------------
>
>                 Key: TEZ-969
>                 URL: https://issues.apache.org/jira/browse/TEZ-969
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Arpit Gupta
>            Priority: Critical
>
> In our nightlies we saw that hive queries can some times get stuck and make no progress.



--
This message was sent by Atlassian JIRA
(v6.2#6252)