You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Arpit Gupta (JIRA)" <ji...@apache.org> on 2014/03/22 17:31:44 UTC
[jira] [Commented] (TEZ-969) Hive on Tez job gets stuck as reducers
makes no progress
[ https://issues.apache.org/jira/browse/TEZ-969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13944140#comment-13944140 ]
Arpit Gupta commented on TEZ-969:
---------------------------------
Thanks to [~sseth] to help debug the issue. Here is the part of the interesting trace
{code}
"ShuffleMergeRunner" daemon prio=10 tid=0x00007fc5f5843800 nid=0x2145 runnable [0x00007fc5d751d000]
java.lang.Thread.State: RUNNABLE
at org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.computeBytesInMerges(TezMerger.java:836)
at org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:593)
at org.apache.tez.runtime.library.common.sort.impl.TezMerger$MergeQueue.merge(TezMerger.java:567)
at org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:143)
at org.apache.tez.runtime.library.common.sort.impl.TezMerger.merge(TezMerger.java:126)
at org.apache.tez.runtime.library.common.shuffle.impl.MergeManager.finalMerge(MergeManager.java:915)
at org.apache.tez.runtime.library.common.shuffle.impl.MergeManager.close(MergeManager.java:476)
at org.apache.tez.runtime.library.common.shuffle.impl.Shuffle$RunShuffleCallable.call(Shuffle.java:275)
at org.apache.tez.runtime.library.common.shuffle.impl.Shuffle$RunShuffleCallable.call(Shuffle.java:234)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.lang.Thread.run(Thread.java:722)
{code}
> Hive on Tez job gets stuck as reducers makes no progress
> --------------------------------------------------------
>
> Key: TEZ-969
> URL: https://issues.apache.org/jira/browse/TEZ-969
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Arpit Gupta
> Priority: Critical
>
> In our nightlies we saw that hive queries can some times get stuck and make no progress.
--
This message was sent by Atlassian JIRA
(v6.2#6252)