You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Wanqiang Ji (Jira)" <ji...@apache.org> on 2020/03/01 05:06:00 UTC
[jira] [Commented] (MAPREDUCE-7248) Catch RuntimeException in yarn
historyserver
[ https://issues.apache.org/jira/browse/MAPREDUCE-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048466#comment-17048466 ]
Wanqiang Ji commented on MAPREDUCE-7248:
----------------------------------------
Hi [~cane], I found the `ZkConfiguredFailoverProxyProvider` in the stack trace, I can't found it in the source. Is it implemented by yourself? Maybe it's not compatible.
> Catch RuntimeException in yarn historyserver
> ---------------------------------------------
>
> Key: MAPREDUCE-7248
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7248
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver
> Reporter: zhoukang
> Priority: Major
> Attachments: YARN-9973.001.patch
>
>
> When we got exception below the thread in jobhisotry will exit, we should catch runtime exception
> {code:java}
> xxx 2019-06-30,17:45:52,386 ERROR org.apache.hadoop.hdfs.server.namenode.ha.ZkConfiguredFailoverProxyProvider: Fail to get initial active Namenode informationjava.lang.RuntimeException: Fail to get active namenode from zookeeper
> at org.apache.hadoop.hdfs.server.namenode.ha.ZkConfiguredFailoverProxyProvider.getActiveNNIndex(ZkConfiguredFailoverProxyProvider.java:149)
> at org.apache.hadoop.hdfs.server.namenode.ha.ZkConfiguredFailoverProxyProvider.performFailover(ZkConfiguredFailoverProxyProvider.java:176)
> at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:159)
> at $Proxy15.getListing(Unknown Source)
> at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1996)
> at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:211)
> at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:198)
> at org.apache.hadoop.fs.Hdfs$2.<init>(Hdfs.java:180)
> at org.apache.hadoop.fs.Hdfs.listStatusIterator(Hdfs.java:180)
> at org.apache.hadoop.fs.FileContext$21.next(FileContext.java:1445)
> at org.apache.hadoop.fs.FileContext$21.next(FileContext.java:1440)
> at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90)
> at org.apache.hadoop.fs.FileContext.listStatus(FileContext.java:1440)
> at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.scanDirectory(HistoryFileManager.java:739)
> at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.scanDirectoryForHistoryFiles(HistoryFileManager.java:752)
> at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.scanIntermediateDirectory(HistoryFileManager.java:806)
> at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.access$200(HistoryFileManager.java:82)
> at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager$UserLogDir.scanIfNeeded(HistoryFileManager.java:280)
> at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.scanIntermediateDirectory(HistoryFileManager.java:792)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org