You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Rohith Sharma K S (JIRA)" <ji...@apache.org> on 2018/11/16 04:59:00 UTC
[jira] [Resolved] (YARN-9028) TLSv2.0 ats-hbase app flooding Isilon
OneFS hdfs.log and ats-hbase region server logs
[ https://issues.apache.org/jira/browse/YARN-9028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohith Sharma K S resolved YARN-9028.
-------------------------------------
Resolution: Invalid
> TLSv2.0 ats-hbase app flooding Isilon OneFS hdfs.log and ats-hbase region server logs
> -------------------------------------------------------------------------------------
>
> Key: YARN-9028
> URL: https://issues.apache.org/jira/browse/YARN-9028
> Project: Hadoop YARN
> Issue Type: Bug
> Components: ATSv2
> Affects Versions: 3.0.1
> Reporter: Kirankumar Bhusanurmath
> Priority: Major
>
> HDp3.0.1 deployed on DellEMC Isilon OneFS 8.1.2
> The ats-hbase app is up and running but flooding the OneFS hdfs and ats-hbase region server logs with below message.
> OneFS log
> 2018-11-16T04:29:44Z <30.6> kbhusan-y93o5ew-1 hdfs[2711]: [hdfs] RPC V9 complete user: yarn-ats exception: java.io.FileNotFoundException cause: File not found: /atsv2/hbase/data/WALs/rduvnode334518.west.isilon.com,17020,1542081292033/rduvnode334518.west.isilon.com%2C17020%2C1542081292033.1542088499176 <FS Exception at CreateHandleFromPath():448 status: STATUS_OBJECT_NAME_NOT_FOUND = 0xC0000034 Path: atsv2/hbase/data/WALs/rduvnode334518.west.isilon.com,17020,1542081292033/rduvnode334518.west.isilon.com%2C17020%2C1542081292033.1542088499176>
> 2018-11-16T04:29:45Z <30.6> kbhusan-y93o5ew-1 hdfs[2711]: [hdfs] RPC V9 complete user: yarn-ats exception: java.io.FileNotFoundException cause: File not found: /atsv2/hbase/data/WALs/rduvnode334518.west.isilon.com,17020,1542081292033/rduvnode334518.west.isilon.com%2C17020%2C1542081292033.meta.1542185701850.meta <FS Exception at CreateHandleFromPath():448 status: STATUS_OBJECT_NAME_NOT_FOUND = 0xC0000034 Path: atsv2/hbase/data/WALs/rduvnode334518.west.isilon.com,17020,1542081292033/rduvnode334518.west.isilon.com%2C17020%2C1542081292033.meta.1542185701850.meta>
>
> hbase-yarn-ats-regionserver-RDUVNODE334518.log.
> 2018-11-13 03:23:30,178 WARN [Close-WAL-Writer-22] asyncfs.FanOutOneBlockAsyncDFSOutputHelper: complete file /atsv2/hbase/data/WALs/rduvnode334518.west.isilon.com,17020,1541663220372/rduvnode334518.west.isilon.com%2C17020%2C1541663220372.1541742426412 failed, retry = 16586
> org.apache.hadoop.ipc.RemoteException(java.io.FileNotFoundException): File not found: /atsv2/hbase/data/WALs/rduvnode334518.west.isilon.com,17020,1541663220372/rduvnode334518.west.isilon.com%2C17020%2C1541663220372.1541742426412
> at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1497)
> at org.apache.hadoop.ipc.Client.call(Client.java:1443)
> at org.apache.hadoop.ipc.Client.call(Client.java:1353)
> at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:228)
> at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:116)
> at com.sun.proxy.$Proxy18.complete(Unknown Source)
> --------------------
> (each logs are more then 250MB unable to upload
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org