You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@accumulo.apache.org by "David Medinets (JIRA)" <ji...@apache.org> on 2012/07/15 04:18:34 UTC
[jira] [Created] (ACCUMULO-693) Too Many "Problem Renewing Lease"
Messages
David Medinets created ACCUMULO-693:
---------------------------------------
Summary: Too Many "Problem Renewing Lease" Messages
Key: ACCUMULO-693
URL: https://issues.apache.org/jira/browse/ACCUMULO-693
Project: Accumulo
Issue Type: Improvement
Affects Versions: 1.5.0
Reporter: David Medinets
Priority: Minor
I restarted Hadoop and reloaded my Accumulo monitor page. Then the exception below starting appearing in my tserver log - a lot. Does it make sense to try three times with increasing pauses between the attempts? Should the web page timeout an display an error message?
15 02:14:32,694 [hdfs.DFSClient] WARN : Problem renewing lease for DFSClient_134996827
org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_134996827. Name node is in safe mode.
The ratio of reported blocks 0.8750 has not reached the threshold 0.9990. Safe mode will be turned off automatically.
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:1978)
at org.apache.hadoop.hdfs.server.namenode.NameNode.renewLease(NameNode.java:550)
at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:959)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:955)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:953)
at org.apache.hadoop.ipc.Client.call(Client.java:740)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
at $Proxy0.renewLease(Unknown Source)
at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
at $Proxy0.renewLease(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient$LeaseChecker.renew(DFSClient.java:1057)
at org.apache.hadoop.hdfs.DFSClient$LeaseChecker.run(DFSClient.java:1069)
at java.lang.Thread.run(Thread.java:722)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (ACCUMULO-693) Too Many "Problem Renewing Lease"
Messages
Posted by "Christopher Tubbs (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christopher Tubbs updated ACCUMULO-693:
---------------------------------------
Affects Version/s: (was: 1.5.0)
> Too Many "Problem Renewing Lease" Messages
> ------------------------------------------
>
> Key: ACCUMULO-693
> URL: https://issues.apache.org/jira/browse/ACCUMULO-693
> Project: Accumulo
> Issue Type: Improvement
> Reporter: David Medinets
> Priority: Minor
>
> I restarted Hadoop and reloaded my Accumulo monitor page. Then the exception below starting appearing in my tserver log - a lot. Does it make sense to try three times with increasing pauses between the attempts? Should the web page timeout an display an error message?
> 15 02:14:32,694 [hdfs.DFSClient] WARN : Problem renewing lease for DFSClient_134996827
> org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_134996827. Name node is in safe mode.
> The ratio of reported blocks 0.8750 has not reached the threshold 0.9990. Safe mode will be turned off automatically.
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:1978)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.renewLease(NameNode.java:550)
> at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:959)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:955)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:953)
> at org.apache.hadoop.ipc.Client.call(Client.java:740)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
> at $Proxy0.renewLease(Unknown Source)
> at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
> at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
> at $Proxy0.renewLease(Unknown Source)
> at org.apache.hadoop.hdfs.DFSClient$LeaseChecker.renew(DFSClient.java:1057)
> at org.apache.hadoop.hdfs.DFSClient$LeaseChecker.run(DFSClient.java:1069)
> at java.lang.Thread.run(Thread.java:722)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (ACCUMULO-693) Too Many "Problem Renewing Lease"
Messages
Posted by "John Vines (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13414563#comment-13414563 ]
John Vines commented on ACCUMULO-693:
-------------------------------------
it looks like your hdfs is in safe mode. We intentionally leave it polling for when hdfs is available.
> Too Many "Problem Renewing Lease" Messages
> ------------------------------------------
>
> Key: ACCUMULO-693
> URL: https://issues.apache.org/jira/browse/ACCUMULO-693
> Project: Accumulo
> Issue Type: Improvement
> Affects Versions: 1.5.0
> Reporter: David Medinets
> Priority: Minor
>
> I restarted Hadoop and reloaded my Accumulo monitor page. Then the exception below starting appearing in my tserver log - a lot. Does it make sense to try three times with increasing pauses between the attempts? Should the web page timeout an display an error message?
> 15 02:14:32,694 [hdfs.DFSClient] WARN : Problem renewing lease for DFSClient_134996827
> org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_134996827. Name node is in safe mode.
> The ratio of reported blocks 0.8750 has not reached the threshold 0.9990. Safe mode will be turned off automatically.
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:1978)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.renewLease(NameNode.java:550)
> at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:959)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:955)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:953)
> at org.apache.hadoop.ipc.Client.call(Client.java:740)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
> at $Proxy0.renewLease(Unknown Source)
> at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
> at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
> at $Proxy0.renewLease(Unknown Source)
> at org.apache.hadoop.hdfs.DFSClient$LeaseChecker.renew(DFSClient.java:1057)
> at org.apache.hadoop.hdfs.DFSClient$LeaseChecker.run(DFSClient.java:1069)
> at java.lang.Thread.run(Thread.java:722)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira