You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Mark Miller (JIRA)" <ji...@apache.org> on 2015/03/21 18:36:38 UTC
[jira] [Commented] (SOLR-7092) Stop the HDFS lease recovery retries
on HdfsTransactionLog on close and try to avoid lease recovery on closed
files.
[ https://issues.apache.org/jira/browse/SOLR-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14372913#comment-14372913 ]
Mark Miller commented on SOLR-7092:
-----------------------------------
There still appears to be an internal HDFS lease renewer that I don't see how to stop, but with the latest patch, I've had good results so far.
{noformat} [junit4] 2> 504053 T130 oahh.LeaseRenewer.run WARN Failed to renew lease for [DFSClient_NONMAPREDUCE_-1506464199_13] for 429 seconds. Will retry shortly ... java.net.ConnectException: Call From totalmetal/127.0.1.1 to localhost:43747 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
[junit4] 2> at sun.reflect.GeneratedConstructorAccessor179.newInstance(Unknown Source)
[junit4] 2> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
[junit4] 2> at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
[junit4] 2> at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783)
[junit4] 2> at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:730)
[junit4] 2> at org.apache.hadoop.ipc.Client.call(Client.java:1410)
[junit4] 2> at org.apache.hadoop.ipc.Client.call(Client.java:1359)
[junit4] 2> at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
[junit4] 2> at com.sun.proxy.$Proxy39.renewLease(Unknown Source)
[junit4] 2> at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:497)
[junit4] 2> at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)
[junit4] 2> at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
[junit4] 2> at com.sun.proxy.$Proxy39.renewLease(Unknown Source)
[junit4] 2> at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.renewLease(ClientNamenodeProtocolTranslatorPB.java:519)
[junit4] 2> at org.apache.hadoop.hdfs.DFSClient.renewLease(DFSClient.java:773)
[junit4] 2> at org.apache.hadoop.hdfs.LeaseRenewer.renew(LeaseRenewer.java:417)
[junit4] 2> at org.apache.hadoop.hdfs.LeaseRenewer.run(LeaseRenewer.java:442)
[junit4] 2> at org.apache.hadoop.hdfs.LeaseRenewer.access$700(LeaseRenewer.java:71)
[junit4] 2> at org.apache.hadoop.hdfs.LeaseRenewer$1.run(LeaseRenewer.java:298)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.net.ConnectException: Connection refused{noformat}
> Stop the HDFS lease recovery retries on HdfsTransactionLog on close and try to avoid lease recovery on closed files.
> --------------------------------------------------------------------------------------------------------------------
>
> Key: SOLR-7092
> URL: https://issues.apache.org/jira/browse/SOLR-7092
> Project: Solr
> Issue Type: Bug
> Reporter: Mark Miller
> Assignee: Mark Miller
> Attachments: SOLR-7092.patch, SOLR-7092.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org