You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Hairong Kuang (JIRA)" <ji...@apache.org> on 2010/08/04 02:41:17 UTC
[jira] Created: (HDFS-1330) Make RPCs to DataNodes timeout
Make RPCs to DataNodes timeout
------------------------------
Key: HDFS-1330
URL: https://issues.apache.org/jira/browse/HDFS-1330
Project: Hadoop HDFS
Issue Type: New Feature
Components: data-node
Affects Versions: 0.22.0
Reporter: Hairong Kuang
Assignee: Hairong Kuang
Fix For: 0.22.0
This jira aims to make client/datanode or datanode/datanode RPC to have a timeout of DataNode#socketTimeout.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-1330) Make RPCs to DataNodes timeout
Posted by "Wang Xu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12895115#action_12895115 ]
Wang Xu commented on HDFS-1330:
-------------------------------
What's the relation between this issue and HDFS-1325 ?
> Make RPCs to DataNodes timeout
> ------------------------------
>
> Key: HDFS-1330
> URL: https://issues.apache.org/jira/browse/HDFS-1330
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: 0.22.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.22.0
>
>
> This jira aims to make client/datanode or datanode/datanode RPC to have a timeout of DataNode#socketTimeout.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-1330) Make RPCs to DataNodes timeout
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12900619#action_12900619 ]
Hudson commented on HDFS-1330:
------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #370 (See [https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/370/])
> Make RPCs to DataNodes timeout
> ------------------------------
>
> Key: HDFS-1330
> URL: https://issues.apache.org/jira/browse/HDFS-1330
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: 0.22.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.22.0
>
> Attachments: hdfsRpcTimeout.patch
>
>
> This jira aims to make client/datanode or datanode/datanode RPC to have a timeout of DataNode#socketTimeout.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-1330) Make RPCs to DataNodes timeout
Posted by "sam rash (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12896684#action_12896684 ]
sam rash commented on HDFS-1330:
--------------------------------
+1 lgtm
> Make RPCs to DataNodes timeout
> ------------------------------
>
> Key: HDFS-1330
> URL: https://issues.apache.org/jira/browse/HDFS-1330
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: 0.22.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.22.0
>
> Attachments: hdfsRpcTimeout.patch
>
>
> This jira aims to make client/datanode or datanode/datanode RPC to have a timeout of DataNode#socketTimeout.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1330) Make RPCs to DataNodes timeout
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang updated HDFS-1330:
--------------------------------
Status: Patch Available (was: Open)
> Make RPCs to DataNodes timeout
> ------------------------------
>
> Key: HDFS-1330
> URL: https://issues.apache.org/jira/browse/HDFS-1330
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: 0.22.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.22.0
>
> Attachments: hdfsRpcTimeout.patch
>
>
> This jira aims to make client/datanode or datanode/datanode RPC to have a timeout of DataNode#socketTimeout.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1330) Make RPCs to DataNodes timeout
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang updated HDFS-1330:
--------------------------------
Attachment: hdfsRpcTimeout.patch
> Make RPCs to DataNodes timeout
> ------------------------------
>
> Key: HDFS-1330
> URL: https://issues.apache.org/jira/browse/HDFS-1330
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: 0.22.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.22.0
>
> Attachments: hdfsRpcTimeout.patch
>
>
> This jira aims to make client/datanode or datanode/datanode RPC to have a timeout of DataNode#socketTimeout.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-1330) Make RPCs to DataNodes timeout
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12895132#action_12895132 ]
Hairong Kuang commented on HDFS-1330:
-------------------------------------
There are two kinds of communications to a DataNode. Most of them directly uses socket for things like replica reading or writing. A few of them use RPC.
HDFS-1325 is a problem with file read/write, while this jira is for a problem with RPC communications. We see that a problematic DataNode causes a client stuck in waiting for response forever. Having a timeout should help with this problem.
> Make RPCs to DataNodes timeout
> ------------------------------
>
> Key: HDFS-1330
> URL: https://issues.apache.org/jira/browse/HDFS-1330
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: 0.22.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.22.0
>
>
> This jira aims to make client/datanode or datanode/datanode RPC to have a timeout of DataNode#socketTimeout.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-1330) Make RPCs to DataNodes timeout
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12896715#action_12896715 ]
Hairong Kuang commented on HDFS-1330:
-------------------------------------
Thanks Sam for reviewing the patch.
Test results ran on my linux box are posted below:
ant test-patch:
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to i
[exec] nclude 3 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
Ant test did not succeed. Failed tests included TestBlockRecovery, TestHDFSTrash(timeout), and TestBackupNode. But they seemed not related to this patch.
> Make RPCs to DataNodes timeout
> ------------------------------
>
> Key: HDFS-1330
> URL: https://issues.apache.org/jira/browse/HDFS-1330
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: 0.22.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.22.0
>
> Attachments: hdfsRpcTimeout.patch
>
>
> This jira aims to make client/datanode or datanode/datanode RPC to have a timeout of DataNode#socketTimeout.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1330) Make RPCs to DataNodes timeout
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang updated HDFS-1330:
--------------------------------
Status: Resolved (was: Patch Available)
Hadoop Flags: [Reviewed]
Resolution: Fixed
I've committed this!
> Make RPCs to DataNodes timeout
> ------------------------------
>
> Key: HDFS-1330
> URL: https://issues.apache.org/jira/browse/HDFS-1330
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: 0.22.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.22.0
>
> Attachments: hdfsRpcTimeout.patch
>
>
> This jira aims to make client/datanode or datanode/datanode RPC to have a timeout of DataNode#socketTimeout.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1330) Make RPCs to DataNodes timeout
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang updated HDFS-1330:
--------------------------------
Attachment: hdfsRpcTimeout.patch
A patch for review.
> Make RPCs to DataNodes timeout
> ------------------------------
>
> Key: HDFS-1330
> URL: https://issues.apache.org/jira/browse/HDFS-1330
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: 0.22.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.22.0
>
> Attachments: hdfsRpcTimeout.patch
>
>
> This jira aims to make client/datanode or datanode/datanode RPC to have a timeout of DataNode#socketTimeout.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-1330) Make RPCs to DataNodes timeout
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang updated HDFS-1330:
--------------------------------
Attachment: (was: hdfsRpcTimeout.patch)
> Make RPCs to DataNodes timeout
> ------------------------------
>
> Key: HDFS-1330
> URL: https://issues.apache.org/jira/browse/HDFS-1330
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: 0.22.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.22.0
>
>
> This jira aims to make client/datanode or datanode/datanode RPC to have a timeout of DataNode#socketTimeout.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.