You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Eli Collins (JIRA)" <ji...@apache.org> on 2012/06/07 19:08:23 UTC
[jira] [Created] (HDFS-3515) Port HDFS-1457 to branch-1
Eli Collins created HDFS-3515:
---------------------------------
Summary: Port HDFS-1457 to branch-1
Key: HDFS-3515
URL: https://issues.apache.org/jira/browse/HDFS-3515
Project: Hadoop HDFS
Issue Type: New Feature
Components: name-node
Affects Versions: 1.0.0
Reporter: Eli Collins
Assignee: Eli Collins
Let's port HDFS-1457 (configuration option to enable limiting the transfer rate used when sending the image and edits for checkpointing) to branch-1.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3515) Port HDFS-1457 to branch-1
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated HDFS-3515:
------------------------------
Attachment: hdfs-3515.txt
Patch attached. Straightforward change. I resisted cleaning up BlockTransferThrottler so it's clear it's just a rename to DataTransferThrottler.
Passes all the unit tests. I'm also currently testing setting dfs.image.transfer.bandwidthPerSec to 1mb/sec with a large image to confirm that the rate is in fact throttled and also to test the corner case where the checkpoint period is shorter than the time it takes to transmit the image.
> Port HDFS-1457 to branch-1
> --------------------------
>
> Key: HDFS-3515
> URL: https://issues.apache.org/jira/browse/HDFS-3515
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: name-node
> Affects Versions: 1.0.0
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hdfs-3515.txt
>
>
> Let's port HDFS-1457 (configuration option to enable limiting the transfer rate used when sending the image and edits for checkpointing) to branch-1.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (HDFS-3515) Port HDFS-1457 to branch-1
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Work on HDFS-3515 started by Eli Collins.
> Port HDFS-1457 to branch-1
> --------------------------
>
> Key: HDFS-3515
> URL: https://issues.apache.org/jira/browse/HDFS-3515
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: name-node
> Affects Versions: 1.0.0
> Reporter: Eli Collins
> Assignee: Eli Collins
> Fix For: 1.2.0
>
> Attachments: hdfs-3515.txt
>
>
> Let's port HDFS-1457 (configuration option to enable limiting the transfer rate used when sending the image and edits for checkpointing) to branch-1.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-3515) Port HDFS-1457 to branch-1
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins resolved HDFS-3515.
-------------------------------
Resolution: Fixed
Fix Version/s: 1.2.0
Target Version/s: (was: 1.1.1)
Hadoop Flags: Reviewed
Thanks Todd. I've confirmed the testing and committed to branch-1.
> Port HDFS-1457 to branch-1
> --------------------------
>
> Key: HDFS-3515
> URL: https://issues.apache.org/jira/browse/HDFS-3515
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: name-node
> Affects Versions: 1.0.0
> Reporter: Eli Collins
> Assignee: Eli Collins
> Fix For: 1.2.0
>
> Attachments: hdfs-3515.txt
>
>
> Let's port HDFS-1457 (configuration option to enable limiting the transfer rate used when sending the image and edits for checkpointing) to branch-1.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3515) Port HDFS-1457 to branch-1
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291165#comment-13291165 ]
Todd Lipcon commented on HDFS-3515:
-----------------------------------
Patch looks good to me. +1 pending the results of your test you described above.
> Port HDFS-1457 to branch-1
> --------------------------
>
> Key: HDFS-3515
> URL: https://issues.apache.org/jira/browse/HDFS-3515
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: name-node
> Affects Versions: 1.0.0
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hdfs-3515.txt
>
>
> Let's port HDFS-1457 (configuration option to enable limiting the transfer rate used when sending the image and edits for checkpointing) to branch-1.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3515) Port HDFS-1457 to branch-1
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291136#comment-13291136 ]
Eli Collins commented on HDFS-3515:
-----------------------------------
Test patch results follow. The findbugs warnings are HADOOP-7847.
{noformat}
[exec]
[exec] -1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 3 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] -1 findbugs. The patch appears to introduce 8 new Findbugs (version 1.3.9) warnings.
[exec]
{noformat}
> Port HDFS-1457 to branch-1
> --------------------------
>
> Key: HDFS-3515
> URL: https://issues.apache.org/jira/browse/HDFS-3515
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: name-node
> Affects Versions: 1.0.0
> Reporter: Eli Collins
> Assignee: Eli Collins
> Attachments: hdfs-3515.txt
>
>
> Let's port HDFS-1457 (configuration option to enable limiting the transfer rate used when sending the image and edits for checkpointing) to branch-1.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira