You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Eli Collins (JIRA)" <ji...@apache.org> on 2012/06/07 19:08:23 UTC

[jira] [Created] (HDFS-3515) Port HDFS-1457 to branch-1

Eli Collins created HDFS-3515:
---------------------------------

             Summary: Port HDFS-1457 to branch-1
                 Key: HDFS-3515
                 URL: https://issues.apache.org/jira/browse/HDFS-3515
             Project: Hadoop HDFS
          Issue Type: New Feature
          Components: name-node
    Affects Versions: 1.0.0
            Reporter: Eli Collins
            Assignee: Eli Collins


Let's port HDFS-1457 (configuration option to enable limiting the transfer rate used when sending the image and edits for checkpointing) to branch-1.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-3515) Port HDFS-1457 to branch-1

Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eli Collins updated HDFS-3515:
------------------------------

    Attachment: hdfs-3515.txt

Patch attached. Straightforward change. I resisted cleaning up BlockTransferThrottler so it's clear it's just a rename to DataTransferThrottler.

Passes all the unit tests. I'm also currently testing  setting dfs.image.transfer.bandwidthPerSec to 1mb/sec with a large image to confirm that the rate is in fact throttled and also to test the corner case where the checkpoint period is shorter than the time it takes to transmit the image.
                
> Port HDFS-1457 to branch-1
> --------------------------
>
>                 Key: HDFS-3515
>                 URL: https://issues.apache.org/jira/browse/HDFS-3515
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: name-node
>    Affects Versions: 1.0.0
>            Reporter: Eli Collins
>            Assignee: Eli Collins
>         Attachments: hdfs-3515.txt
>
>
> Let's port HDFS-1457 (configuration option to enable limiting the transfer rate used when sending the image and edits for checkpointing) to branch-1.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Work started] (HDFS-3515) Port HDFS-1457 to branch-1

Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on HDFS-3515 started by Eli Collins.

> Port HDFS-1457 to branch-1
> --------------------------
>
>                 Key: HDFS-3515
>                 URL: https://issues.apache.org/jira/browse/HDFS-3515
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: name-node
>    Affects Versions: 1.0.0
>            Reporter: Eli Collins
>            Assignee: Eli Collins
>             Fix For: 1.2.0
>
>         Attachments: hdfs-3515.txt
>
>
> Let's port HDFS-1457 (configuration option to enable limiting the transfer rate used when sending the image and edits for checkpointing) to branch-1.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (HDFS-3515) Port HDFS-1457 to branch-1

Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eli Collins resolved HDFS-3515.
-------------------------------

          Resolution: Fixed
       Fix Version/s: 1.2.0
    Target Version/s:   (was: 1.1.1)
        Hadoop Flags: Reviewed

Thanks Todd. I've confirmed the testing and committed to branch-1.
                
> Port HDFS-1457 to branch-1
> --------------------------
>
>                 Key: HDFS-3515
>                 URL: https://issues.apache.org/jira/browse/HDFS-3515
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: name-node
>    Affects Versions: 1.0.0
>            Reporter: Eli Collins
>            Assignee: Eli Collins
>             Fix For: 1.2.0
>
>         Attachments: hdfs-3515.txt
>
>
> Let's port HDFS-1457 (configuration option to enable limiting the transfer rate used when sending the image and edits for checkpointing) to branch-1.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-3515) Port HDFS-1457 to branch-1

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291165#comment-13291165 ] 

Todd Lipcon commented on HDFS-3515:
-----------------------------------

Patch looks good to me. +1 pending the results of your test you described above.
                
> Port HDFS-1457 to branch-1
> --------------------------
>
>                 Key: HDFS-3515
>                 URL: https://issues.apache.org/jira/browse/HDFS-3515
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: name-node
>    Affects Versions: 1.0.0
>            Reporter: Eli Collins
>            Assignee: Eli Collins
>         Attachments: hdfs-3515.txt
>
>
> Let's port HDFS-1457 (configuration option to enable limiting the transfer rate used when sending the image and edits for checkpointing) to branch-1.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-3515) Port HDFS-1457 to branch-1

Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291136#comment-13291136 ] 

Eli Collins commented on HDFS-3515:
-----------------------------------

Test patch results follow. The findbugs warnings are HADOOP-7847.

{noformat}
     [exec] 
     [exec] -1 overall.  
     [exec] 
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec] 
     [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
     [exec] 
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec] 
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler warnings.
     [exec] 
     [exec]     -1 findbugs.  The patch appears to introduce 8 new Findbugs (version 1.3.9) warnings.
     [exec] 
{noformat}
                
> Port HDFS-1457 to branch-1
> --------------------------
>
>                 Key: HDFS-3515
>                 URL: https://issues.apache.org/jira/browse/HDFS-3515
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: name-node
>    Affects Versions: 1.0.0
>            Reporter: Eli Collins
>            Assignee: Eli Collins
>         Attachments: hdfs-3515.txt
>
>
> Let's port HDFS-1457 (configuration option to enable limiting the transfer rate used when sending the image and edits for checkpointing) to branch-1.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira