You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Markus Jelsma (Created) (JIRA)" <ji...@apache.org> on 2012/01/02 19:30:30 UTC

[jira] [Created] (HDFS-2741) dfs.datanode.max.xcievers missing in 0.20.205.0

dfs.datanode.max.xcievers missing in 0.20.205.0
-----------------------------------------------

                 Key: HDFS-2741
                 URL: https://issues.apache.org/jira/browse/HDFS-2741
             Project: Hadoop HDFS
          Issue Type: Bug
    Affects Versions: 0.20.205.0
            Reporter: Markus Jelsma
            Priority: Minor


The dfs.datanode.max.xcievers configuration directive is missing in the hdfs-default.xml and documentation.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2741) dfs.datanode.max.xcievers missing in 0.20.205.0

Posted by "Harsh J (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J updated HDFS-2741:
--------------------------

    Target Version/s: 1.0.0
    
> dfs.datanode.max.xcievers missing in 0.20.205.0
> -----------------------------------------------
>
>                 Key: HDFS-2741
>                 URL: https://issues.apache.org/jira/browse/HDFS-2741
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0
>            Reporter: Markus Jelsma
>            Priority: Minor
>
> The dfs.datanode.max.xcievers configuration directive is missing in the hdfs-default.xml and documentation.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2741) dfs.datanode.max.xcievers missing in 0.20.205.0

Posted by "Harsh J (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J updated HDFS-2741:
--------------------------

    Release Note: Document and raise the maximum allowed transfer threads on a DataNode to 4096. This helps Apache HBase in particular.
    
> dfs.datanode.max.xcievers missing in 0.20.205.0
> -----------------------------------------------
>
>                 Key: HDFS-2741
>                 URL: https://issues.apache.org/jira/browse/HDFS-2741
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0
>            Reporter: Markus Jelsma
>            Priority: Minor
>             Fix For: 1.1.0
>
>         Attachments: HDFS-2741-branch1-1.patch, HDFS-2741-branch1-2.patch
>
>
> The dfs.datanode.max.xcievers configuration directive is missing in the hdfs-default.xml and documentation.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2741) dfs.datanode.max.xcievers missing in 0.20.205.0

Posted by "Markus Jelsma (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13178497#comment-13178497 ] 

Markus Jelsma commented on HDFS-2741:
-------------------------------------

As discussed in the following thread:
http://search-hadoop.com/m/I5uSBI9xLY&subj=Re+I+O+errors+reading+task+output+on+20+205+0
                
> dfs.datanode.max.xcievers missing in 0.20.205.0
> -----------------------------------------------
>
>                 Key: HDFS-2741
>                 URL: https://issues.apache.org/jira/browse/HDFS-2741
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0
>            Reporter: Markus Jelsma
>            Priority: Minor
>
> The dfs.datanode.max.xcievers configuration directive is missing in the hdfs-default.xml and documentation.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2741) dfs.datanode.max.xcievers missing in 0.20.205.0

Posted by "Harsh J (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J updated HDFS-2741:
--------------------------

       Resolution: Fixed
    Fix Version/s: 1.1.0
           Status: Resolved  (was: Patch Available)

Committed to branch-1. Thanks for your time and contributions Markus! Looking forward to more improvements and reports from you :)
                
> dfs.datanode.max.xcievers missing in 0.20.205.0
> -----------------------------------------------
>
>                 Key: HDFS-2741
>                 URL: https://issues.apache.org/jira/browse/HDFS-2741
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0
>            Reporter: Markus Jelsma
>            Priority: Minor
>             Fix For: 1.1.0
>
>         Attachments: HDFS-2741-branch1-1.patch, HDFS-2741-branch1-2.patch
>
>
> The dfs.datanode.max.xcievers configuration directive is missing in the hdfs-default.xml and documentation.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2741) dfs.datanode.max.xcievers missing in 0.20.205.0

Posted by "Harsh J (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13178595#comment-13178595 ] 

Harsh J commented on HDFS-2741:
-------------------------------

Markus,

Thanks for filing this! Would you like to checkout branch-1 and provide a patch as well?
                
> dfs.datanode.max.xcievers missing in 0.20.205.0
> -----------------------------------------------
>
>                 Key: HDFS-2741
>                 URL: https://issues.apache.org/jira/browse/HDFS-2741
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0
>            Reporter: Markus Jelsma
>            Priority: Minor
>
> The dfs.datanode.max.xcievers configuration directive is missing in the hdfs-default.xml and documentation.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2741) dfs.datanode.max.xcievers missing in 0.20.205.0

Posted by "Harsh J (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J updated HDFS-2741:
--------------------------

    Hadoop Flags: Reviewed
          Status: Patch Available  (was: Open)

Markus,

I think its mostly only HBase that needs this raised anyway. Thanks for the patch, it looks great, committing in a few :)
                
> dfs.datanode.max.xcievers missing in 0.20.205.0
> -----------------------------------------------
>
>                 Key: HDFS-2741
>                 URL: https://issues.apache.org/jira/browse/HDFS-2741
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0
>            Reporter: Markus Jelsma
>            Priority: Minor
>         Attachments: HDFS-2741-branch1-1.patch, HDFS-2741-branch1-2.patch
>
>
> The dfs.datanode.max.xcievers configuration directive is missing in the hdfs-default.xml and documentation.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2741) dfs.datanode.max.xcievers missing in 0.20.205.0

Posted by "Markus Jelsma (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Markus Jelsma updated HDFS-2741:
--------------------------------

    Attachment: HDFS-2741-branch1-2.patch

Here, but without a note on the setting in the documentation. I've been looking at 0.22 public docs but nothing really comes to mind to write about this setting.
                
> dfs.datanode.max.xcievers missing in 0.20.205.0
> -----------------------------------------------
>
>                 Key: HDFS-2741
>                 URL: https://issues.apache.org/jira/browse/HDFS-2741
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0
>            Reporter: Markus Jelsma
>            Priority: Minor
>         Attachments: HDFS-2741-branch1-1.patch, HDFS-2741-branch1-2.patch
>
>
> The dfs.datanode.max.xcievers configuration directive is missing in the hdfs-default.xml and documentation.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2741) dfs.datanode.max.xcievers missing in 0.20.205.0

Posted by "Markus Jelsma (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Markus Jelsma updated HDFS-2741:
--------------------------------

    Attachment: HDFS-2741-branch1-1.patch

Patch adding dfs.datanode.max.transfer.threads to hdfs-default.xml.
                
> dfs.datanode.max.xcievers missing in 0.20.205.0
> -----------------------------------------------
>
>                 Key: HDFS-2741
>                 URL: https://issues.apache.org/jira/browse/HDFS-2741
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0
>            Reporter: Markus Jelsma
>            Priority: Minor
>         Attachments: HDFS-2741-branch1-1.patch
>
>
> The dfs.datanode.max.xcievers configuration directive is missing in the hdfs-default.xml and documentation.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2741) dfs.datanode.max.xcievers missing in 0.20.205.0

Posted by "Harsh J (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13178774#comment-13178774 ] 

Harsh J commented on HDFS-2741:
-------------------------------

Markus,

In branch-1 (formerly branch-0.20), the property is named as dfs.datanode.max.xcievers. Could you amend your patch to that effect?

Also perhaps you may want to add a note about this property under src/docs/ too somewhere relevant (public pages)?
                
> dfs.datanode.max.xcievers missing in 0.20.205.0
> -----------------------------------------------
>
>                 Key: HDFS-2741
>                 URL: https://issues.apache.org/jira/browse/HDFS-2741
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0
>            Reporter: Markus Jelsma
>            Priority: Minor
>         Attachments: HDFS-2741-branch1-1.patch
>
>
> The dfs.datanode.max.xcievers configuration directive is missing in the hdfs-default.xml and documentation.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira