You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Ron Bodkin (JIRA)" <ji...@apache.org> on 2011/06/23 22:26:47 UTC

[jira] [Created] (HADOOP-7421) Performance Patch: Disable Client-Side Nagle By Default

Performance Patch: Disable Client-Side Nagle By Default
-------------------------------------------------------

                 Key: HADOOP-7421
                 URL: https://issues.apache.org/jira/browse/HADOOP-7421
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: Ron Bodkin


HADOOP-2232 was a valuable contribution, but I would suggest that Hadoop IPC should disable Nagle's algorithm by default, to improve performance system-wide. Nagle just adds delay to network connections, which is unnecessary in the high bandwidth networks that Hadoop uses. As it stands, this becomes an obscure, little known but important performance optimization (especially for HBase), which took us days to track down during a performance tuning exercise. Obviously integrating this optimization into the Hadoop release will require performance testing to validate that it doesn't harm performance, but it should only help.

I will submit a patch for how to address this in trunk.


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (HADOOP-7421) Performance Patch: Disable Client-Side Nagle By Default

Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Suresh Srinivas resolved HADOOP-7421.
-------------------------------------

    Resolution: Duplicate

HADOOP-8069 has some work and more discussion than this jira.
                
> Performance Patch: Disable Client-Side Nagle By Default
> -------------------------------------------------------
>
>                 Key: HADOOP-7421
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7421
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Ron Bodkin
>
> HADOOP-2232 was a valuable contribution, but I would suggest that Hadoop IPC should disable Nagle's algorithm by default, to improve performance system-wide. Nagle just adds delay to network connections, which is unnecessary in the high bandwidth networks that Hadoop uses. As it stands, this becomes an obscure, little known but important performance optimization (especially for HBase), which took us days to track down during a performance tuning exercise. Obviously integrating this optimization into the Hadoop release will require performance testing to validate that it doesn't harm performance, but it should only help.
> I will submit a patch for how to address this in trunk.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira