You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Daryn Sharp (JIRA)" <ji...@apache.org> on 2012/08/16 21:09:38 UTC
[jira] [Commented] (HADOOP-7421) Performance Patch: Disable
Client-Side Nagle By Default
[ https://issues.apache.org/jira/browse/HADOOP-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436238#comment-13436238 ]
Daryn Sharp commented on HADOOP-7421:
-------------------------------------
Regarding concern to harming performance, I recently noticed that MR/Yarn job submission is hardcoded to disable nagle in the conf.
> Performance Patch: Disable Client-Side Nagle By Default
> -------------------------------------------------------
>
> Key: HADOOP-7421
> URL: https://issues.apache.org/jira/browse/HADOOP-7421
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Ron Bodkin
>
> HADOOP-2232 was a valuable contribution, but I would suggest that Hadoop IPC should disable Nagle's algorithm by default, to improve performance system-wide. Nagle just adds delay to network connections, which is unnecessary in the high bandwidth networks that Hadoop uses. As it stands, this becomes an obscure, little known but important performance optimization (especially for HBase), which took us days to track down during a performance tuning exercise. Obviously integrating this optimization into the Hadoop release will require performance testing to validate that it doesn't harm performance, but it should only help.
> I will submit a patch for how to address this in trunk.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira