You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Matt Foley (JIRA)" <ji...@apache.org> on 2012/09/25 03:15:09 UTC
[jira] [Updated] (MAPREDUCE-1906) Lower default minimum heartbeat
interval for tasktracker > Jobtracker
[ https://issues.apache.org/jira/browse/MAPREDUCE-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley updated MAPREDUCE-1906:
----------------------------------
Release Note: The default minimum heartbeat interval has been dropped from 3 seconds to 300ms to increase scheduling throughput on small clusters. Users may tune mapreduce.jobtracker.heartbeats.in.second to adjust this value. (was: The minimum heartbeat interval has been dropped from 3 seconds to 300ms to increase scheduling throughput on small clusters. Users may tune mapreduce.jobtracker.heartbeats.in.second to adjust this value.)
Summary: Lower default minimum heartbeat interval for tasktracker > Jobtracker (was: Lower minimum heartbeat interval for tasktracker > Jobtracker)
> Lower default minimum heartbeat interval for tasktracker > Jobtracker
> ---------------------------------------------------------------------
>
> Key: MAPREDUCE-1906
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1906
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: jobtracker, performance, tasktracker
> Affects Versions: 0.20.1, 0.20.2, 1.2.0
> Reporter: Scott Carey
> Assignee: Todd Lipcon
> Fix For: 0.23.0, 1.2.0
>
> Attachments: MAPREDUCE-1906-0.21.patch, MAPREDUCE-1906.branch-1.patch, mapreduce-1906.txt, mapreduce-1906.txt
>
>
> I get a 0% to 15% performance increase for smaller clusters by making the heartbeat throttle stop penalizing clusters with less than 300 nodes.
> Between 0.19 and 0.20, the default minimum heartbeat interval increased from 2s to 3s. If a JobTracker is throttled at 100 heartbeats / sec for large clusters, why should a cluster with 10 nodes be throttled to 3.3 heartbeats per second?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira