You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2014/07/01 21:47:26 UTC
[jira] [Created] (TEZ-1248) Reduce slow-start should special case 1
reducer runs
Gopal V created TEZ-1248:
----------------------------
Summary: Reduce slow-start should special case 1 reducer runs
Key: TEZ-1248
URL: https://issues.apache.org/jira/browse/TEZ-1248
Project: Apache Tez
Issue Type: Improvement
Affects Versions: 0.5.0
Environment: 20 node cluster running tez
Reporter: Gopal V
Priority: Minor
Reducer slow-start has a performance problem for the small cases where there is just 1 reducer for a case with a single wave.
Tez knows the split count and wave count, being able to determine if the cluster has enough spare capacity to run the reducer earlier for lower latency in a N-mapper -> 1 reducer case.
--
This message was sent by Atlassian JIRA
(v6.2#6252)