You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by "Muhammad Samir Khan (JIRA)" <ji...@apache.org> on 2017/06/22 21:17:00 UTC
[jira] [Created] (TEZ-3772) Allow slowstart for small jobs to be
treated differently
Muhammad Samir Khan created TEZ-3772:
----------------------------------------
Summary: Allow slowstart for small jobs to be treated differently
Key: TEZ-3772
URL: https://issues.apache.org/jira/browse/TEZ-3772
Project: Apache Tez
Issue Type: Improvement
Reporter: Muhammad Samir Khan
Assignee: Muhammad Samir Khan
If there are a small number of reduces (configurable), then having a different threshold can benefit. Performance of jobs with a small number of reduce tasks can benefit significantly. Yes, the job could specify slowstart as 0.0 instead of the default, but that requires job owners to do something. It would be better if the defaults did something more optimal for both large and small jobs.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)