You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2014/01/24 03:03:37 UTC
[jira] [Created] (TEZ-762) Split generation based on headroom can
be problematic
Siddharth Seth created TEZ-762:
----------------------------------
Summary: Split generation based on headroom can be problematic
Key: TEZ-762
URL: https://issues.apache.org/jira/browse/TEZ-762
Project: Apache Tez
Issue Type: Bug
Reporter: Siddharth Seth
Specific case reported by [~hagleitn]. On a cluster with a queue setup to use 50%, but allowed to scale up to 100% - the reported headroom is just for 50% of the cluster.
There's other cases, where #splits may end up being low if the cluster is loaded at the time the query is submitted.
May need to change heuristics on # splits. Potentially get additional queue information from YARN.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)