You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2014/01/24 03:03:37 UTC

[jira] [Created] (TEZ-762) Split generation based on headroom can be problematic

Siddharth Seth created TEZ-762:
----------------------------------

             Summary: Split generation based on headroom can be problematic
                 Key: TEZ-762
                 URL: https://issues.apache.org/jira/browse/TEZ-762
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Siddharth Seth


Specific case reported by [~hagleitn]. On a cluster with a queue setup to use 50%, but allowed to scale up to 100% - the reported headroom is just for 50% of the cluster.
There's other cases, where #splits may end up being low if the cluster is loaded at the time the query is submitted.

May need to change heuristics on # splits. Potentially get additional queue information from YARN.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)