[jira] [Created] (HAWQ-364) Make resource manager dynamically adjust minimum YARN container count in each segment

["Yi Jin (JIRA)" <ji...@apache.org>]

Yi Jin created HAWQ-364:
---------------------------

             Summary: Make resource manager dynamically adjust minimum YARN container count in each segment
                 Key: HAWQ-364
                 URL: https://issues.apache.org/jira/browse/HAWQ-364
             Project: Apache HAWQ
          Issue Type: Improvement
          Components: Resource Manager
            Reporter: Yi Jin
            Assignee: Lei Chang


user can set the minimum YARN container water level through guc hawq_rm_min_resource_perseg. 
1) If the segment capacity is smaller than expected level, this water level is lowered down;
2) If the queue capacity can not make each segment have at least hawq_rm_min_resource_perseg YARN containers, this water level is lowered down.

This improvement can make HAWQ able to dynamically fit the changing YARN cluster and avoid user wrong config caused unexpected behaviors.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)