You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hawq.apache.org by jiny2 <gi...@git.apache.org> on 2016/01/26 22:19:15 UTC
[GitHub] incubator-hawq pull request: HAWQ-364. Make resource manager dynam...
GitHub user jiny2 opened a pull request:
https://github.com/apache/incubator-hawq/pull/297
HAWQ-364. Make resource manager dynamically adjust minimum YARN conta…
user can set the minimum YARN container water level through guc hawq_rm_min_resource_perseg.
1) If the segment capacity is smaller than expected level, this water level is lowered down;
2) If the queue capacity can not make each segment have at least hawq_rm_min_resource_perseg YARN containers, this water level is lowered down.
This improvement can make HAWQ able to dynamically fit the changing YARN cluster and avoid user wrong config caused unexpected behaviors.
If the setting is adjusted by hawq rm, one WARNING log is generated for issue tracking.
"WARNING","01000","Resource manager adjusts minimum global resource manager container count in each segment from 100 to 8.",,,,,,,0,,"resqueuemanager.c",2530,
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jiny2/incubator-hawq HAWQ-364
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-hawq/pull/297.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #297
----
commit a5786b85992305b5ec57189261e7c9d8c057a5f1
Author: YI JIN <yj...@pivotal.io>
Date: 2016-01-26T21:12:09Z
HAWQ-364. Make resource manager dynamically adjust minimum YARN container count in each segment
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-hawq pull request: HAWQ-364. Make resource manager dynam...
Posted by jiny2 <gi...@git.apache.org>.
Github user jiny2 closed the pull request at:
https://github.com/apache/incubator-hawq/pull/297
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-hawq pull request: HAWQ-364. Make resource manager dynam...
Posted by huor <gi...@git.apache.org>.
Github user huor commented on the pull request:
https://github.com/apache/incubator-hawq/pull/297#issuecomment-175379240
The fix looks good. +1
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---