You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by GitBox <gi...@apache.org> on 2020/03/07 05:12:08 UTC
[GitHub] [incubator-gobblin] autumnust commented on a change in pull request
#2912: [GOBBLIN-1072] Being more conservative on leasing containers
autumnust commented on a change in pull request #2912: [GOBBLIN-1072] Being more conservative on leasing containers
URL: https://github.com/apache/incubator-gobblin/pull/2912#discussion_r389229170
##########
File path: gobblin-yarn/src/main/java/org/apache/gobblin/yarn/YarnAutoScalingManager.java
##########
@@ -62,17 +67,24 @@
private final String AUTO_SCALING_MIN_CONTAINERS = AUTO_SCALING_PREFIX + "minContainers";
private final int DEFAULT_AUTO_SCALING_MIN_CONTAINERS = 1;
private final String AUTO_SCALING_MAX_CONTAINERS = AUTO_SCALING_PREFIX + "maxContainers";
- private final int DEFAULT_AUTO_SCALING_MAX_CONTAINERS = Integer.MAX_VALUE;
+ // A rough value of how much containers should be an intolerable number.
+ private final int DEFAULT_AUTO_SCALING_MAX_CONTAINERS = 5000;
Review comment:
If we really request that much, does Yarn have any protection against us ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services