You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by td...@apache.org on 2016/08/08 19:52:09 UTC
spark git commit: [SPARK-16953] Make requestTotalExecutors public
Developer API to be consistent with requestExecutors/killExecutors
Repository: spark
Updated Branches:
refs/heads/master 1739e75fe -> 865023905
[SPARK-16953] Make requestTotalExecutors public Developer API to be consistent with requestExecutors/killExecutors
## What changes were proposed in this pull request?
RequestExecutors and killExecutor are public developer APIs for managing the number of executors allocated to the SparkContext. For consistency, requestTotalExecutors should also be a public Developer API, as it provides similar functionality. In fact, using requestTotalExecutors is more convenient that requestExecutors as the former is idempotent and the latter is not.
Author: Tathagata Das <ta...@gmail.com>
Closes #14541 from tdas/SPARK-16953.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/86502390
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/86502390
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/86502390
Branch: refs/heads/master
Commit: 8650239050ade91689ffa0672ea094de2594e37c
Parents: 1739e75
Author: Tathagata Das <ta...@gmail.com>
Authored: Mon Aug 8 12:52:04 2016 -0700
Committer: Tathagata Das <ta...@gmail.com>
Committed: Mon Aug 8 12:52:04 2016 -0700
----------------------------------------------------------------------
core/src/main/scala/org/apache/spark/SparkContext.scala | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/86502390/core/src/main/scala/org/apache/spark/SparkContext.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/SparkContext.scala b/core/src/main/scala/org/apache/spark/SparkContext.scala
index 48126c2..fc7ea51 100644
--- a/core/src/main/scala/org/apache/spark/SparkContext.scala
+++ b/core/src/main/scala/org/apache/spark/SparkContext.scala
@@ -1473,7 +1473,8 @@ class SparkContext(config: SparkConf) extends Logging with ExecutorAllocationCli
* This includes running, pending, and completed tasks.
* @return whether the request is acknowledged by the cluster manager.
*/
- private[spark] override def requestTotalExecutors(
+ @DeveloperApi
+ override def requestTotalExecutors(
numExecutors: Int,
localityAwareTasks: Int,
hostToLocalTaskCount: scala.collection.immutable.Map[String, Int]
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org