You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by va...@apache.org on 2016/01/08 20:39:05 UTC
spark git commit: [DOCUMENTATION] doc fix of job scheduling
Repository: spark
Updated Branches:
refs/heads/master ea104b8f1 -> 00d926172
[DOCUMENTATION] doc fix of job scheduling
spark.shuffle.service.enabled is spark application related configuration, it is not necessary to set it in yarn-site.xml
Author: Jeff Zhang <zj...@apache.org>
Closes #10657 from zjffdu/doc-fix.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/00d92617
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/00d92617
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/00d92617
Branch: refs/heads/master
Commit: 00d9261724feb48d358679efbae6889833e893e0
Parents: ea104b8
Author: Jeff Zhang <zj...@apache.org>
Authored: Fri Jan 8 11:38:46 2016 -0800
Committer: Marcelo Vanzin <va...@cloudera.com>
Committed: Fri Jan 8 11:38:46 2016 -0800
----------------------------------------------------------------------
docs/job-scheduling.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/00d92617/docs/job-scheduling.md
----------------------------------------------------------------------
diff --git a/docs/job-scheduling.md b/docs/job-scheduling.md
index 36327c6..6c587b3 100644
--- a/docs/job-scheduling.md
+++ b/docs/job-scheduling.md
@@ -91,7 +91,7 @@ pre-packaged distribution.
2. Add this jar to the classpath of all `NodeManager`s in your cluster.
3. In the `yarn-site.xml` on each node, add `spark_shuffle` to `yarn.nodemanager.aux-services`,
then set `yarn.nodemanager.aux-services.spark_shuffle.class` to
-`org.apache.spark.network.yarn.YarnShuffleService` and `spark.shuffle.service.enabled` to true.
+`org.apache.spark.network.yarn.YarnShuffleService`.
4. Restart all `NodeManager`s in your cluster.
All other relevant configurations are optional and under the `spark.dynamicAllocation.*` and
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org