You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by rx...@apache.org on 2013/12/14 23:16:40 UTC
[1/2] git commit: Fix list rendering in YARN markdown docs.
Updated Branches:
refs/heads/master 2fd781d34 -> 7db916596
Fix list rendering in YARN markdown docs.
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/1291dd4d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/1291dd4d
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/1291dd4d
Branch: refs/heads/master
Commit: 1291dd4dceb71ca7e475511870dfa0b418f35ac5
Parents: 153cad1
Author: Patrick Wendell <pw...@gmail.com>
Authored: Tue Dec 10 16:38:20 2013 -0800
Committer: Patrick Wendell <pw...@gmail.com>
Committed: Tue Dec 10 16:38:33 2013 -0800
----------------------------------------------------------------------
docs/running-on-yarn.md | 12 +++++++-----
1 file changed, 7 insertions(+), 5 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/1291dd4d/docs/running-on-yarn.md
----------------------------------------------------------------------
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md
index 9e4c4e1..aa75ca4 100644
--- a/docs/running-on-yarn.md
+++ b/docs/running-on-yarn.md
@@ -32,14 +32,16 @@ If you want to test out the YARN deployment mode, you can use the current Spark
Most of the configs are the same for Spark on YARN as other deploys. See the Configuration page for more information on those. These are configs that are specific to SPARK on YARN.
Environment variables:
+
* `SPARK_YARN_USER_ENV`, to add environment variables to the Spark processes launched on YARN. This can be a comma separated list of environment variables, e.g. `SPARK_YARN_USER_ENV="JAVA_HOME=/jdk64,FOO=bar"`.
System Properties:
-* 'spark.yarn.applicationMaster.waitTries', property to set the number of times the ApplicationMaster waits for the the spark master and then also the number of tries it waits for the Spark Context to be intialized. Default is 10.
-* 'spark.yarn.submit.file.replication', the HDFS replication level for the files uploaded into HDFS for the application. These include things like the spark jar, the app jar, and any distributed cache files/archives.
-* 'spark.yarn.preserve.staging.files', set to true to preserve the staged files(spark jar, app jar, distributed cache files) at the end of the job rather then delete them.
-* 'spark.yarn.scheduler.heartbeat.interval-ms', the interval in ms in which the Spark application master heartbeats into the YARN ResourceManager. Default is 5 seconds.
-* 'spark.yarn.max.worker.failures', the maximum number of worker failures before failing the application. Default is the number of workers requested times 2 with minimum of 3.
+
+* `spark.yarn.applicationMaster.waitTries`, property to set the number of times the ApplicationMaster waits for the the spark master and then also the number of tries it waits for the Spark Context to be intialized. Default is 10.
+* `spark.yarn.submit.file.replication`, the HDFS replication level for the files uploaded into HDFS for the application. These include things like the spark jar, the app jar, and any distributed cache files/archives.
+* `spark.yarn.preserve.staging.files`, set to true to preserve the staged files(spark jar, app jar, distributed cache files) at the end of the job rather then delete them.
+* `spark.yarn.scheduler.heartbeat.interval-ms`, the interval in ms in which the Spark application master heartbeats into the YARN ResourceManager. Default is 5 seconds.
+* `spark.yarn.max.worker.failures`, the maximum number of worker failures before failing the application. Default is the number of workers requested times 2 with minimum of 3.
# Launching Spark on YARN
[2/2] git commit: Merge pull request #251 from pwendell/master
Posted by rx...@apache.org.
Merge pull request #251 from pwendell/master
Fix list rendering in YARN markdown docs.
This is some minor clean-up which makes the list render correctly.
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/7db91659
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/7db91659
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/7db91659
Branch: refs/heads/master
Commit: 7db916596144a8b9e55fabf859d921a093d3c59f
Parents: 2fd781d 1291dd4
Author: Reynold Xin <rx...@apache.org>
Authored: Sat Dec 14 14:16:34 2013 -0800
Committer: Reynold Xin <rx...@apache.org>
Committed: Sat Dec 14 14:16:34 2013 -0800
----------------------------------------------------------------------
docs/running-on-yarn.md | 12 +++++++-----
1 file changed, 7 insertions(+), 5 deletions(-)
----------------------------------------------------------------------