You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by an...@apache.org on 2014/12/03 22:19:43 UTC
spark git commit: [SPARK-4642] Add description about spark.yarn.queue
to running-on-YARN document.
Repository: spark
Updated Branches:
refs/heads/master edd3cd477 -> 692f49378
[SPARK-4642] Add description about spark.yarn.queue to running-on-YARN document.
Added descriptions about these parameters.
- spark.yarn.queue
Modified description about the defalut value of this parameter.
- spark.yarn.submit.file.replication
Author: Masayoshi TSUZUKI <ts...@oss.nttdata.co.jp>
Closes #3500 from tsudukim/feature/SPARK-4642 and squashes the following commits:
ce99655 [Masayoshi TSUZUKI] better gramatically.
21cf624 [Masayoshi TSUZUKI] Removed intentionally undocumented properties.
88cac9b [Masayoshi TSUZUKI] [SPARK-4642] Documents about running-on-YARN needs update
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/692f4937
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/692f4937
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/692f4937
Branch: refs/heads/master
Commit: 692f49378f7d384d5c9c5ab7451a1c1e66f91c50
Parents: edd3cd4
Author: Masayoshi TSUZUKI <ts...@oss.nttdata.co.jp>
Authored: Wed Dec 3 13:16:24 2014 -0800
Committer: Andrew Or <an...@databricks.com>
Committed: Wed Dec 3 13:16:24 2014 -0800
----------------------------------------------------------------------
docs/running-on-yarn.md | 9 ++++++++-
1 file changed, 8 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/692f4937/docs/running-on-yarn.md
----------------------------------------------------------------------
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md
index 45e219e..e97ac9f 100644
--- a/docs/running-on-yarn.md
+++ b/docs/running-on-yarn.md
@@ -30,7 +30,7 @@ Most of the configs are the same for Spark on YARN as for other deployment modes
</tr>
<tr>
<td><code>spark.yarn.submit.file.replication</code></td>
- <td>3</td>
+ <td>The default HDFS replication (usually 3)</td>
<td>
HDFS replication level for the files uploaded into HDFS for the application. These include things like the Spark jar, the app jar, and any distributed cache files/archives.
</td>
@@ -92,6 +92,13 @@ Most of the configs are the same for Spark on YARN as for other deployment modes
</td>
</tr>
<tr>
+ <td><code>spark.yarn.queue</code></td>
+ <td>default</td>
+ <td>
+ The name of the YARN queue to which the application is submitted.
+ </td>
+</tr>
+<tr>
<td><code>spark.yarn.jar</code></td>
<td>(none)</td>
<td>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org