You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by sr...@apache.org on 2016/01/15 14:11:23 UTC
spark git commit: [SPARK-2930] clarify docs on using webhdfs with spark.yarn.access.nam…
Repository: spark
Updated Branches:
refs/heads/master d0a5c32bd -> 96fb894d4
[SPARK-2930] clarify docs on using webhdfs with spark.yarn.access.nam…
…enodes
Author: Tom Graves <tg...@yahoo-inc.com>
Closes #10699 from tgravescs/SPARK-2930.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/96fb894d
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/96fb894d
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/96fb894d
Branch: refs/heads/master
Commit: 96fb894d4b33e293625fa92bbeccbbf5e688015e
Parents: d0a5c32
Author: Tom Graves <tg...@yahoo-inc.com>
Authored: Fri Jan 15 13:11:27 2016 +0000
Committer: Sean Owen <so...@cloudera.com>
Committed: Fri Jan 15 13:11:27 2016 +0000
----------------------------------------------------------------------
docs/running-on-yarn.md | 8 ++++----
1 file changed, 4 insertions(+), 4 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/96fb894d/docs/running-on-yarn.md
----------------------------------------------------------------------
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md
index 06413f8..a148c86 100644
--- a/docs/running-on-yarn.md
+++ b/docs/running-on-yarn.md
@@ -260,10 +260,10 @@ If you need a reference to the proper location to put log files in the YARN so t
<td>(none)</td>
<td>
A comma-separated list of secure HDFS namenodes your Spark application is going to access. For
- example, <code>spark.yarn.access.namenodes=hdfs://nn1.com:8032,hdfs://nn2.com:8032</code>.
- The Spark application must have access to the namenodes listed and Kerberos must
- be properly configured to be able to access them (either in the same realm or in
- a trusted realm). Spark acquires security tokens for each of the namenodes so that
+ example, <code>spark.yarn.access.namenodes=hdfs://nn1.com:8032,hdfs://nn2.com:8032,
+ webhdfs://nn3.com:50070</code>. The Spark application must have access to the namenodes listed
+ and Kerberos must be properly configured to be able to access them (either in the same realm
+ or in a trusted realm). Spark acquires security tokens for each of the namenodes so that
the Spark application can access those remote HDFS clusters.
</td>
</tr>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org