You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Attila Zsolt Piros (Jira)" <ji...@apache.org> on 2019/09/05 10:33:00 UTC
[jira] [Created] (HADOOP-16550) Wrong Spark config name on the
"Launching Applications Using Docker Containers" page
Attila Zsolt Piros created HADOOP-16550:
-------------------------------------------
Summary: Wrong Spark config name on the "Launching Applications Using Docker Containers" page
Key: HADOOP-16550
URL: https://issues.apache.org/jira/browse/HADOOP-16550
Project: Hadoop Common
Issue Type: Bug
Components: documentation
Affects Versions: 3.1.2, 2.8.5, 3.0.3, 2.9.2, 3.1.1, 3.0.2, 2.8.4, 3.0.1, 2.9.1, 3.1.0, 3.0.0, 2.8.3, 2.8.2, 2.9.0
Reporter: Attila Zsolt Piros
On the "Launching Applications Using Docker Containers" page at the "Example: Spark" section the Spark config for configuring the environment variables for the application master the config prefix are wrong:
- spark.yarn.{color:#DE350B}*A*{color}ppMasterEnv.YARN_CONTAINER_RUNTIME_DOCKER_IMAGE
- park.yarn.{color:#DE350B}*A*{color}ppMasterEnv.YARN_CONTAINER_RUNTIME_TYPE
The correct ones:
- spark.yarn.appMasterEnv.YARN_CONTAINER_RUNTIME_DOCKER_IMAGE
- spark.yarn.appMasterEnv.YARN_CONTAINER_RUNTIME_TYPE
See https://spark.apache.org/docs/2.4.0/running-on-yarn.html:
{quote}
spark.yarn.appMasterEnv.[EnvironmentVariableName]
{quote}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org