You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2022/02/01 21:35:53 UTC
[GitHub] [spark] srowen commented on a change in pull request #35223: [SPARK-37925][DOC] Update document to mention the workaround for YARN-11053
srowen commented on a change in pull request #35223:
URL: https://github.com/apache/spark/pull/35223#discussion_r797046615
##########
File path: docs/running-on-yarn.md
##########
@@ -916,9 +916,12 @@ support the ability to run shuffle services within an isolated classloader
can coexist within a single NodeManager. The
`yarn.nodemanager.aux-services.<service-name>.classpath` and, starting from YARN 2.10.2/3.1.1/3.2.0,
`yarn.nodemanager.aux-services.<service-name>.remote-classpath` options can be used to configure
-this. In addition to setting up separate classpaths, it's necessary to ensure the two versions
-advertise to different ports. This can be achieved using the `spark-shuffle-site.xml` file described
-above. For example, you may have configuration like:
+this. Notes that YARN 3.3.0/3.3.1 have an issue which requires setting
Review comment:
Notes -> note
as a workaround, see -> as a workaround. See
##########
File path: docs/running-on-yarn.md
##########
@@ -916,9 +916,12 @@ support the ability to run shuffle services within an isolated classloader
can coexist within a single NodeManager. The
`yarn.nodemanager.aux-services.<service-name>.classpath` and, starting from YARN 2.10.2/3.1.1/3.2.0,
`yarn.nodemanager.aux-services.<service-name>.remote-classpath` options can be used to configure
-this. In addition to setting up separate classpaths, it's necessary to ensure the two versions
-advertise to different ports. This can be achieved using the `spark-shuffle-site.xml` file described
-above. For example, you may have configuration like:
+this. Notes that YARN 3.3.0/3.3.1 have an issue which requires setting
Review comment:
Notes -> Note
as a workaround, see -> as a workaround. See
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org