You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by pianista215 <gi...@git.apache.org> on 2017/12/26 16:52:00 UTC
[GitHub] spark pull request #20083: Supporting different host for Spark-shuffle
GitHub user pianista215 opened a pull request:
https://github.com/apache/spark/pull/20083
Supporting different host for Spark-shuffle
## What changes were proposed in this pull request?
Adding an option as spark.shuffle.service.host let you to specify different ip for the external shuffle service. For example if you have this service in a Docker, or behind a CNI, you won't have the same ip in the service vs the spark executors.
## How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)
Please review http://spark.apache.org/contributing.html before opening a pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/pianista215/spark spark_shuffle_host_config
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20083.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20083
----
commit a3d302dcffcf71fb9d6a94a0860a762fbd80efb1
Author: Unai <us...@...>
Date: 2017-12-26T16:47:47Z
Supporting different host for Spark-shuffle
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark pull request #20083: [SPARK-22906] Supporting different host for exter...
Posted by pianista215 <gi...@git.apache.org>.
Github user pianista215 closed the pull request at:
https://github.com/apache/spark/pull/20083
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] spark issue #20083: Supporting different host for Spark-shuffle
Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20083
Can one of the admins verify this patch?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org