You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2020/04/06 02:05:55 UTC
[spark] branch branch-3.0 updated: [SPARK-27963][DOCS][FOLLOWUP]
Update requirements for spark.dynamicAllocation.enabled
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new 7d6aff0 [SPARK-27963][DOCS][FOLLOWUP] Update requirements for spark.dynamicAllocation.enabled
7d6aff0 is described below
commit 7d6aff0f1a0ece47a49a49ce62745da6ccbd9c8e
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Mon Apr 6 11:04:21 2020 +0900
[SPARK-27963][DOCS][FOLLOWUP] Update requirements for spark.dynamicAllocation.enabled
### What changes were proposed in this pull request?
This PR fixes the outdated requirement for `spark.dynamicAllocation.enabled=true`.
### Why are the changes needed?
This is found during 3.0.0 RC1 document review and testing. As described at `spark.dynamicAllocation.shuffleTracking.enabled` in the same table, we can enabled Dynamic Allocation without external shuffle service.
### Does this PR introduce any user-facing change?
Yes. (Doc.)
### How was this patch tested?
Manually generate the doc by `SKIP_API=1 jekyll build`
**BEFORE**
![Screen Shot 2020-04-05 at 2 31 23 PM](https://user-images.githubusercontent.com/9700541/78510472-29c0ae00-774a-11ea-9916-ba80015fae82.png)
**AFTER**
![Screen Shot 2020-04-05 at 2 29 25 PM](https://user-images.githubusercontent.com/9700541/78510434-ea925d00-7749-11ea-8db8-018955507fd5.png)
Closes #28132 from dongjoon-hyun/SPARK-DA-DOC.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: HyukjinKwon <gu...@apache.org>
(cherry picked from commit 388644233285bc71e43f7d063da57d22ed35ae23)
Signed-off-by: HyukjinKwon <gu...@apache.org>
---
docs/configuration.md | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git a/docs/configuration.md b/docs/configuration.md
index d22038b..8d1cc84 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -2315,7 +2315,8 @@ Apart from these, the following properties are also available, and may be useful
For more detail, see the description
<a href="job-scheduling.html#dynamic-resource-allocation">here</a>.
<br><br>
- This requires <code>spark.shuffle.service.enabled</code> to be set.
+ This requires <code>spark.shuffle.service.enabled</code> or
+ <code>spark.dynamicAllocation.shuffleTracking.enabled</code> to be set.
The following configurations are also relevant:
<code>spark.dynamicAllocation.minExecutors</code>,
<code>spark.dynamicAllocation.maxExecutors</code>, and
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org