You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2020/04/06 02:05:17 UTC

[spark] branch master updated: [SPARK-27963][DOCS][FOLLOWUP] Update requirements for spark.dynamicAllocation.enabled

This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 3886442  [SPARK-27963][DOCS][FOLLOWUP] Update requirements for spark.dynamicAllocation.enabled
3886442 is described below

commit 388644233285bc71e43f7d063da57d22ed35ae23
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Mon Apr 6 11:04:21 2020 +0900

    [SPARK-27963][DOCS][FOLLOWUP] Update requirements for spark.dynamicAllocation.enabled
    
    ### What changes were proposed in this pull request?
    
    This PR fixes the outdated requirement for `spark.dynamicAllocation.enabled=true`.
    
    ### Why are the changes needed?
    
    This is found during 3.0.0 RC1 document review and testing. As described at `spark.dynamicAllocation.shuffleTracking.enabled` in the same table, we can enabled Dynamic Allocation without external shuffle service.
    
    ### Does this PR introduce any user-facing change?
    
    Yes. (Doc.)
    
    ### How was this patch tested?
    
    Manually generate the doc by `SKIP_API=1 jekyll build`
    
    **BEFORE**
    ![Screen Shot 2020-04-05 at 2 31 23 PM](https://user-images.githubusercontent.com/9700541/78510472-29c0ae00-774a-11ea-9916-ba80015fae82.png)
    
    **AFTER**
    ![Screen Shot 2020-04-05 at 2 29 25 PM](https://user-images.githubusercontent.com/9700541/78510434-ea925d00-7749-11ea-8db8-018955507fd5.png)
    
    Closes #28132 from dongjoon-hyun/SPARK-DA-DOC.
    
    Authored-by: Dongjoon Hyun <do...@apache.org>
    Signed-off-by: HyukjinKwon <gu...@apache.org>
---
 docs/configuration.md | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/docs/configuration.md b/docs/configuration.md
index 5081d79..b8f2649 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -2456,7 +2456,8 @@ Apart from these, the following properties are also available, and may be useful
     For more detail, see the description
     <a href="job-scheduling.html#dynamic-resource-allocation">here</a>.
     <br><br>
-    This requires <code>spark.shuffle.service.enabled</code> to be set.
+    This requires <code>spark.shuffle.service.enabled</code> or
+    <code>spark.dynamicAllocation.shuffleTracking.enabled</code> to be set.
     The following configurations are also relevant:
     <code>spark.dynamicAllocation.minExecutors</code>,
     <code>spark.dynamicAllocation.maxExecutors</code>, and


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org