You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Carson Wang (JIRA)" <ji...@apache.org> on 2019/07/11 22:27:00 UTC

[jira] [Created] (SPARK-28356) Do not reduce the number of partitions for repartition in adaptive execution

Carson Wang created SPARK-28356:
-----------------------------------

             Summary: Do not reduce the number of partitions for repartition in adaptive execution
                 Key: SPARK-28356
                 URL: https://issues.apache.org/jira/browse/SPARK-28356
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Carson Wang


Adaptive execution reduces the number of post-shuffle partitions at runtime, even for shuffles caused by repartition. However, the user likely wants to get the desired number of partition when he calls repartition even in adaptive execution. It will be good to support not changing the number of post-shuffle partition for repartition in adaptive execution.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org