You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2019/07/11 22:36:00 UTC

[jira] [Assigned] (SPARK-28356) Do not reduce the number of partitions for repartition in adaptive execution

     [ https://issues.apache.org/jira/browse/SPARK-28356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-28356:
------------------------------------

    Assignee:     (was: Apache Spark)

> Do not reduce the number of partitions for repartition in adaptive execution
> ----------------------------------------------------------------------------
>
>                 Key: SPARK-28356
>                 URL: https://issues.apache.org/jira/browse/SPARK-28356
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Carson Wang
>            Priority: Minor
>
> Adaptive execution reduces the number of post-shuffle partitions at runtime, even for shuffles caused by repartition. However, the user likely wants to get the desired number of partition when he calls repartition even in adaptive execution. It will be good to support not changing the number of post-shuffle partition for repartition in adaptive execution.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org