You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by CodingCat <co...@apache.org> on 2020/08/31 07:40:37 UTC

is it possible to apply AQE rules only on some of nodes?

Hi, Spark devs

I am wondering if it is possible to apply AQE on part of the physical plan?
e.g. I only want to apply coalesce partitions on a
particular ShuffleQueryStageExec?

I didn't find a very straightforward way to achieve this, but is there a
way to workaround the current limitation?

Thanks!

Nan