You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Chao Sun (Jira)" <ji...@apache.org> on 2026/05/13 00:15:00 UTC

[jira] [Created] (SPARK-56842) Short-circuit AQE when materialized stages are empty

Chao Sun created SPARK-56842:
--------------------------------

             Summary: Short-circuit AQE when materialized stages are empty
                 Key: SPARK-56842
                 URL: https://issues.apache.org/jira/browse/SPARK-56842
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 5.0.0
            Reporter: Chao Sun


Adaptive execution can continue planning work after a materialized query stage proves that a branch is empty, including plans wrapped by sort/project/columnar conversion operators. This can leave obsolete exchange stages running and may surface cancellation failures from stages that are no longer relevant to the final plan.

This issue tracks preserving emptiness propagation through those wrappers, handling aggregate row-count semantics correctly, and ignoring cancellation failures from obsolete stages that AQE intentionally replaces.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org