You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/14 13:20:38 UTC
[PR] [SPARK-55877][UI] Side-by-side Initial vs Final plan comparison for AQE queries [spark]
yaooqinn opened a new pull request, #54802:
URL: https://github.com/apache/spark/pull/54802
### What changes were proposed in this pull request?
Add a side-by-side comparison view for AQE (Adaptive Query Execution) plan evolution in the SQL execution detail page.
When AQE rewrites a query plan, the `physicalPlanDescription` contains both "Initial Plan" and "Final Plan" tree sections. This PR parses them and displays in a tabbed layout:
| Tab | Content |
|-----|---------|
| **Side-by-Side** | Two columns: Initial Plan (left) vs Final Plan (right) |
| **Raw** | Original full plan text (backward compatible) |
For non-AQE queries (where initial == final), the raw text is shown directly without tabs.
### Why are the changes needed?
Understanding how AQE rewrites a plan is important for query performance analysis. Currently the plan text mixes both versions in a single block, making it hard to compare. The side-by-side view makes differences immediately visible (e.g., added ShuffleQueryStage, AQEShuffleRead coalescing, statistics).
### Does this PR introduce _any_ user-facing change?
Yes — Plan Details section on the SQL execution page now shows a tabbed Side-by-Side/Raw view when AQE has rewritten the plan.
### How was this patch tested?
Manual testing with AQE-enabled queries. Compilation verified.
### Was this patch authored or co-authored using generative AI tooling?
Yes, co-authored with GitHub Copilot.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-55877][UI] Side-by-side Initial vs Final plan comparison for AQE queries [spark]
Posted by "yaooqinn (via GitHub)" <gi...@apache.org>.
yaooqinn commented on PR #54802:
URL: https://github.com/apache/spark/pull/54802#issuecomment-4060865965
### Screenshots
**Unified view (default) — full plan text with Final Plan, Initial Plan, and node details:**
**Split view — Initial Plan (left) vs Final Plan (right) side-by-side:**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-55877][UI] Side-by-side Initial vs Final plan comparison for AQE queries [spark]
Posted by "yaooqinn (via GitHub)" <gi...@apache.org>.
yaooqinn closed pull request #54802: [SPARK-55877][UI] Side-by-side Initial vs Final plan comparison for AQE queries
URL: https://github.com/apache/spark/pull/54802
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org