You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Victor Sunderland (Jira)" <ji...@apache.org> on 2025/08/19 00:18:00 UTC
[jira] [Resolved] (SPARK-47445) Adding new 'Silent' ExplainMode
[ https://issues.apache.org/jira/browse/SPARK-47445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Victor Sunderland resolved SPARK-47445.
---------------------------------------
Resolution: Fixed
> Adding new 'Silent' ExplainMode
> -------------------------------
>
> Key: SPARK-47445
> URL: https://issues.apache.org/jira/browse/SPARK-47445
> Project: Spark
> Issue Type: Improvement
> Components: Connect, Documentation, PySpark, SQL
> Affects Versions: 4.0.0
> Reporter: Victor Sunderland
> Priority: Minor
> Labels: pull-request-available
>
> While investigating unit test duration we found that org.apache.spark.sql.execution.QueryExecution.explainString () takes approximately 14% time. This method generates the string representation of the execution plan. The string is often used for logging purposes. This is also called for each AQE job so it can save prod execution time too. While SPARK-44485 does exist to help optimize the prod execution time, the main purpose of this PR is to save time during unit testing.
> I've added a silent mode to ExplainMode to try and mitigate this issue.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org