You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/08/02 01:36:00 UTC

[jira] [Commented] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

    [ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573984#comment-17573984 ] 

Dongjoon Hyun commented on SPARK-39902:
---------------------------------------

Thank you, [~sumeet.gajjar] . Apache Spark community have a backporting policy which allows bug fixes only. In other words, we cannot backport new features or improvements to branch-3.3. So, the Affected Version should be the version of master branch which is 3.4.0. I updated it in this JIRA.

> Add Scan details to spark plan scan node in SparkUI
> ---------------------------------------------------
>
>                 Key: SPARK-39902
>                 URL: https://issues.apache.org/jira/browse/SPARK-39902
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL, Web UI
>    Affects Versions: 3.4.0
>            Reporter: Sumeet
>            Priority: Major
>         Attachments: Screen Shot 2022-07-27 at 6.00.27 PM.png, Screen Shot 2022-07-27 at 6.00.50 PM.png, Screen Shot 2022-07-27 at 6.38.56 PM.png, Screen Shot 2022-07-27 at 6.39.48 PM.png
>
>
> Hi,
> For DSv2, the scan node in the spark plan on SparkUI simply shows "BatchScan" as opposed to "Scan <fileformat>".
> Add a method "String name()" to the Scan interface, that "BatchScanExec" can invoke to set the node name the plan. This nodeName will be eventually used by "SparkPlanGraphNode" to display it in the header of the UI node.
>  
> DSv1
> !Screen Shot 2022-07-27 at 6.00.27 PM.png|width=356,height=212!
>  
> DSv2
> !Screen Shot 2022-07-27 at 6.00.50 PM.png|width=293,height=277!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org