You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ya...@apache.org on 2025/04/22 05:32:00 UTC

(spark) branch master updated: [SPARK-51861][SQL][UI] Remove duplicated/unnecessary info of InMemoryRelation Plan Detail

This is an automated email from the ASF dual-hosted git repository.

yao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 7904dd3cd612 [SPARK-51861][SQL][UI] Remove duplicated/unnecessary info of InMemoryRelation Plan Detail
7904dd3cd612 is described below

commit 7904dd3cd612721815d1cbc7d585efaac66d45a1
Author: Kent Yao <ya...@apache.org>
AuthorDate: Tue Apr 22 13:31:46 2025 +0800

    [SPARK-51861][SQL][UI] Remove duplicated/unnecessary info of InMemoryRelation Plan Detail
    
    ### What changes were proposed in this pull request?
    
    Remove duplicated info in InMemoryRelation Plan Detail
    
    - serializer, a dev-only api
    - cachedPlan, duplicated
    - logicalPlan, not necessary for the physical detail
    
    ### Why are the changes needed?
    
    These parameters are unnecessary and unformatted, which make the UI hard to read.
    
    ### Does this PR introduce _any_ user-facing change?
    UI changes
    
    ### How was this patch tested?
    
    ![image](https://github.com/user-attachments/assets/8184626e-e135-4fd4-9bc8-325b748211d3)
    
    ### Was this patch authored or co-authored using generative AI tooling?
    no
    
    Closes #50656 from yaooqinn/stringArgs.
    
    Authored-by: Kent Yao <ya...@apache.org>
    Signed-off-by: Kent Yao <ya...@apache.org>
---
 .../org/apache/spark/sql/execution/columnar/InMemoryRelation.scala     | 3 +++
 1 file changed, 3 insertions(+)

diff --git a/sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala b/sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala
index bdbaee16d4e9..8f704cec7e89 100644
--- a/sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala
+++ b/sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala
@@ -516,4 +516,7 @@ case class InMemoryRelation(
 
   override def simpleString(maxFields: Int): String =
     s"InMemoryRelation [${truncatedString(output, ", ", maxFields)}], ${cacheBuilder.storageLevel}"
+
+  override def stringArgs: Iterator[Any] =
+    Iterator(output, cacheBuilder.storageLevel, outputOrdering)
 }


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org