You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/12/29 13:02:00 UTC

[jira] [Created] (SPARK-26504) Rope-wise dumping of Spark plans

Maxim Gekk created SPARK-26504:
----------------------------------

             Summary: Rope-wise dumping of Spark plans 
                 Key: SPARK-26504
                 URL: https://issues.apache.org/jira/browse/SPARK-26504
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.4.0
            Reporter: Maxim Gekk


Currently, Spark plans are converted to string via StringBuilderWriter when memory for strings are allocated sequentially as soon as elements of plans are added to the StringBuilder.

Proposed improvement is StringRope which has 2 methods:
1. append(s: String): Unit - adds the string to internal list and increases total size
2. toString: String - converts the list of strings to strings



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org