You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Bowen Liang (Jira)" <ji...@apache.org> on 2023/12/08 08:22:00 UTC

[jira] [Created] (SPARK-46328) Allocate enough capacity for assembling array list of TColumns in TRowSet generation

Bowen Liang created SPARK-46328:
-----------------------------------

             Summary: Allocate enough capacity for assembling array list of TColumns in TRowSet generation
                 Key: SPARK-46328
                 URL: https://issues.apache.org/jira/browse/SPARK-46328
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 3.5.0
            Reporter: Bowen Liang


Background:

ArrayList is created for TColumn value collections in RowSetUtils for TRowSet generation. Currently, they are created with Java's default capacity of 16, rather than by the number of columns, which could cause array copying in assembling each TColumn collections when the column number exceeds the default capacity.

 

Suggested solution:

Allocate enough capacity by columns size for assembling array list of TColumns in TRowSet generation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org