[jira] [Resolved] (SPARK-46328) Allocate capacity of array list of TColumns by columns size in TRowSet generation

["Dongjoon Hyun (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-46328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dongjoon Hyun resolved SPARK-46328.
-----------------------------------
    Fix Version/s: 4.0.0
       Resolution: Fixed

Issue resolved by pull request 44258
[https://github.com/apache/spark/pull/44258]

> Allocate capacity of array list of TColumns by columns size in TRowSet generation
> ---------------------------------------------------------------------------------
>
>                 Key: SPARK-46328
>                 URL: https://issues.apache.org/jira/browse/SPARK-46328
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 4.0.0
>            Reporter: Bowen Liang
>            Assignee: Bowen Liang
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>
> Background:
> ArrayList is created for TColumn value collections in RowSetUtils for TRowSet generation. Currently, they are created with Java's default capacity of 16, rather than by the number of columns, which could cause array copying in assembling each TColumn collections when the column number exceeds the default capacity.
>  
> Suggested solution:
> Allocate enough capacity by columns size for assembling array list of TColumns in TRowSet generation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org