You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yang Jie (Jira)" <ji...@apache.org> on 2022/05/19 04:16:00 UTC
[jira] [Resolved] (SPARK-39202) Introduce a `putByteArrays` method to `WritableColumnVector` to support setting multiple duplicate `byte[]`
[ https://issues.apache.org/jira/browse/SPARK-39202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yang Jie resolved SPARK-39202.
------------------------------
Resolution: Won't Fix
> Introduce a `putByteArrays` method to `WritableColumnVector` to support setting multiple duplicate `byte[]`
> -----------------------------------------------------------------------------------------------------------
>
> Key: SPARK-39202
> URL: https://issues.apache.org/jira/browse/SPARK-39202
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.4.0
> Reporter: Yang Jie
> Priority: Minor
>
> Add a `putByteArrays` method to `WritableColumnVector`
>
> {code:java}
> int putByteArrays(int rowId, int total, byte[] value) {code}
>
>
> this method used to support setting multiple duplicate `byte[]` to `WritableColumnVector`.
> Since `byte[] value` is fixed length, memory can allocated at one time without calling `
> reserve(int requiredCapacity)` method many times.
>
> This method is applicable to `ColumnVectorUtils.populate` method with `StringType` and partial `DecimalType` scenario, this corresponds to the Vectorized Partition Column filling of Parquet and Orc
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org