You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "ShuMing Li (Jira)" <ji...@apache.org> on 2020/01/16 07:08:00 UTC
[jira] [Updated] (PARQUET-1771) Support configurable for
DirectByteBufferAllocator from Hadoop Configuration
[ https://issues.apache.org/jira/browse/PARQUET-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ShuMing Li updated PARQUET-1771:
--------------------------------
Description:
Now in [HadoopReadOptions|([https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/HadoopReadOptions.java#L85]] class, we cannot change default allocator from Hadoop Configuration.
Add a config `parquet.allocator.direct.enabled` to enable `DirectByteBufferAllocator` in `ParuqetFileReader`.
was:
Now in [HadoopReadOptions]([https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/HadoopReadOptions.java#L85]) class, we cannot change default allocator from Hadoop Configuration.
Add a config `parquet.allocator.direct.enabled` to enable `DirectByteBufferAllocator` in `ParuqetFileReader`.
> Support configurable for DirectByteBufferAllocator from Hadoop Configuration
> ----------------------------------------------------------------------------
>
> Key: PARQUET-1771
> URL: https://issues.apache.org/jira/browse/PARQUET-1771
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-mr
> Affects Versions: 1.10.1
> Reporter: ShuMing Li
> Priority: Minor
>
> Now in [HadoopReadOptions|([https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/HadoopReadOptions.java#L85]] class, we cannot change default allocator from Hadoop Configuration.
>
> Add a config `parquet.allocator.direct.enabled` to enable `DirectByteBufferAllocator` in `ParuqetFileReader`.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)