You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Manish Agarwal (JIRA)" <ji...@apache.org> on 2015/01/09 02:20:34 UTC
[jira] [Updated] (PARQUET-163) BytesWritable is not in parquet 's
writePrimitive in DataWritableWriter class
[ https://issues.apache.org/jira/browse/PARQUET-163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Manish Agarwal updated PARQUET-163:
-----------------------------------
Description:
currently i have 2 int fileds and 1 string field . To insert it into parquet i use 2 intwritables and 1 binarywriatbel object .
For next record i can reuse my 2 IntWritable objects but i have to create a new BinaryWritable object because BinaryWritable do not have set method . this is a bottleneck for me in performance as i am doing new again for every record .
How do you guys recommend i solve this since BytesWritable is not in parquet 's writePrimitive in DataWritableWriter class . it has ByteWritable and we need BytesWritable
was:
currently i have 2 int fileds and 1 string field . To insert it into parquet i use 2 intwritables and 1 binarywriatbel object .
For next record i can reuse my 2 intwritable objects but i have to cretae a new binarywritable object because binarywritable do not have set method . this is a bottleneck for me in performance .
How do you guys recommend i solve this since BytesWritable is not in parquet 's writePrimitive in DataWritableWriter class . it has ByteWritable and we need BytesWritable
> BytesWritable is not in parquet 's writePrimitive in DataWritableWriter class
> -------------------------------------------------------------------------------
>
> Key: PARQUET-163
> URL: https://issues.apache.org/jira/browse/PARQUET-163
> Project: Parquet
> Issue Type: Bug
> Reporter: Manish Agarwal
>
> currently i have 2 int fileds and 1 string field . To insert it into parquet i use 2 intwritables and 1 binarywriatbel object .
> For next record i can reuse my 2 IntWritable objects but i have to create a new BinaryWritable object because BinaryWritable do not have set method . this is a bottleneck for me in performance as i am doing new again for every record .
> How do you guys recommend i solve this since BytesWritable is not in parquet 's writePrimitive in DataWritableWriter class . it has ByteWritable and we need BytesWritable
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)