You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "BELUGA BEHR (JIRA)" <ji...@apache.org> on 2019/01/27 21:39:00 UTC
[jira] [Created] (PARQUET-1514) ParquetFileWriter Records
Compressed Bytes instead of Uncompressed Bytes
BELUGA BEHR created PARQUET-1514:
------------------------------------
Summary: ParquetFileWriter Records Compressed Bytes instead of Uncompressed Bytes
Key: PARQUET-1514
URL: https://issues.apache.org/jira/browse/PARQUET-1514
Project: Parquet
Issue Type: Bug
Reporter: BELUGA BEHR
As I understand it, the class {{BlockMetaData}} has a {{getTotalByteSize}} and a {{getCompressedSize}}. However, in the case of {{ParquetFileWriter}}, there is one place where the compressed size is being written into {{totalByteSize}} instead of the uncompressed size. This looks incorrect.
{code:java|title=ParquetFileWriter}
private BlockMetaData currentBlock;
...
public void appendRowGroup(SeekableInputStream from, BlockMetaData rowGroup,
boolean dropColumns) throws IOException {
...
currentBlock.setTotalByteSize(blockCompressedSize);
}
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)