[jira] [Comment Edited] (PARQUET-1514) ParquetFileWriter Records Compressed Bytes instead of Uncompressed Bytes

["BELUGA BEHR (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PARQUET-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16753607#comment-16753607 ] 

BELUGA BEHR edited comment on PARQUET-1514 at 1/27/19 10:02 PM:
----------------------------------------------------------------

This may be a non-issue.  This may be on purpose.  However, if my understand is correct, and this is indeed supposed to be uncompressed byes.  I have provided a PR.


was (Author: belugabehr):
This may be a non-issue.  This may be on purpose.  However, my understand is correct, and this is indeed supposed to be uncompressed byes.  I have provided a PR.

> ParquetFileWriter Records Compressed Bytes instead of Uncompressed Bytes
> ------------------------------------------------------------------------
>
>                 Key: PARQUET-1514
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1514
>             Project: Parquet
>          Issue Type: Bug
>            Reporter: BELUGA BEHR
>            Assignee: BELUGA BEHR
>            Priority: Minor
>              Labels: pull-request-available
>
> As I understand it, the class {{BlockMetaData}} has a {{getTotalByteSize}} and a {{getCompressedSize}}.  However, in the case of {{ParquetFileWriter}}, there is one place where the compressed size is being written into {{totalByteSize}} instead of the uncompressed size.  This looks incorrect.
> {code:java|title=ParquetFileWriter}
> private BlockMetaData currentBlock;
> ...
> public void appendRowGroup(SeekableInputStream from, BlockMetaData rowGroup,
>     boolean dropColumns) throws IOException {
>     ...
>     currentBlock.setTotalByteSize(blockCompressedSize);
> }
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)