[jira] [Commented] (PARQUET-574) Boolean format in Plain Decoder

["Wes McKinney (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PARQUET-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15224485#comment-15224485 ] 

Wes McKinney commented on PARQUET-574:
--------------------------------------

[~fmilo] [~blue@cloudera.com] it seems that RLE for boolean is only in Parquet 2.0, can you confirm? 

https://github.com/apache/parquet-format/tree/parquet-format-1.0.0

The current parquet-cpp implementation I believe is in sync with Parquet 1.0 as implemented in Impala, though obviously we will need to support both:

https://github.com/cloudera/Impala/blob/cdh5-trunk/be/src/exec/hdfs-parquet-table-writer.cc#L335

Before I dig around a bunch, can you tell me how I can distinguish between these cases? 

> Boolean format in Plain Decoder 
> --------------------------------
>
>                 Key: PARQUET-574
>                 URL: https://issues.apache.org/jira/browse/PARQUET-574
>             Project: Parquet
>          Issue Type: Improvement
>            Reporter: Fabrizio Milo
>            Priority: Trivial
>
> In the encoding.md document is written that the plain encoder for boolean uses [RLE/BitPacking](https://github.com/apache/parquet-format/blob/master/Encodings.md#plain-plain--0) 
> While in the cpp implementation seems is just using [simple bit decoding back to back.](https://github.com/apache/parquet-cpp/blob/master/src/parquet/encodings/plain-encoding.h#L151)
> Which one is the right format ? 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)