[jira] [Commented] (DRILL-238) parquet reader hangs when reading nullable columns

["Jason Altekruse (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/DRILL-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13770992#comment-13770992 ] 

Jason Altekruse commented on DRILL-238:
---------------------------------------

Review Board for patch
https://reviews.apache.org/r/14207/

                
> parquet reader hangs when reading nullable columns
> --------------------------------------------------
>
>                 Key: DRILL-238
>                 URL: https://issues.apache.org/jira/browse/DRILL-238
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Steven Phillips
>            Assignee: Jason Altekruse
>         Attachments: 0001-Drill-238.-Fixed-bug-with-repeated-varlength-columns.patch
>
>
> Running this physical plan:
> {
>   head : {
>     type : "APACHE_DRILL_PHYSICAL",
>     version : 1,
>     generator : {
>       type : "optiq",
>       info : "na"
>     }
>   },
>   graph : [ {
>     pop : "parquet-scan",
>     @id : 1,
>     entries : [ {
>       path : "/tmp/tpc-h/customer"
>     } ],
>     storageengine : {
>       type : "parquet",
>       dfsName : "file:///"
>     },
>     ref : "_MAP",
>     fragmentPointer : 0
>   }, {
>     pop : "project",
>     @id : 2,
>     exprs : [ {
>       ref : "output.$f0",
>       expr : "1"
>     } ],
>     child : 1
>   }, {
>     pop : "streaming-aggregate",
>     @id : 4,
>     child : 2,
>     keys : [ ],
>     exprs : [ {
>       ref : "EXPR$0",
>       expr : "count($f0) "
>     } ]
>   }, {
>     pop : "screen",
>     @id : 6,
>     child : 4
>   } ]
> }
> against parquet data generated with Pig. The reader hangs. the last message in the log is this:
> records to read in this pass: 4000

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira