You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2013/10/21 23:58:46 UTC
[jira] [Commented] (HIVE-5601) NPE in ORC's PPD when using select
* from table with where predicate
[ https://issues.apache.org/jira/browse/HIVE-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801226#comment-13801226 ]
Owen O'Malley commented on HIVE-5601:
-------------------------------------
Actually, can you fix it lower down and make the Reader.rows replace null with a boolean[] of the right length?
> NPE in ORC's PPD when using select * from table with where predicate
> ---------------------------------------------------------------------
>
> Key: HIVE-5601
> URL: https://issues.apache.org/jira/browse/HIVE-5601
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.12.0
> Reporter: Prasanth J
> Assignee: Prasanth J
> Priority: Critical
> Labels: ORC
> Attachments: HIVE-5601.branch-12.1.patch.txt, HIVE-5601.trunk.1.patch.txt
>
>
> ORCInputFormat has a method findIncludedColumns() which returns boolean array of included columns. In case of the following query
> {code}select * from qlog_orc where id<1000 limit 10;{code}
> where all columns are selected the findIncludedColumns() returns null. This will result in a NPE when PPD is enabled. Following is the stack trace
> {code}Caused by: java.lang.NullPointerException
> at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.planReadPartialDataStreams(RecordReaderImpl.java:2387)
> at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.readPartialDataStreams(RecordReaderImpl.java:2543)
> at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.readStripe(RecordReaderImpl.java:2200)
> at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceStripe(RecordReaderImpl.java:2573)
> at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceToNextRow(RecordReaderImpl.java:2615)
> at org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.<init>(RecordReaderImpl.java:132)
> at org.apache.hadoop.hive.ql.io.orc.ReaderImpl.rows(ReaderImpl.java:348)
> at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$OrcRecordReader.<init>(OrcInputFormat.java:99)
> at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRecordReader(OrcInputFormat.java:241)
> at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:237)
> ... 8 more{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)