You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/01/05 15:49:00 UTC

[jira] [Work logged] (HIVE-24585) NPE in VectorizedOrcAcidRowBatchReader if LLAP is used with IO disabled

     [ https://issues.apache.org/jira/browse/HIVE-24585?focusedWorklogId=531310&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-531310 ]

ASF GitHub Bot logged work on HIVE-24585:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 05/Jan/21 15:48
            Start Date: 05/Jan/21 15:48
    Worklog Time Spent: 10m 
      Work Description: szlta opened a new pull request #1830:
URL: https://github.com/apache/hive/pull/1830


   NPE is thrown if LLAP mode is turned on and LLAP daemon executes a query on an ACID table if LLAP IO is disabled. Although this doesn't seem to be a very useful LLAP environment setup, we'll need to cover this edge case too.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 531310)
    Remaining Estimate: 0h
            Time Spent: 10m

> NPE in VectorizedOrcAcidRowBatchReader if LLAP is used with IO disabled
> -----------------------------------------------------------------------
>
>                 Key: HIVE-24585
>                 URL: https://issues.apache.org/jira/browse/HIVE-24585
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Ádám Szita
>            Assignee: Ádám Szita
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> NPE is thrown if LLAP mode is turned on and LLAP daemon executes a query on an ACID table if LLAP IO is disabled. Although this doesn't seem to be a very useful LLAP environment setup, we'll need to cover this edge case too.
> {code:java}
> Caused by: java.lang.RuntimeException: java.io.IOException: java.lang.NullPointerException
> 	at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:206)
> 	at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.<init>(TezGroupedSplitsInputFormat.java:145)
> 	at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat.getRecordReader(TezGroupedSplitsInputFormat.java:111)
> 	at org.apache.tez.mapreduce.lib.MRReaderMapred.setupOldRecordReader(MRReaderMapred.java:156)
> 	at org.apache.tez.mapreduce.lib.MRReaderMapred.setSplit(MRReaderMapred.java:82)
> 	at org.apache.tez.mapreduce.input.MRInput.initFromEventInternal(MRInput.java:703)
> 	at org.apache.tez.mapreduce.input.MRInput.initFromEvent(MRInput.java:662)
> 	at org.apache.tez.mapreduce.input.MRInputLegacy.checkAndAwaitRecordReaderInitialization(MRInputLegacy.java:150)
> 	at org.apache.tez.mapreduce.input.MRInputLegacy.init(MRInputLegacy.java:114)
> 	at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.getMRInput(MapRecordProcessor.java:543)
> 	at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:189)
> 	at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:266)
> 	... 15 more
> Caused by: java.io.IOException: java.lang.NullPointerException
> 	at org.apache.hadoop.hive.io.HiveIOExceptionHandlerChain.handleRecordReaderCreationException(HiveIOExceptionHandlerChain.java:97)
> 	at org.apache.hadoop.hive.io.HiveIOExceptionHandlerUtil.handleRecordReaderCreationException(HiveIOExceptionHandlerUtil.java:57)
> 	at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:431)
> 	at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:203)
> 	... 26 more
> Caused by: java.lang.NullPointerException
> 	at org.apache.hadoop.hive.ql.io.orc.VectorizedOrcAcidRowBatchReader.getOrcTail(VectorizedOrcAcidRowBatchReader.java:680)
> 	at org.apache.hadoop.hive.ql.io.orc.VectorizedOrcAcidRowBatchReader.findMinMaxKeys(VectorizedOrcAcidRowBatchReader.java:426)
> 	at org.apache.hadoop.hive.ql.io.orc.VectorizedOrcAcidRowBatchReader.<init>(VectorizedOrcAcidRowBatchReader.java:273)
> 	at org.apache.hadoop.hive.ql.io.orc.VectorizedOrcAcidRowBatchReader.<init>(VectorizedOrcAcidRowBatchReader.java:159)
> 	at org.apache.hadoop.hive.ql.io.orc.VectorizedOrcAcidRowBatchReader.<init>(VectorizedOrcAcidRowBatchReader.java:154)
> 	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRecordReader(OrcInputFormat.java:2074)
> 	at org.apache.hadoop.hive.ql.io.RecordReaderWrapper.create(RecordReaderWrapper.java:72)
> 	at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:428)
> 	... 27 more {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)