You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Jason Dere (Jira)" <ji...@apache.org> on 2020/02/10 16:47:00 UTC
[jira] [Commented] (HIVE-22856) Hive LLAP
LlapArrowBatchRecordReader skipping remaining batches when
ArrowStreamReader returns a 0 length batch.
[ https://issues.apache.org/jira/browse/HIVE-22856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17033745#comment-17033745 ]
Jason Dere commented on HIVE-22856:
-----------------------------------
+1 nice catch
> Hive LLAP LlapArrowBatchRecordReader skipping remaining batches when ArrowStreamReader returns a 0 length batch.
> ----------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-22856
> URL: https://issues.apache.org/jira/browse/HIVE-22856
> Project: Hive
> Issue Type: Bug
> Reporter: mahesh kumar behera
> Assignee: mahesh kumar behera
> Priority: Major
> Attachments: HIVE-22856.01.patch
>
>
> LlapArrowBatchRecordReader returns false when the ArrowStreamReader loadNextBatch returns column vector with 0 length. But we should keep reading data until loadNextBatch returns false. Some batch may return column vector of length 0, but we should ignore and wait for the next batch.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)