You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/08/30 13:58:00 UTC
[jira] [Work logged] (HIVE-26506) HiveIcebergVectorizedRecordReader doesn't set the selected array
[ https://issues.apache.org/jira/browse/HIVE-26506?focusedWorklogId=804870&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-804870 ]
ASF GitHub Bot logged work on HIVE-26506:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 30/Aug/22 13:57
Start Date: 30/Aug/22 13:57
Worklog Time Spent: 10m
Work Description: szlta opened a new pull request, #3558:
URL: https://github.com/apache/hive/pull/3558
HiveIcebergVectorizedRecordReader currently only sets selectedInUse but not selected that can cause the following exceptions where ORC row level filtering kicks in:
```
Caused by: java.lang.RuntimeException: all is not in sort order and unique
at org.apache.hadoop.hive.ql.exec.vector.expressions.FilterExprOrExpr.subtract(FilterExprOrExpr.java:69)
at org.apache.hadoop.hive.ql.exec.vector.expressions.FilterExprOrExpr.evaluate(FilterExprOrExpr.java:195)
at org.apache.hadoop.hive.ql.exec.vector.expressions.FilterExprAndExpr.evaluate(FilterExprAndExpr.java:42)
at org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator.process(VectorFilterOperator.java:125)
at org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968)
at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:172)
at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.deliverVectorizedRowBatch(VectorMapOperator.java:809)
at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.process(VectorMapOperator.java:842)
```
Issue Time Tracking
-------------------
Worklog Id: (was: 804870)
Remaining Estimate: 0h
Time Spent: 10m
> HiveIcebergVectorizedRecordReader doesn't set the selected array
> ----------------------------------------------------------------
>
> Key: HIVE-26506
> URL: https://issues.apache.org/jira/browse/HIVE-26506
> Project: Hive
> Issue Type: Bug
> Reporter: Ádám Szita
> Assignee: Ádám Szita
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> HiveIcebergVectorizedRecordReader currently only sets {{selectedInUse}} but not {{selected}} that can cause the following exceptions where ORC row level filtering kicks in:
> {code:java}
> Caused by: java.lang.RuntimeException: all is not in sort order and unique
> at org.apache.hadoop.hive.ql.exec.vector.expressions.FilterExprOrExpr.subtract(FilterExprOrExpr.java:69)
> at org.apache.hadoop.hive.ql.exec.vector.expressions.FilterExprOrExpr.evaluate(FilterExprOrExpr.java:195)
> at org.apache.hadoop.hive.ql.exec.vector.expressions.FilterExprAndExpr.evaluate(FilterExprAndExpr.java:42)
> at org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator.process(VectorFilterOperator.java:125)
> at org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968)
> at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:172)
> at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.deliverVectorizedRowBatch(VectorMapOperator.java:809)
> at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.process(VectorMapOperator.java:842) {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)