You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Ádám Szita (Jira)" <ji...@apache.org> on 2022/08/31 09:00:00 UTC

[jira] [Resolved] (HIVE-26506) HiveIcebergVectorizedRecordReader doesn't set the selected array

     [ https://issues.apache.org/jira/browse/HIVE-26506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ádám Szita resolved HIVE-26506.
-------------------------------
    Fix Version/s: 4.0.0
       Resolution: Fixed

Pushed to master. Thanks for reviewing [~lpinter].

> HiveIcebergVectorizedRecordReader doesn't set the selected array
> ----------------------------------------------------------------
>
>                 Key: HIVE-26506
>                 URL: https://issues.apache.org/jira/browse/HIVE-26506
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Ádám Szita
>            Assignee: Ádám Szita
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> HiveIcebergVectorizedRecordReader currently only sets {{selectedInUse}} but not {{selected}} that can cause the following exceptions where ORC row level filtering kicks in:
> {code:java}
> Caused by: java.lang.RuntimeException: all is not in sort order and unique
> 	at org.apache.hadoop.hive.ql.exec.vector.expressions.FilterExprOrExpr.subtract(FilterExprOrExpr.java:69)
> 	at org.apache.hadoop.hive.ql.exec.vector.expressions.FilterExprOrExpr.evaluate(FilterExprOrExpr.java:195)
> 	at org.apache.hadoop.hive.ql.exec.vector.expressions.FilterExprAndExpr.evaluate(FilterExprAndExpr.java:42)
> 	at org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator.process(VectorFilterOperator.java:125)
> 	at org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:968)
> 	at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:172)
> 	at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.deliverVectorizedRowBatch(VectorMapOperator.java:809)
> 	at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.process(VectorMapOperator.java:842) {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)