[jira] [Resolved] (IMPALA-11280) Zipping unnest hits DCHECK when querying from a view that has an IN operator

["Gabor Kaszab (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gabor Kaszab resolved IMPALA-11280.
-----------------------------------
    Fix Version/s: Impala 4.2.0
       Resolution: Fixed

> Zipping unnest hits DCHECK when querying from a view that has an IN operator
> ----------------------------------------------------------------------------
>
>                 Key: IMPALA-11280
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11280
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Frontend
>    Affects Versions: Impala 4.1.0
>            Reporter: Gabor Kaszab
>            Assignee: Gabor Kaszab
>            Priority: Major
>              Labels: complextype
>             Fix For: Impala 4.2.0
>
>
> *Repro steps:*
> 1) Create a view that returns arrays and has an IN operator in the WHERE clause:
> {code:java}
> drop view if exists unnest_bug_view;
> create view unnest_bug_view as (
>   select id, arr1, arr2
>   from functional_parquet.complextypes_arrays
>   where id % 2 = 1 and id in (select id from functional_parquet.alltypestiny)
> ); {code}
> 2) Unnest the arrays and filter by the unnested values in an outer SELECT:
> {code:java}
> select
>   id,
>   unnested_arr1,
>   unnested_arr2
> from
>   (select
>      id,
>      unnest(arr1) as unnested_arr1,
>      unnest(arr2) as unnested_arr2
>    from unnest_bug_view) a
> where a.unnested_arr1 < 5; {code}
> This hits a DCHECK in RowDescriptor::GetTupleIdx()
>  
>  
> {code:java}
> descriptors.cc:467] 5643fd6cdd5cece3:77942ead00000000] Check failed: id < tuple_idx_map_.size() (3 vs. 2) RowDescriptor: Tuple(id=0 size=29 slots=[Slot(id=2 type=INT col_path=[0] offset=24 null=(offset=28 mask=4) slot_idx=2 field_idx=2), Slot(id=3 type=ARRAY col_path=[1] children_tuple_id=3 offset=0 null=(offset=28 mask=1) slot_idx=0 field_idx=0), Slot(id=5 type=ARRAY col_path=[2] children_tuple_id=4 offset=12 null=(offset=28 mask=2) slot_idx=1 field_idx=1)] tuple_path=[])
> Tuple(id=1 size=5 slots=[Slot(id=0 type=INT col_path=[2] offset=0 null=(offset=4 mask=1) slot_idx=0 field_idx=0)] tuple_path=[])
> *** Check failure stack trace: ***
>     @          0x36fe72c  google::LogMessage::Fail()
>     @          0x36fffdc  google::LogMessage::SendToLog()
>     @          0x36fe08a  google::LogMessage::Flush()
>     @          0x3701c48  google::LogMessageFatal::~LogMessageFatal()
>     @          0x12e47ab  impala::RowDescriptor::GetTupleIdx()
>     @          0x1b378f5  impala::SlotRef::Init()
>     @          0x1b25fea  impala::ScalarExpr::Init()
>     @          0x1b665b2  impala::ScalarFnCall::Init()
>     @          0x1b2c44e  impala::ScalarExpr::Create()
>     @          0x1b2c5df  impala::ScalarExpr::Create()
>     @          0x1b2c6a0  impala::ScalarExpr::Create()
>     @          0x19ad286  impala::PartitionedHashJoinPlanNode::Init()
>     @          0x18b5d8d  impala::PlanNode::CreateTreeHelper()
>     @          0x18b5cd9  impala::PlanNode::CreateTreeHelper()
>     @          0x18b5e48  impala::PlanNode::CreateTree()
>     @          0x12f4ca7  impala::FragmentState::Init()
>     @          0x12f839c  impala::FragmentState::CreateFragmentStateMap()
>     @          0x126cedb  impala::QueryState::StartFInstances()
>     @          0x125c4df  impala::QueryExecMgr::ExecuteQueryHelper()
> {code}
>  
>  
> Some notes about the repro:
>  - The inside of the select (without filtering on the unnested value) is OK.
>  - If I unnest only one array then this is OK.
>  - If I remove the IN clause from the view’s DDL then the query runs well.
>  
> {*}Update{*}:
> I managed to do a repro without creating an actual view. This might reduce the complexity with the tuple/slot IDs for the investigation.
> {code:java}
> select id, unnested_arr1, unnested_arr2 from (
> select id, unnest(arr1) as unnested_arr1, unnest(arr2) as unnested_arr2
>   from functional_parquet.complextypes_arrays
>   where id in (select id from functional_parquet.alltypestiny)) a
> where a.unnested_arr1 < 5 {code}



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org