[jira] [Commented] (IMPALA-11443) Possible overflow in SortNode.java

["Csaba Ringhofer (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-11443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17568128#comment-17568128 ] 

Csaba Ringhofer commented on IMPALA-11443:
------------------------------------------

Found a way to reproduce the error above in dev environment:
{code}
set DISABLE_HDFS_NUM_ROWS_ESTIMATE=1;
explain select tinyint_col, id, rn from (
  select *, row_number() over (partition by tinyint_col order by id) as rn
  from functional.alltypessmall) v
where rn <= 5
order by tinyint_col, rn
{code}

This needs the partitioned top-n with an input cardinality of -1. The example above got the -1 from a scan node, but probably other nodes can also return unknown cardinality.

> Possible overflow in SortNode.java
> ----------------------------------
>
>                 Key: IMPALA-11443
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11443
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Frontend
>            Reporter: Daniel Becker
>            Priority: Major
>
> At line
> https://github.com/apache/impala/blob/d029ae53676c8637bc4f56b80b331920c8289108/fe/src/main/java/org/apache/impala/planner/SortNode.java#L514
> the following precondition check was triggered in ResourceProfileBuilder:
> {code:java}
> Preconditions.checkState(memEstimateBytes_ >= 0, "Mem estimate must be set");
> {code}
> See https://github.com/apache/impala/blob/d029ae53676c8637bc4f56b80b331920c8289108/fe/src/main/java/org/apache/impala/planner/ResourceProfileBuilder.java#L79
> This may be due to corrupt statistics but further investigation is necessary.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org