You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Zoltán Borók-Nagy (JIRA)" <ji...@apache.org> on 2018/05/02 09:25:00 UTC

[jira] [Resolved] (IMPALA-6934) Wrong results with EXISTS subquery containing ORDER BY, LIMIT, and OFFSET

     [ https://issues.apache.org/jira/browse/IMPALA-6934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zoltán Borók-Nagy resolved IMPALA-6934.
---------------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 2.13.0
                   Impala 3.0

> Wrong results with EXISTS subquery containing ORDER BY, LIMIT, and OFFSET
> -------------------------------------------------------------------------
>
>                 Key: IMPALA-6934
>                 URL: https://issues.apache.org/jira/browse/IMPALA-6934
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Frontend
>    Affects Versions: Impala 2.5.0, Impala 2.6.0, Impala 2.7.0, Impala 2.8.0, Impala 2.9.0, Impala 2.10.0, Impala 2.11.0, Impala 2.12.0
>            Reporter: Alexander Behm
>            Assignee: Zoltán Borók-Nagy
>            Priority: Blocker
>              Labels: correctness, planner
>             Fix For: Impala 3.0, Impala 2.13.0
>
>
> Queries may return wrong results if an EXISTS subquery has an ORDER BY with a LIMIT and OFFSET clause. The EXISTS subquery may incorrectly evaluate to TRUE even though it s FALSE.
> Reproduction:
> {code}
> select count(*) from functional.alltypestiny t where
> exists (select id from functional.alltypestiny where id < 5 order by id limit 10 offset 6);
> {code}
> The query should return "0" but it incorrectly returns "8" because an incorrect plan without the offset is generated. See plan:
> {code}
> +-------------------------------------------------+
> | Explain String                                  |
> +-------------------------------------------------+
> | Max Per-Host Resource Reservation: Memory=0B    |
> | Per-Host Resource Estimates: Memory=84.00MB     |
> | Codegen disabled by planner                     |
> |                                                 |
> | PLAN-ROOT SINK                                  |
> | |                                               |
> | 08:AGGREGATE [FINALIZE]                         |
> | |  output: count:merge(*)                       |
> | |                                               |
> | 07:EXCHANGE [UNPARTITIONED]                     |
> | |                                               |
> | 04:AGGREGATE                                    |
> | |  output: count(*)                             |
> | |                                               |
> | 03:NESTED LOOP JOIN [LEFT SEMI JOIN, BROADCAST] |
> | |                                               |
> | |--06:EXCHANGE [BROADCAST]                      |
> | |  |                                            |
> | |  05:MERGING-EXCHANGE [UNPARTITIONED]          |
> | |  |  order by: id ASC                          |
> | |  |  limit: 1                                  |
> | |  |                                            |
> | |  02:TOP-N [LIMIT=1]                           |
> | |  |  order by: id ASC                          |
> | |  |                                            |
> | |  01:SCAN HDFS [functional.alltypestiny]       |
> | |     partitions=4/4 files=4 size=460B          |
> | |     predicates: id < 5                        |
> | |                                               |
> | 00:SCAN HDFS [functional.alltypestiny t]        |
> |    partitions=4/4 files=4 size=460B             |
> +-------------------------------------------------+
> {code}
> Evaluating the subquery by itself gives the expected results:
> {code}
> select id from functional.alltypestiny where id < 5 order by id limit 10 offset 6;
> <empty result set>
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)