[jira] [Work logged] (HIVE-23712) metadata-only queries return incorrect results with empty acid partition

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-23712?focusedWorklogId=450875&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-450875 ]

ASF GitHub Bot logged work on HIVE-23712:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 25/Jun/20 09:02
            Start Date: 25/Jun/20 09:02
    Worklog Time Spent: 10m 
      Work Description: abstractdog opened a new pull request #1182:
URL: https://github.com/apache/hive/pull/1182


   Change-Id: Ia63c4a502f77f863f1ee20e0a407893689d79afb
   
   ## NOTICE
   
   Please create an issue in ASF JIRA before opening a pull request,
   and you need to set the title of the pull request which starts with
   the corresponding JIRA issue number. (e.g. HIVE-XXXXX: Fix a typo in YYY)
   For more details, please see https://cwiki.apache.org/confluence/display/Hive/HowToContribute
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 450875)
    Remaining Estimate: 0h
            Time Spent: 10m

> metadata-only queries return incorrect results with empty acid partition
> ------------------------------------------------------------------------
>
>                 Key: HIVE-23712
>                 URL: https://issues.apache.org/jira/browse/HIVE-23712
>             Project: Hive
>          Issue Type: Bug
>            Reporter: László Bodor
>            Assignee: László Bodor
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Similarly to HIVE-15397, queries can return incorrect results for metadata-only queries, here is a repro scenario which affects master:
> {code}
> set hive.support.concurrency=true;
> set hive.exec.dynamic.partition.mode=nonstrict;
> set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
> set hive.optimize.metadataonly=true;
> create table test1 (id int, val string) partitioned by (val2 string) STORED AS ORC TBLPROPERTIES ('transactional'='true');
> describe formatted test1;
> alter table test1 add partition (val2='foo');
> alter table test1 add partition (val2='bar');
> insert into test1 partition (val2='foo') values (1, 'abc');
> select distinct val2, current_timestamp from test1;
> insert into test1 partition (val2='bar') values (1, 'def');
> delete from test1 where val2 = 'bar';
> select '--> hive.optimize.metadataonly=true';
> select distinct val2, current_timestamp from test1;
> set hive.optimize.metadataonly=false;
> select '--> hive.optimize.metadataonly=false';
> select distinct val2, current_timestamp from test1;
> select current_timestamp, * from test1;
> {code}
> in this case 2 rows returned instead of 1 after a delete with metadata only optimization:
> https://github.com/abstractdog/hive/commit/a7f03513564d01f7c3ba4aa61c4c6537100b4d3f#diff-cb23043000831f41fe7041cb38f82224R114-R128



--
This message was sent by Atlassian Jira
(v8.3.4#803005)