You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Denys Kuzmenko (Jira)" <ji...@apache.org> on 2021/09/06 12:12:00 UTC
[jira] [Updated] (HIVE-25502) Cleaner causes data loss when
processing aborted txn with DP
[ https://issues.apache.org/jira/browse/HIVE-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Denys Kuzmenko updated HIVE-25502:
----------------------------------
Description:
Steps to reproduce:
1) insert into cws partition (a) values (1, '1');
update csw set b='2' where a=1;
2) open HiveStreamingConnection with batch size set to 1, begin txn, write something and abort the txn
3) insert into cws partition (a) values (2, '2');
update csw set b='3' where a=2;
4) manually trigger the compaction and verify that data for part a=1 is gone
> Cleaner causes data loss when processing aborted txn with DP
> -------------------------------------------------------------
>
> Key: HIVE-25502
> URL: https://issues.apache.org/jira/browse/HIVE-25502
> Project: Hive
> Issue Type: Task
> Reporter: Denys Kuzmenko
> Priority: Major
>
> Steps to reproduce:
> 1) insert into cws partition (a) values (1, '1');
> update csw set b='2' where a=1;
> 2) open HiveStreamingConnection with batch size set to 1, begin txn, write something and abort the txn
> 3) insert into cws partition (a) values (2, '2');
> update csw set b='3' where a=2;
> 4) manually trigger the compaction and verify that data for part a=1 is gone
--
This message was sent by Atlassian Jira
(v8.3.4#803005)