[jira] [Created] (HIVE-20852) Compaction Initiator ignores datas inserted by Stream Data Ingest

["Kei Miyauchi (JIRA)" <ji...@apache.org>]

Kei Miyauchi created HIVE-20852:
-----------------------------------

             Summary: Compaction Initiator ignores datas inserted by Stream Data Ingest
                 Key: HIVE-20852
                 URL: https://issues.apache.org/jira/browse/HIVE-20852
             Project: Hive
          Issue Type: Bug
          Components: API
    Affects Versions: 3.1.0
            Reporter: Kei Miyauchi


HI,

Before compaction, Initiator decides whether a table/partition is potentialCompaction by querying COMPLETE_TXN_COMPONENT.
But I found the transactions which committed by Stream Data Ingest is not stored on COMPLETE_TXN_COMPONENT. This is because the statement "insert into COMPLETED_TXN_COMPONENTS (ctc_txnid, ctc_database, ctc_table, ctc_partition, ctc_writeid, ctc_update_delete) select tc_txnid, tc_database, tc_table, tc_partition, tc_writeid, 'N' from TXN_COMPONENTS where tc_txnid = (id)"  fails.
I found INSERT statement to TXN_COMPONENTS isn't fired. select subquery above returns 0 row.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)