[jira] [Created] (ATLAS-629) Kafka messages in ATLAS_HOOK might be lost in HA mode at the instant of failover.

["Hemanth Yamijala (JIRA)" <ji...@apache.org>]

Hemanth Yamijala created ATLAS-629:
--------------------------------------

             Summary: Kafka messages in ATLAS_HOOK might be lost in HA mode at the instant of failover.
                 Key: ATLAS-629
                 URL: https://issues.apache.org/jira/browse/ATLAS-629
             Project: Atlas
          Issue Type: Bug
            Reporter: Hemanth Yamijala
            Priority: Critical
             Fix For: 0.7-incubating


Write data to Kafka continuously from Hive hook - can do this by writing a script that constantly creates tables. Bring down the Active instance with kill -9. Ensure writes continue after passive becomes active. The expectation is the number of tables created and the number of tables in Atlas match.

In one test, wrote 180 tables and switched over 6 times from one instance to another. Found that 1 table was lost of the lot. i.e. 179 tables were created, and 1 did not get in.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)