[jira] [Updated] (ATLAS-515) Ability to initialize Kafka topics with more than 1 replica

["Hemanth Yamijala (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ATLAS-515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hemanth Yamijala updated ATLAS-515:
-----------------------------------
    Attachment: ATLAS-515-poc.patch

This patch is attached as proof of concept (not for review / commit). I am using the class called AdminUtils which appears to be the existing interface to do operations like add topics etc.

I tested this with HiveServer2 and the topic was setup fine with 2 replicas as provided in the code.

> Ability to initialize Kafka topics with more than 1 replica
> -----------------------------------------------------------
>
>                 Key: ATLAS-515
>                 URL: https://issues.apache.org/jira/browse/ATLAS-515
>             Project: Atlas
>          Issue Type: Sub-task
>            Reporter: Hemanth Yamijala
>            Assignee: Hemanth Yamijala
>             Fix For: 0.7-incubating
>
>         Attachments: ATLAS-515-poc.patch
>
>
> Atlas uses two Kafka topics - ATLAS_HOOK and ATLAS_ENTITIES for communicating with its upstream and downstream dependencies. If not explicitly created, these topics are setup with a single replica. From a HA perspective, this becomes a problem. This JIRA is to request for a mechanism for creating topics with more than 1 replica. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)