[jira] [Updated] (PHOENIX-5442) Change Data Capture

["Geoffrey Jacoby (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PHOENIX-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Geoffrey Jacoby updated PHOENIX-5442:
-------------------------------------
    Summary: Change Data Capture  (was: Change Detection Capture)

> Change Data Capture
> -------------------
>
>                 Key: PHOENIX-5442
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-5442
>             Project: Phoenix
>          Issue Type: New Feature
>            Reporter: Geoffrey Jacoby
>            Assignee: Geoffrey Jacoby
>            Priority: Major
>
> Create a change detection capture framework for Phoenix to allow for changes to tables to be streamed to a message bus such as Kafka. This is an umbrella JIRA, and will require several subcomponents, such as 
> * Phoenix schema information annotated into HBase WALs
> * The ability to generate Avro (or similar) schemas for Phoenix objects using the above schema information
> * An HBase replication endpoint that tails HBase WALs, formats the data changes as Avro using the schema information, and then persists to a message bus. Parts of the implementation might work better as part of the connectors repo, or some other repo, to avoid importing too many new dependencies into Phoenix proper. 
> Code will depend on interfaces wherever possible so that different technologies can be used for the message format and message bus. 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)