[jira] [Resolved] (UNOMI-66) Integrate Apache Kafka

["Serge Huber (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/UNOMI-66?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Serge Huber resolved UNOMI-66.
------------------------------
    Resolution: Fixed

> Integrate Apache Kafka
> ----------------------
>
>                 Key: UNOMI-66
>                 URL: https://issues.apache.org/jira/browse/UNOMI-66
>             Project: Apache Unomi
>          Issue Type: Improvement
>          Components: core
>            Reporter: Serge Huber
>            Assignee: Jean-Baptiste Onofré
>            Priority: Major
>             Fix For: 1.5.0
>
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> It would be really great to integrate Apache Kafka into Apache Unomi so that we can push event data and other "heavy" operations into its messaging systems and therefore make it easier to decouple some large scale operations that might require a lot of processing power such as large segment updates, etc...
> An interesting idea would be to put Kafka in "front" of Unomi to absorb the traffic and then clients could use something like the [Kafka REST Proxy |https://docs.confluent.io/1.0/kafka-rest/docs/intro.html] to insert events into Unomi.
> This would also make it a lot easier to integrate with BigData systems such as Apache Spark, Hadoop or others.
> We might want at the same time to see if we can define a mechanism to get the status of long-running operations.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)