[jira] [Updated] (RYA-418) Rya Streams: Use Kafka Connect to push statements from Mongo DB to a Kafka Topic.

["Kevin Chilton (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/RYA-418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kevin Chilton updated RYA-418:
------------------------------
    Description: 
The Rya Streams system reads VisibilityStatements from a Kafka topic as input to the Kafka Streams application. We want to ensure the Kafka Streams applications will process all Statements that have been added to an instance of Rya, so we need a way to detect changes to the Statements collection and forward them along to the Rya Streams input topic.

That's what Kafka Connect does. We may be able to use one of the open source Mongo DB source connectors to do this.

> Rya Streams: Use Kafka Connect to push statements from Mongo DB to a Kafka Topic.
> ---------------------------------------------------------------------------------
>
>                 Key: RYA-418
>                 URL: https://issues.apache.org/jira/browse/RYA-418
>             Project: Rya
>          Issue Type: Task
>            Reporter: Kevin Chilton
>            Assignee: Kevin Chilton
>
> The Rya Streams system reads VisibilityStatements from a Kafka topic as input to the Kafka Streams application. We want to ensure the Kafka Streams applications will process all Statements that have been added to an instance of Rya, so we need a way to detect changes to the Statements collection and forward them along to the Rya Streams input topic.
> That's what Kafka Connect does. We may be able to use one of the open source Mongo DB source connectors to do this.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)