You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Chenxuan Rong (JIRA)" <ji...@apache.org> on 2019/05/06 06:35:00 UTC

[jira] [Commented] (KAFKA-7971) Producer in Streams environment

    [ https://issues.apache.org/jira/browse/KAFKA-7971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833546#comment-16833546 ] 

Chenxuan Rong commented on KAFKA-7971:
--------------------------------------

Hi [~redguy666] could you add me as "contributors" role in Kafka's JIRA instance. I am new and getting started :) Thanks

> Producer in Streams environment
> -------------------------------
>
>                 Key: KAFKA-7971
>                 URL: https://issues.apache.org/jira/browse/KAFKA-7971
>             Project: Kafka
>          Issue Type: Improvement
>          Components: streams
>            Reporter: Maciej Lizewski
>            Priority: Minor
>              Labels: newbie
>
> Would be nice to have Producers that can emit messages to topic just like any producer but also have access to local stores from streams environment in Spring.
> consider case: I have event sourced ordering process like this:
> [EVENTS QUEUE] -> [MERGING PROCESS] -> [ORDERS CHANGELOG/KTABLE]
> Merging process uses local storage "opened orders" to easily apply new changes.
> Now I want to implement process of closing abandoned orders (orders that were started, but for too long there was no change and they hang in beginning status). Easiest way is to periodically scan "opened orders" store and produce "abandon event" for every order that meets criteria. The obnly way now i to create Transformer with punctuator and connect output to [EVENTS QUEUE]. That is obvious. but Transformer must be also connected to some input stream, but these events must be dropped as we want only the punctuator results. This causes unnecessary overhead in processing input messages (although they are just dropped) and it is not very elegant.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)