You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by ? ? <fu...@live.com> on 2018/03/08 02:58:32 UTC

kafka streams guarantee Extract once?

Hi:
I used kafka streams for days.
and I use it for data real-time analysis.
that is my flow
A (source topic)----------> B (internal topic) ----------> C(sink-topic)
and there ara two process program here.
1).consumed A topic to downstream B topic
2).consumed B topic to downstream C topic
but  in one of that condition.there are also due to consumer commit offset or producer retries or session time out
the downstream topic message logsize is larger than upstream Topic
how  to avoid this ?
https://www.confluent.io/blog/enabling-exactly-kafka-streams/
I miss understand with this blog
________________________________
funkyyj@live.com