You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Himanshu Sareen <hi...@outlook.com> on 2022/09/23 07:48:42 UTC

Query/Issues - Statefun - Flink

Team,


I'm looking for an flink documentation which addresses/documents the comparison of Remote functions/Embedded/Data Stream.

I'm presently exploring Flink Remote State-fun functions and looking for a clarity on the following:


  1.  send_egress - Is there a way to get a callback registered to get ack/fail if message is published to Kafka or not ?
  2.  Does State-fun supports exactly-once for Kafka Egress ? ( I got duplicate records with this [cid:ee0fb95f-b723-437c-b2f9-10f69f860d23] )
  3.  If Kafka (egress) is down/un-reachable then how is this handled by Flink ? ( retries or messages are dropped ? )
  4.  When backpressure occurs Flink restarts as checkpoints start to fail. I tried unalligned checkpoint but got this : Invalid configuration: execution.checkpointing.unaligned; StateFun currently does not support unaligned checkpointing
  5.
  6.
  7.  Also does Datastream API or Embedded will also have similar issues ?

Regards,
Himanshu