You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Oleh Lukyrych <lu...@gmail.com> on 2018/06/03 18:41:11 UTC

Buffer congestion in a downstream operator hangs SourceContext.collect in an (in?)finite loop

 Hello,

I have a scenario, where FlinkKafkaProducer instance isn't able to write to
a certain partition (the broker for the partition is down, or whatever),
it's buffer eventually becomes full, and the whole topology freezes,
because the root source (nonparallel) get's blocked on it, however it could
still serve other branches/partitions.

Please see https://stackoverflow.com/questions/50667499/how-to-keep
-broadcasting-from-non-parallel-source-when-one-of-the-downstreams-ha for
more details.

What can be wrong, could you suggest anything?

Respectfully,
Oleh.