You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user-zh@flink.apache.org by XW Marvin <ma...@gmail.com> on 2020/04/26 12:42:31 UTC

flink reduce becoming increasingly over time

Hi All

This My Coding:

statDataStream
  .map(new InnerStatMap(logType))
    .uid("InnerStatMap").name("InnerStatMap")
  .keyBy(new InnerKeySelector)
  .timeWindow(Time.seconds(statTimeWindow))
  .reduce(new InnerStatReduce)
    .uid("InnerReduce").name("InnerReduce")
  .addSink(innerStatProducer)
    .uid("InnerSink").name("InnerSink")
  .setParallelism(sinkParallelism)


I find checkpoint state is becoming increasingly over time

best wishes