You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by Kevin Jacobs <ke...@cern.ch> on 2016/07/28 15:00:25 UTC
Use case
Hi all,
I am trying to keep track of the biggest value in a stream. I do this by
using the iterative step mechanism of Apache Flink. However, I get an
exception that checkpointing is not supported for iterative jobs. Why
can't this be enabled? My iterative stream is also quite small: only one
value. Is there a better way to keep track of a largest value in a stream?
Regards,
Kevin
Re: Use case
Posted by Timo Walther <tw...@apache.org>.
Hi Kevin,
I don't know what your entire program is doing but wouldn't be a
FlatMapFunction containing a state with your biggest value sufficient?
Your stream goes through your FlatMapper and compares with the last
saved biggest value. You can then emit something if the value has increased.
I hope that helps.
Timo
Am 28/07/16 um 17:00 schrieb Kevin Jacobs:
> Hi all,
>
> I am trying to keep track of the biggest value in a stream. I do this
> by using the iterative step mechanism of Apache Flink. However, I get
> an exception that checkpointing is not supported for iterative jobs.
> Why can't this be enabled? My iterative stream is also quite small:
> only one value. Is there a better way to keep track of a largest value
> in a stream?
>
> Regards,
> Kevin
--
Freundliche Gr��e / Kind Regards
Timo Walther
Follow me: @twalthr
https://www.linkedin.com/in/twalthr