You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by Christopher Horn <ch...@gmail.com> on 2018/07/05 17:50:49 UTC

[SS] Trigger.Once not working with watermarked event time

Does anyone who worked on SS or is familiar with it have an opinion on
this?:

https://issues.apache.org/jira/browse/SPARK-24699

https://github.com/apache/spark/pull/21676

I don't like the idea of making Trigger.Once execute two batches, but it is
the simplest way to get the desired batch state cleanup and output.