You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by sanjay_awat <sa...@yahoo.com> on 2018/10/24 17:55:53 UTC

Re: Watermarking without aggregation with Structured Streaming

Try this


peay-2 wrote
> For my purposes, an alternative solution to pushing it out to the source
> would be to make the watermark timestamp available through a function so
> that it can be used in a regular filter clause. Based on my experiments,
> the timestamp is computed and updated even when no stateful computations
> occur. I am not sure how easy that would be to contribute though, maybe
> someone can suggest a starting point?





--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org