You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by subramgr <su...@gmail.com> on 2018/07/10 02:34:35 UTC

[Structured Streaming] Last processed event time always behind Direct Streaming

Hi

We are migrating our Direct Streaming Spark job to Structured Streaming. We
have a batch size of 1 minute.

I am consistently seeing that the Structured Streaming job is always (3-5
minutes) behind the Direct Streaming job. Is there some kinda fine tuning
that will help Structured Streaming catch up ?



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org