You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Jordan Pilat <jr...@gmail.com> on 2018/03/12 21:22:25 UTC

Spark UI Streaming batch time interval does not match batch interval

Hello,

I am running a streaming app on Spark 2.1.2.  The batch interval is set to 5000ms, and when I go to the "Streaming" tab in the Spark UI, it correctly reports a 5 second batch interval, but the list of batches below only shows one batch every two minutes (IE the batch time for each batch is two minutes after the prior batch).

Keep in mind, I am not referring to delay or processing time -- only when each batch starts.  What could account for this discrepancy?

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org