You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Wallace Baggaley (JIRA)" <ji...@apache.org> on 2017/11/13 22:31:00 UTC

[jira] [Updated] (SPARK-22509) Spark Streaming: jobs with same batch length all start at the same time, permit jobs to be offset

     [ https://issues.apache.org/jira/browse/SPARK-22509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wallace Baggaley updated SPARK-22509:
-------------------------------------
    Summary: Spark Streaming: jobs with same batch length all start at the same time, permit jobs to be offset  (was: Spark Streaming: jobs with 5 minute batch length all start at the same time, permit jobs to be offset)

> Spark Streaming: jobs with same batch length all start at the same time, permit jobs to be offset
> -------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-22509
>                 URL: https://issues.apache.org/jira/browse/SPARK-22509
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 2.2.0
>            Reporter: Wallace Baggaley
>            Priority: Minor
>
> Using Spark Streaming, a batch will run precisely on the zeroes and fives. Would be beneficial for performance to permit running spark jobs on offset minutes (1s and 6s or 2s and 7s), if configured so to do.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org