You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Zhiwen Sun (JIRA)" <ji...@apache.org> on 2017/05/10 10:43:04 UTC

[jira] [Created] (SPARK-20692) unknowing delay in event timeline

Zhiwen Sun created SPARK-20692:
----------------------------------

             Summary: unknowing delay in event timeline
                 Key: SPARK-20692
                 URL: https://issues.apache.org/jira/browse/SPARK-20692
             Project: Spark
          Issue Type: Bug
          Components: DStreams
    Affects Versions: 1.6.2
         Environment: Spark 1.6.1 + kafka 0.8.2
            Reporter: Zhiwen Sun


Spark streaming job with 1s interval.

Process time of micro batch suddenly became to 4s while is is usually 0.4s .

when we check where time spent, we find a unknown delay in job. there is no executor computing or shuffle reading. About 4s blank in event timeline, 




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org