You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Genmao Yu (JIRA)" <ji...@apache.org> on 2017/01/20 08:21:26 UTC

[jira] [Issue Comment Deleted] (SPARK-18116) spark streaming ui show 0 events when recovering from checkpoint

     [ https://issues.apache.org/jira/browse/SPARK-18116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Genmao Yu updated SPARK-18116:
------------------------------
    Comment: was deleted

(was: working on this.)

> spark streaming ui show 0 events when recovering from checkpoint
> ----------------------------------------------------------------
>
>                 Key: SPARK-18116
>                 URL: https://issues.apache.org/jira/browse/SPARK-18116
>             Project: Spark
>          Issue Type: Bug
>          Components: DStreams
>    Affects Versions: 1.6.1
>         Environment: jdk1.8.0_77  Red Hat 4.4.7-11
>            Reporter: liujianhui
>            Priority: Minor
>             Fix For: 2.0.3, 2.1.1
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> run a streaming application which souce from kafka.There are many batchs queued in the job list before application stopped, and then stop the application, as follow starting it from checkpointed file, in the spark ui, the size of the queued batchs which stored in the checkpoint file are 0
> Batch Time	Input Size	Scheduling Delay (?) 	Processing Time (?) 	Total Delay (?) 	Output Ops: Succeeded/Total
> 2016/10/26 19:02:15 	0 events	1.1 h 	13 s 	1.1 h 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org