You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Tathagata Das (JIRA)" <ji...@apache.org> on 2015/04/03 23:25:53 UTC

[jira] [Created] (SPARK-6702) Update the Streaming Tab in Spark UI to show more batch information

Tathagata Das created SPARK-6702:
------------------------------------

             Summary: Update the Streaming Tab in Spark UI to show more batch information
                 Key: SPARK-6702
                 URL: https://issues.apache.org/jira/browse/SPARK-6702
             Project: Spark
          Issue Type: Improvement
          Components: Streaming, Web UI
    Affects Versions: 1.3.1
            Reporter: Tathagata Das
            Assignee: Tathagata Das


Since the Streaming Tab was added to the Spark UI in Spark 1.0, its has proven to be a defacto way to debug Spark Streaming applications at the time of development. However, there is much more we can do to help developers debug their streaming applications. Specifically we would like to show the details of individual batches and link them to the jobs that ran for that batch (similar to job details showing stages in the job). Furthermore we would also like show timelines to see trends over time for processing times data rates etc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org