You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/05 06:02:00 UTC

[jira] [Updated] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress

     [ https://issues.apache.org/jira/browse/SPARK-24748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shixiong Zhu updated SPARK-24748:
---------------------------------
    Fix Version/s:     (was: 2.4.0)

> Support for reporting custom metrics via Streaming Query Progress
> -----------------------------------------------------------------
>
>                 Key: SPARK-24748
>                 URL: https://issues.apache.org/jira/browse/SPARK-24748
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 2.3.1
>            Reporter: Arun Mahadevan
>            Priority: Major
>
> Currently the Structured Streaming sources and sinks does not have a way to report custom metrics. Providing an option to report custom metrics and making it available via Streaming Query progress can enable sources and sinks to report custom progress information (E.g. the lag metrics for Kafka source).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org