You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Arun Mahadevan (JIRA)" <ji...@apache.org> on 2018/07/06 01:51:00 UTC

[jira] [Created] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress

Arun Mahadevan created SPARK-24748:
--------------------------------------

             Summary: Support for reporting custom metrics via Streaming Query Progress
                 Key: SPARK-24748
                 URL: https://issues.apache.org/jira/browse/SPARK-24748
             Project: Spark
          Issue Type: Improvement
          Components: Structured Streaming
    Affects Versions: 2.3.1
            Reporter: Arun Mahadevan


Currently the Structured Streaming sources and sinks does not have a way to report custom metrics. Providing an option to report custom metrics and making it available via Streaming Query progress can enable sources and sinks to report custom progress information (E.g. the lag metrics for Kafka source).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org