You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/11/26 07:33:00 UTC

[jira] [Created] (SPARK-26170) Add missing metrics in FlatMapGroupsWithState

Jungtaek Lim created SPARK-26170:
------------------------------------

             Summary: Add missing metrics in FlatMapGroupsWithState
                 Key: SPARK-26170
                 URL: https://issues.apache.org/jira/browse/SPARK-26170
             Project: Spark
          Issue Type: Improvement
          Components: Structured Streaming
    Affects Versions: 3.0.0
            Reporter: Jungtaek Lim


Credit to [~jlaskowski]: I can't change reporter so please try to change it if you would like to registered as reporter of this issue.

Unlike other operators like StateStoreSaveExec, StreamingDeduplicateExec, and StreamingGlobalLimitExec, FlatMapGroupsWithStateExec doesn't measure available metrics in StateStoreWriter, so only part of metrics are measured in setStoreMetrics.

This issue is to track the effort to measure all possible metrics from FlatMapGroupsWithStateExec. Some metrics will be kept unavailable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org