You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Venki Korukanti (Jira)" <ji...@apache.org> on 2021/06/24 15:22:00 UTC

[jira] [Created] (SPARK-35880) [SS] Track the number of duplicates dropped in streaming dedupe operator

Venki Korukanti created SPARK-35880:
---------------------------------------

             Summary: [SS] Track the number of duplicates dropped in streaming dedupe operator
                 Key: SPARK-35880
                 URL: https://issues.apache.org/jira/browse/SPARK-35880
             Project: Spark
          Issue Type: Improvement
          Components: Structured Streaming
    Affects Versions: 3.1.2
            Reporter: Venki Korukanti


Currently there is no way to find how many duplicates in the input are dropped. Having this metric will help track down incorrect results issues.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org