You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Marcelo Masiero Vanzin (Jira)" <ji...@apache.org> on 2019/11/06 00:14:00 UTC

[jira] [Created] (SPARK-29766) Aggregate metrics asynchronously in SQL listener

Marcelo Masiero Vanzin created SPARK-29766:
----------------------------------------------

             Summary: Aggregate metrics asynchronously in SQL listener
                 Key: SPARK-29766
                 URL: https://issues.apache.org/jira/browse/SPARK-29766
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.4.4
            Reporter: Marcelo Masiero Vanzin


This is a follow up to SPARK-29562.

That change made metrics collection faster, and also sped up metrics aggregation. But it is still too slow to execute in an event handler, so we should do it asynchronously to minimize events being dropped by the listener bus.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org