[jira] [Resolved] (SPARK-29766) Aggregate metrics asynchronously in SQL listener

["Dongjoon Hyun (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-29766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dongjoon Hyun resolved SPARK-29766.
-----------------------------------
    Fix Version/s: 3.0.0
       Resolution: Fixed

Issue resolved by pull request 26405
[https://github.com/apache/spark/pull/26405]

> Aggregate metrics asynchronously in SQL listener
> ------------------------------------------------
>
>                 Key: SPARK-29766
>                 URL: https://issues.apache.org/jira/browse/SPARK-29766
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.4.4
>            Reporter: Marcelo Masiero Vanzin
>            Assignee: Marcelo Masiero Vanzin
>            Priority: Major
>             Fix For: 3.0.0
>
>
> This is a follow up to SPARK-29562.
> That change made metrics collection faster, and also sped up metrics aggregation. But it is still too slow to execute in an event handler, so we should do it asynchronously to minimize events being dropped by the listener bus.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org