You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2017/07/28 13:22:00 UTC

[jira] [Created] (SPARK-21560) Add hold mode for the LiveListenerBus

Li Yuanjian created SPARK-21560:
-----------------------------------

             Summary: Add hold mode for the LiveListenerBus
                 Key: SPARK-21560
                 URL: https://issues.apache.org/jira/browse/SPARK-21560
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 2.2.0, 2.1.0
            Reporter: Li Yuanjian


As the comments in SPARK-18838, we also face the same problem about critical events dropped while the event queue is full. 
There's no doubt that improving the performance of the processing thread is important, whether the solution is multithreading or any others like SPARK-20776, but maybe we still need the hold strategy when the event queue is full, and restart after some room released. The hold strategy open or not and the empty rate should both configurable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org