[jira] [Commented] (SPARK-21560) Add hold mode for the LiveListenerBus

["Hyukjin Kwon (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-21560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16111566#comment-16111566 ] 

Hyukjin Kwon commented on SPARK-21560:
--------------------------------------

User 'xuanyuanking' has created a pull request for this issue:
https://github.com/apache/spark/pull/18760

> Add hold mode for the LiveListenerBus
> -------------------------------------
>
>                 Key: SPARK-21560
>                 URL: https://issues.apache.org/jira/browse/SPARK-21560
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 2.1.0, 2.2.0
>            Reporter: Li Yuanjian
>
> As the comments in SPARK-18838, we also face the same problem about critical events dropped while the event queue is full. 
> There's no doubt that improving the performance of the processing thread is important, whether the solution is multithreading or any others like SPARK-20776, but maybe we still need the hold strategy when the event queue is full, and restart after some room released. The hold strategy open or not and the empty rate should both configurable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org