You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/05/20 08:11:25 UTC

[GitHub] [spark] zuotingbing commented on issue #20056: [SPARK-22878] [CORE] Count totalDroppedEvents for LiveListenerBus

zuotingbing commented on issue #20056: [SPARK-22878] [CORE] Count totalDroppedEvents for LiveListenerBus
URL: https://github.com/apache/spark/pull/20056#issuecomment-493883117
 
 
   i faced an issue about LiveListenerBus. 
   We start HiveThirftServer and execute some sql with beeline. we found some job hung for the reasone "Dropping SparkListenerEvent ...". 
   So we increase the spark.scheduler.listenerbus.eventqueue.size form 10000 to 1000000. After that, the job was not hung but we found the job still in processing very slowly which displayed in WebUI even though all tasks has finished. Thanks!
   @Ngone51 @cloud-fan 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org