[GitHub] [spark] wang-zhun opened a new pull request #27692: [SPARK-30945][CORE] Preserve JVM information when executor heartbeat …

[GitBox <gi...@apache.org>]

wang-zhun opened a new pull request #27692: [SPARK-30945][CORE] Preserve JVM information when executor heartbeat …
URL: https://github.com/apache/spark/pull/27692
 
 
   ### What changes were proposed in this pull request?
   I added GC detection to generate heap when appropriate
   
   ### Why are the changes needed?
   In practice, it was found that executor has a gc loop state, which will cause gc to spend a lot of time. Usually, this situation does not cause OOM, but causes the connection driver to timeout.
   
   ### Does this PR introduce any user-facing change?
   Users can start the detection process via "spark.jvmQuake.enabled=true"
   
   ### How was this patch tested?
   Unit test
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org