You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/05/15 02:32:29 UTC
[GitHub] [spark] oikomi opened a new pull request #28535: add jvm opt -Xms to reduce FGC
oikomi opened a new pull request #28535:
URL: https://github.com/apache/spark/pull/28535
hi
we found CoarseGrainedExecutorBackend process not used -Xms jvm opt, and this will lead to FGC frequently.
we suggest to add jvm opt -Xms to reduce FGC .
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #28535: add jvm opt -Xms to reduce FGC
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #28535:
URL: https://github.com/apache/spark/pull/28535#issuecomment-628990862
Can one of the admins verify this patch?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #28535: add jvm opt -Xms to reduce FGC
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #28535:
URL: https://github.com/apache/spark/pull/28535#issuecomment-628990862
Can one of the admins verify this patch?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #28535: add jvm opt -Xms to reduce FGC
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on pull request #28535:
URL: https://github.com/apache/spark/pull/28535#issuecomment-629014875
@oikomi, please keep the PR description and file a JIRA. Also, I think you can specify Xms via `spark.driver.extraJavaOptions` and `spark.executor.extraJavaOptions` already. Let's don't assume all users want to set the minimum memory.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon closed pull request #28535: add jvm opt -Xms to reduce FGC
Posted by GitBox <gi...@apache.org>.
HyukjinKwon closed pull request #28535:
URL: https://github.com/apache/spark/pull/28535
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] srowen commented on pull request #28535: add jvm opt -Xms to reduce FGC
Posted by GitBox <gi...@apache.org>.
srowen commented on pull request #28535:
URL: https://github.com/apache/spark/pull/28535#issuecomment-629230896
I don't think we want to set the min heap size to the max; the executor may never need that much heap. The GCs are a good thing in this case.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #28535: add jvm opt -Xms to reduce FGC
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #28535:
URL: https://github.com/apache/spark/pull/28535#issuecomment-628992894
Can one of the admins verify this patch?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org