You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2022/02/14 13:07:18 UTC
[GitHub] [spark] Kimahriman commented on pull request #35504: [SPARK-38194][YARN] Make yarn memory overhead factor configurable
Kimahriman commented on pull request #35504:
URL: https://github.com/apache/spark/pull/35504#issuecomment-1039064063
> Memory overhead is not specific to yarn, but applies to all resource managers. Also, split it by driver and executor as well, to independently control them.
>
> See all usages of `EXECUTOR_MEMORY_OVERHEAD` and `DRIVER_MEMORY_OVERHEAD`
So are you saying to just use this opportunity to unify all the difference resource managers with this config? Currently they all have their slight own ways of dealing with it but I can try to
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org