You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/10/27 05:54:12 UTC
[GitHub] [spark] otterc edited a comment on pull request #30139: [SPARK-31069][CORE] high cpu caused by chunksBeingTransferred in external shuffle service
otterc edited a comment on pull request #30139:
URL: https://github.com/apache/spark/pull/30139#issuecomment-717001727
> IMO, we can add a lock to keep strong consistence of value `totalChunksBeingTransferred`, such as
> 
>
> And I have run the test in desc, this change has little effect on performance. WDYT?
This should have a considerable impact on the performance when there are multiple open streams because updates of different streams would lock on a single object `totalChunksBeingTransferred`?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org