[GitHub] [spark] hgs19921112 commented on pull request #42572: [SPARK-44881[COMMON]Executor stucked on retrying to fetch shuffle data when `java.lang.OutOfMemoryError. unable to create native thread` exception occurred.

["hgs19921112 (via GitHub)" <gi...@apache.org>]

hgs19921112 commented on PR #42572:
URL: https://github.com/apache/spark/pull/42572#issuecomment-1685202521

   > Why would this help ? Please add more details to the description.
   > 
   > If this is still work in progress, please mark it as draft.
   The reason why executor stucked is because in `RetryingBlockTransferor#initiateRetry`
   failed to create native thread. But the member `currentListener` in RetryingBlockTransferor
   has changed before the retry submit. But the Exception occurred in the old `currentListener`.
   But int `RetryingBlockTransferor.RetryingBlockTransferListener#handleBlockTransferFailure` will
   judge `this == currentListener` , but `this` is the old one , so `this` not equals `currentListener`.
   Then it happed.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org