Re: [PR] [SPARK-44881[COMMON]Executor stucked on retrying to fetch shuffle data when `java.lang.OutOfMemoryError. unable to create native thread` exception occurred. [spark]

["fengDianDemaNong (via GitHub)" <gi...@apache.org>]

fengDianDemaNong commented on PR #42572:
URL: https://github.com/apache/spark/pull/42572#issuecomment-1833303013

   [0.025s][warning][os,thread] Failed to start thread "Unknown thread" - pthread_create failed (EAGAIN) for attributes: stacksize: 1024k, guardsize: 0k, detached.
   Error occurred during initialization of VM
   java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached
   /opt/spark/bin/spark-class: line 96: CMD: bad array subscript 
   
   
   I have also encountered this issue several times during Spark on k8s. Is there a solution


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org