You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/05/05 13:52:18 UTC

[GitHub] [spark] IgorBerman commented on issue #10921: [SPARK-12265][Mesos] Spark calls System.exit inside driver instead of throwing exception

IgorBerman commented on issue #10921: [SPARK-12265][Mesos] Spark calls System.exit inside driver instead of throwing exception
URL: https://github.com/apache/spark/pull/10921#issuecomment-489428542
 
 
   @dragos @andrewor14 @srowen I believe I have some corner case connected to this fix:
   Suppose I have spark driver embedded in java service and mesosDriver.run() exits for any reason(in my case due to temporary un-availability of external shuffle service on one of the worker nodes)
   
   currently there is no way to get this information besides checking if "-mesos-driver" exists somehow. I.e. the initialisation sequence went smoothly but due to dynamic allocation quirks mesos-driver exits(so countDown latch will be released already at this point)
   
   I'm wondering if I can get this signal with some spark listener?
   Should I create additional jira for this? 
   
   WDYT? 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org