[GitHub] [spark] tgravescs commented on pull request #31437: [SPARK-34329][YARN] When hit ApplicationAttemptNotFoundException, we can't just stop app for all case

[GitBox <gi...@apache.org>]

tgravescs commented on pull request #31437:
URL: https://github.com/apache/spark/pull/31437#issuecomment-788039596


   Sorry was out of office for a bit. did you look at the test failure?
   
   >> The only thing better would be if yarn told us this was a preempt case, did you look at that at all? its been a while since I looked into the yarn code.
   > From the error stack, it only tell us the attempt can't be found. I got root cause in yarn's log. Since we can't change yarn's code in spark side, what we can do here is just retry. I am looking into yarn's code these days.
   
   did you have a chance to look at the yarn code here?  I thought YARN was supposed to give indication that it was going to preempt you but its been a while since I did anything in YARN.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org