You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/02/03 15:44:24 UTC

[GitHub] [spark] AngersZhuuuu edited a comment on pull request #31437: [SPARK-34329][YARN] When hit ApplicationAttemptNotFoundException, we can't just stop app for all case

AngersZhuuuu edited a comment on pull request #31437:
URL: https://github.com/apache/spark/pull/31437#issuecomment-772604648


   > can you provide more detail here.
   > what mode is this running in when you hit this (client or cluster - unmanaged am or managed)?
   
   Our case is client mode. this error throw in driver side.
   So we can change to :
   
   1. client- mode, for this error we can have a retry.
   2. cluster-mode, since this ApplicationMaster running in the AM container, so we can just stop?
   
   > When you say its preempted, I assume that you mean this application was killed by the RM due to higher priority? If it was killed how can it stay alive.
   
   I mean client mode AM's container was preempted. Then RM can't find this attempt. Then client driver backend receive  ApplicationAttemptNotFoundException.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org