[jira] [Created] (SPARK-31246) GracefulShutdown does not work when application is terminated from RestSubmissionClient or YarnClient

["Gajanan Hebbar (Jira)" <ji...@apache.org>]

Gajanan Hebbar created SPARK-31246:
--------------------------------------

             Summary: GracefulShutdown does not work when application is terminated from RestSubmissionClient or YarnClient
                 Key: SPARK-31246
                 URL: https://issues.apache.org/jira/browse/SPARK-31246
             Project: Spark
          Issue Type: Bug
          Components: Java API
    Affects Versions: 2.4.3
         Environment: spark-2.4.3
            Reporter: Gajanan Hebbar


While starting the Spark Application "*spark.streaming.stopGracefullyOnShutdown*" is set to true

try to terminate the application programatically using JAVA API

1 using RestSubmissionClient client = new RestSubmissionClient(masterUrl);
             SubmitRestProtocolResponse statusResponse = client.killSubmission(submissionId);  

 

2. using getYarnClient().killApplication(appId);

 

In both the cases Application dose not stop gracefully

 

But killing the Application using  

 

Kill -SIGTERM <pid>  will shutdown the application gracefully.


Expected : Application should have terminated gracefully in all cases when spark.streaming.stopGracefullyOnShutdown is set



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org