You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "JacobZheng (Jira)" <ji...@apache.org> on 2021/10/27 07:24:00 UTC
[jira] [Created] (SPARK-37128) Application has been removed by
master but driver still running
JacobZheng created SPARK-37128:
----------------------------------
Summary: Application has been removed by master but driver still running
Key: SPARK-37128
URL: https://issues.apache.org/jira/browse/SPARK-37128
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.0.1
Reporter: JacobZheng
{code:java}
21/08/30 10:27:31 INFO Master: Removing executor app-20210827190502-0030/1 because it is EXITED
21/08/30 10:27:31 INFO Master: Launching executor app-20210827190502-0030/4 on worker worker-20210826183405-10.39.0.69-37147
21/08/30 10:27:31 INFO Master: 10.39.0.68:47160 got disassociated, removing it.
21/08/30 10:27:31 INFO Master: 10.39.0.68:35160 got disassociated, removing it.
21/08/30 10:27:31 INFO Master: Removing app app-20210827190502-0030
21/08/30 10:27:31 WARN Master: Got status update for unknown executor app-20210827190502-0030/4
21/08/30 10:27:31 WARN Master: Got status update for unknown executor app-20210827190502-0030/4
21/08/30 10:27:46 WARN Master: Got status update for unknown executor app-20210827190502-0030/2
21/08/30 10:27:48 WARN Master: Got status update for unknown executor app-20210827190502-0030/0
21/08/30 10:27:50 WARN Master: Got status update for unknown executor app-20210827190502-0030/3{code}
As the logs show, Spark master removed my application. But my driver process is still running. I would like to know what could be the cause of this and how I can avoid it.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org