Zombie Driver process (Standalone Cluster)

[map reduced <k3...@gmail.com>]

Hi,

I am noticing zombie driver processes running on my standalone cluster. Not
sure about the reason - but node (with driver on it) restart may be a
potential cause.
What's interesting about these is: SparkUI doesn't recognize it as a
running driver, hence no 'kill' option there. Also, if I try running
command line driver kill command, it says no such driver found running.

bin/spark-class org.apache.spark.deploy.Client kill
spark://master-url:31498 driver-20161005204049-0031

Gives:
Driver driver-20161005204049-0031 has already finished or does not exist.

Here's another screenshot which shows that Spark Master UI doesn't find it
as a running driver:

[image: Inline image 1]
But it's really running on one of the workers:

[image: Inline image 2]
(Sorry can't share hostnames etc).

Any idea why this is happening and how to kill it? (I don't have a way to
ssh into that machine).

Thanks,
KP