You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Josh J <jo...@gmail.com> on 2015/01/14 03:17:30 UTC

spark standalone master with workers on two nodes

Hi,

I'm trying to run Spark Streaming standalone on two nodes. I'm able to run
on a single node fine. I start both workers and it registers in the Spark
UI. However, the application says

"SparkDeploySchedulerBackend: Asked to remove non-existent executor 2"

Any ideas?

Thanks,
Josh

Re: spark standalone master with workers on two nodes

Posted by Akhil Das <ak...@sigmoidanalytics.com>.

You could be hitting this issue
https://issues.apache.org/jira/browse/SPARK-5098

Thanks
Best Regards

On Wed, Jan 14, 2015 at 7:47 AM, Josh J <jo...@gmail.com> wrote:

> Hi,
>
> I'm trying to run Spark Streaming standalone on two nodes. I'm able to run
> on a single node fine. I start both workers and it registers in the Spark
> UI. However, the application says
>
> "SparkDeploySchedulerBackend: Asked to remove non-existent executor 2"
>
> Any ideas?
>
> Thanks,
> Josh
>