You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Guangyang Li (JIRA)" <ji...@apache.org> on 2015/08/07 03:01:45 UTC
[jira] [Updated] (SPARK-9711) spark-submit fails after restarting
cluster with spark-ec2
[ https://issues.apache.org/jira/browse/SPARK-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Guangyang Li updated SPARK-9711:
--------------------------------
Description:
With Spark 1.4.1 and YARN client mode. My job works at the first time the cluster is built. If I stop and start the cluster, the same /bin/spark-submit command fails. At the end of the spark logs, it just keeps trying to connect to master node:
```
INFO Client: Retrying connect to server: ec2-54-174-232-129.compute-1.amazonaws.com/172.31.36.29:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
```
was:
With Spark 1.4.1 and YARN client mode. My job works at the first time the cluster is built. If I stop and start the cluster, the same /bin/spark-submit command fails and keeps trying to connect to master node:
INFO Client: Retrying connect to server: ec2-54-174-232-129.compute-1.amazonaws.com/172.31.36.29:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
> spark-submit fails after restarting cluster with spark-ec2
> ----------------------------------------------------------
>
> Key: SPARK-9711
> URL: https://issues.apache.org/jira/browse/SPARK-9711
> Project: Spark
> Issue Type: Bug
> Components: EC2
> Affects Versions: 1.4.1
> Reporter: Guangyang Li
>
> With Spark 1.4.1 and YARN client mode. My job works at the first time the cluster is built. If I stop and start the cluster, the same /bin/spark-submit command fails. At the end of the spark logs, it just keeps trying to connect to master node:
> ```
> INFO Client: Retrying connect to server: ec2-54-174-232-129.compute-1.amazonaws.com/172.31.36.29:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
> ```
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org