You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by mrm <ma...@skimlinks.com> on 2015/03/20 11:21:52 UTC
Spark 1.2. loses often all executors
Hi,
I recently changed from Spark 1.1. to Spark 1.2., and I noticed that it
loses all executors whenever I have any Python code bug (like looking up a
key in a dictionary that does not exist). In earlier versions, it would
raise an exception but it would not lose all executors.
Anybody with a similar problem?
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-2-loses-often-all-executors-tp22162.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Spark 1.2. loses often all executors
Posted by Davies Liu <da...@databricks.com>.
Maybe this is related to a bug in 1.2 [1], it's fixed in 1.2.2 (not
released), could checkout the 1.2 branch and verify that?
[1] https://issues.apache.org/jira/browse/SPARK-5788
On Fri, Mar 20, 2015 at 3:21 AM, mrm <ma...@skimlinks.com> wrote:
> Hi,
>
> I recently changed from Spark 1.1. to Spark 1.2., and I noticed that it
> loses all executors whenever I have any Python code bug (like looking up a
> key in a dictionary that does not exist). In earlier versions, it would
> raise an exception but it would not lose all executors.
>
> Anybody with a similar problem?
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-2-loses-often-all-executors-tp22162.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Spark 1.2. loses often all executors
Posted by Akhil Das <ak...@sigmoidanalytics.com>.
Isn't that a feature? Other than running a buggy pipeline, just kills all
executors? You can always handle exceptions with proper try catch in your
code though.
Thanks
Best Regards
On Fri, Mar 20, 2015 at 3:51 PM, mrm <ma...@skimlinks.com> wrote:
> Hi,
>
> I recently changed from Spark 1.1. to Spark 1.2., and I noticed that it
> loses all executors whenever I have any Python code bug (like looking up a
> key in a dictionary that does not exist). In earlier versions, it would
> raise an exception but it would not lose all executors.
>
> Anybody with a similar problem?
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-2-loses-often-all-executors-tp22162.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
Re: Spark 1.2. loses often all executors
Posted by Ted Yu <yu...@gmail.com>.
In this thread:
http://search-hadoop.com/m/JW1q5DM69G
I only saw two replies. Maybe some people forgot to use 'Reply to All' ?
Cheers
On Mon, Mar 23, 2015 at 8:19 AM, mrm <ma...@skimlinks.com> wrote:
> Hi,
>
> I have received three replies to my question on my personal e-mail, why
> don't they also show up on the mailing list? I would like to reply to the 3
> users through a thread.
>
> Thanks,
> Maria
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-2-loses-often-all-executors-tp22162p22187.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
Re: Spark 1.2. loses often all executors
Posted by mrm <ma...@skimlinks.com>.
Hi,
I have received three replies to my question on my personal e-mail, why
don't they also show up on the mailing list? I would like to reply to the 3
users through a thread.
Thanks,
Maria
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-2-loses-often-all-executors-tp22162p22187.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org