You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by William Kinney <wi...@gmail.com> on 2015/07/31 19:01:42 UTC

Setting a stage timeout

Hi,

I had a job that got stuck on yarn due to
https://issues.apache.org/jira/browse/SPARK-6954
It never exited properly.

Is there a way to set a timeout for a stage or all stages?

Re: Setting a stage timeout

Posted by William Kinney <wi...@gmail.com>.

Yes I upgraded but I would still like to set an overall stage timeout. Does
that exist?

On Fri, Jul 31, 2015 at 1:13 PM, Ted Yu <yu...@gmail.com> wrote:

> The referenced bug has been fixed in 1.4.0, are you able to upgrade ?
>
> Cheers
>
> On Fri, Jul 31, 2015 at 10:01 AM, William Kinney <william.kinney@gmail.com
> > wrote:
>
>> Hi,
>>
>> I had a job that got stuck on yarn due to
>> https://issues.apache.org/jira/browse/SPARK-6954
>> It never exited properly.
>>
>> Is there a way to set a timeout for a stage or all stages?
>>
>
>

Re: Setting a stage timeout

Posted by Ted Yu <yu...@gmail.com>.

The referenced bug has been fixed in 1.4.0, are you able to upgrade ?

Cheers

On Fri, Jul 31, 2015 at 10:01 AM, William Kinney <wi...@gmail.com>
wrote:

> Hi,
>
> I had a job that got stuck on yarn due to
> https://issues.apache.org/jira/browse/SPARK-6954
> It never exited properly.
>
> Is there a way to set a timeout for a stage or all stages?
>