You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by "mohit.goyal" <mo...@guavus.com> on 2014/03/21 06:24:16 UTC

Sprak Job stuck

Hi,

I have run the spark application to process input data of size ~14GB with
executor memory 10GB. The job got stuck with below message

14/03/21 05:02:07 WARN storage.BlockManagerMasterActor: Removing
BlockManager BlockManagerId(0, guavus-0102bf, 49347, 0) with no recent heart
beats: 85563ms exceeds 45000ms

But job completed successfully if i increase executor memory 40GB.

Any idea??

Thanks
Mohit Goyal




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Sprak-Job-stuck-tp2979.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Sprak Job stuck

Posted by Usman Ghani <us...@platfora.com>.

Were you able to figure out what this was?

You can try setting spark.akka.askTimeout to a larger value. That might
help.


On Thu, Mar 20, 2014 at 10:24 PM, mohit.goyal <mo...@guavus.com>wrote:

> Hi,
>
> I have run the spark application to process input data of size ~14GB with
> executor memory 10GB. The job got stuck with below message
>
> 14/03/21 05:02:07 WARN storage.BlockManagerMasterActor: Removing
> BlockManager BlockManagerId(0, guavus-0102bf, 49347, 0) with no recent
> heart
> beats: 85563ms exceeds 45000ms
>
> But job completed successfully if i increase executor memory 40GB.
>
> Any idea??
>
> Thanks
> Mohit Goyal
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Sprak-Job-stuck-tp2979.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>