You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by 洪奇 <qi...@alibaba-inc.com> on 2014/07/15 08:20:01 UTC

答复:RACK_LOCAL Tasks Failed to finish

I just running PageRank(included in GraphX) on a dataset which has 55876487 edges. I submit the application to YARN with options`--num-executors 30 --executor-memory 30g --driver-memory 10g --executor-cores 8`.

Thanks------------------------------------------------------------------发件人:Ankur Dave <an...@gmail.com>发送时间:2014年7月15日(星期二) 11:52收件人:user <us...@spark.apache.org>,李奇平(洪奇) <qi...@alibaba-inc.com>主 题:Re: RACK_LOCAL Tasks Failed to finish
What GraphX application are you running? If it's a custom application that calls RDD.unpersist, that might cause RDDs to be recomputed. It's tricky to do unpersisting correctly, so you might try not unpersisting and see if that helps.

Ankur