You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Zhiliang Zhu <zc...@yahoo.com.INVALID> on 2016/06/17 06:33:27 UTC

Re: spark job automatically killed without rhyme or reason

anyone ever met the similar problem, which is quite strange ...  

    On Friday, June 17, 2016 2:13 PM, Zhiliang Zhu <zc...@yahoo.com.INVALID> wrote:
 

 Hi All,
I have a big job which mainly takes more than one hour to run the whole, however, it is very much unreasonable to exit & finish to run midway (almost 80% of the job finished actually, but not all), without any apparent error or exception log.
I submitted the same job for many times, it is same as that.In the last line of the run log, just one word "killed" to end, or sometimes not any  other wrong log, all seems okay but should not finish.
What is the way for the problem? Is there any other friends that ever met the similar issue ...
Thanks in advance!