You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@crunch.apache.org by 陈竞 <cj...@gmail.com> on 2016/04/21 09:42:38 UTC
crunch's pipeline does't support re-runing from failed job?
hi, i'm new to crunch, i begin to use crunch, I found that, once
once the pipeline failed, it can't start from latest failed job when
re-running.
thx
--
陈竞，中科院计算技术研究所，高性能计算机中心
Jing Chen HPCC.ICT.AC China
Re: crunch's pipeline does't support re-runing from failed job?
Posted by 陈竞 <cj...@gmail.com>.
ok， thx，i try it
2016-04-21 19:41 GMT+08:00 David Ortiz <dp...@gmail.com>:
> To get it to pick up from where it left off, you have to write out
> intermediate data with WriteMode.CHECKPOINT
>
> On Thu, Apr 21, 2016, 3:42 AM 陈竞 <cj...@gmail.com> wrote:
>
>> hi, i'm new to crunch, i begin to use crunch, I found that, once
>> once the pipeline failed, it can't start from latest failed job when
>> re-running.
>>
>> thx
>>
>> --
>> 陈竞，中科院计算技术研究所，高性能计算机中心
>> Jing Chen HPCC.ICT.AC China
>>
>
--
陈竞，中科院计算技术研究所，高性能计算机中心
Jing Chen HPCC.ICT.AC China
Re: crunch's pipeline does't support re-runing from failed job?
Posted by David Ortiz <dp...@gmail.com>.
To get it to pick up from where it left off, you have to write out
intermediate data with WriteMode.CHECKPOINT
On Thu, Apr 21, 2016, 3:42 AM 陈竞 <cj...@gmail.com> wrote:
> hi, i'm new to crunch, i begin to use crunch, I found that, once
> once the pipeline failed, it can't start from latest failed job when
> re-running.
>
> thx
>
> --
> 陈竞，中科院计算技术研究所，高性能计算机中心
> Jing Chen HPCC.ICT.AC China
>