Question regarding re-run and latest

[Harshal Vora <ha...@komli.com>]

Hey,

Say I have jobs running at interval of half hour. 
Jobs ran at 12:00, 12:30, 1:00, 1:30 and say by chance, 12:30 job failed and I re-ran the previous instance after the 1:30 job got over.

If I choose latest(0) to latest(-1), will i get 1:00 and 1:30 output or will I get 1:30 and 12:30 output.

And, say, if i do not re-run the previous instance, but by some mechanism start a new instance of the co-ordinator job which will consume the same data as of 12:30 job and emit output. I guess this output will be for time 1:45.
Will latest(0) give me 1:45 or will it give me 1:30 output?

Regards,

Re: Question regarding re-run and latest

[Mayank Bansal <ma...@gmail.com>]

HI Harshal,

This is not deterministic, this is based on what are the instances actually
completed at the time of this job had started

So lets take an example
if you are running 12:00, 12:30,12:45,1:00,1:30 and now 1:45 instance is
going to start.
but some reason
12:45 and 1:00 instances are still running
then latest(-2) will give 12:30
and if 12:45 is finished by that time then it can give 12:45 as well.

So it is decided at the run time.

Thanks,
Mayank

On Wed, Nov 23, 2011 at 6:15 AM, Harshal Vora <ha...@komli.com>wrote:

>
> Hey,
>
> Say I have jobs running at interval of half hour.
> Jobs ran at 12:00, 12:30, 1:00, 1:30 and say by chance, 12:30 job failed
> and I re-ran the previous instance after the 1:30 job got over.
>
> If I choose latest(0) to latest(-1), will i get 1:00 and 1:30 output or
> will I get 1:30 and 12:30 output.
>
> And, say, if i do not re-run the previous instance, but by some mechanism
> start a new instance of the co-ordinator job which will consume the same
> data as of 12:30 job and emit output. I guess this output will be for time
> 1:45.
> Will latest(0) give me 1:45 or will it give me 1:30 output?
>
> Regards,
>



-- 
Thanks and Regards,
Mayank
Cell: 408-718-9370