You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@falcon.apache.org by Mahak Mukhi <mm...@yahoo-inc.com.INVALID> on 2015/06/12 00:35:50 UTC

Falcon only replicates jobs with exact timestamp

Hi,
Consider the following situation; I have a files being generated roughly every(say 10 mins) so I set up a feed to replicate them. Now the falcon job has a start time of say 17:31 while the timestamp on the files is in the denomination of 10s (i.e. 201506111720, 201506111730, 201506111740 etc). In a situation like this no files are copied! Because Falcon sets up oozie to look for files with names such as 201506111731 2015061141 2015061151.How can one get around this scenario?
 Regards,
Mahak Mukhi

RE: Falcon only replicates jobs with exact timestamp

Posted by Srikanth Sundarrajan <sr...@hotmail.com>.

The way things are implemented currently, feed start time should align with a valid feed instance time. In your case 17:10 / 17:20 or 17:30

Regards
Srikanth Sundarrajan

> Date: Thu, 11 Jun 2015 22:35:50 +0000
> From: mmukhi@yahoo-inc.com.INVALID
> To: dev@falcon.incubator.apache.org; dev@falcon.apache.org
> Subject: Falcon only replicates jobs with exact timestamp
> 
> Hi,
> Consider the following situation; I have a files being generated roughly every(say 10 mins) so I set up a feed to replicate them. Now the falcon job has a start time of say 17:31 while the timestamp on the files is in the denomination of 10s (i.e. 201506111720, 201506111730, 201506111740 etc). In a situation like this no files are copied! Because Falcon sets up oozie to look for files with names such as 201506111731 2015061141 2015061151.How can one get around this scenario?
>  Regards,
> Mahak Mukhi