You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Shwetha G S (JIRA)" <ji...@apache.org> on 2014/08/22 13:09:11 UTC
[jira] [Updated] (FALCON-630) late data rerun for process broken in
trunk
[ https://issues.apache.org/jira/browse/FALCON-630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shwetha G S updated FALCON-630:
-------------------------------
Attachment: FALCON-630.patch
This is just main code changes. I have introduced new variable which contains input names which is used for late data detection. I have also renamed {{WorkflowExecutionArgs.FEED_NAMES}} to OUTPUT_FEED_NAMES and {{WorkflowExecutionArgs.FEED_PATHS}} to OUTPUT_FEED_PATHS. Still need to fix the tests.
[~svenkat], can you please check if the main changes are ok
> late data rerun for process broken in trunk
> --------------------------------------------
>
> Key: FALCON-630
> URL: https://issues.apache.org/jira/browse/FALCON-630
> Project: Falcon
> Issue Type: Bug
> Components: rerun
> Affects Versions: 0.5
> Reporter: Samarth Gupta
> Assignee: Shwetha G S
> Priority: Blocker
> Fix For: 0.4
>
> Attachments: FALCON-630.patch
>
>
> late data rerun for process is not working . it seems like in pre processing record size is storing data by Feed name and not by input name , due to which late data is never detected.
> {code}
> -falconInputFeeds
> FETL2-RRLog#FETL-RTBS-PRLog#FETL-RTBS-NPRLog
> {code}
> above even though param in tasktracker logs says InputFeeds , they are actually feed name.
--
This message was sent by Atlassian JIRA
(v6.2#6252)