You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Shwetha G S (JIRA)" <ji...@apache.org> on 2014/08/22 13:09:11 UTC

[jira] [Updated] (FALCON-630) late data rerun for process broken in trunk

     [ https://issues.apache.org/jira/browse/FALCON-630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shwetha G S updated FALCON-630:
-------------------------------

    Attachment: FALCON-630.patch

This is just main code changes. I have introduced new variable which contains input names which is used for late data detection. I have also renamed {{WorkflowExecutionArgs.FEED_NAMES}} to OUTPUT_FEED_NAMES and {{WorkflowExecutionArgs.FEED_PATHS}} to OUTPUT_FEED_PATHS. Still need to fix the tests.

[~svenkat], can you please check if the main changes are ok

> late data rerun for process broken in trunk 
> --------------------------------------------
>
>                 Key: FALCON-630
>                 URL: https://issues.apache.org/jira/browse/FALCON-630
>             Project: Falcon
>          Issue Type: Bug
>          Components: rerun
>    Affects Versions: 0.5
>            Reporter: Samarth Gupta
>            Assignee: Shwetha G S
>            Priority: Blocker
>             Fix For: 0.4
>
>         Attachments: FALCON-630.patch
>
>
> late data rerun for process is not working . it seems like in pre processing record size is storing data by Feed name and not by input name , due to which late data is never detected. 
> {code}
>                     -falconInputFeeds
>                     FETL2-RRLog#FETL-RTBS-PRLog#FETL-RTBS-NPRLog
> {code}
> above even though param in tasktracker logs says InputFeeds , they are actually feed name. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)