You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Shwetha G S (JIRA)" <ji...@apache.org> on 2014/03/21 14:18:42 UTC

[jira] [Updated] (FALCON-369) Refactor workflow builder

     [ https://issues.apache.org/jira/browse/FALCON-369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shwetha G S updated FALCON-369:
-------------------------------

    Attachment: FALCON-369.patch

This is the first cut to review the approach. Its implemented just for process, but gives an essence of the approach. The code is just moved from OozieProcessWorkflowBuilder to different classes. Tested this with an end to end flow for process with filesystem location.

If you have any suggestions/concerns, please bring it up now.

> Refactor workflow builder
> -------------------------
>
>                 Key: FALCON-369
>                 URL: https://issues.apache.org/jira/browse/FALCON-369
>             Project: Falcon
>          Issue Type: Improvement
>            Reporter: Shwetha G S
>            Assignee: Shwetha G S
>         Attachments: FALCON-369.patch
>
>
> Currently, feed/process workflow builder is a single class which handles all different cases of lifecycles, storage types, workflow engines and building all oozie entities(workflow, coord and bundle). This is not readable and difficult to maintain. This needs some re-factoring.
> Approach:
> Maintain different builders for
> 1. oozie entities - workflow, coord and bundle. 
> 2. entity types - feed and process
> 3. lifecycle - process, retention and replication
> 4. workflow engines - oozie, pig and hive



--
This message was sent by Atlassian JIRA
(v6.2#6252)