[jira] [Created] (GOBBLIN-1724) Support a flowgraph layout for shared node configurations

["William Lo (Jira)" <ji...@apache.org>]

William Lo created GOBBLIN-1724:
-----------------------------------

             Summary: Support a flowgraph layout for shared node configurations
                 Key: GOBBLIN-1724
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1724
             Project: Apache Gobblin
          Issue Type: Improvement
            Reporter: William Lo


Currently the GaaS Flowgraph assumes that there will be one separate flowgraph for each configured use case, but this adds for a large amount of duplication when supporting multiple flowgraphs.

We should support a layout where there can be a directory for shared nodes between each flowgraph, and each flowgraph can overwrite properties for these nodes if needed.

e.g.
{code:java}
/flowgraph
../nodeA
..../nodeB
......edgeAB.properties
../nodeB
....nodeB.properties
/nodes
..nodeA.properties
..nodeB.properties{code}
Where nodeA will use the shared properties, and nodeB will use the union of the properties in /flowgraph and the shared properties.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)