You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Urmi Mustafi (Jira)" <ji...@apache.org> on 2023/11/09 01:25:00 UTC

[jira] [Created] (GOBBLIN-1954) Update FlowSpec Safely to Avoid Compilation Failure

Urmi Mustafi created GOBBLIN-1954:
-------------------------------------

             Summary: Update FlowSpec Safely to Avoid Compilation Failure
                 Key: GOBBLIN-1954
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1954
             Project: Apache Gobblin
          Issue Type: Bug
          Components: gobblin-service
            Reporter: Urmi Mustafi
            Assignee: Abhishek Tiwari


When copying a flowSpec to add flowExecutionId into its config, all components need to be carefully duplicated to ensure compilation, serialization and deserialization are successful. Some pieces can easily be missed so instead, we add the property to the Properties object of the FlowSpec which is mutable. This test also ensures that the DagManager thread will not silently die during leadership changes by catching all types of Exceptions.  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)