You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Urmi Mustafi (Jira)" <ji...@apache.org> on 2023/11/09 01:25:00 UTC
[jira] [Updated] (GOBBLIN-1954) Update FlowSpec Safely to Avoid Deserialization and Compilation Failure
[ https://issues.apache.org/jira/browse/GOBBLIN-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Urmi Mustafi updated GOBBLIN-1954:
----------------------------------
Summary: Update FlowSpec Safely to Avoid Deserialization and Compilation Failure (was: Update FlowSpec Safely to Avoid Compilation Failure)
> Update FlowSpec Safely to Avoid Deserialization and Compilation Failure
> -----------------------------------------------------------------------
>
> Key: GOBBLIN-1954
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1954
> Project: Apache Gobblin
> Issue Type: Bug
> Components: gobblin-service
> Reporter: Urmi Mustafi
> Assignee: Abhishek Tiwari
> Priority: Major
>
> When copying a flowSpec to add flowExecutionId into its config, all components need to be carefully duplicated to ensure compilation, serialization and deserialization are successful. Some pieces can easily be missed so instead, we add the property to the Properties object of the FlowSpec which is mutable. This test also ensures that the DagManager thread will not silently die during leadership changes by catching all types of Exceptions.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)