You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "William Lo (Jira)" <ji...@apache.org> on 2024/02/02 20:49:00 UTC
[jira] [Created] (GOBBLIN-1999) Fix GaaS flowstatus reporting when multiple leaders execute flow
William Lo created GOBBLIN-1999:
-----------------------------------
Summary: Fix GaaS flowstatus reporting when multiple leaders execute flow
Key: GOBBLIN-1999
URL: https://issues.apache.org/jira/browse/GOBBLIN-1999
Project: Apache Gobblin
Issue Type: Bug
Reporter: William Lo
In GaaS multileader there is a race condition where one host will compile/kick off a job, and the other hosts have an expected behavior of compiling the job but avoiding submission until the DagManager supports multiple leaders. The other hosts that run slower will try to check if the current job is running, and then mark the flow as failed at the same time when the leader submits the job. This leads to scenarios where successful flows can be marked as failed flows.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)