You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "William Lo (Jira)" <ji...@apache.org> on 2024/02/02 20:49:00 UTC

[jira] [Created] (GOBBLIN-1999) Fix GaaS flowstatus reporting when multiple leaders execute flow

William Lo created GOBBLIN-1999:
-----------------------------------

             Summary: Fix GaaS flowstatus reporting when multiple leaders execute flow
                 Key: GOBBLIN-1999
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1999
             Project: Apache Gobblin
          Issue Type: Bug
            Reporter: William Lo


In GaaS multileader there is a race condition where one host will compile/kick off a job, and the other hosts have an expected behavior of compiling the job but avoiding submission until the DagManager supports multiple leaders. The other hosts that run slower will try to check if the current job is running, and then mark the flow as failed at the same time when the leader submits the job. This leads to scenarios where successful flows can be marked as failed flows.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)