You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Urmi Mustafi (Jira)" <ji...@apache.org> on 2023/10/25 23:09:00 UTC

[jira] [Created] (GOBBLIN-1937) Quantify Missed Work Completed by Reminders

Urmi Mustafi created GOBBLIN-1937:
-------------------------------------

             Summary: Quantify Missed Work Completed by Reminders
                 Key: GOBBLIN-1937
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1937
             Project: Apache Gobblin
          Issue Type: Bug
          Components: gobblin-service
            Reporter: Urmi Mustafi
            Assignee: Abhishek Tiwari


Measure the amount of work that would have been missed by a participant otherwise completed by the reminder event concept. This can be done by checking the number of reminder events that actually obtain a lease to re-trigger a flow launch. Reminder events that see another lease is in progress are not included to avoid double counting the participant actually doing the work on reminder case. 

Additionally, address a bug to filter out heartbeat events _before_ attempting to extract the {{FlowActionType}} from {{DagActionStoreChangeEvents}} because heartbeat events have null {{{}FlowActionTypes{}}}, causing the heartbeats to be rightfully skipped but for the wrong reason. 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)