You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Vikram Bohra (Jira)" <ji...@apache.org> on 2023/03/31 22:11:00 UTC

[jira] [Created] (GOBBLIN-1805) Check watermark for the most recent hour for quiet topics

Vikram Bohra created GOBBLIN-1805:
-------------------------------------

             Summary: Check watermark for the most recent hour for quiet topics
                 Key: GOBBLIN-1805
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1805
             Project: Apache Gobblin
          Issue Type: Task
            Reporter: Vikram Bohra


Currently, Audit check is done for [currentWatermark, currentWatermark +1hour] window for quiet topics. However when the audit check for this window fails (due to an upstream bug in audit), the watermark never progress as the currentWatermark is never updated. To avoid this we keep progressing the watermark by checking the window [currentHour -1, currentHour] window



--
This message was sent by Atlassian Jira
(v8.20.10#820010)