You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Andy Jiang (Jira)" <ji...@apache.org> on 2023/05/30 18:59:00 UTC

[jira] [Created] (GOBBLIN-1838) Introduce total count based completion watermark

Andy Jiang created GOBBLIN-1838:
-----------------------------------

             Summary: Introduce total count based completion watermark
                 Key: GOBBLIN-1838
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1838
             Project: Apache Gobblin
          Issue Type: New Feature
            Reporter: Andy Jiang


Currently the completion watermark is determined according to the completeness percentage: "max of srcCount/refCount, for each refTier".

This change introduces a new "total count based completion watermark", which is determined by a new completeness percentage: "srcCount / sum of all refCount, for each refTier".



--
This message was sent by Atlassian Jira
(v8.20.10#820010)