You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Sudarshan Vasudevan (Jira)" <ji...@apache.org> on 2020/08/03 19:10:06 UTC

[jira] [Updated] (GOBBLIN-921) Make pull/push mode when registering partition to be configurable

     [ https://issues.apache.org/jira/browse/GOBBLIN-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sudarshan Vasudevan updated GOBBLIN-921:
----------------------------------------
    Fix Version/s: 0.15.0

> Make pull/push mode when registering partition to be configurable
> -----------------------------------------------------------------
>
>                 Key: GOBBLIN-921
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-921
>             Project: Apache Gobblin
>          Issue Type: Task
>            Reporter: Zihan Li
>            Priority: Major
>             Fix For: 0.15.0
>
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> In pull mode, register will first try to check if the partition has already existed to reduce the call to add_partition. In push mode, register will try to call add_partition directly and relying on the exception to determine whether existed which mode should be used when most of the partition the HiveRegister try to register is not existed to reduce the call to HiveMetaStore.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)