You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Zihan Li (Jira)" <ji...@apache.org> on 2020/11/05 22:47:00 UTC

[jira] [Updated] (GOBBLIN-863) Handle race condition between concurrent Gobblin tasks performing Hive registration

     [ https://issues.apache.org/jira/browse/GOBBLIN-863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zihan Li updated GOBBLIN-863:
-----------------------------
    Description: We need a distributed lock to be used in streaming mode hive registration. When updating the hive table, lock the table and fetch the latest schema from schema registry and use the latest schema to update table to make sure the table always has the latest schema

> Handle race condition between concurrent Gobblin tasks performing Hive registration
> -----------------------------------------------------------------------------------
>
>                 Key: GOBBLIN-863
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-863
>             Project: Apache Gobblin
>          Issue Type: Task
>          Components: hive-registration
>            Reporter: Zihan Li
>            Assignee: Abhishek Tiwari
>            Priority: Major
>             Fix For: 0.15.0
>
>          Time Spent: 4h
>  Remaining Estimate: 0h
>
> We need a distributed lock to be used in streaming mode hive registration. When updating the hive table, lock the table and fetch the latest schema from schema registry and use the latest schema to update table to make sure the table always has the latest schema



--
This message was sent by Atlassian Jira
(v8.3.4#803005)