You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Kuai Yu (JIRA)" <ji...@apache.org> on 2019/08/12 17:48:00 UTC
[jira] [Updated] (GOBBLIN-851) Provide capability to disable hive
schema registration in partition level
[ https://issues.apache.org/jira/browse/GOBBLIN-851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kuai Yu updated GOBBLIN-851:
----------------------------
Description:
We had problems when table level schema and partition level schema diverges. Think about the case when user register two partitions : 2019/08/10, 2019/08/11, but schema changes in between(S1->S2). Now the table level has schema S2, but 2019/08/10 will have schema S1.
Query on the latest schema will cause the old partition failure.
> Provide capability to disable hive schema registration in partition level
> -------------------------------------------------------------------------
>
> Key: GOBBLIN-851
> URL: https://issues.apache.org/jira/browse/GOBBLIN-851
> Project: Apache Gobblin
> Issue Type: Improvement
> Reporter: Kuai Yu
> Priority: Major
>
> We had problems when table level schema and partition level schema diverges. Think about the case when user register two partitions : 2019/08/10, 2019/08/11, but schema changes in between(S1->S2). Now the table level has schema S2, but 2019/08/10 will have schema S1.
> Query on the latest schema will cause the old partition failure.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)