You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Sergey Shelukhin (JIRA)" <ji...@apache.org> on 2015/11/12 03:13:12 UTC
[jira] [Updated] (HIVE-11201) HCatalog is ignoring user specified
avro schema in the table definition
[ https://issues.apache.org/jira/browse/HIVE-11201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sergey Shelukhin updated HIVE-11201:
------------------------------------
Should this issue be backported to branch-1? It looks like a bug.
> HCatalog is ignoring user specified avro schema in the table definition
> ------------------------------------------------------------------------
>
> Key: HIVE-11201
> URL: https://issues.apache.org/jira/browse/HIVE-11201
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
> Affects Versions: 1.2.0, 1.2.1
> Reporter: Bing Li
> Assignee: Bing Li
> Priority: Critical
> Fix For: 2.0.0
>
> Attachments: HIVE-11201.1.patch
>
>
> HCatalog is ignoring user specified avro schema in the table definition , instead generating its own avro based from hive meta store.
> By generating its own schema will result in mismatch names. For exmple Avro fields name are Case Sensitive. By generating it's own schema will result in incorrect schema written to the avro file , and result select fail on read. And also Even if user specified schema does not allow null , when data is written using Hcatalog , it will write a schema that will allow null.
> For example in the table , user specified , all CAPITAL letters in the schema , and record name as LINEITEM. The schema should be written as it is. Instead Hcatalog ignores it and generated its own avro schema from the hive table case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)