You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Bing Li (JIRA)" <ji...@apache.org> on 2015/09/09 05:20:46 UTC

[jira] [Commented] (HIVE-11201) HCatalog is ignoring user specified avro schema in the table definition

    [ https://issues.apache.org/jira/browse/HIVE-11201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14736076#comment-14736076 ] 

Bing Li commented on HIVE-11201:
--------------------------------

I submitted the review request manually.
The link is https://reviews.apache.org/r/34877/

> HCatalog  is ignoring user specified avro schema in the table definition
> ------------------------------------------------------------------------
>
>                 Key: HIVE-11201
>                 URL: https://issues.apache.org/jira/browse/HIVE-11201
>             Project: Hive
>          Issue Type: Bug
>          Components: HCatalog
>    Affects Versions: 1.2.0, 1.2.1
>            Reporter: Bing Li
>            Assignee: Bing Li
>            Priority: Critical
>         Attachments: HIVE-11201.1.patch
>
>
> HCatalog  is ignoring user specified avro schema in the table definition , instead generating its own avro based  from hive meta store. 
> By generating its own schema  will result in mismatch names.  For exmple Avro fields name are Case Sensitive.  By generating it's own schema will  result in incorrect schema written to the avro file , and result   select fail on read.   And also Even if user specified schema does not allow null ,  when data is written using Hcatalog , it will write a schema that will allow null. 
> For example in the table ,  user specified , all CAPITAL letters in the schema , and record name as LINEITEM.  The schema should be written as it is.  Instead Hcatalog ignores it and generated its own avro schema from the hive table case. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)