[jira] Updated: (HIVE-193) Cannot create table with tinyint type column

["Cyrus Katrak (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Cyrus Katrak updated HIVE-193:
------------------------------

    Attachment: HIVE-193-1-generated.patch
                HIVE-193-1.patch

Here is a quick first pass at this, it seems to half work. (Patch is split into real changes, and changes that were a result of running javacc on the .jjt file)

Can create a dynamicserde table with a tiny int:
"CREATE TABLE input_tiny(key TINYINT, value STRING) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe' WITH SERDEPROPERTIES ('serialization.format'= 'org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol') STORED AS TEXTFILE;"

Can load data in:
"FROM input_nottiny INSERT OVERWRITE TABLE input_tiny SELECT cast(input_nottiny.key as TINYINT), input_nottiny.value;"

But I am getting a deserialization error when I try to use the table:
java.lang.NullPointerException
	at java.util.regex.Matcher.getTextLength(Matcher.java:1140)
	at java.util.regex.Matcher.reset(Matcher.java:291)
	at java.util.regex.Matcher.<init>(Matcher.java:211)
	at java.util.regex.Pattern.matcher(Pattern.java:888)
	at java.util.regex.Pattern.split(Pattern.java:997)
	at java.util.regex.Pattern.split(Pattern.java:1059)
	at org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol.readStructBegin(TCTLSeparatedProtocol.java:573)
	at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDeStructBase.deserialize(DynamicSerDeStructBase.java:56)
	at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.deserialize(DynamicSerDe.java:131)
	at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:257)
	at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:113)
	at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:540)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:131)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:181)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:287)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Failed with exception java.io.IOException:org.apache.hadoop.hive.serde2.SerDeException: java.lang.NullPointerException

Not quite sure where to go from here. Any Ideas?

> Cannot create table with tinyint type column
> --------------------------------------------
>
>                 Key: HIVE-193
>                 URL: https://issues.apache.org/jira/browse/HIVE-193
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor, Serializers/Deserializers
>    Affects Versions: 0.2.0
>            Reporter: Johan Oskarsson
>             Fix For: 0.5.0
>
>         Attachments: HIVE-193-1-generated.patch, HIVE-193-1.patch
>
>
> Running this query "create table something2 (test tinyint);" gives the following exception:
> org.apache.hadoop.hive.serde2.dynamic_type.ParseException: Encountered "byte" at line 1, column 21.
> Was expecting one of:
>     "bool" ...
>     "i16" ...
>     "i32" ...
>     "i64" ...
>     "double" ...
>     "string" ...
>     "map" ...
>     "list" ...
>     "set" ...
>     "required" ...
>     "optional" ...
>     "skip" ...
>     <tok_int_constant> ...
>     <IDENTIFIER> ...
>     "}" ...
>     
> 	at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.generateParseException(thrift_grammar.java:2321)
> 	at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.jj_consume_token(thrift_grammar.java:2253)
> 	at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1172)
> 	at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497)
> 	at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439)
> 	at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101)
> 	at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97)
> 	at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180)
> 	at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141)
> 	at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202)
> 	at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641)
> 	at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98)
> 	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215)
> 	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207)
> 	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.