You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2019/10/21 09:31:00 UTC
[jira] [Work logged] (HIVE-22360) MultiSerDe returns wrong results
in last column when the loaded file has more columns than those in table
schema
[ https://issues.apache.org/jira/browse/HIVE-22360?focusedWorklogId=331301&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-331301 ]
ASF GitHub Bot logged work on HIVE-22360:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 21/Oct/19 09:30
Start Date: 21/Oct/19 09:30
Worklog Time Spent: 10m
Work Description: ShubhamChaurasia commented on pull request #823: HIVE-22360: MultiSerDe returns wrong results in last column when the loaded file has more columns than those in table schema
URL: https://github.com/apache/hive/pull/823
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 331301)
Remaining Estimate: 0h
Time Spent: 10m
> MultiSerDe returns wrong results in last column when the loaded file has more columns than those in table schema
> ----------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-22360
> URL: https://issues.apache.org/jira/browse/HIVE-22360
> Project: Hive
> Issue Type: Bug
> Components: Serializers/Deserializers
> Affects Versions: 4.0.0
> Reporter: Shubham Chaurasia
> Assignee: Shubham Chaurasia
> Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Repro steps:
> Input file:
> {code}
> 1^,1^,^,0^,0^,0
> 2^,1^,^,0^,1^,0
> 3^,1^,^,0^,0^,0
> 4^,1^,^,0^,1^,0
> {code}
> Queries:
> {code}
> CREATE TABLE n2(colA int, colB tinyint, colC timestamp, colD smallint, colE smallint) ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.MultiDelimitSerDe' WITH SERDEPROPERTIES ("field.delim"="^,")STORED AS TEXTFILE;
> LOAD DATA LOCAL INPATH '/Users/schaurasia/Documents/input_6_cols.csv' OVERWRITE INTO TABLE n2;
> select * from n2;
> // wrong last column results here.
> +----------+----------+----------+----------+----------+
> | n2.cola | n2.colb | n2.colc | n2.cold | n2.cole |
> +----------+----------+----------+----------+----------+
> | 1 | 1 | NULL | 0 | NULL |
> | 2 | 1 | NULL | 0 | NULL |
> | 3 | 1 | NULL | 0 | NULL |
> | 4 | 1 | NULL | 0 | NULL |
> +----------+----------+----------+----------+----------+
> {code}
> Cause:
> In multi-serde parsing, the total length calculation here: https://github.com/apache/hive/blob/rel/release-3.1.2/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyStruct.java#L308 does not take extra fields into account.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)