You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Alexander Pivovarov (JIRA)" <ji...@apache.org> on 2015/02/01 06:19:34 UTC

[jira] [Commented] (HIVE-6532) ORC NPE on null Map

    [ https://issues.apache.org/jira/browse/HIVE-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14300080#comment-14300080 ] 

Alexander Pivovarov commented on HIVE-6532:
-------------------------------------------

I tried to run the query from the description on trunk (90a9cce1e)  1.2.0-SNAPSHOT 2015-01-31
{code}
-- orc table tm_orc has one column m map<string, string>. The table has 3 rows. One of the cells is null
select * from tm_orc;
OK
{"A":"1"}
NULL
{"B":"2"}

--lets try to run select
hive> select * from tm_orc where m['B'] = '2';
OK
{"B":"2"}

--table details
hive> desc extended tm_orc;
OK
m                   	map<string,string>  	                    
	 	 
Detailed Table Information	Table(tableName:tm_orc, dbName:default, owner:apivovarov, createTime:1422767300, lastAccessTime:0, retention:0, sd:StorageDescriptor(cols:[FieldSchema(name:m, type:map<string,string>, comment:null)], location:hdfs://localhost:8020/apps/hive/warehouse/tm_orc, inputFormat:org.apache.hadoop.hive.ql.io.orc.OrcInputFormat, outputFormat:org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat, compressed:false, numBuckets:-1, serdeInfo:SerDeInfo(name:null, serializationLib:org.apache.hadoop.hive.ql.io.orc.OrcSerde, parameters:{serialization.format=1}), bucketCols:[], sortCols:[], parameters:{}, skewedInfo:SkewedInfo(skewedColNames:[], skewedColValues:[], skewedColValueLocationMaps:{}), storedAsSubDirectories:false), partitionKeys:[], parameters:{numFiles=1, COLUMN_STATS_ACCURATE=true, transient_lastDdlTime=1422767300, numRows=3, totalSize=328, rawDataSize=340}, viewOriginalText:null, viewExpandedText:null, tableType:MANAGED_TABLE)
{code}

Issue can be closed

> ORC NPE on null Map
> -------------------
>
>                 Key: HIVE-6532
>                 URL: https://issues.apache.org/jira/browse/HIVE-6532
>             Project: Hive
>          Issue Type: Bug
>          Components: File Formats
>    Affects Versions: 0.12.0
>         Environment: ubuntu 12.04 
>            Reporter: nicolas maillard
>            Priority: Trivial
>
> On a select query map tasks will fail with npe for a where clause on a null map. on an ORC table 
> example
>  select * from my table where mymap['entry'] = 'something'
> If my map where to be null in a line we will get an npe exception.
> Maybe the line should just be ignored.
> The same query on a text format table will resolve correctly



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)