You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Zhu Li (JIRA)" <ji...@apache.org> on 2016/07/02 00:58:10 UTC

[jira] [Created] (HIVE-14154) Select from ORC table stored VectorizedOrcInputFormat fails

Zhu Li created HIVE-14154:
-----------------------------

             Summary: Select from ORC table stored VectorizedOrcInputFormat fails
                 Key: HIVE-14154
                 URL: https://issues.apache.org/jira/browse/HIVE-14154
             Project: Hive
          Issue Type: Bug
          Components: Hive
            Reporter: Zhu Li


TABLE INFORMATION:
# col_name            	data_type           	comment             	 	 
c_1m_l              	bigint              	                    
c_10_l              	bigint              	                    
c_100_l             	bigint              	                    
c_1k_l              	bigint              	                    
c_10k_l             	bigint              	                    
c_100k_l            	bigint              	                    
c_1k_r              	bigint              	                    
c_1m_r              	bigint              	                    
s_5000_r            	char(40)            	                    
s_1m_r              	char(40)            	                    
	 	 
# Detailed Table Information	 	 
Database:           	default             	 
Owner:              	hdfs                	 
CreateTime:         	Fri Jul 01 17:32:23 PDT 2016	 
LastAccessTime:     	UNKNOWN             	 
Protect Mode:       	None                	 
Retention:          	0                   	 
Location:           	hdfs://mynamenode:8020/apps/hive/warehouse/t_1m_2_orc_vec	 
Table Type:         	MANAGED_TABLE       	 
Table Parameters:	 	 
	COLUMN_STATS_ACCURATE	true                
	numFiles            	8                   
	numRows             	10000000            
	rawDataSize         	3120000000          
	totalSize           	105254801           
	transient_lastDdlTime	1467419689   
Storage Information	 	 
SerDe Library:      org.apache.hadoop.hive.ql.io.orc.OrcSerde	 
InputFormat:         org.apache.hadoop.hive.ql.io.orc.VectorizedOrcInputFormat	 
OutputFormat:      org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat	 
Compressed:         	No                  	 
Num Buckets:        	-1                  	 
Bucket Columns:     []                  	 
Sort Columns:       	[]                  	 
Storage Desc Params:	 	 
	serialization.format	1 

QUERY: select * from t_1m_2_orc_vec limit 10;

ERROR:
Failed with exception java.io.IOException:java.lang.RuntimeException: java.lang.RuntimeException: Failed to load plan: null: java.lang.NullPointerException

Additional information:
input format is set as org.apache.hadoop.hive.ql.io.orc.VectorizedOrcInputFormat 

When I want to read from this table with HCatalog API, I got the following error:
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: Failed to load plan: null: java.lang.NullPointerException
	at org.apache.hadoop.hive.ql.io.orc.VectorizedOrcInputFormat$VectorizedOrcRecordReader.<init>(VectorizedOrcInputFormat.java:76)
	at org.apache.hadoop.hive.ql.io.orc.VectorizedOrcInputFormat.getRecordReader(VectorizedOrcInputFormat.java:156)
	at org.apache.hive.hcatalog.mapreduce.HCatRecordReader.createBaseRecordReader(HCatRecordReader.java:116)
	at org.apache.hive.hcatalog.mapreduce.HCatRecordReader.initialize(HCatRecordReader.java:91)
	at OrcConnector.main(OrcConnector.java:254)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)
Caused by: java.lang.RuntimeException: Failed to load plan: null: java.lang.NullPointerException
	at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:461)
	at org.apache.hadoop.hive.ql.exec.Utilities.getMapWork(Utilities.java:300)
	at org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatchCtx.init(VectorizedRowBatchCtx.java:171)
	at org.apache.hadoop.hive.ql.io.orc.VectorizedOrcInputFormat$VectorizedOrcRecordReader.<init>(VectorizedOrcInputFormat.java:74)
	... 9 more
Caused by: java.lang.NullPointerException
	at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:416)
	... 12 more




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)