You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by Kumar K <se...@gmail.com> on 2014/07/11 16:52:04 UTC
Help Please - Hive query is failing with ArrayIndexOutOfBoundsException
(using Cygwin on Windows + Hive0.11 + hadoop-0.20.2)
Hive query is failing with ArrayIndexOutOfBoundsException, when selecting a
column in a query, say SELECT ID FROM TABLE1
Environment: Hive0.11 + hadoop-0.20.2 + Cygwin on Windows
Execution query and results:
$ bin/hive -e 'SELECT ID FROM MYFI'
Logging initialized using configuration in
jar:file:/C:/cygwin/home/Kumar/hive-0.11.0-bin/lib/hive-common-0.11.0.jar!/hive-log4j.properties
Hive history
file=/tmp/cyg_server/hive_job_log_cyg_server_9284@BLRKEC103526L_201407111642_1460033646.txt
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201407111237_0006, Tracking URL =
http://127.0.0.1:50030/jobdetails.jsp?jobid=job_201407111237_0006
Kill Command = C:\cygwin\home\Kumar\hadoop-0.20.2\\bin\hadoop.cmd job
-kill job_201407111237_0006
Hadoop job information for Stage-1: number of mappers: 1; number of
reducers: 0
2014-07-11 16:42:31,898 Stage-1 map = 0%, reduce = 0%
2014-07-11 16:42:58,923 Stage-1 map = 100%, reduce = 100%
Ended Job = job_201407111237_0006 with errors
Error during job, obtaining debugging information...
Job Tracking URL:
http://127.0.0.1:50030/jobdetails.jsp?jobid=job_201407111237_0006
Examining task ID: task_201407111237_0006_m_000002 (and more) from job
job_201407111237_0006
Task with the most failures(4):
-----
Task ID:
task_201407111237_0006_m_000000
URL:
http://127.0.0.1:50030/taskdetails.jsp?jobid=job_201407111237_0006&tipid=task_201407111237_0006_m_000000
-----
Diagnostic Messages for this Task:
java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: 0
at
org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:230)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:255)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:381)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:374)
at
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:540)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:338)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.ArrayIndexOutOfBoundsException: 0
at java.beans.XMLDecoder.readObject(XMLDecoder.java:250)
at
org.apache.hadoop.hive.ql.exec.Utilities.deserializeMapRedWork(Utilities.java:542)
at
org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:222)
... 7 more
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
MapReduce Jobs Launched:
Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 0 msec
the issue might be related to Cygwin, requesting help to solve this. thank
you.