You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by suyu xie <su...@hotmail.com> on 2011/06/14 14:41:38 UTC

Hive index exceptions

I created the hive index based on hive-0.7, the stataments are as follows:
 
create index ind_userid_txt on table users(userid)as 'org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler' WITH DEFERRED REBUILD STORED AS RCFile;
ALTER INDEX ind_userid_txt ON users REBUILD;
set hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat;
insert overwrite directory "/tmp/index_result" select '_bucketname','_offset' from default__users_ind_userid_txt__ where userid=1;
set hive.exec.index_file=/tmp/index_result; 
set hive.input.format=org.apache.hadoop.hive.ql.index.io.HiveIndexInputFormat;

select * from users where userid=1; 
 
the exception as follows, pls explain why throw the following exceptions,thanks.
 
11/06/14 10:06:55 INFO exec.MapRedTask: Number of reduce tasks is set to 0 since there's no reduce operator
11/06/14 10:06:55 INFO exec.MapRedTask: Using org.apache.hadoop.hive.ql.index.io.HiveIndexInputFormat
java.lang.RuntimeException: org.apache.hadoop.hive.ql.index.io.HiveIndexInputFormat
at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:548)
at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:123)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:164)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:241)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:456)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
11/06/14 10:06:55 ERROR exec.MapRedTask: Exception: org.apache.hadoop.hive.ql.index.io.HiveIndexInputFormat
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
11/06/14 10:06:55 ERROR ql.Driver: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
hive> isap-00:/home/liren/hive-0.7.0/bin #

Re: Hive index exceptions

Posted by John Sichi <js...@fb.com>.
It's because you have ...index.io.HiveIndexInputFormat instead of ...index.HiveIndexInputFormat.

JVS

On Jun 14, 2011, at 5:41 AM, suyu xie wrote:

> 
> I created the hive index based on hive-0.7, the stataments are as follows:
> 
> create index ind_userid_txt on table users(userid)as 'org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler' WITH DEFERRED REBUILD STORED AS RCFile;
> ALTER INDEX ind_userid_txt ON users REBUILD;
> set hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat;
> insert overwrite directory "/tmp/index_result" select '_bucketname','_offset' from default__users_ind_userid_txt__ where userid=1;
> set hive.exec.index_file=/tmp/index_result; 
> set hive.input.format=org.apache.hadoop.hive.ql.index.io.HiveIndexInputFormat;
> 
> select * from users where userid=1; 
> 
> the exception as follows, pls explain why throw the following exceptions,thanks.
> 
> 11/06/14 10:06:55 INFO exec.MapRedTask: Number of reduce tasks is set to 0 since there's no reduce operator
> 11/06/14 10:06:55 INFO exec.MapRedTask: Using org.apache.hadoop.hive.ql.index.io.HiveIndexInputFormat
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.index.io.HiveIndexInputFormat
> at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:548)
> at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:123)
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
> at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:164)
> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:241)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:456)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> 11/06/14 10:06:55 ERROR exec.MapRedTask: Exception: org.apache.hadoop.hive.ql.index.io.HiveIndexInputFormat
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
> 11/06/14 10:06:55 ERROR ql.Driver: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
> hive> isap-00:/home/liren/hive-0.7.0/bin # 
> 
>