skewjoin bug in Hive?

[董友良 <as...@sina.com>]

Hi 

 

   We used hive0.7 with Hadoop 0.20.5.  I have a sql like this:

 

set mapred.reduce.tasks=256;       

set hive.groupby.skewindata = true;

set hive.optimize.skewjoin=true;

 

A Long sql here join 2 big table …..

 

I found a error as follow:

 

Ended Job = job_201202080532_94374

java.lang.NullPointerException

        at
org.apache.hadoop.hive.ql.plan.ConditionalResolverSkewJoin.getTasks(Conditio
nalResolverSkewJoin.java:97)

        at
org.apache.hadoop.hive.ql.exec.ConditionalTask.execute(ConditionalTask.java:
81)

        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)

        at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)

        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)

        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)

        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)

        at
org.apache.hadoop.hive.cli.NewCliDriver.processCmd(NewCliDriver.java:166)

        at org.apache.hadoop.hive.cli.NewCliDriver.processLine(NewCliDriver.
java:243)

        at
org.apache.hadoop.hive.cli.NewCliDriver.main(NewCliDriver.java:469)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39
)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:25)

        at java.lang.reflect.Method.invoke(Method.java:597)

        at org.apache.hadoop.util.RunJar.main(RunJar.java:186)

FAILED: Execution Error, return code -101 from
org.apache.hadoop.hive.ql.exec.ConditionalTask

 

How can I do?

 

Leon Dong