You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Xuefu Zhang (JIRA)" <ji...@apache.org> on 2013/10/04 19:21:42 UTC
[jira] [Updated] (HIVE-5432) self join for a table with serde
definition fails with classNotFoundException, single queries work fine
[ https://issues.apache.org/jira/browse/HIVE-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xuefu Zhang updated HIVE-5432:
------------------------------
Description:
Steps to reproduce
{code}
hive> add jar /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar;
Added /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar to class path
Added resource: /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar
hive> create table if not exists test(a string,b string) ROW FORMAT SERDE 'com.cloudera.hive.serde.JSONSerDe';
OK
Time taken: 0.159 seconds
hive> load data local inpath '/tmp/1' overwrite into table test;
Copying data from file:/tmp/1
Copying file: file:/tmp/1
Loading data to table default.test
Table default.test stats: [num_partitions: 0, num_files: 1, num_rows: 0, total_size: 51, raw_data_size: 0]
OK
Time taken: 0.659 seconds
hive> select a from test;
Total MapReduce jobs = 1
Launching Job 1 out of 1
...
...
hive> select * from (select b from test where a="test")x join (select b from test where a="test1")y on (x.b = y.b);
Total MapReduce jobs = 1
setting HADOOP_USER_NAME hive
Execution log at: /tmp/hive/.log
java.lang.ClassNotFoundException: com.cloudera.hive.serde.JSONSerDe
Continuing ...
2013-10-03 05:13:00 Starting to launch local task to process map join; maximum memory = 1065484288
org.apache.hadoop.hive.ql.metadata.HiveException: Failed with exception nulljava.lang.NullPointerException
at org.apache.hadoop.hive.ql.exec.FetchOperator.getRowInspectorFromTable(FetchOperator.java:230)
at org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:595)
at org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:406)
at org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:290)
at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:682)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
at org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:631)
at org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:406)
at org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:290)
at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:682)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
Execution failed with exit status: 2
Obtaining error information
Task failed!
Task ID:
{code}
was:
Steps to reproduce
hive> add jar /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar;
Added /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar to class path
Added resource: /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar
hive> create table if not exists test(a string,b string) ROW FORMAT SERDE 'com.cloudera.hive.serde.JSONSerDe';
OK
Time taken: 0.159 seconds
hive> load data local inpath '/tmp/1' overwrite into table test;
Copying data from file:/tmp/1
Copying file: file:/tmp/1
Loading data to table default.test
Table default.test stats: [num_partitions: 0, num_files: 1, num_rows: 0, total_size: 51, raw_data_size: 0]
OK
Time taken: 0.659 seconds
hive> select a from test;
Total MapReduce jobs = 1
Launching Job 1 out of 1
...
...
hive> select * from (select b from test where a="test")x join (select b from test where a="test1")y on (x.b = y.b);
Total MapReduce jobs = 1
setting HADOOP_USER_NAME hive
Execution log at: /tmp/hive/.log
java.lang.ClassNotFoundException: com.cloudera.hive.serde.JSONSerDe
Continuing ...
2013-10-03 05:13:00 Starting to launch local task to process map join; maximum memory = 1065484288
org.apache.hadoop.hive.ql.metadata.HiveException: Failed with exception nulljava.lang.NullPointerException
at org.apache.hadoop.hive.ql.exec.FetchOperator.getRowInspectorFromTable(FetchOperator.java:230)
at org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:595)
at org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:406)
at org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:290)
at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:682)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
at org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:631)
at org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:406)
at org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:290)
at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:682)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
Execution failed with exit status: 2
Obtaining error information
Task failed!
Task ID:
> self join for a table with serde definition fails with classNotFoundException, single queries work fine
> -------------------------------------------------------------------------------------------------------
>
> Key: HIVE-5432
> URL: https://issues.apache.org/jira/browse/HIVE-5432
> Project: Hive
> Issue Type: Bug
> Components: CLI
> Affects Versions: 0.11.0
> Environment: rhel6.4
> Reporter: Nitin Pawar
>
> Steps to reproduce
> {code}
> hive> add jar /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar;
> Added /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar to class path
> Added resource: /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar
> hive> create table if not exists test(a string,b string) ROW FORMAT SERDE 'com.cloudera.hive.serde.JSONSerDe';
> OK
> Time taken: 0.159 seconds
> hive> load data local inpath '/tmp/1' overwrite into table test;
> Copying data from file:/tmp/1
> Copying file: file:/tmp/1
> Loading data to table default.test
> Table default.test stats: [num_partitions: 0, num_files: 1, num_rows: 0, total_size: 51, raw_data_size: 0]
> OK
> Time taken: 0.659 seconds
> hive> select a from test;
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> ...
> ...
> hive> select * from (select b from test where a="test")x join (select b from test where a="test1")y on (x.b = y.b);
> Total MapReduce jobs = 1
> setting HADOOP_USER_NAME hive
> Execution log at: /tmp/hive/.log
> java.lang.ClassNotFoundException: com.cloudera.hive.serde.JSONSerDe
> Continuing ...
> 2013-10-03 05:13:00 Starting to launch local task to process map join; maximum memory = 1065484288
> org.apache.hadoop.hive.ql.metadata.HiveException: Failed with exception nulljava.lang.NullPointerException
> at org.apache.hadoop.hive.ql.exec.FetchOperator.getRowInspectorFromTable(FetchOperator.java:230)
> at org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:595)
> at org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:406)
> at org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:290)
> at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:682)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
> at org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:631)
> at org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:406)
> at org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:290)
> at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:682)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
> Execution failed with exit status: 2
> Obtaining error information
> Task failed!
> Task ID:
> {code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)