You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Bing Li <sm...@gmail.com> on 2012/01/17 13:32:31 UTC
scripe_pipe.q (TestCliDriver) FAILED in open JDK
Hi, Devs
When I ran UT of *hive-0.8.0*, script_pipe.q failed as:
[junit] Running org.apache.hadoop.hive.cli.TestCliDriver
[junit] Begin query: *script_pipe.q*
[junit] *java.io.IOException: No such file or directory*
[junit] at java.io.FileOutputStream.writeBytes(Native Method)
[junit] at java.io.FileOutputStream.write(FileOutputStream.java:293)
[junit] at
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:76)
[junit] at
java.io.BufferedOutputStream.flush(BufferedOutputStream.java:134)
[junit] at
java.io.BufferedOutputStream.flush(BufferedOutputStream.java:135)
[junit] at java.io.DataOutputStream.flush(DataOutputStream.java:117)
[junit] * at
org.apache.hadoop.hive.ql.exec.TextRecordWriter.close(TextRecordWriter.java:48)
*
[junit] * at
org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:365)
*
[junit] at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
[junit] at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
[junit] at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
[junit] at
org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303)
[junit] at
org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473)
[junit] at
org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
[junit] at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
[junit]* org.apache.hadoop.hive.ql.metadata.HiveException: Hit error
while closing ..*
[junit] at
org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:452)
[junit] at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
[junit] at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
[junit] at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
[junit] at
org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303)
[junit] at
org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473)
[junit] at
org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
[junit] at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
[junit] org.apache.hadoop.hive.ql.metadata.HiveException: Hit error
while closing ..
[junit] at
org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:452)
[junit] at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
[junit] at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
[junit] at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
[junit] at
org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303)
[junit] at
org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473)
[junit] at
org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
[junit] at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
[junit] org.apache.hadoop.hive.ql.metadata.HiveException: Hit error
while closing ..
[junit] at
org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:452)
[junit] at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
[junit] at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
[junit] at
org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
[junit] at
org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303)
[junit] at
org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473)
[junit] at
org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
[junit] at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
[junit] Ended Job = job_local_0001 with errors
[junit] Error during job, obtaining debugging information...
[junit] Exception: Client Execution failed with error code = 9
[junit] See build/ql/tmp/hive.log, or try "ant test ...
-Dtest.silent=false" to get more logs.
[junit] junit.framework.AssertionFailedError: Client Execution failed
with error code = 9
[junit] See build/ql/tmp/hive.log, or try "ant test ...
-Dtest.silent=false" to get more logs.
[junit] at junit.framework.Assert.fail(Assert.java:50)
[junit] at
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_script_pipe(TestCliDriver.java:109)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
[junit] at java.lang.reflect.Method.invoke(Method.java:611)
[junit] at junit.framework.TestCase.runTest(TestCase.java:168)
[junit] at junit.framework.TestCase.runBare(TestCase.java:134)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
[junit] at
junit.framework.TestResult.runProtected(TestResult.java:128)
[junit] at junit.framework.TestResult.run(TestResult.java:113)
[junit] at junit.framework.TestCase.run(TestCase.java:124)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
[junit] at junit.framework.TestSuite.run(TestSuite.java:238)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
[junit] Cleaning up TestCliDriver
[junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 13.701 sec
[junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
[for] /home/libing/Round-6/ibm-hive-0.8.0/ql/build.xml: The following
error occurred while executing this line:
[for] /home/libing/Round-6/ibm-hive-0.8.0/build.xml:317: The
following error occurred while executing this line:
[for] /home/libing/Round-6/ibm-hive-0.8.0/build-common.xml:406: Tests
failed!
In *script_pipe.q.out*,
PREHOOK: query: SELECT TRANSFORM(*) USING 'true' AS a, b, c FROM (SELECT *
FROM src LIMIT 1) tmp
PREHOOK: type: QUERY
PREHOOK: Input: default@src
PREHOOK: Output:
file:/tmp/libing/hive_2012-01-17_04-13-08_823_8673422141513900730/-mr-10000
Execution failed with exit status: 2
Obtaining error information
Task failed!
Task ID:
Stage-1
Logs:
/home/libing/workspace-RTC/ibm-hive-0.8.0/build/ql/tmp//hive.log
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
*Do you have some ideas on this? *
Thanks
-- Bing
Re: scripe_pipe.q (TestCliDriver) FAILED in open JDK
Posted by Bing Li <sm...@gmail.com>.
Updated
==========
If there are *TWO columns* in table *src*, which are key and value:
SELECT TRANSFORM(*key, value*) USING 'head -n 1' as a,b,c,d FROM src; // *
PASS*
SELECT TRANSFORM(*key, value, key, value*) USING 'head -n 1' as a,b,c,d
FROM src; //* FAILED*
2012/1/17 Bing Li <sm...@gmail.com>
> Hi, Devs
> When I ran UT of *hive-0.8.0*, script_pipe.q failed as:
>
> [junit] Running org.apache.hadoop.hive.cli.TestCliDriver
> [junit] Begin query: *script_pipe.q*
> [junit] *java.io.IOException: No such file or directory*
> [junit] at java.io.FileOutputStream.writeBytes(Native Method)
> [junit] at
> java.io.FileOutputStream.write(FileOutputStream.java:293)
> [junit] at
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:76)
> [junit] at
> java.io.BufferedOutputStream.flush(BufferedOutputStream.java:134)
> [junit] at
> java.io.BufferedOutputStream.flush(BufferedOutputStream.java:135)
> [junit] at
> java.io.DataOutputStream.flush(DataOutputStream.java:117)
> [junit] * at
> org.apache.hadoop.hive.ql.exec.TextRecordWriter.close(TextRecordWriter.java:48)
> *
> [junit] * at
> org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:365)
> *
> [junit] at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> [junit] at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> [junit] at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> [junit] at
> org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303)
> [junit] at
> org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473)
> [junit] at
> org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> [junit] at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
> [junit]* org.apache.hadoop.hive.ql.metadata.HiveException: Hit error
> while closing ..*
> [junit] at
> org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:452)
> [junit] at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> [junit] at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> [junit] at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> [junit] at
> org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303)
> [junit] at
> org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473)
> [junit] at
> org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> [junit] at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
> [junit] org.apache.hadoop.hive.ql.metadata.HiveException: Hit error
> while closing ..
> [junit] at
> org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:452)
> [junit] at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> [junit] at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> [junit] at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> [junit] at
> org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303)
> [junit] at
> org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473)
> [junit] at
> org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> [junit] at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
> [junit] org.apache.hadoop.hive.ql.metadata.HiveException: Hit error
> while closing ..
> [junit] at
> org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:452)
> [junit] at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> [junit] at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> [junit] at
> org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566)
> [junit] at
> org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303)
> [junit] at
> org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473)
> [junit] at
> org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> [junit] at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
> [junit] Ended Job = job_local_0001 with errors
> [junit] Error during job, obtaining debugging information...
> [junit] Exception: Client Execution failed with error code = 9
> [junit] See build/ql/tmp/hive.log, or try "ant test ...
> -Dtest.silent=false" to get more logs.
> [junit] junit.framework.AssertionFailedError: Client Execution failed
> with error code = 9
> [junit] See build/ql/tmp/hive.log, or try "ant test ...
> -Dtest.silent=false" to get more logs.
> [junit] at junit.framework.Assert.fail(Assert.java:50)
> [junit] at
> org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_script_pipe(TestCliDriver.java:109)
> [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> [junit] at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
> [junit] at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
> [junit] at java.lang.reflect.Method.invoke(Method.java:611)
> [junit] at junit.framework.TestCase.runTest(TestCase.java:168)
> [junit] at junit.framework.TestCase.runBare(TestCase.java:134)
> [junit] at
> junit.framework.TestResult$1.protect(TestResult.java:110)
> [junit] at
> junit.framework.TestResult.runProtected(TestResult.java:128)
> [junit] at junit.framework.TestResult.run(TestResult.java:113)
> [junit] at junit.framework.TestCase.run(TestCase.java:124)
> [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
> [junit] at junit.framework.TestSuite.run(TestSuite.java:238)
> [junit] at
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
> [junit] at
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
> [junit] at
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
> [junit] Cleaning up TestCliDriver
> [junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 13.701 sec
> [junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
> [for] /home/libing/Round-6/ibm-hive-0.8.0/ql/build.xml: The
> following error occurred while executing this line:
> [for] /home/libing/Round-6/ibm-hive-0.8.0/build.xml:317: The
> following error occurred while executing this line:
> [for] /home/libing/Round-6/ibm-hive-0.8.0/build-common.xml:406:
> Tests failed!
>
> In *script_pipe.q.out*,
>
> PREHOOK: query: SELECT TRANSFORM(*) USING 'true' AS a, b, c FROM (SELECT *
> FROM src LIMIT 1) tmp
> PREHOOK: type: QUERY
> PREHOOK: Input: default@src
> PREHOOK: Output:
> file:/tmp/libing/hive_2012-01-17_04-13-08_823_8673422141513900730/-mr-10000
> Execution failed with exit status: 2
> Obtaining error information
>
> Task failed!
> Task ID:
> Stage-1
>
> Logs:
>
> /home/libing/workspace-RTC/ibm-hive-0.8.0/build/ql/tmp//hive.log
> FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.MapRedTask
>
>
> *Do you have some ideas on this? *
>
>
> Thanks
> -- Bing
>