You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by Amir Sanjar <v1...@us.ibm.com> on 2013/07/31 04:08:14 UTC
Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Hi all ,
My team is new to Oozie. We have successfully build Oozie 3.3.2 with
hadoop 2.0.4-alpha by modifying multiple pom.xml to add hadoop 2.0.4-alpha.
We also used command "mvn clean package -Dhadoop.version=2.0.4-alpha" for
build.
However multiple unit testcases, as listed below, are failing. Are these
known issues? Does Oozie 3.3.2 support hadoop 2.x?
any help would be greatly appreciated..
Running org.apache.oozie.action.hadoop.TestHiveActionExecutor
Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.861 sec
<<< FAILURE!
Running org.apache.oozie.command.wf.TestActionCheckXCommand
Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.282 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestLauncher
Tests run: 10, Failures: 7, Errors: 0, Skipped: 0, Time elapsed: 60.42 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestMapReduceActionError
Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.757 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestDistCpActionExecutor
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 8.055 sec
<<< FAILURE!
Running org.apache.oozie.service.TestRecoveryService
Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 46.539 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestJavaActionExecutor
Tests run: 25, Failures: 9, Errors: 0, Skipped: 0, Time elapsed: 156.315
sec <<< FAILURE!
Running org.apache.oozie.command.wf.TestActionStartXCommand
Tests run: 6, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 24.878 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestShellActionExecutor
Tests run: 6, Failures: 3, Errors: 1, Skipped: 0, Time elapsed: 34.981 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestMapReduceActionExecutor
Tests run: 12, Failures: 6, Errors: 0, Skipped: 0, Time elapsed: 59.235 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestRerun
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 121.987 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestHiveMain
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 37.348 sec
<<< FAILURE!
Results :
Failed tests: testHiveAction
(org.apache.oozie.action.hadoop.TestHiveActionExecutor)
testActionCheck(org.apache.oozie.command.wf.TestActionCheckXCommand)
testOutput(org.apache.oozie.action.hadoop.TestLauncher)
testExit0(org.apache.oozie.action.hadoop.TestLauncher)
testExit1(org.apache.oozie.action.hadoop.TestLauncher)
testEmpty(org.apache.oozie.action.hadoop.TestLauncher)
testException(org.apache.oozie.action.hadoop.TestLauncher)
testNewId(org.apache.oozie.action.hadoop.TestLauncher)
testSecurityManager(org.apache.oozie.action.hadoop.TestLauncher)
testDistCpFile(org.apache.oozie.action.hadoop.TestDistCpActionExecutor)
testWorkflowActionRecoveryUserRetry
(org.apache.oozie.service.TestRecoveryService)
testOutputSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testRecovery(org.apache.oozie.action.hadoop.TestJavaActionExecutor):
expected:<...ob_1375223658833_002[0]> but was:<...ob_1375223658833_002[1]>
testAdditionalJarSubmitOK
(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testSimpestSleSubmitOK
(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testIdSwapSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testExit0SubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testExit1SubmitError
(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testExceptionSubmitError
(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testPrepare(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testActionWithEscapedStringAndCDATA
(org.apache.oozie.command.wf.TestActionStartXCommand)
testActionStart(org.apache.oozie.command.wf.TestActionStartXCommand)
testShellScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
testShellScriptError
(org.apache.oozie.action.hadoop.TestShellActionExecutor)
testPerlScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
testSetExecutionStats_when_user_has_specified_stats_write_TRUE
(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testSetExecutionStats_when_user_has_specified_stats_write_FALSE
(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testMapReduceWithCredentials
(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testStreaming(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testSetMapredJobName
(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testRerun(org.apache.oozie.action.hadoop.TestRerun): expected:<SUCCEEDED>
but was:<KILLED>
testMain(org.apache.oozie.action.hadoop.TestHiveMain)
Tests in error:
testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionError)
testEnvVar(org.apache.oozie.action.hadoop.TestShellActionExecutor): str
cannot be null
Tests run: 929, Failures: 33, Errors: 2, Skipped: 0
Best Regards
Amir Sanjar
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Posted by Amir Sanjar <v1...@us.ibm.com>.
sorry mona, I need more coffee :) correct, I meant to say it "does not".
Files with issue:
core/src/test/java/org/apache/oozie/test/MiniHCatServer.java (does not
exist in Oozie 3.3.2)
core/src/test/java/org/apache/oozie/command/coord/TestCoordPushDependencyCheckXCommand.java
(does not exist in Oozie 3.3.2)
core/src/test/java/org/apache/oozie/action/hadoop/TestJavaActionExecutor.java
( error )
Best Regards
Amir Sanjar
System Management Architect
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
From: Mona Chitnis <ch...@yahoo-inc.com>
To: "dev@oozie.apache.org" <de...@oozie.apache.org>,
Date: 08/01/2013 11:53 AM
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Did you say it does "not" apply cleanly on top of 3.3.2? Can you paste here
the file names that had merge problems?
From: Amir Sanjar <v1...@us.ibm.com>>
Reply-To: "dev@oozie.apache.org<ma...@oozie.apache.org>"
<de...@oozie.apache.org>>
Date: Thursday, August 1, 2013 6:53 AM
To: "dev@oozie.apache.org<ma...@oozie.apache.org>"
<de...@oozie.apache.org>>
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Hi Mona,
Thank you in advance for your help; two question:
1) are there any prerequisite JIRAs to
https://issues.apache.org/jira/browse/OOZIE-1374 ? It does apply cleanly on
top of
Oozie 3.3.2, missing files.
2) When Oozie 4.0 will become available?
Best Regards
Amir Sanjar
System Management Architect
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
[Inactive hide details for Mona Chitnis ---07/31/2013 12:44:10 PM---Yes you
should be able to. From: Amir Sanjar <v1sanjar@us.ib]Mona Chitnis
---07/31/2013 12:44:10 PM---Yes you should be able to. From: Amir Sanjar
<v1...@us.ibm.com><mailto:v1sanjar@us.ibm.com
>>
From: Mona Chitnis <ch...@yahoo-inc.com>>
To: "dev@oozie.apache.org<ma...@oozie.apache.org>"
<de...@oozie.apache.org>>,
Date: 07/31/2013 12:44 PM
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
________________________________
Yes you should be able to.
From: Amir Sanjar <v1...@us.ibm.com><
mailto:v1sanjar@us.ibm.com>>
Reply-To: "dev@oozie.apache.org<ma...@oozie.apache.org><
mailto:dev@oozie.apache.org>" <dev@oozie.apache.org<
mailto:dev@oozie.apache.org><ma...@oozie.apache.org>>
Date: Wednesday, July 31, 2013 10:31 AM
To: "dev@oozie.apache.org<ma...@oozie.apache.org><
mailto:dev@oozie.apache.org>" <dev@oozie.apache.org<
mailto:dev@oozie.apache.org><ma...@oozie.apache.org>>
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
thanks mona,
Could we apply the patch on top of Oozie 3.3.2 source code?
Best Regards
Amir Sanjar
System Management Architect
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
[Inactive hide details for Mona Chitnis ---07/31/2013 12:06:24 PM---The
unit tests which involve launching a child M-R job, whic]Mona Chitnis
---07/31/2013 12:06:24 PM---The unit tests which involve launching a child
M-R job, which include exactly the ones you've enlist
From: Mona Chitnis <ch...@yahoo-inc.com><
mailto:chitnis@yahoo-inc.com>>
To: "dev@oozie.apache.org<ma...@oozie.apache.org><
mailto:dev@oozie.apache.org>" <dev@oozie.apache.org<
mailto:dev@oozie.apache.org><ma...@oozie.apache.org>>,
Date: 07/31/2013 12:06 PM
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
________________________________
The unit tests which involve launching a child M-R job, which include
exactly the ones you've enlisted, will fail with Hadoop-2.x if using a
version older than 4.0
See JIRA https://issues.apache.org/jira/browse/OOZIE-1374
We will be releasing Oozie-4.0 shortly.
--
Mona
On 7/31/13 9:39 AM, "Amir Sanjar" <v1sanjar@us.ibm.com<
mailto:v1sanjar@us.ibm.com><ma...@us.ibm.com>> wrote:
>
>
>
>Hi Mohammad,
>Thanks for the reply, we made changes in four pom.xml files listed below.
>Basically, we replaced all references to hadoop-2.0.2-alpha with
>hadoop-2.0.4-alpha
> hadooplibs/hadoop-test-2/pom.xml
> hadooplibs/hadoop-2/pom.xml
> hadooplibs/hadoop-distcp-2/pom.xml
> pom.xml
>
>
>
>Best Regards
>Amir Sanjar
>
>
>PowerLinux Hadoop projects development lead
>IBM Senior Software Engineer
>Phone# 512-286-8393
>Fax# 512-838-8858
>
>-----Mohammad Islam <mi...@yahoo.com><
mailto:mislam77@yahoo.com>> wrote: -----
>To: "dev@oozie.apache.org<ma...@oozie.apache.org><
mailto:dev@oozie.apache.org>" <dev@oozie.apache.org<
mailto:dev@oozie.apache.org><ma...@oozie.apache.org>>
>From: Mohammad Islam <mi...@yahoo.com><
mailto:mislam77@yahoo.com>>
>Date: 07/31/2013 03:06AM
>Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
>
>Hi Amir,
>What pom file changes have you made?
>
>Regards,
>Mohammad
>
>
>
>
>
>________________________________
> From: Amir Sanjar <v1...@us.ibm.com><
mailto:v1sanjar@us.ibm.com>>
>To: dev@oozie.apache.org<ma...@oozie.apache.org><
mailto:dev@oozie.apache.org>
>Sent: Tuesday, July 30, 2013 7:08 PM
>Subject: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
>
>
>
>
>
>
>Hi all ,
>My team is new to Oozie. We have successfully build Oozie 3.3.2 with
>hadoop 2.0.4-alpha by modifying multiple pom.xml to add hadoop
>2.0.4-alpha.
>We also used command "mvn clean package -Dhadoop.version=2.0.4-alpha" for
>build.
>However multiple unit testcases, as listed below, are failing. Are these
>known issues? Does Oozie 3.3.2 support hadoop 2.x?
>any help would be greatly appreciated..
>
>Running org.apache.oozie.action.hadoop.TestHiveActionExecutor
>Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.861 sec
><<< FAILURE!
>Running org.apache.oozie.command.wf.TestActionCheckXCommand
>Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.282 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestLauncher
>Tests run: 10, Failures: 7, Errors: 0, Skipped: 0, Time elapsed: 60.42 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestMapReduceActionError
>Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.757 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestDistCpActionExecutor
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 8.055 sec
><<< FAILURE!
>Running org.apache.oozie.service.TestRecoveryService
>Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 46.539 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestJavaActionExecutor
>Tests run: 25, Failures: 9, Errors: 0, Skipped: 0, Time elapsed: 156.315
>sec <<< FAILURE!
>Running org.apache.oozie.command.wf.TestActionStartXCommand
>Tests run: 6, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 24.878 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestShellActionExecutor
>Tests run: 6, Failures: 3, Errors: 1, Skipped: 0, Time elapsed: 34.981 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestMapReduceActionExecutor
>Tests run: 12, Failures: 6, Errors: 0, Skipped: 0, Time elapsed: 59.235
>sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestRerun
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 121.987
>sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestHiveMain
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 37.348 sec
><<< FAILURE!
>
>Results :
>
>Failed tests: testHiveAction
>(org.apache.oozie.action.hadoop.TestHiveActionExecutor)
> testActionCheck(org.apache.oozie.command.wf.TestActionCheckXCommand)
> testOutput(org.apache.oozie.action.hadoop.TestLauncher)
> testExit0(org.apache.oozie.action.hadoop.TestLauncher)
> testExit1(org.apache.oozie.action.hadoop.TestLauncher)
> testEmpty(org.apache.oozie.action.hadoop.TestLauncher)
> testException(org.apache.oozie.action.hadoop.TestLauncher)
> testNewId(org.apache.oozie.action.hadoop.TestLauncher)
> testSecurityManager(org.apache.oozie.action.hadoop.TestLauncher)
> testDistCpFile(org.apache.oozie.action.hadoop.TestDistCpActionExecutor)
> testWorkflowActionRecoveryUserRetry
>(org.apache.oozie.service.TestRecoveryService)
>
>testOutputSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testRecovery(org.apache.oozie.action.hadoop.TestJavaActionExecutor):
>expected:<...ob_1375223658833_002[0]> but was:<...ob_1375223658833_002[1]>
> testAdditionalJarSubmitOK
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testSimpestSleSubmitOK
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
>
>testIdSwapSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExit0SubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExit1SubmitError
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExceptionSubmitError
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testPrepare(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testActionWithEscapedStringAndCDATA
>(org.apache.oozie.command.wf.TestActionStartXCommand)
> testActionStart(org.apache.oozie.command.wf.TestActionStartXCommand)
> testShellScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testShellScriptError
>(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testPerlScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testSetExecutionStats_when_user_has_specified_stats_write_TRUE
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testSetExecutionStats_when_user_has_specified_stats_write_FALSE
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
>
>testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testMapReduceWithCredentials
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
>
>testStreaming(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testSetMapredJobName
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testRerun(org.apache.oozie.action.hadoop.TestRerun):
>expected:<SUCCEEDED>
>but was:<KILLED>
> testMain(org.apache.oozie.action.hadoop.TestHiveMain)
>
>Tests in error:
> testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionError)
> testEnvVar(org.apache.oozie.action.hadoop.TestShellActionExecutor): str
>cannot be null
>
>Tests run: 929, Failures: 33, Errors: 2, Skipped: 0
>
>
>Best Regards
>Amir Sanjar
>
>
>PowerLinux Open Source Hadoop development lead
>IBM Senior Software Engineer
>Phone# 512-286-8393
>Fax# 512-838-8858
Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Posted by Mona Chitnis <ch...@yahoo-inc.com>.
Did you say it does "not" apply cleanly on top of 3.3.2? Can you paste here the file names that had merge problems?
From: Amir Sanjar <v1...@us.ibm.com>>
Reply-To: "dev@oozie.apache.org<ma...@oozie.apache.org>" <de...@oozie.apache.org>>
Date: Thursday, August 1, 2013 6:53 AM
To: "dev@oozie.apache.org<ma...@oozie.apache.org>" <de...@oozie.apache.org>>
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Hi Mona,
Thank you in advance for your help; two question:
1) are there any prerequisite JIRAs to https://issues.apache.org/jira/browse/OOZIE-1374 ? It does apply cleanly on top of
Oozie 3.3.2, missing files.
2) When Oozie 4.0 will become available?
Best Regards
Amir Sanjar
System Management Architect
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
[Inactive hide details for Mona Chitnis ---07/31/2013 12:44:10 PM---Yes you should be able to. From: Amir Sanjar <v1sanjar@us.ib]Mona Chitnis ---07/31/2013 12:44:10 PM---Yes you should be able to. From: Amir Sanjar <v1...@us.ibm.com>>
From: Mona Chitnis <ch...@yahoo-inc.com>>
To: "dev@oozie.apache.org<ma...@oozie.apache.org>" <de...@oozie.apache.org>>,
Date: 07/31/2013 12:44 PM
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
________________________________
Yes you should be able to.
From: Amir Sanjar <v1...@us.ibm.com>>
Reply-To: "dev@oozie.apache.org<ma...@oozie.apache.org>" <de...@oozie.apache.org>>
Date: Wednesday, July 31, 2013 10:31 AM
To: "dev@oozie.apache.org<ma...@oozie.apache.org>" <de...@oozie.apache.org>>
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
thanks mona,
Could we apply the patch on top of Oozie 3.3.2 source code?
Best Regards
Amir Sanjar
System Management Architect
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
[Inactive hide details for Mona Chitnis ---07/31/2013 12:06:24 PM---The unit tests which involve launching a child M-R job, whic]Mona Chitnis ---07/31/2013 12:06:24 PM---The unit tests which involve launching a child M-R job, which include exactly the ones you've enlist
From: Mona Chitnis <ch...@yahoo-inc.com>>
To: "dev@oozie.apache.org<ma...@oozie.apache.org>" <de...@oozie.apache.org>>,
Date: 07/31/2013 12:06 PM
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
________________________________
The unit tests which involve launching a child M-R job, which include
exactly the ones you've enlisted, will fail with Hadoop-2.x if using a
version older than 4.0
See JIRA https://issues.apache.org/jira/browse/OOZIE-1374
We will be releasing Oozie-4.0 shortly.
--
Mona
On 7/31/13 9:39 AM, "Amir Sanjar" <v1...@us.ibm.com>> wrote:
>
>
>
>Hi Mohammad,
>Thanks for the reply, we made changes in four pom.xml files listed below.
>Basically, we replaced all references to hadoop-2.0.2-alpha with
>hadoop-2.0.4-alpha
> hadooplibs/hadoop-test-2/pom.xml
> hadooplibs/hadoop-2/pom.xml
> hadooplibs/hadoop-distcp-2/pom.xml
> pom.xml
>
>
>
>Best Regards
>Amir Sanjar
>
>
>PowerLinux Hadoop projects development lead
>IBM Senior Software Engineer
>Phone# 512-286-8393
>Fax# 512-838-8858
>
>-----Mohammad Islam <mi...@yahoo.com>> wrote: -----
>To: "dev@oozie.apache.org<ma...@oozie.apache.org>" <de...@oozie.apache.org>>
>From: Mohammad Islam <mi...@yahoo.com>>
>Date: 07/31/2013 03:06AM
>Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
>
>Hi Amir,
>What pom file changes have you made?
>
>Regards,
>Mohammad
>
>
>
>
>
>________________________________
> From: Amir Sanjar <v1...@us.ibm.com>>
>To: dev@oozie.apache.org<ma...@oozie.apache.org>
>Sent: Tuesday, July 30, 2013 7:08 PM
>Subject: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
>
>
>
>
>
>
>Hi all ,
>My team is new to Oozie. We have successfully build Oozie 3.3.2 with
>hadoop 2.0.4-alpha by modifying multiple pom.xml to add hadoop
>2.0.4-alpha.
>We also used command "mvn clean package -Dhadoop.version=2.0.4-alpha" for
>build.
>However multiple unit testcases, as listed below, are failing. Are these
>known issues? Does Oozie 3.3.2 support hadoop 2.x?
>any help would be greatly appreciated..
>
>Running org.apache.oozie.action.hadoop.TestHiveActionExecutor
>Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.861 sec
><<< FAILURE!
>Running org.apache.oozie.command.wf.TestActionCheckXCommand
>Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.282 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestLauncher
>Tests run: 10, Failures: 7, Errors: 0, Skipped: 0, Time elapsed: 60.42 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestMapReduceActionError
>Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.757 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestDistCpActionExecutor
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 8.055 sec
><<< FAILURE!
>Running org.apache.oozie.service.TestRecoveryService
>Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 46.539 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestJavaActionExecutor
>Tests run: 25, Failures: 9, Errors: 0, Skipped: 0, Time elapsed: 156.315
>sec <<< FAILURE!
>Running org.apache.oozie.command.wf.TestActionStartXCommand
>Tests run: 6, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 24.878 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestShellActionExecutor
>Tests run: 6, Failures: 3, Errors: 1, Skipped: 0, Time elapsed: 34.981 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestMapReduceActionExecutor
>Tests run: 12, Failures: 6, Errors: 0, Skipped: 0, Time elapsed: 59.235
>sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestRerun
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 121.987
>sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestHiveMain
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 37.348 sec
><<< FAILURE!
>
>Results :
>
>Failed tests: testHiveAction
>(org.apache.oozie.action.hadoop.TestHiveActionExecutor)
> testActionCheck(org.apache.oozie.command.wf.TestActionCheckXCommand)
> testOutput(org.apache.oozie.action.hadoop.TestLauncher)
> testExit0(org.apache.oozie.action.hadoop.TestLauncher)
> testExit1(org.apache.oozie.action.hadoop.TestLauncher)
> testEmpty(org.apache.oozie.action.hadoop.TestLauncher)
> testException(org.apache.oozie.action.hadoop.TestLauncher)
> testNewId(org.apache.oozie.action.hadoop.TestLauncher)
> testSecurityManager(org.apache.oozie.action.hadoop.TestLauncher)
> testDistCpFile(org.apache.oozie.action.hadoop.TestDistCpActionExecutor)
> testWorkflowActionRecoveryUserRetry
>(org.apache.oozie.service.TestRecoveryService)
>
>testOutputSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testRecovery(org.apache.oozie.action.hadoop.TestJavaActionExecutor):
>expected:<...ob_1375223658833_002[0]> but was:<...ob_1375223658833_002[1]>
> testAdditionalJarSubmitOK
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testSimpestSleSubmitOK
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
>
>testIdSwapSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExit0SubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExit1SubmitError
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExceptionSubmitError
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testPrepare(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testActionWithEscapedStringAndCDATA
>(org.apache.oozie.command.wf.TestActionStartXCommand)
> testActionStart(org.apache.oozie.command.wf.TestActionStartXCommand)
> testShellScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testShellScriptError
>(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testPerlScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testSetExecutionStats_when_user_has_specified_stats_write_TRUE
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testSetExecutionStats_when_user_has_specified_stats_write_FALSE
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
>
>testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testMapReduceWithCredentials
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
>
>testStreaming(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testSetMapredJobName
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testRerun(org.apache.oozie.action.hadoop.TestRerun):
>expected:<SUCCEEDED>
>but was:<KILLED>
> testMain(org.apache.oozie.action.hadoop.TestHiveMain)
>
>Tests in error:
> testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionError)
> testEnvVar(org.apache.oozie.action.hadoop.TestShellActionExecutor): str
>cannot be null
>
>Tests run: 929, Failures: 33, Errors: 2, Skipped: 0
>
>
>Best Regards
>Amir Sanjar
>
>
>PowerLinux Open Source Hadoop development lead
>IBM Senior Software Engineer
>Phone# 512-286-8393
>Fax# 512-838-8858
Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Posted by Amir Sanjar <v1...@us.ibm.com>.
Hi Mona,
Thank you in advance for your help; two question:
1) are there any prerequisite JIRAs to
https://issues.apache.org/jira/browse/OOZIE-1374 ? It does apply cleanly on
top of
Oozie 3.3.2, missing files.
2) When Oozie 4.0 will become available?
Best Regards
Amir Sanjar
System Management Architect
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
From: Mona Chitnis <ch...@yahoo-inc.com>
To: "dev@oozie.apache.org" <de...@oozie.apache.org>,
Date: 07/31/2013 12:44 PM
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Yes you should be able to.
From: Amir Sanjar <v1...@us.ibm.com>>
Reply-To: "dev@oozie.apache.org<ma...@oozie.apache.org>"
<de...@oozie.apache.org>>
Date: Wednesday, July 31, 2013 10:31 AM
To: "dev@oozie.apache.org<ma...@oozie.apache.org>"
<de...@oozie.apache.org>>
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
thanks mona,
Could we apply the patch on top of Oozie 3.3.2 source code?
Best Regards
Amir Sanjar
System Management Architect
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
[Inactive hide details for Mona Chitnis ---07/31/2013 12:06:24 PM---The
unit tests which involve launching a child M-R job, whic]Mona Chitnis
---07/31/2013 12:06:24 PM---The unit tests which involve launching a child
M-R job, which include exactly the ones you've enlist
From: Mona Chitnis <ch...@yahoo-inc.com>>
To: "dev@oozie.apache.org<ma...@oozie.apache.org>"
<de...@oozie.apache.org>>,
Date: 07/31/2013 12:06 PM
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
________________________________
The unit tests which involve launching a child M-R job, which include
exactly the ones you've enlisted, will fail with Hadoop-2.x if using a
version older than 4.0
See JIRA https://issues.apache.org/jira/browse/OOZIE-1374
We will be releasing Oozie-4.0 shortly.
--
Mona
On 7/31/13 9:39 AM, "Amir Sanjar" <v1sanjar@us.ibm.com<
mailto:v1sanjar@us.ibm.com>> wrote:
>
>
>
>Hi Mohammad,
>Thanks for the reply, we made changes in four pom.xml files listed below.
>Basically, we replaced all references to hadoop-2.0.2-alpha with
>hadoop-2.0.4-alpha
> hadooplibs/hadoop-test-2/pom.xml
> hadooplibs/hadoop-2/pom.xml
> hadooplibs/hadoop-distcp-2/pom.xml
> pom.xml
>
>
>
>Best Regards
>Amir Sanjar
>
>
>PowerLinux Hadoop projects development lead
>IBM Senior Software Engineer
>Phone# 512-286-8393
>Fax# 512-838-8858
>
>-----Mohammad Islam <mi...@yahoo.com>> wrote:
-----
>To: "dev@oozie.apache.org<ma...@oozie.apache.org>"
<de...@oozie.apache.org>>
>From: Mohammad Islam <mi...@yahoo.com>>
>Date: 07/31/2013 03:06AM
>Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
>
>Hi Amir,
>What pom file changes have you made?
>
>Regards,
>Mohammad
>
>
>
>
>
>________________________________
> From: Amir Sanjar <v1...@us.ibm.com>>
>To: dev@oozie.apache.org<ma...@oozie.apache.org>
>Sent: Tuesday, July 30, 2013 7:08 PM
>Subject: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
>
>
>
>
>
>
>Hi all ,
>My team is new to Oozie. We have successfully build Oozie 3.3.2 with
>hadoop 2.0.4-alpha by modifying multiple pom.xml to add hadoop
>2.0.4-alpha.
>We also used command "mvn clean package -Dhadoop.version=2.0.4-alpha" for
>build.
>However multiple unit testcases, as listed below, are failing. Are these
>known issues? Does Oozie 3.3.2 support hadoop 2.x?
>any help would be greatly appreciated..
>
>Running org.apache.oozie.action.hadoop.TestHiveActionExecutor
>Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.861 sec
><<< FAILURE!
>Running org.apache.oozie.command.wf.TestActionCheckXCommand
>Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.282 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestLauncher
>Tests run: 10, Failures: 7, Errors: 0, Skipped: 0, Time elapsed: 60.42 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestMapReduceActionError
>Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.757 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestDistCpActionExecutor
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 8.055 sec
><<< FAILURE!
>Running org.apache.oozie.service.TestRecoveryService
>Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 46.539 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestJavaActionExecutor
>Tests run: 25, Failures: 9, Errors: 0, Skipped: 0, Time elapsed: 156.315
>sec <<< FAILURE!
>Running org.apache.oozie.command.wf.TestActionStartXCommand
>Tests run: 6, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 24.878 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestShellActionExecutor
>Tests run: 6, Failures: 3, Errors: 1, Skipped: 0, Time elapsed: 34.981 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestMapReduceActionExecutor
>Tests run: 12, Failures: 6, Errors: 0, Skipped: 0, Time elapsed: 59.235
>sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestRerun
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 121.987
>sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestHiveMain
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 37.348 sec
><<< FAILURE!
>
>Results :
>
>Failed tests: testHiveAction
>(org.apache.oozie.action.hadoop.TestHiveActionExecutor)
> testActionCheck(org.apache.oozie.command.wf.TestActionCheckXCommand)
> testOutput(org.apache.oozie.action.hadoop.TestLauncher)
> testExit0(org.apache.oozie.action.hadoop.TestLauncher)
> testExit1(org.apache.oozie.action.hadoop.TestLauncher)
> testEmpty(org.apache.oozie.action.hadoop.TestLauncher)
> testException(org.apache.oozie.action.hadoop.TestLauncher)
> testNewId(org.apache.oozie.action.hadoop.TestLauncher)
> testSecurityManager(org.apache.oozie.action.hadoop.TestLauncher)
> testDistCpFile(org.apache.oozie.action.hadoop.TestDistCpActionExecutor)
> testWorkflowActionRecoveryUserRetry
>(org.apache.oozie.service.TestRecoveryService)
>
>testOutputSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testRecovery(org.apache.oozie.action.hadoop.TestJavaActionExecutor):
>expected:<...ob_1375223658833_002[0]> but was:<...ob_1375223658833_002[1]>
> testAdditionalJarSubmitOK
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testSimpestSleSubmitOK
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
>
>testIdSwapSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExit0SubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExit1SubmitError
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExceptionSubmitError
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testPrepare(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testActionWithEscapedStringAndCDATA
>(org.apache.oozie.command.wf.TestActionStartXCommand)
> testActionStart(org.apache.oozie.command.wf.TestActionStartXCommand)
> testShellScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testShellScriptError
>(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testPerlScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testSetExecutionStats_when_user_has_specified_stats_write_TRUE
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testSetExecutionStats_when_user_has_specified_stats_write_FALSE
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
>
>testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testMapReduceWithCredentials
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
>
>testStreaming(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testSetMapredJobName
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testRerun(org.apache.oozie.action.hadoop.TestRerun):
>expected:<SUCCEEDED>
>but was:<KILLED>
> testMain(org.apache.oozie.action.hadoop.TestHiveMain)
>
>Tests in error:
> testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionError)
> testEnvVar(org.apache.oozie.action.hadoop.TestShellActionExecutor): str
>cannot be null
>
>Tests run: 929, Failures: 33, Errors: 2, Skipped: 0
>
>
>Best Regards
>Amir Sanjar
>
>
>PowerLinux Open Source Hadoop development lead
>IBM Senior Software Engineer
>Phone# 512-286-8393
>Fax# 512-838-8858
Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Posted by Mona Chitnis <ch...@yahoo-inc.com>.
Yes you should be able to.
From: Amir Sanjar <v1...@us.ibm.com>>
Reply-To: "dev@oozie.apache.org<ma...@oozie.apache.org>" <de...@oozie.apache.org>>
Date: Wednesday, July 31, 2013 10:31 AM
To: "dev@oozie.apache.org<ma...@oozie.apache.org>" <de...@oozie.apache.org>>
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
thanks mona,
Could we apply the patch on top of Oozie 3.3.2 source code?
Best Regards
Amir Sanjar
System Management Architect
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
[Inactive hide details for Mona Chitnis ---07/31/2013 12:06:24 PM---The unit tests which involve launching a child M-R job, whic]Mona Chitnis ---07/31/2013 12:06:24 PM---The unit tests which involve launching a child M-R job, which include exactly the ones you've enlist
From: Mona Chitnis <ch...@yahoo-inc.com>>
To: "dev@oozie.apache.org<ma...@oozie.apache.org>" <de...@oozie.apache.org>>,
Date: 07/31/2013 12:06 PM
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
________________________________
The unit tests which involve launching a child M-R job, which include
exactly the ones you've enlisted, will fail with Hadoop-2.x if using a
version older than 4.0
See JIRA https://issues.apache.org/jira/browse/OOZIE-1374
We will be releasing Oozie-4.0 shortly.
--
Mona
On 7/31/13 9:39 AM, "Amir Sanjar" <v1...@us.ibm.com>> wrote:
>
>
>
>Hi Mohammad,
>Thanks for the reply, we made changes in four pom.xml files listed below.
>Basically, we replaced all references to hadoop-2.0.2-alpha with
>hadoop-2.0.4-alpha
> hadooplibs/hadoop-test-2/pom.xml
> hadooplibs/hadoop-2/pom.xml
> hadooplibs/hadoop-distcp-2/pom.xml
> pom.xml
>
>
>
>Best Regards
>Amir Sanjar
>
>
>PowerLinux Hadoop projects development lead
>IBM Senior Software Engineer
>Phone# 512-286-8393
>Fax# 512-838-8858
>
>-----Mohammad Islam <mi...@yahoo.com>> wrote: -----
>To: "dev@oozie.apache.org<ma...@oozie.apache.org>" <de...@oozie.apache.org>>
>From: Mohammad Islam <mi...@yahoo.com>>
>Date: 07/31/2013 03:06AM
>Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
>
>Hi Amir,
>What pom file changes have you made?
>
>Regards,
>Mohammad
>
>
>
>
>
>________________________________
> From: Amir Sanjar <v1...@us.ibm.com>>
>To: dev@oozie.apache.org<ma...@oozie.apache.org>
>Sent: Tuesday, July 30, 2013 7:08 PM
>Subject: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
>
>
>
>
>
>
>Hi all ,
>My team is new to Oozie. We have successfully build Oozie 3.3.2 with
>hadoop 2.0.4-alpha by modifying multiple pom.xml to add hadoop
>2.0.4-alpha.
>We also used command "mvn clean package -Dhadoop.version=2.0.4-alpha" for
>build.
>However multiple unit testcases, as listed below, are failing. Are these
>known issues? Does Oozie 3.3.2 support hadoop 2.x?
>any help would be greatly appreciated..
>
>Running org.apache.oozie.action.hadoop.TestHiveActionExecutor
>Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.861 sec
><<< FAILURE!
>Running org.apache.oozie.command.wf.TestActionCheckXCommand
>Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.282 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestLauncher
>Tests run: 10, Failures: 7, Errors: 0, Skipped: 0, Time elapsed: 60.42 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestMapReduceActionError
>Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.757 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestDistCpActionExecutor
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 8.055 sec
><<< FAILURE!
>Running org.apache.oozie.service.TestRecoveryService
>Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 46.539 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestJavaActionExecutor
>Tests run: 25, Failures: 9, Errors: 0, Skipped: 0, Time elapsed: 156.315
>sec <<< FAILURE!
>Running org.apache.oozie.command.wf.TestActionStartXCommand
>Tests run: 6, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 24.878 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestShellActionExecutor
>Tests run: 6, Failures: 3, Errors: 1, Skipped: 0, Time elapsed: 34.981 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestMapReduceActionExecutor
>Tests run: 12, Failures: 6, Errors: 0, Skipped: 0, Time elapsed: 59.235
>sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestRerun
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 121.987
>sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestHiveMain
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 37.348 sec
><<< FAILURE!
>
>Results :
>
>Failed tests: testHiveAction
>(org.apache.oozie.action.hadoop.TestHiveActionExecutor)
> testActionCheck(org.apache.oozie.command.wf.TestActionCheckXCommand)
> testOutput(org.apache.oozie.action.hadoop.TestLauncher)
> testExit0(org.apache.oozie.action.hadoop.TestLauncher)
> testExit1(org.apache.oozie.action.hadoop.TestLauncher)
> testEmpty(org.apache.oozie.action.hadoop.TestLauncher)
> testException(org.apache.oozie.action.hadoop.TestLauncher)
> testNewId(org.apache.oozie.action.hadoop.TestLauncher)
> testSecurityManager(org.apache.oozie.action.hadoop.TestLauncher)
> testDistCpFile(org.apache.oozie.action.hadoop.TestDistCpActionExecutor)
> testWorkflowActionRecoveryUserRetry
>(org.apache.oozie.service.TestRecoveryService)
>
>testOutputSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testRecovery(org.apache.oozie.action.hadoop.TestJavaActionExecutor):
>expected:<...ob_1375223658833_002[0]> but was:<...ob_1375223658833_002[1]>
> testAdditionalJarSubmitOK
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testSimpestSleSubmitOK
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
>
>testIdSwapSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExit0SubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExit1SubmitError
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExceptionSubmitError
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testPrepare(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testActionWithEscapedStringAndCDATA
>(org.apache.oozie.command.wf.TestActionStartXCommand)
> testActionStart(org.apache.oozie.command.wf.TestActionStartXCommand)
> testShellScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testShellScriptError
>(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testPerlScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testSetExecutionStats_when_user_has_specified_stats_write_TRUE
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testSetExecutionStats_when_user_has_specified_stats_write_FALSE
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
>
>testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testMapReduceWithCredentials
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
>
>testStreaming(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testSetMapredJobName
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testRerun(org.apache.oozie.action.hadoop.TestRerun):
>expected:<SUCCEEDED>
>but was:<KILLED>
> testMain(org.apache.oozie.action.hadoop.TestHiveMain)
>
>Tests in error:
> testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionError)
> testEnvVar(org.apache.oozie.action.hadoop.TestShellActionExecutor): str
>cannot be null
>
>Tests run: 929, Failures: 33, Errors: 2, Skipped: 0
>
>
>Best Regards
>Amir Sanjar
>
>
>PowerLinux Open Source Hadoop development lead
>IBM Senior Software Engineer
>Phone# 512-286-8393
>Fax# 512-838-8858
Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Posted by Amir Sanjar <v1...@us.ibm.com>.
thanks mona,
Could we apply the patch on top of Oozie 3.3.2 source code?
Best Regards
Amir Sanjar
System Management Architect
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
From: Mona Chitnis <ch...@yahoo-inc.com>
To: "dev@oozie.apache.org" <de...@oozie.apache.org>,
Date: 07/31/2013 12:06 PM
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
The unit tests which involve launching a child M-R job, which include
exactly the ones you've enlisted, will fail with Hadoop-2.x if using a
version older than 4.0
See JIRA https://issues.apache.org/jira/browse/OOZIE-1374
We will be releasing Oozie-4.0 shortly.
--
Mona
On 7/31/13 9:39 AM, "Amir Sanjar" <v1...@us.ibm.com> wrote:
>
>
>
>Hi Mohammad,
>Thanks for the reply, we made changes in four pom.xml files listed below.
>Basically, we replaced all references to hadoop-2.0.2-alpha with
>hadoop-2.0.4-alpha
> hadooplibs/hadoop-test-2/pom.xml
> hadooplibs/hadoop-2/pom.xml
> hadooplibs/hadoop-distcp-2/pom.xml
> pom.xml
>
>
>
>Best Regards
>Amir Sanjar
>
>
>PowerLinux Hadoop projects development lead
>IBM Senior Software Engineer
>Phone# 512-286-8393
>Fax# 512-838-8858
>
>-----Mohammad Islam <mi...@yahoo.com> wrote: -----
>To: "dev@oozie.apache.org" <de...@oozie.apache.org>
>From: Mohammad Islam <mi...@yahoo.com>
>Date: 07/31/2013 03:06AM
>Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
>
>Hi Amir,
>What pom file changes have you made?
>
>Regards,
>Mohammad
>
>
>
>
>
>________________________________
> From: Amir Sanjar <v1...@us.ibm.com>
>To: dev@oozie.apache.org
>Sent: Tuesday, July 30, 2013 7:08 PM
>Subject: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
>
>
>
>
>
>
>Hi all ,
>My team is new to Oozie. We have successfully build Oozie 3.3.2 with
>hadoop 2.0.4-alpha by modifying multiple pom.xml to add hadoop
>2.0.4-alpha.
>We also used command "mvn clean package -Dhadoop.version=2.0.4-alpha" for
>build.
>However multiple unit testcases, as listed below, are failing. Are these
>known issues? Does Oozie 3.3.2 support hadoop 2.x?
>any help would be greatly appreciated..
>
>Running org.apache.oozie.action.hadoop.TestHiveActionExecutor
>Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.861 sec
><<< FAILURE!
>Running org.apache.oozie.command.wf.TestActionCheckXCommand
>Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.282 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestLauncher
>Tests run: 10, Failures: 7, Errors: 0, Skipped: 0, Time elapsed: 60.42 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestMapReduceActionError
>Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.757 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestDistCpActionExecutor
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 8.055 sec
><<< FAILURE!
>Running org.apache.oozie.service.TestRecoveryService
>Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 46.539 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestJavaActionExecutor
>Tests run: 25, Failures: 9, Errors: 0, Skipped: 0, Time elapsed: 156.315
>sec <<< FAILURE!
>Running org.apache.oozie.command.wf.TestActionStartXCommand
>Tests run: 6, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 24.878 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestShellActionExecutor
>Tests run: 6, Failures: 3, Errors: 1, Skipped: 0, Time elapsed: 34.981 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestMapReduceActionExecutor
>Tests run: 12, Failures: 6, Errors: 0, Skipped: 0, Time elapsed: 59.235
>sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestRerun
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 121.987
>sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestHiveMain
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 37.348 sec
><<< FAILURE!
>
>Results :
>
>Failed tests: testHiveAction
>(org.apache.oozie.action.hadoop.TestHiveActionExecutor)
> testActionCheck(org.apache.oozie.command.wf.TestActionCheckXCommand)
> testOutput(org.apache.oozie.action.hadoop.TestLauncher)
> testExit0(org.apache.oozie.action.hadoop.TestLauncher)
> testExit1(org.apache.oozie.action.hadoop.TestLauncher)
> testEmpty(org.apache.oozie.action.hadoop.TestLauncher)
> testException(org.apache.oozie.action.hadoop.TestLauncher)
> testNewId(org.apache.oozie.action.hadoop.TestLauncher)
> testSecurityManager(org.apache.oozie.action.hadoop.TestLauncher)
> testDistCpFile(org.apache.oozie.action.hadoop.TestDistCpActionExecutor)
> testWorkflowActionRecoveryUserRetry
>(org.apache.oozie.service.TestRecoveryService)
>
>testOutputSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testRecovery(org.apache.oozie.action.hadoop.TestJavaActionExecutor):
>expected:<...ob_1375223658833_002[0]> but was:<...ob_1375223658833_002[1]>
> testAdditionalJarSubmitOK
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testSimpestSleSubmitOK
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
>
>testIdSwapSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExit0SubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExit1SubmitError
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExceptionSubmitError
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testPrepare(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testActionWithEscapedStringAndCDATA
>(org.apache.oozie.command.wf.TestActionStartXCommand)
> testActionStart(org.apache.oozie.command.wf.TestActionStartXCommand)
> testShellScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testShellScriptError
>(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testPerlScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testSetExecutionStats_when_user_has_specified_stats_write_TRUE
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testSetExecutionStats_when_user_has_specified_stats_write_FALSE
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
>
>testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testMapReduceWithCredentials
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
>
>testStreaming(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testSetMapredJobName
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testRerun(org.apache.oozie.action.hadoop.TestRerun):
>expected:<SUCCEEDED>
>but was:<KILLED>
> testMain(org.apache.oozie.action.hadoop.TestHiveMain)
>
>Tests in error:
> testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionError)
> testEnvVar(org.apache.oozie.action.hadoop.TestShellActionExecutor): str
>cannot be null
>
>Tests run: 929, Failures: 33, Errors: 2, Skipped: 0
>
>
>Best Regards
>Amir Sanjar
>
>
>PowerLinux Open Source Hadoop development lead
>IBM Senior Software Engineer
>Phone# 512-286-8393
>Fax# 512-838-8858
Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Posted by Mona Chitnis <ch...@yahoo-inc.com>.
The unit tests which involve launching a child M-R job, which include
exactly the ones you've enlisted, will fail with Hadoop-2.x if using a
version older than 4.0
See JIRA https://issues.apache.org/jira/browse/OOZIE-1374
We will be releasing Oozie-4.0 shortly.
--
Mona
On 7/31/13 9:39 AM, "Amir Sanjar" <v1...@us.ibm.com> wrote:
>
>
>
>Hi Mohammad,
>Thanks for the reply, we made changes in four pom.xml files listed below.
>Basically, we replaced all references to hadoop-2.0.2-alpha with
>hadoop-2.0.4-alpha
> hadooplibs/hadoop-test-2/pom.xml
> hadooplibs/hadoop-2/pom.xml
> hadooplibs/hadoop-distcp-2/pom.xml
> pom.xml
>
>
>
>Best Regards
>Amir Sanjar
>
>
>PowerLinux Hadoop projects development lead
>IBM Senior Software Engineer
>Phone# 512-286-8393
>Fax# 512-838-8858
>
>-----Mohammad Islam <mi...@yahoo.com> wrote: -----
>To: "dev@oozie.apache.org" <de...@oozie.apache.org>
>From: Mohammad Islam <mi...@yahoo.com>
>Date: 07/31/2013 03:06AM
>Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
>
>Hi Amir,
>What pom file changes have you made?
>
>Regards,
>Mohammad
>
>
>
>
>
>________________________________
> From: Amir Sanjar <v1...@us.ibm.com>
>To: dev@oozie.apache.org
>Sent: Tuesday, July 30, 2013 7:08 PM
>Subject: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
>
>
>
>
>
>
>Hi all ,
>My team is new to Oozie. We have successfully build Oozie 3.3.2 with
>hadoop 2.0.4-alpha by modifying multiple pom.xml to add hadoop
>2.0.4-alpha.
>We also used command "mvn clean package -Dhadoop.version=2.0.4-alpha" for
>build.
>However multiple unit testcases, as listed below, are failing. Are these
>known issues? Does Oozie 3.3.2 support hadoop 2.x?
>any help would be greatly appreciated..
>
>Running org.apache.oozie.action.hadoop.TestHiveActionExecutor
>Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.861 sec
><<< FAILURE!
>Running org.apache.oozie.command.wf.TestActionCheckXCommand
>Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.282 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestLauncher
>Tests run: 10, Failures: 7, Errors: 0, Skipped: 0, Time elapsed: 60.42 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestMapReduceActionError
>Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.757 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestDistCpActionExecutor
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 8.055 sec
><<< FAILURE!
>Running org.apache.oozie.service.TestRecoveryService
>Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 46.539 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestJavaActionExecutor
>Tests run: 25, Failures: 9, Errors: 0, Skipped: 0, Time elapsed: 156.315
>sec <<< FAILURE!
>Running org.apache.oozie.command.wf.TestActionStartXCommand
>Tests run: 6, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 24.878 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestShellActionExecutor
>Tests run: 6, Failures: 3, Errors: 1, Skipped: 0, Time elapsed: 34.981 sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestMapReduceActionExecutor
>Tests run: 12, Failures: 6, Errors: 0, Skipped: 0, Time elapsed: 59.235
>sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestRerun
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 121.987
>sec
><<< FAILURE!
>Running org.apache.oozie.action.hadoop.TestHiveMain
>Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 37.348 sec
><<< FAILURE!
>
>Results :
>
>Failed tests: testHiveAction
>(org.apache.oozie.action.hadoop.TestHiveActionExecutor)
> testActionCheck(org.apache.oozie.command.wf.TestActionCheckXCommand)
> testOutput(org.apache.oozie.action.hadoop.TestLauncher)
> testExit0(org.apache.oozie.action.hadoop.TestLauncher)
> testExit1(org.apache.oozie.action.hadoop.TestLauncher)
> testEmpty(org.apache.oozie.action.hadoop.TestLauncher)
> testException(org.apache.oozie.action.hadoop.TestLauncher)
> testNewId(org.apache.oozie.action.hadoop.TestLauncher)
> testSecurityManager(org.apache.oozie.action.hadoop.TestLauncher)
> testDistCpFile(org.apache.oozie.action.hadoop.TestDistCpActionExecutor)
> testWorkflowActionRecoveryUserRetry
>(org.apache.oozie.service.TestRecoveryService)
>
>testOutputSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testRecovery(org.apache.oozie.action.hadoop.TestJavaActionExecutor):
>expected:<...ob_1375223658833_002[0]> but was:<...ob_1375223658833_002[1]>
> testAdditionalJarSubmitOK
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testSimpestSleSubmitOK
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
>
>testIdSwapSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExit0SubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExit1SubmitError
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testExceptionSubmitError
>(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testPrepare(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
> testActionWithEscapedStringAndCDATA
>(org.apache.oozie.command.wf.TestActionStartXCommand)
> testActionStart(org.apache.oozie.command.wf.TestActionStartXCommand)
> testShellScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testShellScriptError
>(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testPerlScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
> testSetExecutionStats_when_user_has_specified_stats_write_TRUE
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testSetExecutionStats_when_user_has_specified_stats_write_FALSE
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
>
>testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testMapReduceWithCredentials
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
>
>testStreaming(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testSetMapredJobName
>(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
> testRerun(org.apache.oozie.action.hadoop.TestRerun):
>expected:<SUCCEEDED>
>but was:<KILLED>
> testMain(org.apache.oozie.action.hadoop.TestHiveMain)
>
>Tests in error:
> testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionError)
> testEnvVar(org.apache.oozie.action.hadoop.TestShellActionExecutor): str
>cannot be null
>
>Tests run: 929, Failures: 33, Errors: 2, Skipped: 0
>
>
>Best Regards
>Amir Sanjar
>
>
>PowerLinux Open Source Hadoop development lead
>IBM Senior Software Engineer
>Phone# 512-286-8393
>Fax# 512-838-8858
Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Posted by Amir Sanjar <v1...@us.ibm.com>.
Hi Mohammad,
Thanks for the reply, we made changes in four pom.xml files listed below.
Basically, we replaced all references to hadoop-2.0.2-alpha with
hadoop-2.0.4-alpha
hadooplibs/hadoop-test-2/pom.xml
hadooplibs/hadoop-2/pom.xml
hadooplibs/hadoop-distcp-2/pom.xml
pom.xml
Best Regards
Amir Sanjar
PowerLinux Hadoop projects development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
-----Mohammad Islam <mi...@yahoo.com> wrote: -----
To: "dev@oozie.apache.org" <de...@oozie.apache.org>
From: Mohammad Islam <mi...@yahoo.com>
Date: 07/31/2013 03:06AM
Subject: Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Hi Amir,
What pom file changes have you made?
Regards,
Mohammad
________________________________
From: Amir Sanjar <v1...@us.ibm.com>
To: dev@oozie.apache.org
Sent: Tuesday, July 30, 2013 7:08 PM
Subject: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Hi all ,
My team is new to Oozie. We have successfully build Oozie 3.3.2 with
hadoop 2.0.4-alpha by modifying multiple pom.xml to add hadoop 2.0.4-alpha.
We also used command "mvn clean package -Dhadoop.version=2.0.4-alpha" for
build.
However multiple unit testcases, as listed below, are failing. Are these
known issues? Does Oozie 3.3.2 support hadoop 2.x?
any help would be greatly appreciated..
Running org.apache.oozie.action.hadoop.TestHiveActionExecutor
Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.861 sec
<<< FAILURE!
Running org.apache.oozie.command.wf.TestActionCheckXCommand
Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.282 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestLauncher
Tests run: 10, Failures: 7, Errors: 0, Skipped: 0, Time elapsed: 60.42 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestMapReduceActionError
Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.757 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestDistCpActionExecutor
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 8.055 sec
<<< FAILURE!
Running org.apache.oozie.service.TestRecoveryService
Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 46.539 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestJavaActionExecutor
Tests run: 25, Failures: 9, Errors: 0, Skipped: 0, Time elapsed: 156.315
sec <<< FAILURE!
Running org.apache.oozie.command.wf.TestActionStartXCommand
Tests run: 6, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 24.878 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestShellActionExecutor
Tests run: 6, Failures: 3, Errors: 1, Skipped: 0, Time elapsed: 34.981 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestMapReduceActionExecutor
Tests run: 12, Failures: 6, Errors: 0, Skipped: 0, Time elapsed: 59.235 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestRerun
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 121.987 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestHiveMain
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 37.348 sec
<<< FAILURE!
Results :
Failed tests: testHiveAction
(org.apache.oozie.action.hadoop.TestHiveActionExecutor)
testActionCheck(org.apache.oozie.command.wf.TestActionCheckXCommand)
testOutput(org.apache.oozie.action.hadoop.TestLauncher)
testExit0(org.apache.oozie.action.hadoop.TestLauncher)
testExit1(org.apache.oozie.action.hadoop.TestLauncher)
testEmpty(org.apache.oozie.action.hadoop.TestLauncher)
testException(org.apache.oozie.action.hadoop.TestLauncher)
testNewId(org.apache.oozie.action.hadoop.TestLauncher)
testSecurityManager(org.apache.oozie.action.hadoop.TestLauncher)
testDistCpFile(org.apache.oozie.action.hadoop.TestDistCpActionExecutor)
testWorkflowActionRecoveryUserRetry
(org.apache.oozie.service.TestRecoveryService)
testOutputSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testRecovery(org.apache.oozie.action.hadoop.TestJavaActionExecutor):
expected:<...ob_1375223658833_002[0]> but was:<...ob_1375223658833_002[1]>
testAdditionalJarSubmitOK
(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testSimpestSleSubmitOK
(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testIdSwapSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testExit0SubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testExit1SubmitError
(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testExceptionSubmitError
(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testPrepare(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testActionWithEscapedStringAndCDATA
(org.apache.oozie.command.wf.TestActionStartXCommand)
testActionStart(org.apache.oozie.command.wf.TestActionStartXCommand)
testShellScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
testShellScriptError
(org.apache.oozie.action.hadoop.TestShellActionExecutor)
testPerlScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
testSetExecutionStats_when_user_has_specified_stats_write_TRUE
(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testSetExecutionStats_when_user_has_specified_stats_write_FALSE
(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testMapReduceWithCredentials
(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testStreaming(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testSetMapredJobName
(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testRerun(org.apache.oozie.action.hadoop.TestRerun): expected:<SUCCEEDED>
but was:<KILLED>
testMain(org.apache.oozie.action.hadoop.TestHiveMain)
Tests in error:
testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionError)
testEnvVar(org.apache.oozie.action.hadoop.TestShellActionExecutor): str
cannot be null
Tests run: 929, Failures: 33, Errors: 2, Skipped: 0
Best Regards
Amir Sanjar
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
Re: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Posted by Mohammad Islam <mi...@yahoo.com>.
Hi Amir,
What pom file changes have you made?
Regards,
Mohammad
________________________________
From: Amir Sanjar <v1...@us.ibm.com>
To: dev@oozie.apache.org
Sent: Tuesday, July 30, 2013 7:08 PM
Subject: Oozie 3.3.2 + hadoop 2.0.4-alpha failure
Hi all ,
My team is new to Oozie. We have successfully build Oozie 3.3.2 with
hadoop 2.0.4-alpha by modifying multiple pom.xml to add hadoop 2.0.4-alpha.
We also used command "mvn clean package -Dhadoop.version=2.0.4-alpha" for
build.
However multiple unit testcases, as listed below, are failing. Are these
known issues? Does Oozie 3.3.2 support hadoop 2.x?
any help would be greatly appreciated..
Running org.apache.oozie.action.hadoop.TestHiveActionExecutor
Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.861 sec
<<< FAILURE!
Running org.apache.oozie.command.wf.TestActionCheckXCommand
Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.282 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestLauncher
Tests run: 10, Failures: 7, Errors: 0, Skipped: 0, Time elapsed: 60.42 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestMapReduceActionError
Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.757 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestDistCpActionExecutor
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 8.055 sec
<<< FAILURE!
Running org.apache.oozie.service.TestRecoveryService
Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 46.539 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestJavaActionExecutor
Tests run: 25, Failures: 9, Errors: 0, Skipped: 0, Time elapsed: 156.315
sec <<< FAILURE!
Running org.apache.oozie.command.wf.TestActionStartXCommand
Tests run: 6, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 24.878 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestShellActionExecutor
Tests run: 6, Failures: 3, Errors: 1, Skipped: 0, Time elapsed: 34.981 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestMapReduceActionExecutor
Tests run: 12, Failures: 6, Errors: 0, Skipped: 0, Time elapsed: 59.235 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestRerun
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 121.987 sec
<<< FAILURE!
Running org.apache.oozie.action.hadoop.TestHiveMain
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 37.348 sec
<<< FAILURE!
Results :
Failed tests: testHiveAction
(org.apache.oozie.action.hadoop.TestHiveActionExecutor)
testActionCheck(org.apache.oozie.command.wf.TestActionCheckXCommand)
testOutput(org.apache.oozie.action.hadoop.TestLauncher)
testExit0(org.apache.oozie.action.hadoop.TestLauncher)
testExit1(org.apache.oozie.action.hadoop.TestLauncher)
testEmpty(org.apache.oozie.action.hadoop.TestLauncher)
testException(org.apache.oozie.action.hadoop.TestLauncher)
testNewId(org.apache.oozie.action.hadoop.TestLauncher)
testSecurityManager(org.apache.oozie.action.hadoop.TestLauncher)
testDistCpFile(org.apache.oozie.action.hadoop.TestDistCpActionExecutor)
testWorkflowActionRecoveryUserRetry
(org.apache.oozie.service.TestRecoveryService)
testOutputSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testRecovery(org.apache.oozie.action.hadoop.TestJavaActionExecutor):
expected:<...ob_1375223658833_002[0]> but was:<...ob_1375223658833_002[1]>
testAdditionalJarSubmitOK
(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testSimpestSleSubmitOK
(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testIdSwapSubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testExit0SubmitOK(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testExit1SubmitError
(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testExceptionSubmitError
(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testPrepare(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
testActionWithEscapedStringAndCDATA
(org.apache.oozie.command.wf.TestActionStartXCommand)
testActionStart(org.apache.oozie.command.wf.TestActionStartXCommand)
testShellScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
testShellScriptError
(org.apache.oozie.action.hadoop.TestShellActionExecutor)
testPerlScript(org.apache.oozie.action.hadoop.TestShellActionExecutor)
testSetExecutionStats_when_user_has_specified_stats_write_TRUE
(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testSetExecutionStats_when_user_has_specified_stats_write_FALSE
(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testMapReduceWithCredentials
(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testStreaming(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testSetMapredJobName
(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)
testRerun(org.apache.oozie.action.hadoop.TestRerun): expected:<SUCCEEDED>
but was:<KILLED>
testMain(org.apache.oozie.action.hadoop.TestHiveMain)
Tests in error:
testMapReduce(org.apache.oozie.action.hadoop.TestMapReduceActionError)
testEnvVar(org.apache.oozie.action.hadoop.TestShellActionExecutor): str
cannot be null
Tests run: 929, Failures: 33, Errors: 2, Skipped: 0
Best Regards
Amir Sanjar
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858