You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Robert Kanter (JIRA)" <ji...@apache.org> on 2013/10/19 02:37:43 UTC
[jira] [Commented] (OOZIE-1551) Change hadoop-2 profile to use
2.2.0
[ https://issues.apache.org/jira/browse/OOZIE-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799704#comment-13799704 ]
Robert Kanter commented on OOZIE-1551:
--------------------------------------
- I think {{TestCoordPushDependencyCheckXCommand}} was just being flakey
- {{TestShareLibService#testAddShareLibDistributedCache}} fails because it checks the distributed cache for 2 jars that were added, but finds 4 jars. The extra 2 jars are:
{noformat}
hdfs://localhost:64929/user/rkanter/target/MiniMRCluster_1118556015-tmpDir/MRAppJar.jar
hdfs://localhost:64929/user/rkanter/target/MiniMRCluster_1118556015-tmpDir/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar
{noformat}
which look to be something Hadoop is adding. I think we simply need to adjust the test to account for this.
- I'm not really sure what's wrong with the pig tests, the error I see when running TestPigMain is this:
{noformat}
ERROR 2244: Job failed, hadoop does not return any error message
org.apache.pig.backend.executionengine.ExecException: ERROR 2244: Job failed, hadoop does not return any error message
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:141)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:166)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
at org.apache.pig.Main.run(Main.java:430)
at org.apache.pig.PigRunner.run(PigRunner.java:49)
at org.apache.oozie.action.hadoop.PigMain.runPigJob(PigMain.java:284)
at org.apache.oozie.action.hadoop.PigMain.run(PigMain.java:224)
at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:38)
at org.apache.oozie.action.hadoop.PigMain.main(PigMain.java:76)
at org.apache.oozie.action.hadoop.TestPigMain.call(TestPigMain.java:117)
at org.apache.oozie.action.hadoop.TestPigMain.call(TestPigMain.java:37)
at org.apache.oozie.action.hadoop.MainTestCase$1.run(MainTestCase.java:32)
at org.apache.oozie.action.hadoop.MainTestCase$1.run(MainTestCase.java:30)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:394)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
at org.apache.oozie.action.hadoop.MainTestCase.execute(MainTestCase.java:30)
at org.apache.oozie.action.hadoop.PigTestCase.testPigScript(PigTestCase.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:168)
at junit.framework.TestCase.runBare(TestCase.java:134)
at junit.framework.TestResult$1.protect(TestResult.java:110)
at junit.framework.TestResult.runProtected(TestResult.java:128)
at junit.framework.TestResult.run(TestResult.java:113)
at junit.framework.TestCase.run(TestCase.java:124)
at junit.framework.TestSuite.runTest(TestSuite.java:243)
at junit.framework.TestSuite.run(TestSuite.java:238)
at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83)
at org.apache.maven.surefire.junitcore.ClassDemarcatingRunner.run(ClassDemarcatingRunner.java:58)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:24)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:695)
{noformat}
Looking earlier, I see that the Yarn container failed to launch with the unhelpful exception:
{noformat}
2013-10-18 17:30:18,316 [AsyncDispatcher event handler] WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger - USER=test OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1382142539659_0001 failed 2 times due to AM Container for appattempt_1382142539659_0001_000002 exited with exitCode: 1 due to: Exception from container-launch:
org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
at org.apache.hadoop.util.Shell.run(Shell.java:379)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:695)
{noformat}
It will require a deeper look to figure out the Pig issue.
> Change hadoop-2 profile to use 2.2.0
> ------------------------------------
>
> Key: OOZIE-1551
> URL: https://issues.apache.org/jira/browse/OOZIE-1551
> Project: Oozie
> Issue Type: Improvement
> Components: build
> Affects Versions: trunk, 4.0.1
> Reporter: Robert Kanter
> Assignee: Robert Kanter
> Priority: Blocker
> Attachments: OOZIE-1551.patch, OOZIE-1551.patch
>
>
> We should change the hadoop-2 profile to use 2.2.0 (GA) instead of 2.2.0-SNAPSHOT now that its been released.
--
This message was sent by Atlassian JIRA
(v6.1#6144)