You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by William Shen <wi...@marinsoftware.com> on 2019/02/19 18:58:27 UTC
Integration Testing Requirements
Hi everyone,
I'm trying to set up the Jenkins job at work to build Phoenix and run the
integration tests. However, repeatedly I encounter issues with the hive
module when I run mvn verify. Does the hive integration tests require any
special set up for them to pass? The other modules passed integration
testing successfully.
Attaching below is a sample failure trace.
Thanks!
- Will
[ERROR] Tests run: 6, Failures: 6, Errors: 0, Skipped: 0, Time
elapsed: 48.302 s <<< FAILURE! - in
org.apache.phoenix.hive.HiveTezIT[ERROR]
simpleColumnMapTest(org.apache.phoenix.hive.HiveTezIT) Time elapsed:
6.727 s <<< FAILURE!junit.framework.AssertionFailedError:
Unexpected exception java.lang.RuntimeException:
org.apache.tez.dag.api.SessionNotRunning: TezSession has already
shutdown. Application application_1550371508120_0001 failed 2 times
due to AM Container for appattempt_1550371508120_0001_000002 exited
with exitCode: 127
For more detailed output, check application tracking
page:http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then,
click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1550371508120_0001_02_000001
Exit code: 127
Stack trace: ExitCodeException exitCode=127:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
at org.apache.hadoop.util.Shell.run(Shell.java:456)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
Container exited with a non-zero exit code 127
Failing this attempt. Failing the application.
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535)
at org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:637)
at org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:590)
at org.apache.phoenix.hive.BaseHivePhoenixStoreIT.runTest(BaseHivePhoenixStoreIT.java:117)
at org.apache.phoenix.hive.HivePhoenixStoreIT.simpleColumnMapTest(HivePhoenixStoreIT.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55)
at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137)
at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:157)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143)
Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has
already shutdown. Application application_1550371508120_0001 failed 2
times due to AM Container for appattempt_1550371508120_0001_000002
exited with exitCode: 127
For more detailed output, check application tracking
page:http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then,
click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1550371508120_0001_02_000001
Exit code: 127
Stack trace: ExitCodeException exitCode=127:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
at org.apache.hadoop.util.Shell.run(Shell.java:456)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
Container exited with a non-zero exit code 127
Failing this attempt. Failing the application.
at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:914)
at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:883)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:205)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:532)
... 40 more
Re: Integration Testing Requirements
Posted by William Shen <wi...@marinsoftware.com>.
Funny. The specific IT passed locally for me. Seems more like a Jenkins
setup to troubleshoot for us... Thanks for your help Ankit.
On Wed, Feb 20, 2019 at 12:07 PM William Shen <wi...@marinsoftware.com>
wrote:
> Thanks Ankit.
>
> What is the difference between these hive tests
> (e.g., org.apache.phoenix.hive.HiveTezIT) and other tests that also use a
> mini cluster
> (org.apache.phoenix.end2end.MigrateSystemTablesToSystemNamespaceIT), which
> are passing? Specifically, what does it need from HADOOP_HOME?
>
> On Tue, Feb 19, 2019 at 11:39 AM Ankit Singhal <an...@gmail.com>
> wrote:
>
>> you can check if HADOOP_HOME and JAVA_HOME are properly set in the
>> environment.
>>
>> On Tue, Feb 19, 2019 at 11:23 AM William Shen <willshen@marinsoftware.com
>> >
>> wrote:
>>
>> > Hi everyone,
>> >
>> > I'm trying to set up the Jenkins job at work to build Phoenix and run
>> the
>> > integration tests. However, repeatedly I encounter issues with the hive
>> > module when I run mvn verify. Does the hive integration tests require
>> any
>> > special set up for them to pass? The other modules passed integration
>> > testing successfully.
>> >
>> > Attaching below is a sample failure trace.
>> >
>> > Thanks!
>> >
>> > - Will
>> >
>> > [ERROR] Tests run: 6, Failures: 6, Errors: 0, Skipped: 0, Time
>> > elapsed: 48.302 s <<< FAILURE! - in
>> > org.apache.phoenix.hive.HiveTezIT[ERROR]
>> > simpleColumnMapTest(org.apache.phoenix.hive.HiveTezIT) Time elapsed:
>> > 6.727 s <<< FAILURE!junit.framework.AssertionFailedError:
>> > Unexpected exception java.lang.RuntimeException:
>> > org.apache.tez.dag.api.SessionNotRunning: TezSession has already
>> > shutdown. Application application_1550371508120_0001 failed 2 times
>> > due to AM Container for appattempt_1550371508120_0001_000002 exited
>> > with exitCode: 127
>> > For more detailed output, check application tracking
>> > page:
>> >
>> http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then,
>> > click on links to logs of each attempt.
>> > Diagnostics: Exception from container-launch.
>> > Container id: container_1550371508120_0001_02_000001
>> > Exit code: 127
>> > Stack trace: ExitCodeException exitCode=127:
>> > at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
>> > at org.apache.hadoop.util.Shell.run(Shell.java:456)
>> > at
>> >
>> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
>> > at
>> >
>> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>> > at
>> >
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>> > at
>> >
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > at
>> >
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>> > at
>> >
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>> > at java.lang.Thread.run(Thread.java:748)
>> >
>> >
>> > Container exited with a non-zero exit code 127
>> > Failing this attempt. Failing the application.
>> > at
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535)
>> > at
>> > org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:637)
>> > at
>> > org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:590)
>> > at
>> >
>> org.apache.phoenix.hive.BaseHivePhoenixStoreIT.runTest(BaseHivePhoenixStoreIT.java:117)
>> > at
>> >
>> org.apache.phoenix.hive.HivePhoenixStoreIT.simpleColumnMapTest(HivePhoenixStoreIT.java:103)
>> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > at
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> > at
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> > at java.lang.reflect.Method.invoke(Method.java:498)
>> > at
>> >
>> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
>> > at
>> >
>> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
>> > at
>> >
>> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
>> > at
>> >
>> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
>> > at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
>> > at
>> >
>> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
>> > at
>> >
>> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
>> > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
>> > at
>> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
>> > at
>> > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
>> > at
>> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
>> > at
>> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
>> > at
>> >
>> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
>> > at
>> >
>> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
>> > at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
>> > at org.junit.runners.Suite.runChild(Suite.java:128)
>> > at org.junit.runners.Suite.runChild(Suite.java:27)
>> > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
>> > at
>> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
>> > at
>> > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
>> > at
>> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
>> > at
>> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
>> > at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
>> > at
>> > org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55)
>> > at
>> >
>> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137)
>> > at
>> >
>> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
>> > at
>> >
>> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
>> > at
>> >
>> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
>> > at
>> >
>> org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:157)
>> > at
>> >
>> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386)
>> > at
>> >
>> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323)
>> > at
>> >
>> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143)
>> > Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has
>> > already shutdown. Application application_1550371508120_0001 failed 2
>> > times due to AM Container for appattempt_1550371508120_0001_000002
>> > exited with exitCode: 127
>> > For more detailed output, check application tracking
>> > page:
>> >
>> http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then,
>> > click on links to logs of each attempt.
>> > Diagnostics: Exception from container-launch.
>> > Container id: container_1550371508120_0001_02_000001
>> > Exit code: 127
>> > Stack trace: ExitCodeException exitCode=127:
>> > at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
>> > at org.apache.hadoop.util.Shell.run(Shell.java:456)
>> > at
>> >
>> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
>> > at
>> >
>> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>> > at
>> >
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>> > at
>> >
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > at
>> >
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>> > at
>> >
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>> > at java.lang.Thread.run(Thread.java:748)
>> >
>> >
>> > Container exited with a non-zero exit code 127
>> > Failing this attempt. Failing the application.
>> > at
>> > org.apache.tez.client.TezClient.waitTillReady(TezClient.java:914)
>> > at
>> > org.apache.tez.client.TezClient.waitTillReady(TezClient.java:883)
>> > at
>> >
>> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:205)
>> > at
>> >
>> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116)
>> > at
>> >
>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:532)
>> > ... 40 more
>> >
>>
>
Re: Integration Testing Requirements
Posted by William Shen <wi...@marinsoftware.com>.
Thanks Ankit.
What is the difference between these hive tests
(e.g., org.apache.phoenix.hive.HiveTezIT) and other tests that also use a
mini cluster
(org.apache.phoenix.end2end.MigrateSystemTablesToSystemNamespaceIT), which
are passing? Specifically, what does it need from HADOOP_HOME?
On Tue, Feb 19, 2019 at 11:39 AM Ankit Singhal <an...@gmail.com>
wrote:
> you can check if HADOOP_HOME and JAVA_HOME are properly set in the
> environment.
>
> On Tue, Feb 19, 2019 at 11:23 AM William Shen <wi...@marinsoftware.com>
> wrote:
>
> > Hi everyone,
> >
> > I'm trying to set up the Jenkins job at work to build Phoenix and run the
> > integration tests. However, repeatedly I encounter issues with the hive
> > module when I run mvn verify. Does the hive integration tests require any
> > special set up for them to pass? The other modules passed integration
> > testing successfully.
> >
> > Attaching below is a sample failure trace.
> >
> > Thanks!
> >
> > - Will
> >
> > [ERROR] Tests run: 6, Failures: 6, Errors: 0, Skipped: 0, Time
> > elapsed: 48.302 s <<< FAILURE! - in
> > org.apache.phoenix.hive.HiveTezIT[ERROR]
> > simpleColumnMapTest(org.apache.phoenix.hive.HiveTezIT) Time elapsed:
> > 6.727 s <<< FAILURE!junit.framework.AssertionFailedError:
> > Unexpected exception java.lang.RuntimeException:
> > org.apache.tez.dag.api.SessionNotRunning: TezSession has already
> > shutdown. Application application_1550371508120_0001 failed 2 times
> > due to AM Container for appattempt_1550371508120_0001_000002 exited
> > with exitCode: 127
> > For more detailed output, check application tracking
> > page:
> > http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then
> ,
> > click on links to logs of each attempt.
> > Diagnostics: Exception from container-launch.
> > Container id: container_1550371508120_0001_02_000001
> > Exit code: 127
> > Stack trace: ExitCodeException exitCode=127:
> > at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
> > at org.apache.hadoop.util.Shell.run(Shell.java:456)
> > at
> > org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
> > at
> >
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
> > at
> >
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> > at
> >
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:748)
> >
> >
> > Container exited with a non-zero exit code 127
> > Failing this attempt. Failing the application.
> > at
> >
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535)
> > at
> > org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:637)
> > at
> > org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:590)
> > at
> >
> org.apache.phoenix.hive.BaseHivePhoenixStoreIT.runTest(BaseHivePhoenixStoreIT.java:117)
> > at
> >
> org.apache.phoenix.hive.HivePhoenixStoreIT.simpleColumnMapTest(HivePhoenixStoreIT.java:103)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:498)
> > at
> >
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> > at
> >
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> > at
> >
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> > at
> >
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> > at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> > at
> >
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> > at
> >
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> > at
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> > at
> > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> > at
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> > at
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> > at
> >
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> > at
> >
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> > at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> > at org.junit.runners.Suite.runChild(Suite.java:128)
> > at org.junit.runners.Suite.runChild(Suite.java:27)
> > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> > at
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> > at
> > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> > at
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> > at
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> > at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> > at
> > org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55)
> > at
> >
> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137)
> > at
> >
> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
> > at
> >
> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
> > at
> >
> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
> > at
> >
> org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:157)
> > at
> >
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386)
> > at
> >
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323)
> > at
> > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143)
> > Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has
> > already shutdown. Application application_1550371508120_0001 failed 2
> > times due to AM Container for appattempt_1550371508120_0001_000002
> > exited with exitCode: 127
> > For more detailed output, check application tracking
> > page:
> > http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then
> ,
> > click on links to logs of each attempt.
> > Diagnostics: Exception from container-launch.
> > Container id: container_1550371508120_0001_02_000001
> > Exit code: 127
> > Stack trace: ExitCodeException exitCode=127:
> > at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
> > at org.apache.hadoop.util.Shell.run(Shell.java:456)
> > at
> > org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
> > at
> >
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
> > at
> >
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> > at
> >
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:748)
> >
> >
> > Container exited with a non-zero exit code 127
> > Failing this attempt. Failing the application.
> > at
> > org.apache.tez.client.TezClient.waitTillReady(TezClient.java:914)
> > at
> > org.apache.tez.client.TezClient.waitTillReady(TezClient.java:883)
> > at
> >
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:205)
> > at
> >
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116)
> > at
> >
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:532)
> > ... 40 more
> >
>
Re: Integration Testing Requirements
Posted by Ankit Singhal <an...@gmail.com>.
you can check if HADOOP_HOME and JAVA_HOME are properly set in the
environment.
On Tue, Feb 19, 2019 at 11:23 AM William Shen <wi...@marinsoftware.com>
wrote:
> Hi everyone,
>
> I'm trying to set up the Jenkins job at work to build Phoenix and run the
> integration tests. However, repeatedly I encounter issues with the hive
> module when I run mvn verify. Does the hive integration tests require any
> special set up for them to pass? The other modules passed integration
> testing successfully.
>
> Attaching below is a sample failure trace.
>
> Thanks!
>
> - Will
>
> [ERROR] Tests run: 6, Failures: 6, Errors: 0, Skipped: 0, Time
> elapsed: 48.302 s <<< FAILURE! - in
> org.apache.phoenix.hive.HiveTezIT[ERROR]
> simpleColumnMapTest(org.apache.phoenix.hive.HiveTezIT) Time elapsed:
> 6.727 s <<< FAILURE!junit.framework.AssertionFailedError:
> Unexpected exception java.lang.RuntimeException:
> org.apache.tez.dag.api.SessionNotRunning: TezSession has already
> shutdown. Application application_1550371508120_0001 failed 2 times
> due to AM Container for appattempt_1550371508120_0001_000002 exited
> with exitCode: 127
> For more detailed output, check application tracking
> page:
> http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then,
> click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1550371508120_0001_02_000001
> Exit code: 127
> Stack trace: ExitCodeException exitCode=127:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
> at org.apache.hadoop.util.Shell.run(Shell.java:456)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:748)
>
>
> Container exited with a non-zero exit code 127
> Failing this attempt. Failing the application.
> at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535)
> at
> org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:637)
> at
> org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:590)
> at
> org.apache.phoenix.hive.BaseHivePhoenixStoreIT.runTest(BaseHivePhoenixStoreIT.java:117)
> at
> org.apache.phoenix.hive.HivePhoenixStoreIT.simpleColumnMapTest(HivePhoenixStoreIT.java:103)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> at
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> at org.junit.runners.Suite.runChild(Suite.java:128)
> at org.junit.runners.Suite.runChild(Suite.java:27)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> at
> org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55)
> at
> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137)
> at
> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
> at
> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
> at
> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
> at
> org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:157)
> at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386)
> at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323)
> at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143)
> Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has
> already shutdown. Application application_1550371508120_0001 failed 2
> times due to AM Container for appattempt_1550371508120_0001_000002
> exited with exitCode: 127
> For more detailed output, check application tracking
> page:
> http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then,
> click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1550371508120_0001_02_000001
> Exit code: 127
> Stack trace: ExitCodeException exitCode=127:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
> at org.apache.hadoop.util.Shell.run(Shell.java:456)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:748)
>
>
> Container exited with a non-zero exit code 127
> Failing this attempt. Failing the application.
> at
> org.apache.tez.client.TezClient.waitTillReady(TezClient.java:914)
> at
> org.apache.tez.client.TezClient.waitTillReady(TezClient.java:883)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:205)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116)
> at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:532)
> ... 40 more
>