You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@tez.apache.org by Sam Joe <ga...@gmail.com> on 2016/04/06 19:51:00 UTC
Unable To Build Apache Tez 0.7.1 on Hadoop 2.7
Hi,
Could any help me in resolving the following error which I am getting while
building Apache Tez 0.7.1 on Hadoop 2.7:
*testCommitOutputOnDAGSuccess(org.apache.tez.dag.app.TestMockDAGAppMaster)
Time elapsed: 0.453 sec <<< ERROR!*
*org.apache.tez.dag.api.TezException: App master already running a DAG*
* at
org.apache.tez.dag.app.DAGAppMaster.submitDAGToAppMaster(DAGAppMaster.java:1256)*
I can see that there is a Jira found in the following link but not sure how
to use the fix.
https://issues.apache.org/jira/browse/TEZ-2307
Please help.
Thanks,
Sam
Re: Unable To Build Apache Tez 0.7.1 on Hadoop 2.7
Posted by Sam Joe <ga...@gmail.com>.
Thanks Hitesh for your help!
I followed your instruction and successfully built Tez for runtime only,
without the UI. I will try to resolve the Tez-UI sometime later.
Thanks!
On Wed, Apr 6, 2016 at 6:22 PM, Hitesh Shah <hi...@apache.org> wrote:
> We have been seeing some recent failures due to some form of npm registry
> errors even though no code has changed (
> https://issues.apache.org/jira/browse/TEZ-3201 ) - is this what you are
> seeing?
>
> BIGTOP-1826 is a different issue. That is due to the frontend-plugin not
> being compatible with certain versions of maven ( 0.0.22 is not compatible
> with mvn 3.3 ).This was fixed in Tez by switching the frontend plugin
> version based on the mvn version in use. If you check the top-level pom, it
> is defaulting to 0.0.23 but falls back to 0.0.22 if you have an older
> version of mvn.
>
> That said, a simpler approach for your case is to remove tez-ui from the
> module list at the top-level and re-compile ( i.e. not build tez-ui
> module). The tez-ui.war is not really used by the tez runtime but only used
> as part of the Tez UI. For this, you can download the war from
> https://repository.apache.org/content/groups/public/org/apache/tez/tez-ui/
> and use as needed if you have the UI deployed.
>
> thanks
> — Hitesh
>
>
> On Apr 6, 2016, at 2:47 PM, Sam Joe <ga...@gmail.com> wrote:
>
> > Thanks for your valuable suggestion. I used -fae option to skip the
> errors and proceed with the ones which is working.
> > sudo mvn clean package -DskipTests=true -Dmaven.javadoc.skip=true
> -Dfrontend-maven-plugin.version=0.0.22 -fae
> >
> > Now I'm stuck with only the following 2 errors:
> >
> > [ERROR] Failed to execute goal
> com.github.eirslett:frontend-maven-plugin:0.0.16:npm (npm install) on
> project tez-ui: Failed to run task: 'npm install --color=false' failed.
> (error code 34) -> [Help 1]
> > [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-assembly-plugin:2.4:single (package-tez) on
> project tez-dist: Failed to create assembly: Artifact:
> org.apache.tez:tez-ui:war:0.7.0 (included by module) does not have an
> artifact with a file. Please ensure the package phase is run before the
> assembly is generated. -> [Help 2]
> >
> >
> > [INFO] tez ............................................... SUCCESS
> [3.861s]
> > [INFO] tez-api ........................................... SUCCESS
> [37.493s]
> > [INFO] tez-common ........................................ SUCCESS
> [3.843s]
> > [INFO] tez-runtime-internals ............................. SUCCESS
> [5.211s]
> > [INFO] tez-runtime-library ............................... SUCCESS
> [9.675s]
> > [INFO] tez-mapreduce ..................................... SUCCESS
> [11.038s]
> > [INFO] tez-examples ...................................... SUCCESS
> [1.355s]
> > [INFO] tez-dag ........................................... SUCCESS
> [21.797s]
> > [INFO] tez-tests ......................................... SUCCESS
> [4.109s]
> > [INFO] tez-ui ............................................ FAILURE
> [1:12.348s]
> > [INFO] tez-plugins ....................................... SUCCESS
> [0.057s]
> > [INFO] tez-yarn-timeline-history ......................... SUCCESS
> [1.816s]
> > [INFO] tez-yarn-timeline-history-with-acls ............... SUCCESS
> [1.292s]
> > [INFO] tez-mbeans-resource-calculator .................... SUCCESS
> [0.640s]
> > [INFO] tez-tools ......................................... SUCCESS
> [0.148s]
> > [INFO] tez-dist .......................................... FAILURE
> [8.107s]
> > [INFO] Tez ............................................... SUCCESS
> [0.063s]
> >
> > For the npm error I see a open JIRA :
> https://issues.apache.org/jira/browse/BIGTOP-1826
> >
> > Do you have any suggestion?
> >
> > Thanks.
> >
> >
> > On Wed, Apr 6, 2016 at 4:13 PM Hitesh Shah <hi...@apache.org> wrote:
> > Not sure why you are hitting those timeouts. Are you running this on a
> small-sized VM which may be impacting the tests? Running locally on my
> laptop, I don’t seem to be having any issues doing a mvn test on 0.7.0
> against hadoop-2.7.0.
> >
> > One option would be to just do a fail-at-end and then re-run the failed
> tests separately to see if they are just flaky on your env.
> >
> > thanks
> > — Hitesh
> >
> > On Apr 6, 2016, at 12:48 PM, Sam Joe <ga...@gmail.com> wrote:
> >
> > > Hi Hitesh,
> > >
> > > My environment: Hadoop 2.7.0
> > > As suggested by you I'm trying with apache-tez-0.7.0-src
> > >
> > > I've to use the following command to avoid npm and Dfrontend missing
> error:
> > >
> > > sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22
> > >
> > > I keep getting timeout error while building Tez as shown in the error
> log below:
> > >
> > >
> -------------------------------------------------------------------------------
> > > Test set: org.apache.tez.client.TestTezClient
> > >
> -------------------------------------------------------------------------------
> > > Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.013
> sec <<< FAILURE!
> > > testTezclientSession(org.apache.tez.client.TestTezClient) Time
> elapsed: 5.062 sec <<< ERROR!
> > > java.lang.Exception: test timed out after 5000 milliseconds
> > >
> > > (Earlier I was able to build apache-tez-0.5.0-src in the same
> environment however had to upgrade to 0.7.0 in order to avoid some bugs
> fixed in 0.7.0 version).
> > >
> > > Please help.
> > >
> > >
> > > Thanks,
> > > Joel
> > >
> > > On Wed, Apr 6, 2016 at 3:01 PM Hitesh Shah <hi...@apache.org> wrote:
> > > Hello Sam,
> > >
> > > Couple of things to confirm:
> > > - I assume you are building branch-0.7 of Tez for 0.7.1-SNAPSHOT
> as there has not yet been a release of 0.7.1?
> > > - For hadoop, are you using hadoop-2.7.0 or hadoop-2.7.1 ( though
> this really should not be too relevant here )?
> > >
> > > I took branch-0.7 of the current code base and compiled it against
> hadoop-2.7.1. I also ran the test that was failing and it did not fail.
> > >
> > > Picked up _JAVA_OPTIONS: -Djava.awt.headless=true
> > > Running org.apache.tez.dag.app.TestMockDAGAppMaster
> > > 2016-04-06 11:31:18.076 java[20695:1903] Unable to load realm info
> from SCDynamicStore
> > > Tests run: 17, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 5.788
> sec
> > >
> > > I think this might be a flaky test that we need to fix. I would
> suggest filing a bug for this with the surefire logs for the test in
> question so that it will help us debug the flaky failure. Please update the
> jira with hadoop version too. If this test is consistently failing for
> you, let us know ( if not, a quick fix would be to just patch the code with
> an @Ignore to skip the test )
> > >
> > > thanks
> > > — Hitesh
> > >
> > >
> > > On Apr 6, 2016, at 10:57 AM, Sam Joe <ga...@gmail.com> wrote:
> > >
> > > > I am using the following command for building Tez.
> > > >
> > > > sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22
> > > >
> > > > Thanks,
> > > > Joel
> > > >
> > > > On Wed, Apr 6, 2016 at 1:51 PM, Sam Joe <ga...@gmail.com>
> wrote:
> > > > Hi,
> > > >
> > > > Could any help me in resolving the following error which I am
> getting while building Apache Tez 0.7.1 on Hadoop 2.7:
> > > >
> > > >
> testCommitOutputOnDAGSuccess(org.apache.tez.dag.app.TestMockDAGAppMaster)
> Time elapsed: 0.453 sec <<< ERROR!
> > > > org.apache.tez.dag.api.TezException: App master already running a DAG
> > > > at
> org.apache.tez.dag.app.DAGAppMaster.submitDAGToAppMaster(DAGAppMaster.java:1256)
> > > >
> > > > I can see that there is a Jira found in the following link but not
> sure how to use the fix.
> > > >
> > > > https://issues.apache.org/jira/browse/TEZ-2307
> > > >
> > > > Please help.
> > > >
> > > > Thanks,
> > > > Sam
> > > >
> > >
> >
>
>
Re: Unable To Build Apache Tez 0.7.1 on Hadoop 2.7
Posted by Hitesh Shah <hi...@apache.org>.
We have been seeing some recent failures due to some form of npm registry errors even though no code has changed ( https://issues.apache.org/jira/browse/TEZ-3201 ) - is this what you are seeing?
BIGTOP-1826 is a different issue. That is due to the frontend-plugin not being compatible with certain versions of maven ( 0.0.22 is not compatible with mvn 3.3 ).This was fixed in Tez by switching the frontend plugin version based on the mvn version in use. If you check the top-level pom, it is defaulting to 0.0.23 but falls back to 0.0.22 if you have an older version of mvn.
That said, a simpler approach for your case is to remove tez-ui from the module list at the top-level and re-compile ( i.e. not build tez-ui module). The tez-ui.war is not really used by the tez runtime but only used as part of the Tez UI. For this, you can download the war from https://repository.apache.org/content/groups/public/org/apache/tez/tez-ui/ and use as needed if you have the UI deployed.
thanks
— Hitesh
On Apr 6, 2016, at 2:47 PM, Sam Joe <ga...@gmail.com> wrote:
> Thanks for your valuable suggestion. I used -fae option to skip the errors and proceed with the ones which is working.
> sudo mvn clean package -DskipTests=true -Dmaven.javadoc.skip=true -Dfrontend-maven-plugin.version=0.0.22 -fae
>
> Now I'm stuck with only the following 2 errors:
>
> [ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:0.0.16:npm (npm install) on project tez-ui: Failed to run task: 'npm install --color=false' failed. (error code 34) -> [Help 1]
> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.4:single (package-tez) on project tez-dist: Failed to create assembly: Artifact: org.apache.tez:tez-ui:war:0.7.0 (included by module) does not have an artifact with a file. Please ensure the package phase is run before the assembly is generated. -> [Help 2]
>
>
> [INFO] tez ............................................... SUCCESS [3.861s]
> [INFO] tez-api ........................................... SUCCESS [37.493s]
> [INFO] tez-common ........................................ SUCCESS [3.843s]
> [INFO] tez-runtime-internals ............................. SUCCESS [5.211s]
> [INFO] tez-runtime-library ............................... SUCCESS [9.675s]
> [INFO] tez-mapreduce ..................................... SUCCESS [11.038s]
> [INFO] tez-examples ...................................... SUCCESS [1.355s]
> [INFO] tez-dag ........................................... SUCCESS [21.797s]
> [INFO] tez-tests ......................................... SUCCESS [4.109s]
> [INFO] tez-ui ............................................ FAILURE [1:12.348s]
> [INFO] tez-plugins ....................................... SUCCESS [0.057s]
> [INFO] tez-yarn-timeline-history ......................... SUCCESS [1.816s]
> [INFO] tez-yarn-timeline-history-with-acls ............... SUCCESS [1.292s]
> [INFO] tez-mbeans-resource-calculator .................... SUCCESS [0.640s]
> [INFO] tez-tools ......................................... SUCCESS [0.148s]
> [INFO] tez-dist .......................................... FAILURE [8.107s]
> [INFO] Tez ............................................... SUCCESS [0.063s]
>
> For the npm error I see a open JIRA : https://issues.apache.org/jira/browse/BIGTOP-1826
>
> Do you have any suggestion?
>
> Thanks.
>
>
> On Wed, Apr 6, 2016 at 4:13 PM Hitesh Shah <hi...@apache.org> wrote:
> Not sure why you are hitting those timeouts. Are you running this on a small-sized VM which may be impacting the tests? Running locally on my laptop, I don’t seem to be having any issues doing a mvn test on 0.7.0 against hadoop-2.7.0.
>
> One option would be to just do a fail-at-end and then re-run the failed tests separately to see if they are just flaky on your env.
>
> thanks
> — Hitesh
>
> On Apr 6, 2016, at 12:48 PM, Sam Joe <ga...@gmail.com> wrote:
>
> > Hi Hitesh,
> >
> > My environment: Hadoop 2.7.0
> > As suggested by you I'm trying with apache-tez-0.7.0-src
> >
> > I've to use the following command to avoid npm and Dfrontend missing error:
> >
> > sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22
> >
> > I keep getting timeout error while building Tez as shown in the error log below:
> >
> > -------------------------------------------------------------------------------
> > Test set: org.apache.tez.client.TestTezClient
> > -------------------------------------------------------------------------------
> > Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.013 sec <<< FAILURE!
> > testTezclientSession(org.apache.tez.client.TestTezClient) Time elapsed: 5.062 sec <<< ERROR!
> > java.lang.Exception: test timed out after 5000 milliseconds
> >
> > (Earlier I was able to build apache-tez-0.5.0-src in the same environment however had to upgrade to 0.7.0 in order to avoid some bugs fixed in 0.7.0 version).
> >
> > Please help.
> >
> >
> > Thanks,
> > Joel
> >
> > On Wed, Apr 6, 2016 at 3:01 PM Hitesh Shah <hi...@apache.org> wrote:
> > Hello Sam,
> >
> > Couple of things to confirm:
> > - I assume you are building branch-0.7 of Tez for 0.7.1-SNAPSHOT as there has not yet been a release of 0.7.1?
> > - For hadoop, are you using hadoop-2.7.0 or hadoop-2.7.1 ( though this really should not be too relevant here )?
> >
> > I took branch-0.7 of the current code base and compiled it against hadoop-2.7.1. I also ran the test that was failing and it did not fail.
> >
> > Picked up _JAVA_OPTIONS: -Djava.awt.headless=true
> > Running org.apache.tez.dag.app.TestMockDAGAppMaster
> > 2016-04-06 11:31:18.076 java[20695:1903] Unable to load realm info from SCDynamicStore
> > Tests run: 17, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 5.788 sec
> >
> > I think this might be a flaky test that we need to fix. I would suggest filing a bug for this with the surefire logs for the test in question so that it will help us debug the flaky failure. Please update the jira with hadoop version too. If this test is consistently failing for you, let us know ( if not, a quick fix would be to just patch the code with an @Ignore to skip the test )
> >
> > thanks
> > — Hitesh
> >
> >
> > On Apr 6, 2016, at 10:57 AM, Sam Joe <ga...@gmail.com> wrote:
> >
> > > I am using the following command for building Tez.
> > >
> > > sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22
> > >
> > > Thanks,
> > > Joel
> > >
> > > On Wed, Apr 6, 2016 at 1:51 PM, Sam Joe <ga...@gmail.com> wrote:
> > > Hi,
> > >
> > > Could any help me in resolving the following error which I am getting while building Apache Tez 0.7.1 on Hadoop 2.7:
> > >
> > > testCommitOutputOnDAGSuccess(org.apache.tez.dag.app.TestMockDAGAppMaster) Time elapsed: 0.453 sec <<< ERROR!
> > > org.apache.tez.dag.api.TezException: App master already running a DAG
> > > at org.apache.tez.dag.app.DAGAppMaster.submitDAGToAppMaster(DAGAppMaster.java:1256)
> > >
> > > I can see that there is a Jira found in the following link but not sure how to use the fix.
> > >
> > > https://issues.apache.org/jira/browse/TEZ-2307
> > >
> > > Please help.
> > >
> > > Thanks,
> > > Sam
> > >
> >
>
Re: Unable To Build Apache Tez 0.7.1 on Hadoop 2.7
Posted by Sam Joe <ga...@gmail.com>.
Thanks for your valuable suggestion. I used -fae option to skip the errors
and proceed with the ones which is working.
*sudo mvn clean package -DskipTests=true -Dmaven.javadoc.skip=true
-Dfrontend-maven-plugin.version=0.0.22 -fae*
Now I'm stuck with only the following 2 errors:
*[ERROR] Failed to execute goal
com.github.eirslett:frontend-maven-plugin:0.0.16:npm (npm install) on
project tez-ui: Failed to run task: 'npm install --color=false' failed.
(error code 34) -> [Help 1]*
*[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-assembly-plugin:2.4:single (package-tez) on
project tez-dist: Failed to create assembly: Artifact:
org.apache.tez:tez-ui:war:0.7.0 (included by module) does not have an
artifact with a file. Please ensure the package phase is run before the
assembly is generated. -> [Help 2]*
*[INFO] tez ............................................... SUCCESS
[3.861s]*
*[INFO] tez-api ........................................... SUCCESS
[37.493s]*
*[INFO] tez-common ........................................ SUCCESS
[3.843s]*
*[INFO] tez-runtime-internals ............................. SUCCESS
[5.211s]*
*[INFO] tez-runtime-library ............................... SUCCESS
[9.675s]*
*[INFO] tez-mapreduce ..................................... SUCCESS
[11.038s]*
*[INFO] tez-examples ...................................... SUCCESS
[1.355s]*
*[INFO] tez-dag ........................................... SUCCESS
[21.797s]*
*[INFO] tez-tests ......................................... SUCCESS
[4.109s]*
*[INFO] tez-ui ............................................ FAILURE
[1:12.348s]*
*[INFO] tez-plugins ....................................... SUCCESS
[0.057s]*
*[INFO] tez-yarn-timeline-history ......................... SUCCESS
[1.816s]*
*[INFO] tez-yarn-timeline-history-with-acls ............... SUCCESS
[1.292s]*
*[INFO] tez-mbeans-resource-calculator .................... SUCCESS
[0.640s]*
*[INFO] tez-tools ......................................... SUCCESS
[0.148s]*
*[INFO] tez-dist .......................................... FAILURE
[8.107s]*
*[INFO] Tez ............................................... SUCCESS
[0.063s]*
For the npm error I see a open JIRA :
https://issues.apache.org/jira/browse/BIGTOP-1826
Do you have any suggestion?
Thanks.
On Wed, Apr 6, 2016 at 4:13 PM Hitesh Shah <hi...@apache.org> wrote:
> Not sure why you are hitting those timeouts. Are you running this on a
> small-sized VM which may be impacting the tests? Running locally on my
> laptop, I don’t seem to be having any issues doing a mvn test on 0.7.0
> against hadoop-2.7.0.
>
> One option would be to just do a fail-at-end and then re-run the failed
> tests separately to see if they are just flaky on your env.
>
> thanks
> — Hitesh
>
> On Apr 6, 2016, at 12:48 PM, Sam Joe <ga...@gmail.com> wrote:
>
> > Hi Hitesh,
> >
> > My environment: Hadoop 2.7.0
> > As suggested by you I'm trying with apache-tez-0.7.0-src
> >
> > I've to use the following command to avoid npm and Dfrontend missing
> error:
> >
> > sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22
> >
> > I keep getting timeout error while building Tez as shown in the error
> log below:
> >
> >
> -------------------------------------------------------------------------------
> > Test set: org.apache.tez.client.TestTezClient
> >
> -------------------------------------------------------------------------------
> > Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.013
> sec <<< FAILURE!
> > testTezclientSession(org.apache.tez.client.TestTezClient) Time elapsed:
> 5.062 sec <<< ERROR!
> > java.lang.Exception: test timed out after 5000 milliseconds
> >
> > (Earlier I was able to build apache-tez-0.5.0-src in the same
> environment however had to upgrade to 0.7.0 in order to avoid some bugs
> fixed in 0.7.0 version).
> >
> > Please help.
> >
> >
> > Thanks,
> > Joel
> >
> > On Wed, Apr 6, 2016 at 3:01 PM Hitesh Shah <hi...@apache.org> wrote:
> > Hello Sam,
> >
> > Couple of things to confirm:
> > - I assume you are building branch-0.7 of Tez for 0.7.1-SNAPSHOT as
> there has not yet been a release of 0.7.1?
> > - For hadoop, are you using hadoop-2.7.0 or hadoop-2.7.1 ( though
> this really should not be too relevant here )?
> >
> > I took branch-0.7 of the current code base and compiled it against
> hadoop-2.7.1. I also ran the test that was failing and it did not fail.
> >
> > Picked up _JAVA_OPTIONS: -Djava.awt.headless=true
> > Running org.apache.tez.dag.app.TestMockDAGAppMaster
> > 2016-04-06 11:31:18.076 java[20695:1903] Unable to load realm info from
> SCDynamicStore
> > Tests run: 17, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 5.788
> sec
> >
> > I think this might be a flaky test that we need to fix. I would suggest
> filing a bug for this with the surefire logs for the test in question so
> that it will help us debug the flaky failure. Please update the jira with
> hadoop version too. If this test is consistently failing for you, let us
> know ( if not, a quick fix would be to just patch the code with an @Ignore
> to skip the test )
> >
> > thanks
> > — Hitesh
> >
> >
> > On Apr 6, 2016, at 10:57 AM, Sam Joe <ga...@gmail.com> wrote:
> >
> > > I am using the following command for building Tez.
> > >
> > > sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22
> > >
> > > Thanks,
> > > Joel
> > >
> > > On Wed, Apr 6, 2016 at 1:51 PM, Sam Joe <ga...@gmail.com>
> wrote:
> > > Hi,
> > >
> > > Could any help me in resolving the following error which I am getting
> while building Apache Tez 0.7.1 on Hadoop 2.7:
> > >
> > >
> testCommitOutputOnDAGSuccess(org.apache.tez.dag.app.TestMockDAGAppMaster)
> Time elapsed: 0.453 sec <<< ERROR!
> > > org.apache.tez.dag.api.TezException: App master already running a DAG
> > > at
> org.apache.tez.dag.app.DAGAppMaster.submitDAGToAppMaster(DAGAppMaster.java:1256)
> > >
> > > I can see that there is a Jira found in the following link but not
> sure how to use the fix.
> > >
> > > https://issues.apache.org/jira/browse/TEZ-2307
> > >
> > > Please help.
> > >
> > > Thanks,
> > > Sam
> > >
> >
>
>
Re: Unable To Build Apache Tez 0.7.1 on Hadoop 2.7
Posted by Hitesh Shah <hi...@apache.org>.
Not sure why you are hitting those timeouts. Are you running this on a small-sized VM which may be impacting the tests? Running locally on my laptop, I don’t seem to be having any issues doing a mvn test on 0.7.0 against hadoop-2.7.0.
One option would be to just do a fail-at-end and then re-run the failed tests separately to see if they are just flaky on your env.
thanks
— Hitesh
On Apr 6, 2016, at 12:48 PM, Sam Joe <ga...@gmail.com> wrote:
> Hi Hitesh,
>
> My environment: Hadoop 2.7.0
> As suggested by you I'm trying with apache-tez-0.7.0-src
>
> I've to use the following command to avoid npm and Dfrontend missing error:
>
> sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22
>
> I keep getting timeout error while building Tez as shown in the error log below:
>
> -------------------------------------------------------------------------------
> Test set: org.apache.tez.client.TestTezClient
> -------------------------------------------------------------------------------
> Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.013 sec <<< FAILURE!
> testTezclientSession(org.apache.tez.client.TestTezClient) Time elapsed: 5.062 sec <<< ERROR!
> java.lang.Exception: test timed out after 5000 milliseconds
>
> (Earlier I was able to build apache-tez-0.5.0-src in the same environment however had to upgrade to 0.7.0 in order to avoid some bugs fixed in 0.7.0 version).
>
> Please help.
>
>
> Thanks,
> Joel
>
> On Wed, Apr 6, 2016 at 3:01 PM Hitesh Shah <hi...@apache.org> wrote:
> Hello Sam,
>
> Couple of things to confirm:
> - I assume you are building branch-0.7 of Tez for 0.7.1-SNAPSHOT as there has not yet been a release of 0.7.1?
> - For hadoop, are you using hadoop-2.7.0 or hadoop-2.7.1 ( though this really should not be too relevant here )?
>
> I took branch-0.7 of the current code base and compiled it against hadoop-2.7.1. I also ran the test that was failing and it did not fail.
>
> Picked up _JAVA_OPTIONS: -Djava.awt.headless=true
> Running org.apache.tez.dag.app.TestMockDAGAppMaster
> 2016-04-06 11:31:18.076 java[20695:1903] Unable to load realm info from SCDynamicStore
> Tests run: 17, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 5.788 sec
>
> I think this might be a flaky test that we need to fix. I would suggest filing a bug for this with the surefire logs for the test in question so that it will help us debug the flaky failure. Please update the jira with hadoop version too. If this test is consistently failing for you, let us know ( if not, a quick fix would be to just patch the code with an @Ignore to skip the test )
>
> thanks
> — Hitesh
>
>
> On Apr 6, 2016, at 10:57 AM, Sam Joe <ga...@gmail.com> wrote:
>
> > I am using the following command for building Tez.
> >
> > sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22
> >
> > Thanks,
> > Joel
> >
> > On Wed, Apr 6, 2016 at 1:51 PM, Sam Joe <ga...@gmail.com> wrote:
> > Hi,
> >
> > Could any help me in resolving the following error which I am getting while building Apache Tez 0.7.1 on Hadoop 2.7:
> >
> > testCommitOutputOnDAGSuccess(org.apache.tez.dag.app.TestMockDAGAppMaster) Time elapsed: 0.453 sec <<< ERROR!
> > org.apache.tez.dag.api.TezException: App master already running a DAG
> > at org.apache.tez.dag.app.DAGAppMaster.submitDAGToAppMaster(DAGAppMaster.java:1256)
> >
> > I can see that there is a Jira found in the following link but not sure how to use the fix.
> >
> > https://issues.apache.org/jira/browse/TEZ-2307
> >
> > Please help.
> >
> > Thanks,
> > Sam
> >
>
Re: Unable To Build Apache Tez 0.7.1 on Hadoop 2.7
Posted by Sam Joe <ga...@gmail.com>.
Hi Hitesh,
My environment: Hadoop 2.7.0
As suggested by you I'm trying with apache-tez-0.7.0-src
I've to use the following command to avoid npm and Dfrontend missing error:
*sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22*
I keep getting timeout error while building Tez as shown in the error log
below:
*-------------------------------------------------------------------------------*
*Test set: org.apache.tez.client.TestTezClient*
*-------------------------------------------------------------------------------*
*Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.013 sec
<<< FAILURE!*
*testTezclientSession(org.apache.tez.client.TestTezClient) Time elapsed:
5.062 sec <<< ERROR!*
*java.lang.Exception: test timed out after 5000 milliseconds*
(Earlier I was able to build apache-tez-0.5.0-src in the same environment
however had to upgrade to 0.7.0 in order to avoid some bugs fixed in 0.7.0
version).
Please help.
Thanks,
Joel
On Wed, Apr 6, 2016 at 3:01 PM Hitesh Shah <hi...@apache.org> wrote:
> Hello Sam,
>
> Couple of things to confirm:
> - I assume you are building branch-0.7 of Tez for 0.7.1-SNAPSHOT as
> there has not yet been a release of 0.7.1?
> - For hadoop, are you using hadoop-2.7.0 or hadoop-2.7.1 ( though this
> really should not be too relevant here )?
>
> I took branch-0.7 of the current code base and compiled it against
> hadoop-2.7.1. I also ran the test that was failing and it did not fail.
>
> Picked up _JAVA_OPTIONS: -Djava.awt.headless=true
> Running org.apache.tez.dag.app.TestMockDAGAppMaster
> 2016-04-06 11:31:18.076 java[20695:1903] Unable to load realm info from
> SCDynamicStore
> Tests run: 17, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 5.788 sec
>
> I think this might be a flaky test that we need to fix. I would suggest
> filing a bug for this with the surefire logs for the test in question so
> that it will help us debug the flaky failure. Please update the jira with
> hadoop version too. If this test is consistently failing for you, let us
> know ( if not, a quick fix would be to just patch the code with an @Ignore
> to skip the test )
>
> thanks
> — Hitesh
>
>
> On Apr 6, 2016, at 10:57 AM, Sam Joe <ga...@gmail.com> wrote:
>
> > I am using the following command for building Tez.
> >
> > sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22
> >
> > Thanks,
> > Joel
> >
> > On Wed, Apr 6, 2016 at 1:51 PM, Sam Joe <ga...@gmail.com> wrote:
> > Hi,
> >
> > Could any help me in resolving the following error which I am getting
> while building Apache Tez 0.7.1 on Hadoop 2.7:
> >
> >
> testCommitOutputOnDAGSuccess(org.apache.tez.dag.app.TestMockDAGAppMaster)
> Time elapsed: 0.453 sec <<< ERROR!
> > org.apache.tez.dag.api.TezException: App master already running a DAG
> > at
> org.apache.tez.dag.app.DAGAppMaster.submitDAGToAppMaster(DAGAppMaster.java:1256)
> >
> > I can see that there is a Jira found in the following link but not sure
> how to use the fix.
> >
> > https://issues.apache.org/jira/browse/TEZ-2307
> >
> > Please help.
> >
> > Thanks,
> > Sam
> >
>
>
Re: Unable To Build Apache Tez 0.7.1 on Hadoop 2.7
Posted by Hitesh Shah <hi...@apache.org>.
Hello Sam,
Couple of things to confirm:
- I assume you are building branch-0.7 of Tez for 0.7.1-SNAPSHOT as there has not yet been a release of 0.7.1?
- For hadoop, are you using hadoop-2.7.0 or hadoop-2.7.1 ( though this really should not be too relevant here )?
I took branch-0.7 of the current code base and compiled it against hadoop-2.7.1. I also ran the test that was failing and it did not fail.
Picked up _JAVA_OPTIONS: -Djava.awt.headless=true
Running org.apache.tez.dag.app.TestMockDAGAppMaster
2016-04-06 11:31:18.076 java[20695:1903] Unable to load realm info from SCDynamicStore
Tests run: 17, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 5.788 sec
I think this might be a flaky test that we need to fix. I would suggest filing a bug for this with the surefire logs for the test in question so that it will help us debug the flaky failure. Please update the jira with hadoop version too. If this test is consistently failing for you, let us know ( if not, a quick fix would be to just patch the code with an @Ignore to skip the test )
thanks
— Hitesh
On Apr 6, 2016, at 10:57 AM, Sam Joe <ga...@gmail.com> wrote:
> I am using the following command for building Tez.
>
> sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22
>
> Thanks,
> Joel
>
> On Wed, Apr 6, 2016 at 1:51 PM, Sam Joe <ga...@gmail.com> wrote:
> Hi,
>
> Could any help me in resolving the following error which I am getting while building Apache Tez 0.7.1 on Hadoop 2.7:
>
> testCommitOutputOnDAGSuccess(org.apache.tez.dag.app.TestMockDAGAppMaster) Time elapsed: 0.453 sec <<< ERROR!
> org.apache.tez.dag.api.TezException: App master already running a DAG
> at org.apache.tez.dag.app.DAGAppMaster.submitDAGToAppMaster(DAGAppMaster.java:1256)
>
> I can see that there is a Jira found in the following link but not sure how to use the fix.
>
> https://issues.apache.org/jira/browse/TEZ-2307
>
> Please help.
>
> Thanks,
> Sam
>
Re: Unable To Build Apache Tez 0.7.1 on Hadoop 2.7
Posted by Sam Joe <ga...@gmail.com>.
I am using the following command for building Tez.
sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22
Thanks,
Joel
On Wed, Apr 6, 2016 at 1:51 PM, Sam Joe <ga...@gmail.com> wrote:
> Hi,
>
> Could any help me in resolving the following error which I am getting
> while building Apache Tez 0.7.1 on Hadoop 2.7:
>
> *testCommitOutputOnDAGSuccess(org.apache.tez.dag.app.TestMockDAGAppMaster)
> Time elapsed: 0.453 sec <<< ERROR!*
> *org.apache.tez.dag.api.TezException: App master already running a DAG*
> * at
> org.apache.tez.dag.app.DAGAppMaster.submitDAGToAppMaster(DAGAppMaster.java:1256)*
>
> I can see that there is a Jira found in the following link but not sure
> how to use the fix.
>
> https://issues.apache.org/jira/browse/TEZ-2307
>
> Please help.
>
> Thanks,
> Sam
>