You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by Mike Liddell <Mi...@microsoft.com> on 2013/03/26 21:00:03 UTC
getting started with Tez
I'm working to get a basic build and run.. a few notes
1. Eclipse project dependencies
I initially created an empty eclipse workspace and imported D:\src\tez-trunk. However I found I needed to have a single workspace with all the Yarn projects and Tez projects.
I now have a workspace with the full set of projects from d:\src\yarn-trunk + d:\src\tez-trunk. This seems happy.
If there is a better way to set things up, pls share.
2. Junit dependency
My initial java builds in eclipse complained that the Junit 4.11 jars couldn't be found in .m2 cache.
-> I think the projects using junit need a maven dependency added. (or perhaps this can go in the root pom.xml?)
(attached: tez-junit-dependency.patch)
3. Tez-yarn-application build fails
I run the build (on windows) via >mvn package -DskipTests
Can't find symbol AMResponse.
=> should I be adding a class path entry to Yarn, eg D:\src\yarn-trunk\hadoop-yarn-project\hadoop-yarn\hadoop-yarn-api\target\classes\org\apache\hadoop\yarn\api\records\AMResponse.class?
Help on this one appreciated
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] tez ............................................... SUCCESS [0.269s]
[INFO] tez-api ........................................... SUCCESS [1.967s]
[INFO] tez-common ........................................ SUCCESS [1.346s]
[INFO] tez-engine ........................................ SUCCESS [2.217s]
[INFO] tez-mapreduce ..................................... SUCCESS [2.625s]
[INFO] tez-yarn-application .............................. FAILURE [2.807s]
[INFO] tez-yarn-client ................................... SKIPPED
[INFO] tez-task-library .................................. SKIPPED
[INFO] tez-ampool ........................................ SKIPPED
[INFO] tez-dist .......................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 11.556s
[INFO] Finished at: Tue Mar 26 12:51:23 PDT 2013
[INFO] Final Memory: 53M/387M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:compile (default-compile) on project tez-yarn-application: Compilation failure: Compilation failure:
[ERROR] \src\tez-trunk\tez-yarn-application\src\main\java\org\apache\hadoop\mapreduce\v2\app2\rm\RMContainerRequestor.java:[48,41] cannot find symbol
[ERROR] symbol : class AMResponse
[ERROR] location: package org.apache.hadoop.yarn.api.records
-mike.
Re: getting started with Tez
Posted by Arun C Murthy <ac...@hortonworks.com>.
Awesome, thanks Mike!
On Mar 26, 2013, at 1:00 PM, Mike Liddell wrote:
> I’m working to get a basic build and run.. a few notes
>
> 1. Eclipse project dependencies
> I initially created an empty eclipse workspace and imported D:\src\tez-trunk. However I found I needed to have a single workspace with all the Yarn projects and Tez projects.
> I now have a workspace with the full set of projects from d:\src\yarn-trunk + d:\src\tez-trunk. This seems happy.
> If there is a better way to set things up, pls share.
>
> 2. Junit dependency
> My initial java builds in eclipse complained that the Junit 4.11 jars couldn’t be found in .m2 cache.
> -> I think the projects using junit need a maven dependency added. (or perhaps this can go in the root pom.xml?)
> (attached: tez-junit-dependency.patch)
Yes, please - can you please open a jira and attach a patch?
https://issues.apache.org/jira/browse/TEZ
>
> 3. Tez-yarn-application build fails
> I run the build (on windows) via >mvn package –DskipTests
> Can’t find symbol AMResponse.
> => should I be adding a class path entry to Yarn, eg D:\src\yarn-trunk\hadoop-yarn-project\hadoop-yarn\hadoop-yarn-api\target\classes\org\apache\hadoop\yarn\api\records\AMResponse.class?
> Help on this one appreciated
It means the dep isn't properly defined in the pom, çan you pls verify?
thanks,
Arun
>
> [INFO] -------------------------------------------------------------
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] tez ............................................... SUCCESS [0.269s]
> [INFO] tez-api ........................................... SUCCESS [1.967s]
> [INFO] tez-common ........................................ SUCCESS [1.346s]
> [INFO] tez-engine ........................................ SUCCESS [2.217s]
> [INFO] tez-mapreduce ..................................... SUCCESS [2.625s]
> [INFO] tez-yarn-application .............................. FAILURE [2.807s]
> [INFO] tez-yarn-client ................................... SKIPPED
> [INFO] tez-task-library .................................. SKIPPED
> [INFO] tez-ampool ........................................ SKIPPED
> [INFO] tez-dist .......................................... SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 11.556s
> [INFO] Finished at: Tue Mar 26 12:51:23 PDT 2013
> [INFO] Final Memory: 53M/387M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:compile (default-compile) on project tez-yarn-application: Compilation failure: Compilation failure:
> [ERROR] \src\tez-trunk\tez-yarn-application\src\main\java\org\apache\hadoop\mapreduce\v2\app2\rm\RMContainerRequestor.java:[48,41] cannot find symbol
> [ERROR] symbol : class AMResponse
> [ERROR] location: package org.apache.hadoop.yarn.api.records
>
> -mike.
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/