You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Eli Reisman (JIRA)" <ji...@apache.org> on 2013/04/14 18:54:15 UTC
[jira] [Resolved] (GIRAPH-629) YARN profile is broken when compiled
against hadoop-2.0.4
[ https://issues.apache.org/jira/browse/GIRAPH-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Reisman resolved GIRAPH-629.
--------------------------------
Resolution: Won't Fix
As is stated in the final Giraph-13 stuff, The hadoop version is currently hardcoded to 2.0.3 and while we can upgrade this by hand in the POMs there is no setup to move it from code yet. I would suggest a new JIRA to reconfigure the POM to accept this.
My "dream" was to have the build do something on the order of:
{code}
mvn -Phadoop_yarn,HADOOPVERSION clean install
{code}
where "HADOOPVERSION" would be the name of one of our other profiles, so that you could pick at the command line and have it blow up if the versioning made no sense (as 0.20.x would etc) but due to strange behavior in the filtering (I can't try to compile the YARN code against hadoop versions that do not supply it) this was not possible.
so option two (which might be possible) is something like this:
{code}
mvn -Phadoop_yarn -Dhadoop.version=HADOOPVERSION clean install
{code}
however early attempts to do this indicate that the POM hadoop-version is being overridden at times in our build by sub-project POM's or not propagating correctly to allow it. I ran out of time at HW to handle this, but if I didn't put up a JIRA for it already (I think I did) then we should have one, this seems like it could be done and would work.
Anyway, because this behavior (only allowing 2.0.3) is "normal" for now, I'm resolving this particular JIRA as "won't fix"
> YARN profile is broken when compiled against hadoop-2.0.4
> ---------------------------------------------------------
>
> Key: GIRAPH-629
> URL: https://issues.apache.org/jira/browse/GIRAPH-629
> Project: Giraph
> Issue Type: Bug
> Components: build
> Affects Versions: 1.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
>
> {noformat}
> $ mvn -Phadoop_yarn -DskipTests -Dhadoop.version=2.0.4-SNAPSHOT clean package
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Giraph Parent .............................. SUCCESS [1.359s]
> [INFO] Apache Giraph Core ................................ FAILURE [15.319s]
> [INFO] Apache Giraph Hive I/O ............................ SKIPPED
> [INFO] Apache Giraph Examples ............................ SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 17.374s
> [INFO] Finished at: Fri Apr 12 17:21:11 PDT 2013
> [INFO] Final Memory: 39M/481M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.0:compile (default-compile) on project giraph-core: Compilation failure: Compilation failure:
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[46,42] cannot find symbol
> [ERROR] symbol : class AMResponse
> [ERROR] location: package org.apache.hadoop.yarn.api.records
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[206,42] cannot find symbol
> [ERROR] symbol : class AMResponse
> [ERROR] location: class org.apache.giraph.yarn.GiraphApplicationMaster
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[291,47] cannot find symbol
> [ERROR] symbol : class AMResponse
> [ERROR] location: class org.apache.giraph.yarn.GiraphApplicationMaster
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[368,11] cannot find symbol
> [ERROR] symbol : class AMResponse
> [ERROR] location: class org.apache.giraph.yarn.GiraphApplicationMaster
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[398,35] cannot find symbol
> [ERROR] symbol : class AMResponse
> [ERROR] location: class org.apache.giraph.yarn.GiraphApplicationMaster
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[178,7] cannot find symbol
> [ERROR] symbol : class AMResponse
> [ERROR] location: class org.apache.giraph.yarn.GiraphApplicationMaster
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[255,26] cannot find symbol
> [ERROR] symbol : method getAMResponse()
> [ERROR] location: interface org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[296,37] cannot find symbol
> [ERROR] symbol : method getAMResponse()
> [ERROR] location: interface org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[327,49] cannot find symbol
> [ERROR] symbol : method getState()
> [ERROR] location: interface org.apache.hadoop.yarn.api.records.Container
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[349,46] cannot find symbol
> [ERROR] symbol : method getAMResponse()
> [ERROR] location: interface org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[353,42] cannot find symbol
> [ERROR] symbol : method getAMResponse()
> [ERROR] location: interface org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[379,7] cannot find symbol
> [ERROR] symbol : class AMResponse
> [ERROR] location: class org.apache.giraph.yarn.GiraphApplicationMaster
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[379,44] cannot find symbol
> [ERROR] symbol : method getAMResponse()
> [ERROR] location: interface org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR] mvn <goals> -rf :giraph-core
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira