You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Eli Reisman (JIRA)" <ji...@apache.org> on 2013/03/28 23:55:15 UTC
[jira] [Commented] (GIRAPH-599) Hive IO dependency issues with some
Hadoop profiles
[ https://issues.apache.org/jira/browse/GIRAPH-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13616759#comment-13616759 ]
Eli Reisman commented on GIRAPH-599:
------------------------------------
I am assuming the problem is somewhere in the giraph-hive dependencies, we are using {code}hadoop.version{code} where we cannot safely do so to choose the right facebook hive io jar. Thanks!
> Hive IO dependency issues with some Hadoop profiles
> ---------------------------------------------------
>
> Key: GIRAPH-599
> URL: https://issues.apache.org/jira/browse/GIRAPH-599
> Project: Giraph
> Issue Type: Bug
> Affects Versions: 0.2.0
> Reporter: Eli Reisman
> Fix For: 0.2.0
>
>
> Hey folks. I was rebasing GIRAPH-13 for all the new changes today and now this happens:
> {code}
> [INFO] ------------------------------------------------------------------------
> [INFO] Building Apache Giraph Hive I/O 0.2-SNAPSHOT
> [INFO] ------------------------------------------------------------------------
> Downloading: http://repo1.maven.org/maven2/com/facebook/giraph/hive/hive-io-experimental/0.5/hive-io-experimental-0.5.pom
> Downloading: https://repository.cloudera.com/artifactory/cloudera-repos/com/facebook/giraph/hive/hive-io-experimental/0.5/hive-io-experimental-0.5.pom
> Downloading: https://repository.apache.org/content/groups/public/com/facebook/giraph/hive/hive-io-experimental/0.5/hive-io-experimental-0.5.pom
> Downloading: https://oss.sonatype.org/content/groups/public/com/facebook/giraph/hive/hive-io-experimental/0.5/hive-io-experimental-0.5.pom
> Downloaded: https://oss.sonatype.org/content/groups/public/com/facebook/giraph/hive/hive-io-experimental/0.5/hive-io-experimental-0.5.pom (15 KB at 20.2 KB/sec)
> Downloading: http://repo1.maven.org/maven2/com/facebook/hadoop/hadoop-core/2.0.3-alpha/hadoop-core-2.0.3-alpha.pom
> Downloading: https://repository.cloudera.com/artifactory/cloudera-repos/com/facebook/hadoop/hadoop-core/2.0.3-alpha/hadoop-core-2.0.3-alpha.pom
> Downloading: https://repository.apache.org/content/groups/public/com/facebook/hadoop/hadoop-core/2.0.3-alpha/hadoop-core-2.0.3-alpha.pom
> Downloading: https://oss.sonatype.org/content/groups/public/com/facebook/hadoop/hadoop-core/2.0.3-alpha/hadoop-core-2.0.3-alpha.pom
> [WARNING] The POM for com.facebook.hadoop:hadoop-core:jar:2.0.3-alpha is missing, no dependency information available
> Downloading: http://repo1.maven.org/maven2/com/facebook/giraph/hive/hive-io-experimental/0.5/hive-io-experimental-0.5.jar
> Downloading: http://repo1.maven.org/maven2/com/facebook/hadoop/hadoop-core/2.0.3-alpha/hadoop-core-2.0.3-alpha.jar
> Downloading: https://repository.cloudera.com/artifactory/cloudera-repos/com/facebook/giraph/hive/hive-io-experimental/0.5/hive-io-experimental-0.5.jar
> Downloading: https://repository.cloudera.com/artifactory/cloudera-repos/com/facebook/hadoop/hadoop-core/2.0.3-alpha/hadoop-core-2.0.3-alpha.jar
> Downloading: https://repository.apache.org/content/groups/public/com/facebook/giraph/hive/hive-io-experimental/0.5/hive-io-experimental-0.5.jar
> Downloading: https://repository.apache.org/content/groups/public/com/facebook/hadoop/hadoop-core/2.0.3-alpha/hadoop-core-2.0.3-alpha.jar
> Downloading: https://oss.sonatype.org/content/groups/public/com/facebook/giraph/hive/hive-io-experimental/0.5/hive-io-experimental-0.5.jar
> Downloading: https://oss.sonatype.org/content/groups/public/com/facebook/hadoop/hadoop-core/2.0.3-alpha/hadoop-core-2.0.3-alpha.jar
> Downloaded: https://oss.sonatype.org/content/groups/public/com/facebook/giraph/hive/hive-io-experimental/0.5/hive-io-experimental-0.5.jar (201 KB at 194.6 KB/sec)
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Giraph Parent .............................. SUCCESS [0.717s]
> [INFO] Apache Giraph Core ................................ SUCCESS [2:58.276s]
> [INFO] Apache Giraph Hive I/O ............................ FAILURE [6.455s]
> [INFO] Apache Giraph Examples ............................ SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 3:05.779s
> [INFO] Finished at: Thu Mar 28 14:40:17 PDT 2013
> [INFO] Final Memory: 48M/352M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal on project giraph-hive: Could not resolve dependencies for project org.apache.giraph:giraph-hive:jar:0.2-SNAPSHOT: Could not find artifact com.facebook.hadoop:hadoop-core:jar:2.0.3-alpha in central (http://repo1.maven.org/maven2) -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR] mvn <goals> -rf :giraph-hive
> {code}
> I was building the YARN profile, which used to cause giraph-hive not to build (incompatible profiles or something) but now Maven tries to download jars that don't exist. I suspect running a build on trunk right now from -Phadoop_2.0.x or -Phadoop_trunk would have the same problem?
> Everyone is iterating on the Hive IO so fast right now I don't want to mess with it, so I'm posting it here for everyone else to deal with ;)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira