You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Andrew Purtell (JIRA)" <ji...@apache.org> on 2012/05/21 22:20:42 UTC
[jira] [Comment Edited] (BIGTOP-570) Build package for Apache
Giraph
[ https://issues.apache.org/jira/browse/BIGTOP-570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13280441#comment-13280441 ]
Andrew Purtell edited comment on BIGTOP-570 at 5/21/12 8:20 PM:
----------------------------------------------------------------
Attached is an updated patch that includes a Giraph smoke test, cribbed from a unit test. I wish I could report more progress. It took too much time just to figure out Maven was pulling in dependencies to some defunct java.net repo from ZooKeeper. Now I can't seem to get Maven to select the correct Hadoop artifact ("java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected"). Perhaps this is a familiar problem?
Unfortunately just executing 'hadoop jar ...' using iTest Shell is not an option because Giraph requires execution of more than one task in parallel, something not supported by LocalTaskRunner.
Edit: Fixed formatting.
was (Author: apurtell):
Attached is an updated patch that includes a Giraph smoke test, cribbed from a unit test. I wish I could report more progress. It took too much time just to figure out Maven was pulling in dependencies to some defunct java.net repo from ZooKeeper. Now I can't seem to get Maven to select the correct Hadoop artifact ("java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapre\
duce.JobContext, but class was expected
"). Perhaps this is a familiar problem?
Unfortunately just executing 'hadoop jar ...' using iTest Shell is not an option because Giraph requires execution of more than one task in parallel, something not supported by LocalTaskRunner.
> Build package for Apache Giraph
> -------------------------------
>
> Key: BIGTOP-570
> URL: https://issues.apache.org/jira/browse/BIGTOP-570
> Project: Bigtop
> Issue Type: New Feature
> Reporter: Andrew Purtell
> Assignee: Roman Shaposhnik
> Priority: Minor
> Attachments: 0001-Giraph-package-WIP.patch.gz, 0001-Giraph-package-WIP.patch.gz
>
>
> We are basing our next internal Hadoop distribution on Bigtop and want to make Apache Giraph available to our users as part of the platform. Apache Giraph is a promising platform for running large-scale graph algorithms on top of existing Hadoop infrastructure, currently in incubation. For more information on the project, please see: http://incubator.apache.org/giraph/ If this is of interest to anyone, I've ported the RPM specfile and common build scripts to both Bigtop and Giraph trunks. Unfortunately I don't know how to package for Debian.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira