You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@giraph.apache.org by Arko Provo Mukherjee <ar...@gmail.com> on 2014/03/02 02:14:24 UTC
Using Giraph
Hello Giraph Gurus,
I am interested in learning how to learn code custom graph algorithms using
Giraph.
I have some experience using MapReduce and have coded Graph Algorithms on
top of Hadoop. Now I want to learn how to do the same for Pregel (using
Giraph).
I have downloaded giraph-1.0.0 but didn't find in JAR files as you do in
Hadoop Downloads that you can compile against.
So I wanted to understand how to compile a giraph program.
Also pointing out to some trivial example code or elementary skeleton code
would really help.
Thanks a lot in advance! Appreciate all your help!
Warm regards
Arko
Re: Using Giraph
Posted by Arko Provo Mukherjee <ar...@gmail.com>.
Thanks much for the info. I will come back if I face further issues. I
surely will!
Cheers
Arko
On Tue, Mar 4, 2014 at 5:24 AM, Agrta Rawat <ag...@gmail.com> wrote:
> Yes, you have to build the jar file to use it.
>
>
> On Mon, Mar 3, 2014 at 11:46 PM, Arko Provo Mukherjee <
> arkoprovomukherjee@gmail.com> wrote:
>
>> Thanks! Let me follow the steps as given in the link.
>> Also, does this mean that Giraph doesn't come in compiled form that can
>> be directly downloaded and must be compiled in the local system before use?
>> Warm regards
>> Arko
>>
>>
>> On Sun, Mar 2, 2014 at 11:08 PM, Agrta Rawat <ag...@gmail.com>wrote:
>>
>>> Hi Arko,
>>> You first need to have java, hadoop and maven 3 or higher installed.
>>> Then, compile or install mvn. After you will get a giraph-<version>-SNAPSHOT-for-hadoop-<version>-jar-with-dependencies.jar
>>> inside GIRAPH_HOME/giraph-core/target folder. Use this jar file. Take a
>>> look at following link.
>>> https://giraph.apache.org/quick_start.html
>>>
>>>
>>> On Sun, Mar 2, 2014 at 6:44 AM, Arko Provo Mukherjee <
>>> arkoprovomukherjee@gmail.com> wrote:
>>>
>>>> Hello Giraph Gurus,
>>>>
>>>> I am interested in learning how to learn code custom graph algorithms
>>>> using Giraph.
>>>>
>>>> I have some experience using MapReduce and have coded Graph Algorithms
>>>> on top of Hadoop. Now I want to learn how to do the same for Pregel (using
>>>> Giraph).
>>>>
>>>> I have downloaded giraph-1.0.0 but didn't find in JAR files as you do
>>>> in Hadoop Downloads that you can compile against.
>>>>
>>>> So I wanted to understand how to compile a giraph program.
>>>>
>>>> Also pointing out to some trivial example code or elementary skeleton
>>>> code would really help.
>>>>
>>>> Thanks a lot in advance! Appreciate all your help!
>>>>
>>>> Warm regards
>>>> Arko
>>>>
>>>
>>>
>>
>
Re: Using Giraph
Posted by Agrta Rawat <ag...@gmail.com>.
Yes, you have to build the jar file to use it.
On Mon, Mar 3, 2014 at 11:46 PM, Arko Provo Mukherjee <
arkoprovomukherjee@gmail.com> wrote:
> Thanks! Let me follow the steps as given in the link.
> Also, does this mean that Giraph doesn't come in compiled form that can be
> directly downloaded and must be compiled in the local system before use?
> Warm regards
> Arko
>
>
> On Sun, Mar 2, 2014 at 11:08 PM, Agrta Rawat <ag...@gmail.com>wrote:
>
>> Hi Arko,
>> You first need to have java, hadoop and maven 3 or higher installed.
>> Then, compile or install mvn. After you will get a giraph-<version>-SNAPSHOT-for-hadoop-<version>-jar-with-dependencies.jar
>> inside GIRAPH_HOME/giraph-core/target folder. Use this jar file. Take a
>> look at following link.
>> https://giraph.apache.org/quick_start.html
>>
>>
>> On Sun, Mar 2, 2014 at 6:44 AM, Arko Provo Mukherjee <
>> arkoprovomukherjee@gmail.com> wrote:
>>
>>> Hello Giraph Gurus,
>>>
>>> I am interested in learning how to learn code custom graph algorithms
>>> using Giraph.
>>>
>>> I have some experience using MapReduce and have coded Graph Algorithms
>>> on top of Hadoop. Now I want to learn how to do the same for Pregel (using
>>> Giraph).
>>>
>>> I have downloaded giraph-1.0.0 but didn't find in JAR files as you do in
>>> Hadoop Downloads that you can compile against.
>>>
>>> So I wanted to understand how to compile a giraph program.
>>>
>>> Also pointing out to some trivial example code or elementary skeleton
>>> code would really help.
>>>
>>> Thanks a lot in advance! Appreciate all your help!
>>>
>>> Warm regards
>>> Arko
>>>
>>
>>
>
Re: Using Giraph
Posted by Arko Provo Mukherjee <ar...@gmail.com>.
Thanks! Let me follow the steps as given in the link.
Also, does this mean that Giraph doesn't come in compiled form that can be
directly downloaded and must be compiled in the local system before use?
Warm regards
Arko
On Sun, Mar 2, 2014 at 11:08 PM, Agrta Rawat <ag...@gmail.com> wrote:
> Hi Arko,
> You first need to have java, hadoop and maven 3 or higher installed. Then,
> compile or install mvn. After you will get a giraph-<version>-SNAPSHOT-for-hadoop-<version>-jar-with-dependencies.jar
> inside GIRAPH_HOME/giraph-core/target folder. Use this jar file. Take a
> look at following link.
> https://giraph.apache.org/quick_start.html
>
>
> On Sun, Mar 2, 2014 at 6:44 AM, Arko Provo Mukherjee <
> arkoprovomukherjee@gmail.com> wrote:
>
>> Hello Giraph Gurus,
>>
>> I am interested in learning how to learn code custom graph algorithms
>> using Giraph.
>>
>> I have some experience using MapReduce and have coded Graph Algorithms on
>> top of Hadoop. Now I want to learn how to do the same for Pregel (using
>> Giraph).
>>
>> I have downloaded giraph-1.0.0 but didn't find in JAR files as you do in
>> Hadoop Downloads that you can compile against.
>>
>> So I wanted to understand how to compile a giraph program.
>>
>> Also pointing out to some trivial example code or elementary skeleton
>> code would really help.
>>
>> Thanks a lot in advance! Appreciate all your help!
>>
>> Warm regards
>> Arko
>>
>
>
Re: Using Giraph
Posted by Agrta Rawat <ag...@gmail.com>.
Hi Arko,
You first need to have java, hadoop and maven 3 or higher installed. Then,
compile or install mvn. After you will get a
giraph-<version>-SNAPSHOT-for-hadoop-<version>-jar-with-dependencies.jar
inside GIRAPH_HOME/giraph-core/target folder. Use this jar file. Take a
look at following link.
https://giraph.apache.org/quick_start.html
On Sun, Mar 2, 2014 at 6:44 AM, Arko Provo Mukherjee <
arkoprovomukherjee@gmail.com> wrote:
> Hello Giraph Gurus,
>
> I am interested in learning how to learn code custom graph algorithms
> using Giraph.
>
> I have some experience using MapReduce and have coded Graph Algorithms on
> top of Hadoop. Now I want to learn how to do the same for Pregel (using
> Giraph).
>
> I have downloaded giraph-1.0.0 but didn't find in JAR files as you do in
> Hadoop Downloads that you can compile against.
>
> So I wanted to understand how to compile a giraph program.
>
> Also pointing out to some trivial example code or elementary skeleton code
> would really help.
>
> Thanks a lot in advance! Appreciate all your help!
>
> Warm regards
> Arko
>
Re: Using Giraph
Posted by Arko Provo Mukherjee <ar...@gmail.com>.
Hello,
Thanks for the reply. I tried the suggestion, but the error persists:
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal org.apache.maven.plugins:maven-enforcer-plugin:1.2:enforce (default)
on project giraph-parent: Some Enforcer rules have failed. Look above for
specific messages explaining why the rule failed.
Thanks & regards
Arko
On Tue, Mar 11, 2014 at 1:33 PM, Sebastian Schelter <ss...@apache.org> wrote:
> Try mvn -Phadoop_1 -DskipTests clean package
>
> That should built for Hadoop 1.x
>
>
> On 03/11/2014 07:23 PM, Arko Provo Mukherjee wrote:
>
>> To add on to the last post, I am using Hadoop 1.2.1. I want to be sure
>> that
>> is not causing an issue?
>> Thanks & regards
>> Arko
>>
>>
>>
>> On Tue, Mar 11, 2014 at 1:19 PM, Arko Provo Mukherjee <
>> arkoprovomukherjee@gmail.com> wrote:
>>
>> Hello,
>>>
>>> I am trying to install Giraph using the guidelines in:
>>> *http://giraph.apache.org/quick_start.html
>>> <http://giraph.apache.org/quick_start.html>*
>>>
>>>
>>> When I try to run $ mvn package -DskipTests, I get the following errors:
>>>
>>> *[WARNING] Some problems were encountered while building the effective
>>> model for org.apache.giraph:giraph-rexster-io:jar:1.1.0-SNAPSHOT*
>>> *[WARNING] 'dependencies.dependency.systemPath' for
>>>
>>> org.apache.giraph:giraph-kibble:jar refers to a non-existing file
>>> /Users/arko/Documents/Tools/giraph/giraph-rexster/giraph-
>>> rexster-io/../../giraph-rexster/giraph-kibble/target/
>>> giraph-kibble-1.1.0-SNAPSHOT.jar
>>> @ line 178, column 19*
>>>
>>> *[WARNING] Rule 2: org.apache.maven.plugins.enforcer.RequireJavaVersion
>>> failed with message:*
>>> *Detected JDK Version: 1.6.0-65 is not in the allowed range 1.7.*
>>>
>>>
>>> *[INFO] Apache Giraph Parent .............................. FAILURE
>>> [2.482s]*
>>>
>>> *[ERROR] Failed to execute goal
>>>
>>> org.apache.maven.plugins:maven-enforcer-plugin:1.2:enforce (default) on
>>> project giraph-parent: Some Enforcer rules have failed. Look above for
>>> specific messages explaining why the rule failed. -> [Help 1]*
>>>
>>>
>>> Please help! The Java issue seems to be a warning rather than an error.
>>> My
>>> Java version is 1.6.0_65.
>>>
>>> Thanks & regards
>>> Arko
>>>
>>>
>>>
>>>
>>> On Sat, Mar 1, 2014 at 7:14 PM, Arko Provo Mukherjee <
>>> arkoprovomukherjee@gmail.com> wrote:
>>>
>>> Hello Giraph Gurus,
>>>>
>>>> I am interested in learning how to learn code custom graph algorithms
>>>> using Giraph.
>>>>
>>>> I have some experience using MapReduce and have coded Graph Algorithms
>>>> on
>>>> top of Hadoop. Now I want to learn how to do the same for Pregel (using
>>>> Giraph).
>>>>
>>>> I have downloaded giraph-1.0.0 but didn't find in JAR files as you do in
>>>> Hadoop Downloads that you can compile against.
>>>>
>>>> So I wanted to understand how to compile a giraph program.
>>>>
>>>> Also pointing out to some trivial example code or elementary skeleton
>>>> code would really help.
>>>>
>>>> Thanks a lot in advance! Appreciate all your help!
>>>>
>>>> Warm regards
>>>> Arko
>>>>
>>>>
>>>
>>>
>>
>
Re: Using Giraph
Posted by Sebastian Schelter <ss...@apache.org>.
Try mvn -Phadoop_1 -DskipTests clean package
That should built for Hadoop 1.x
On 03/11/2014 07:23 PM, Arko Provo Mukherjee wrote:
> To add on to the last post, I am using Hadoop 1.2.1. I want to be sure that
> is not causing an issue?
> Thanks & regards
> Arko
>
>
>
> On Tue, Mar 11, 2014 at 1:19 PM, Arko Provo Mukherjee <
> arkoprovomukherjee@gmail.com> wrote:
>
>> Hello,
>>
>> I am trying to install Giraph using the guidelines in:
>> *http://giraph.apache.org/quick_start.html
>> <http://giraph.apache.org/quick_start.html>*
>>
>> When I try to run $ mvn package -DskipTests, I get the following errors:
>>
>> *[WARNING] Some problems were encountered while building the effective
>> model for org.apache.giraph:giraph-rexster-io:jar:1.1.0-SNAPSHOT*
>> *[WARNING] 'dependencies.dependency.systemPath' for
>> org.apache.giraph:giraph-kibble:jar refers to a non-existing file
>> /Users/arko/Documents/Tools/giraph/giraph-rexster/giraph-rexster-io/../../giraph-rexster/giraph-kibble/target/giraph-kibble-1.1.0-SNAPSHOT.jar
>> @ line 178, column 19*
>>
>> *[WARNING] Rule 2: org.apache.maven.plugins.enforcer.RequireJavaVersion
>> failed with message:*
>> *Detected JDK Version: 1.6.0-65 is not in the allowed range 1.7.*
>>
>>
>> *[INFO] Apache Giraph Parent .............................. FAILURE
>> [2.482s]*
>>
>> *[ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-enforcer-plugin:1.2:enforce (default) on
>> project giraph-parent: Some Enforcer rules have failed. Look above for
>> specific messages explaining why the rule failed. -> [Help 1]*
>>
>> Please help! The Java issue seems to be a warning rather than an error. My
>> Java version is 1.6.0_65.
>>
>> Thanks & regards
>> Arko
>>
>>
>>
>>
>> On Sat, Mar 1, 2014 at 7:14 PM, Arko Provo Mukherjee <
>> arkoprovomukherjee@gmail.com> wrote:
>>
>>> Hello Giraph Gurus,
>>>
>>> I am interested in learning how to learn code custom graph algorithms
>>> using Giraph.
>>>
>>> I have some experience using MapReduce and have coded Graph Algorithms on
>>> top of Hadoop. Now I want to learn how to do the same for Pregel (using
>>> Giraph).
>>>
>>> I have downloaded giraph-1.0.0 but didn't find in JAR files as you do in
>>> Hadoop Downloads that you can compile against.
>>>
>>> So I wanted to understand how to compile a giraph program.
>>>
>>> Also pointing out to some trivial example code or elementary skeleton
>>> code would really help.
>>>
>>> Thanks a lot in advance! Appreciate all your help!
>>>
>>> Warm regards
>>> Arko
>>>
>>
>>
>
Re: Using Giraph
Posted by Arko Provo Mukherjee <ar...@gmail.com>.
To add on to the last post, I am using Hadoop 1.2.1. I want to be sure that
is not causing an issue?
Thanks & regards
Arko
On Tue, Mar 11, 2014 at 1:19 PM, Arko Provo Mukherjee <
arkoprovomukherjee@gmail.com> wrote:
> Hello,
>
> I am trying to install Giraph using the guidelines in:
> *http://giraph.apache.org/quick_start.html
> <http://giraph.apache.org/quick_start.html>*
>
> When I try to run $ mvn package -DskipTests, I get the following errors:
>
> *[WARNING] Some problems were encountered while building the effective
> model for org.apache.giraph:giraph-rexster-io:jar:1.1.0-SNAPSHOT*
> *[WARNING] 'dependencies.dependency.systemPath' for
> org.apache.giraph:giraph-kibble:jar refers to a non-existing file
> /Users/arko/Documents/Tools/giraph/giraph-rexster/giraph-rexster-io/../../giraph-rexster/giraph-kibble/target/giraph-kibble-1.1.0-SNAPSHOT.jar
> @ line 178, column 19*
>
> *[WARNING] Rule 2: org.apache.maven.plugins.enforcer.RequireJavaVersion
> failed with message:*
> *Detected JDK Version: 1.6.0-65 is not in the allowed range 1.7.*
>
>
> *[INFO] Apache Giraph Parent .............................. FAILURE
> [2.482s]*
>
> *[ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-enforcer-plugin:1.2:enforce (default) on
> project giraph-parent: Some Enforcer rules have failed. Look above for
> specific messages explaining why the rule failed. -> [Help 1]*
>
> Please help! The Java issue seems to be a warning rather than an error. My
> Java version is 1.6.0_65.
>
> Thanks & regards
> Arko
>
>
>
>
> On Sat, Mar 1, 2014 at 7:14 PM, Arko Provo Mukherjee <
> arkoprovomukherjee@gmail.com> wrote:
>
>> Hello Giraph Gurus,
>>
>> I am interested in learning how to learn code custom graph algorithms
>> using Giraph.
>>
>> I have some experience using MapReduce and have coded Graph Algorithms on
>> top of Hadoop. Now I want to learn how to do the same for Pregel (using
>> Giraph).
>>
>> I have downloaded giraph-1.0.0 but didn't find in JAR files as you do in
>> Hadoop Downloads that you can compile against.
>>
>> So I wanted to understand how to compile a giraph program.
>>
>> Also pointing out to some trivial example code or elementary skeleton
>> code would really help.
>>
>> Thanks a lot in advance! Appreciate all your help!
>>
>> Warm regards
>> Arko
>>
>
>
Re: Using Giraph
Posted by Arko Provo Mukherjee <ar...@gmail.com>.
Hello,
I am trying to install Giraph using the guidelines in:
*http://giraph.apache.org/quick_start.html
<http://giraph.apache.org/quick_start.html>*
When I try to run $ mvn package -DskipTests, I get the following errors:
*[WARNING] Some problems were encountered while building the effective
model for org.apache.giraph:giraph-rexster-io:jar:1.1.0-SNAPSHOT*
*[WARNING] 'dependencies.dependency.systemPath' for
org.apache.giraph:giraph-kibble:jar refers to a non-existing file
/Users/arko/Documents/Tools/giraph/giraph-rexster/giraph-rexster-io/../../giraph-rexster/giraph-kibble/target/giraph-kibble-1.1.0-SNAPSHOT.jar
@ line 178, column 19*
*[WARNING] Rule 2: org.apache.maven.plugins.enforcer.RequireJavaVersion
failed with message:*
*Detected JDK Version: 1.6.0-65 is not in the allowed range 1.7.*
*[INFO] Apache Giraph Parent .............................. FAILURE
[2.482s]*
*[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-enforcer-plugin:1.2:enforce (default) on
project giraph-parent: Some Enforcer rules have failed. Look above for
specific messages explaining why the rule failed. -> [Help 1]*
Please help! The Java issue seems to be a warning rather than an error. My
Java version is 1.6.0_65.
Thanks & regards
Arko
On Sat, Mar 1, 2014 at 7:14 PM, Arko Provo Mukherjee <
arkoprovomukherjee@gmail.com> wrote:
> Hello Giraph Gurus,
>
> I am interested in learning how to learn code custom graph algorithms
> using Giraph.
>
> I have some experience using MapReduce and have coded Graph Algorithms on
> top of Hadoop. Now I want to learn how to do the same for Pregel (using
> Giraph).
>
> I have downloaded giraph-1.0.0 but didn't find in JAR files as you do in
> Hadoop Downloads that you can compile against.
>
> So I wanted to understand how to compile a giraph program.
>
> Also pointing out to some trivial example code or elementary skeleton code
> would really help.
>
> Thanks a lot in advance! Appreciate all your help!
>
> Warm regards
> Arko
>