You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@giraph.apache.org by Deepankar Patra <de...@gmail.com> on 2014/01/29 13:39:51 UTC

Help needed in Compilation and execution of a giraph code(Giraph noob)

Hi all,

I am new to Apache Giraph. I am struggling to compile and run my code using
apache giraph. I have got giraph installed properly, I have successfully
tested shortest path example too. Now when I try to write my own code I'm
unable to figure out how to compile it and run, the documentation in
giraph.apache.org explains nothing about it. Any help will be highly
appreciated.

As per my understanding the main function is in GraphRunner class, we don't
need to implement the main function ourselves, but then I've no idea what
to do next.

Thanks,
Deepankar Patra

Re: Help needed in Compilation and execution of a giraph code(Giraph noob)

Posted by Jyoti Yadav <ra...@gmail.com>.
Hi Deepankar..

pls check your proxy settings first..

then in giraph-examples directory type
mvn install
after that
mvn compile


thanks..





On Wed, Jan 29, 2014 at 8:30 PM, Deepankar Patra <de...@gmail.com>wrote:

> Hi Jyoti,
>
> Thanks for the help. I tried your steps, while trying "mvn compile" I get
> build failure message with these two warnings:
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Building Apache Giraph Examples 1.1.0-SNAPSHOT
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The POM for org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT is
> missing, no dependency information available
> [WARNING] The POM for
> org.apache.giraph:giraph-core:jar:tests:1.1.0-SNAPSHOT is missing, no
> dependency information available
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
>
> and this error message:
> [ERROR] Failed to execute goal on project giraph-examples: Could not
> resolve dependencies for project
> org.apache.giraph:giraph-examples:jar:1.1.0-SNAPSHOT: The following
> artifacts could not be resolved:
> org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT,
> org.apache.giraph:giraph-core:jar:tests:1.1.0-SNAPSHOT: Failure to find
> org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT in
> http://repo1.maven.org/maven2 was cached in the local repository,
> resolution will not be reattempted until the update interval of central has
> elapsed or updates are forced -> [Help 1]
>
> I dont know much of maven, tried google-ing, but it didn't help.
>
> Thanks,
> Deepankar
>
>
> On 29 January 2014 19:08, Jyoti Yadav <ra...@gmail.com> wrote:
>
>> Hi Deepankar...
>>
>> Steps to compile your own program in giraph...
>>
>> 1. write your java  program to be executed..
>> 2. Save the program in giraph-examples directory.
>> 3. in command prompt,type cd $GIRAPH_HOME
>> then cd giraph-examples
>> then type mvn compile
>> Using above command to compile,your program will be compiled..
>> To run the program
>>
>> hadoop jar $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.your_program_name -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/hduser/input/tiny_graph.txt -of org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/hduser/output/shortestpaths -w 1
>>
>> Hope this will work for u..
>> Thanks..
>>
>>
>> On Wed, Jan 29, 2014 at 6:09 PM, Deepankar Patra <deepankarbcse@gmail.com
>> > wrote:
>>
>>> Hi all,
>>>
>>> I am new to Apache Giraph. I am struggling to compile and run my code
>>> using apache giraph. I have got giraph installed properly, I have
>>> successfully tested shortest path example too. Now when I try to write my
>>> own code I'm unable to figure out how to compile it and run, the
>>> documentation in giraph.apache.org explains nothing about it. Any help
>>> will be highly appreciated.
>>>
>>> As per my understanding the main function is in GraphRunner class, we
>>> don't need to implement the main function ourselves, but then I've no idea
>>> what to do next.
>>>
>>> Thanks,
>>> Deepankar Patra
>>>
>>
>>
>

Re: Help needed in Compilation and execution of a giraph code(Giraph noob)

Posted by Lukas Nalezenec <lu...@firma.seznam.cz>.
go to ../giraph-core directory and

run  mvn clean install there.

Lukas

On 29.1.2014 16:00, Deepankar Patra wrote:
> Hi Jyoti,
>
> Thanks for the help. I tried your steps, while trying "mvn compile" I 
> get build failure message with these two warnings:
> [INFO] 
> ------------------------------------------------------------------------
> [INFO] Building Apache Giraph Examples 1.1.0-SNAPSHOT
> [INFO] 
> ------------------------------------------------------------------------
> [WARNING] The POM for org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT 
> is missing, no dependency information available
> [WARNING] The POM for 
> org.apache.giraph:giraph-core:jar:tests:1.1.0-SNAPSHOT is missing, no 
> dependency information available
> [INFO] 
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] 
> ------------------------------------------------------------------------
>
> and this error message:
> [ERROR] Failed to execute goal on project giraph-examples: Could not 
> resolve dependencies for project 
> org.apache.giraph:giraph-examples:jar:1.1.0-SNAPSHOT: The following 
> artifacts could not be resolved: 
> org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT, 
> org.apache.giraph:giraph-core:jar:tests:1.1.0-SNAPSHOT: Failure to 
> find org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT in 
> http://repo1.maven.org/maven2 was cached in the local repository, 
> resolution will not be reattempted until the update interval of 
> central has elapsed or updates are forced -> [Help 1]
>
> I dont know much of maven, tried google-ing, but it didn't help.
>
> Thanks,
> Deepankar
>
>
> On 29 January 2014 19:08, Jyoti Yadav <rao.jyoti26yadav@gmail.com 
> <ma...@gmail.com>> wrote:
>
>     Hi Deepankar...
>
>     Steps to compile your own program in giraph...
>
>     1. write your java  program to be executed..
>     2. Save the program in giraph-examples directory.
>     3. in command prompt,type cd $GIRAPH_HOME
>     then cd giraph-examples
>     then type mvn compile
>     Using above command to compile,your program will be compiled..
>     To run the program
>
>     hadoop jar $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar org.apache.giraph.GiraphRunner  org.apache.giraph.examples.your_program_name  -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat  -vip/user/hduser/input/tiny_graph.txt-of org.apache.giraph.io.formats.IdWithValueTextOutputFormat  -op/user/hduser/output/shortestpaths-w1
>
>     Hope this will work for u..
>     Thanks..
>
>
>     On Wed, Jan 29, 2014 at 6:09 PM, Deepankar Patra
>     <deepankarbcse@gmail.com <ma...@gmail.com>> wrote:
>
>         Hi all,
>
>         I am new to Apache Giraph. I am struggling to compile and run
>         my code using apache giraph. I have got giraph installed
>         properly, I have successfully tested shortest path example
>         too. Now when I try to write my own code I'm unable to figure
>         out how to compile it and run, the documentation in
>         giraph.apache.org <http://giraph.apache.org> explains nothing
>         about it. Any help will be highly appreciated.
>
>         As per my understanding the main function is in GraphRunner
>         class, we don't need to implement the main function ourselves,
>         but then I've no idea what to do next.
>
>         Thanks,
>         Deepankar Patra
>
>
>


Re: Help needed in Compilation and execution of a giraph code(Giraph noob)

Posted by Anis Nasir <aa...@gmail.com>.
Dear Deepankar,

you can use steps mentioned on this link

http://anisnasir.wordpress.com/2014/01/03/running-a-custom-code-in-apache-giraph/

Regards
Anis




On Wed, Jan 29, 2014 at 4:00 PM, Deepankar Patra <de...@gmail.com>wrote:

> Hi Jyoti,
>
> Thanks for the help. I tried your steps, while trying "mvn compile" I get
> build failure message with these two warnings:
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Building Apache Giraph Examples 1.1.0-SNAPSHOT
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The POM for org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT is
> missing, no dependency information available
> [WARNING] The POM for
> org.apache.giraph:giraph-core:jar:tests:1.1.0-SNAPSHOT is missing, no
> dependency information available
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
>
> and this error message:
> [ERROR] Failed to execute goal on project giraph-examples: Could not
> resolve dependencies for project
> org.apache.giraph:giraph-examples:jar:1.1.0-SNAPSHOT: The following
> artifacts could not be resolved:
> org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT,
> org.apache.giraph:giraph-core:jar:tests:1.1.0-SNAPSHOT: Failure to find
> org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT in
> http://repo1.maven.org/maven2 was cached in the local repository,
> resolution will not be reattempted until the update interval of central has
> elapsed or updates are forced -> [Help 1]
>
> I dont know much of maven, tried google-ing, but it didn't help.
>
> Thanks,
> Deepankar
>
>
> On 29 January 2014 19:08, Jyoti Yadav <ra...@gmail.com> wrote:
>
>> Hi Deepankar...
>>
>> Steps to compile your own program in giraph...
>>
>> 1. write your java  program to be executed..
>> 2. Save the program in giraph-examples directory.
>> 3. in command prompt,type cd $GIRAPH_HOME
>> then cd giraph-examples
>> then type mvn compile
>> Using above command to compile,your program will be compiled..
>> To run the program
>>
>> hadoop jar $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.your_program_name -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/hduser/input/tiny_graph.txt -of org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/hduser/output/shortestpaths -w 1
>>
>> Hope this will work for u..
>> Thanks..
>>
>>
>> On Wed, Jan 29, 2014 at 6:09 PM, Deepankar Patra <deepankarbcse@gmail.com
>> > wrote:
>>
>>> Hi all,
>>>
>>> I am new to Apache Giraph. I am struggling to compile and run my code
>>> using apache giraph. I have got giraph installed properly, I have
>>> successfully tested shortest path example too. Now when I try to write my
>>> own code I'm unable to figure out how to compile it and run, the
>>> documentation in giraph.apache.org explains nothing about it. Any help
>>> will be highly appreciated.
>>>
>>> As per my understanding the main function is in GraphRunner class, we
>>> don't need to implement the main function ourselves, but then I've no idea
>>> what to do next.
>>>
>>> Thanks,
>>> Deepankar Patra
>>>
>>
>>
>

Re: Help needed in Compilation and execution of a giraph code(Giraph noob)

Posted by Deepankar Patra <de...@gmail.com>.
Hi Jyoti,

Thanks for the help. I tried your steps, while trying "mvn compile" I get
build failure message with these two warnings:
[INFO]
------------------------------------------------------------------------
[INFO] Building Apache Giraph Examples 1.1.0-SNAPSHOT
[INFO]
------------------------------------------------------------------------
[WARNING] The POM for org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT is
missing, no dependency information available
[WARNING] The POM for
org.apache.giraph:giraph-core:jar:tests:1.1.0-SNAPSHOT is missing, no
dependency information available
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------

and this error message:
[ERROR] Failed to execute goal on project giraph-examples: Could not
resolve dependencies for project
org.apache.giraph:giraph-examples:jar:1.1.0-SNAPSHOT: The following
artifacts could not be resolved:
org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT,
org.apache.giraph:giraph-core:jar:tests:1.1.0-SNAPSHOT: Failure to find
org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT in
http://repo1.maven.org/maven2 was cached in the local repository,
resolution will not be reattempted until the update interval of central has
elapsed or updates are forced -> [Help 1]

I dont know much of maven, tried google-ing, but it didn't help.

Thanks,
Deepankar


On 29 January 2014 19:08, Jyoti Yadav <ra...@gmail.com> wrote:

> Hi Deepankar...
>
> Steps to compile your own program in giraph...
>
> 1. write your java  program to be executed..
> 2. Save the program in giraph-examples directory.
> 3. in command prompt,type cd $GIRAPH_HOME
> then cd giraph-examples
> then type mvn compile
> Using above command to compile,your program will be compiled..
> To run the program
>
> hadoop jar $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.your_program_name -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/hduser/input/tiny_graph.txt -of org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/hduser/output/shortestpaths -w 1
>
> Hope this will work for u..
> Thanks..
>
>
> On Wed, Jan 29, 2014 at 6:09 PM, Deepankar Patra <de...@gmail.com>wrote:
>
>> Hi all,
>>
>> I am new to Apache Giraph. I am struggling to compile and run my code
>> using apache giraph. I have got giraph installed properly, I have
>> successfully tested shortest path example too. Now when I try to write my
>> own code I'm unable to figure out how to compile it and run, the
>> documentation in giraph.apache.org explains nothing about it. Any help
>> will be highly appreciated.
>>
>> As per my understanding the main function is in GraphRunner class, we
>> don't need to implement the main function ourselves, but then I've no idea
>> what to do next.
>>
>> Thanks,
>> Deepankar Patra
>>
>
>

Re: Help needed in Compilation and execution of a giraph code(Giraph noob)

Posted by Jyoti Yadav <ra...@gmail.com>.
Hi Deepankar...

Steps to compile your own program in giraph...

1. write your java  program to be executed..
2. Save the program in giraph-examples directory.
3. in command prompt,type cd $GIRAPH_HOME
then cd giraph-examples
then type mvn compile
Using above command to compile,your program will be compiled..
To run the program

hadoop jar $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.your_program_name -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /user/hduser/input/tiny_graph.txt -of
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/hduser/output/shortestpaths -w 1

Hope this will work for u..
Thanks..


On Wed, Jan 29, 2014 at 6:09 PM, Deepankar Patra <de...@gmail.com>wrote:

> Hi all,
>
> I am new to Apache Giraph. I am struggling to compile and run my code
> using apache giraph. I have got giraph installed properly, I have
> successfully tested shortest path example too. Now when I try to write my
> own code I'm unable to figure out how to compile it and run, the
> documentation in giraph.apache.org explains nothing about it. Any help
> will be highly appreciated.
>
> As per my understanding the main function is in GraphRunner class, we
> don't need to implement the main function ourselves, but then I've no idea
> what to do next.
>
> Thanks,
> Deepankar Patra
>