You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@giraph.apache.org by vandana bhatia <vb...@gmail.com> on 2015/07/17 14:19:06 UTC
Problem with simple shortest path
*hi.*
*i just started working with giraph. i followed the same steps mentioned in
the quick start guide and tried the following command.*
hadoop jar
$GIRAPH_HOME/giraph-examples/target/giraph-examples-1.2.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.SimpleShortestPathsComputation -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /user/input/tiny_graph.txt -vof
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/output/shortestpaths -w 1
*but getting an error while running it *
*15/07/17 17:43:47 INFO utils.ConfigurationUtils: No edge input format
specified. Ensure your InputFormat does not require one.15/07/17 17:43:47
INFO utils.ConfigurationUtils: No edge output format specified. Ensure your
OutputFormat does not require one.15/07/17 17:43:47 WARN
util.NativeCodeLoader: Unable to load native-hadoop library for your
platform... using builtin-java classes where applicable15/07/17 17:43:47
INFO Configuration.deprecation: mapreduce.job.counters.limit is deprecated.
Instead, use mapreduce.job.counters.max15/07/17 17:43:47 INFO
Configuration.deprecation: mapred.job.map.memory.mb is deprecated. Instead,
use mapreduce.map.memory.mb15/07/17 17:43:47 INFO
Configuration.deprecation: mapred.job.reduce.memory.mb is deprecated.
Instead, use mapreduce.reduce.memory.mb15/07/17 17:43:47 INFO
Configuration.deprecation: mapred.map.tasks.speculative.execution is
deprecated. Instead, use mapreduce.map.speculative15/07/17 17:43:47 INFO
Configuration.deprecation: mapreduce.user.classpath.first is deprecated.
Instead, use mapreduce.job.user.classpath.first15/07/17 17:43:47 INFO
Configuration.deprecation: mapred.map.max.attempts is deprecated. Instead,
use mapreduce.map.maxattempts15/07/17 17:43:47 INFO job.GiraphJob: run:
Since checkpointing is disabled (default), do not allow any task retries
(setting mapred.map.max.attempts = 1, old value = 4)15/07/17 17:43:47 INFO
Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use
mapreduce.jobtracker.addressException in thread "main"
java.lang.IllegalArgumentException: checkLocalJobRunnerConfiguration: When
using LocalJobRunner, you cannot run in split master / worker mode since
there is only 1 task at a time! at
org.apache.giraph.job.GiraphJob.checkLocalJobRunnerConfiguration(GiraphJob.java:167)
at org.apache.giraph.job.GiraphJob.run(GiraphJob.java:235) at
org.apache.giraph.GiraphRunner.run(GiraphRunner.java:94) at
org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at
org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) at
org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497) at
org.apache.hadoop.util.RunJar.run(RunJar.java:221) at
org.apache.hadoop.util.RunJar.main(RunJar.java:136)*
Please help me out in resolving this issue. I am working in giraph 1.1.0
--
Regards,
Vandana Bhatia
Re: Problem with simple shortest path
Posted by "Ing. Alessio Arleo" <in...@icloud.com>.
Hello again
The fix I suggested for the IllegalArgumentException in your output. The Edge input and output format missing warning is not an error, is reminder that you did not specify them (in fact they are classified as INFO, not ERROR nor WARN).
To better understand how the I/O works in Giraph, I suggest you read the “Main Interfaces” paragraph in http://giraph.apache.org/io.html <http://giraph.apache.org/io.html>.
Hope this helps.
=============
Dr. Alessio Arleo
PhD student in Industrial and Information Engineering @ University of Perugia
Linkedin: it.linkedin.com/in/IngArleo
Skype: Ing. Alessio Arleo
E-Mail: ingarleo@icloud.com
=============
> On 18 Jul 2015, at 12:17, vandana bhatia <vb...@gmail.com> wrote:
>
> Hi Alessio ,
>
> Sorry but it did not worked . The problem still exist.
>
> No edge input format specified. Ensure your InputFormat does not require one.
> No edge output format specified. Ensure your OutputFormat does not require one.
>
> It is asking for the above two things.
>
>
> On Fri, Jul 17, 2015 at 7:27 PM, Ing. Alessio Arleo <ingarleo@icloud.com <ma...@icloud.com>> wrote:
> Hello Vandana
>
> If you are working on a single machine, you have to set not to split the master and worker machines.
>
> To do so, add ‘-ca giraph.SplitMasterWorker=false’ to the command you use to launch the job.
>
> Hope this helps.
>
> =============
> Dr. Alessio Arleo
>
> PhD student in Industrial and Information Engineering @ University of Perugia
>
> Doctor in Information and Automation Engineering
>
> Linkedin: it.linkedin.com/in/IngArleo <http://it.linkedin.com/in/IngArleo>
> Skype: Ing. Alessio Arleo
> E-Mail: ingarleo@icloud.com <ma...@icloud.com>
>
>> On 17 Jul 2015, at 14:19, vandana bhatia <vbhatia91@gmail.com <ma...@gmail.com>> wrote:
>>
>> hi.
>> i just started working with giraph. i followed the same steps mentioned in the quick start guide and tried the following command.
>>
>> hadoop jar $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.2.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/input/tiny_graph.txt -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/output/shortestpaths -w 1
>>
>> but getting an error while running it
>> 15/07/17 17:43:47 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your InputFormat does not require one.
>> 15/07/17 17:43:47 INFO utils.ConfigurationUtils: No edge output format specified. Ensure your OutputFormat does not require one.
>> 15/07/17 17:43:47 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
>> 15/07/17 17:43:47 INFO Configuration.deprecation: mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
>> 15/07/17 17:43:47 INFO Configuration.deprecation: mapred.job.map.memory.mb is deprecated. Instead, use mapreduce.map.memory.mb
>> 15/07/17 17:43:47 INFO Configuration.deprecation: mapred.job.reduce.memory.mb is deprecated. Instead, use mapreduce.reduce.memory.mb
>> 15/07/17 17:43:47 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
>> 15/07/17 17:43:47 INFO Configuration.deprecation: mapreduce.user.classpath.first is deprecated. Instead, use mapreduce.job.user.classpath.first
>> 15/07/17 17:43:47 INFO Configuration.deprecation: mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
>> 15/07/17 17:43:47 INFO job.GiraphJob: run: Since checkpointing is disabled (default), do not allow any task retries (setting mapred.map.max.attempts = 1, old value = 4)
>> 15/07/17 17:43:47 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
>> Exception in thread "main" java.lang.IllegalArgumentException: checkLocalJobRunnerConfiguration: When using LocalJobRunner, you cannot run in split master / worker mode since there is only 1 task at a time!
>> at org.apache.giraph.job.GiraphJob.checkLocalJobRunnerConfiguration(GiraphJob.java:167)
>> at org.apache.giraph.job.GiraphJob.run(GiraphJob.java:235)
>> at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:94)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>> at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:497)
>> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>>
>>
>> Please help me out in resolving this issue. I am working in giraph 1.1.0
>>
>>
>> --
>> Regards,
>> Vandana Bhatia
>
>
>
>
> --
> Regards,
> Vandana Bhatia
Re: Problem with simple shortest path
Posted by Sonja Koenig <so...@uni-ulm.de>.
Hi!
Hadoop 2.6.0 should be fine with any version of Giraph - including 1.1.0.
However, it is VERY important to have the correct version of maven. You
definitely have to be higher than Maven 3!
If you've installed maven by */apt-get install maven/*, you can easily
check the package version by executing */apt-cache policy maven/* or
something similar.
I have nooooo idea why your two commands give you different versions,
but I usually checked with mvn -version :D
If you are unsure, better install it again if that's not too big of a
problem..
Have a nice sunday!
Sonja
Am 19.07.2015 um 14:03 schrieb vandana bhatia:
> hi Sonja
>
> I tried release 1.1.0 also. I am using hadoop 2.6.0. Can we use giraph
> 1.1.0 with this release of hadoop? Also when i ask for mvn -version it
> shows 2.2.1 . But when i ask for maven version, it shows 3.3.0 . Do
> you have any idea why it is so?
>
> On Sat, Jul 18, 2015 at 5:30 PM, Sonja Koenig <sonja.koenig@uni-ulm.de
> <ma...@uni-ulm.de>> wrote:
>
> Hi there!
>
> Suggestion:
> Try cloning the release 1.1.0. That solves a couple problems,
> maybe yours, too.
>
> I had several issues with the giraph 1.2.0 version.. I think it's
> not really finished yet. Don't know if you could actually call it
> "stable" :D
>
> Regards!
> Sonja
>
>
> Am 18.07.2015 um 12:17 schrieb vandana bhatia:
>> Hi Alessio ,
>>
>> Sorry but it did not worked . The problem still exist.
>>
>> *No edge input format specified. Ensure your InputFormat does not
>> require one.*
>> *No edge output format specified. Ensure your OutputFormat does
>> not require one.*
>>
>> It is asking for the above two things.
>>
>>
>> On Fri, Jul 17, 2015 at 7:27 PM, Ing. Alessio Arleo
>> <ingarleo@icloud.com <ma...@icloud.com>> wrote:
>>
>> Hello Vandana
>>
>> If you are working on a single machine, you have to set not
>> to split the master and worker machines.
>>
>> To do so, add ‘-ca giraph.SplitMasterWorker=false’ to the
>> command you use to launch the job.
>>
>> Hope this helps.
>>
>> =============
>> Dr. Alessio Arleo
>>
>> PhD student in Industrial and Information Engineering @
>> University of Perugia
>>
>> Doctor in Information and Automation Engineering
>>
>> Linkedin: it.linkedin.com/in/IngArleo
>> <http://it.linkedin.com/in/IngArleo>
>> Skype: Ing. Alessio Arleo
>> E-Mail: ingarleo@icloud.com <ma...@icloud.com>
>>
>>> On 17 Jul 2015, at 14:19, vandana bhatia
>>> <vbhatia91@gmail.com <ma...@gmail.com>> wrote:
>>>
>>> *hi.*
>>> *i just started working with giraph. i followed the same
>>> steps mentioned in the quick start guide and tried the
>>> following command.*
>>>
>>> hadoop jar
>>> $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.2.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar
>>> org.apache.giraph.GiraphRunner
>>> org.apache.giraph.examples.SimpleShortestPathsComputation
>>> -vif
>>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
>>> -vip /user/input/tiny_graph.txt -vof
>>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
>>> /user/output/shortestpaths -w 1
>>>
>>> *but getting an error while running it *
>>> *
>>> 15/07/17 17:43:47 INFO utils.ConfigurationUtils: _No edge
>>> input format specified. Ensure your InputFormat does not
>>> require one._
>>> 15/07/17 17:43:47 INFO utils.ConfigurationUtils: _No edge
>>> output format specified. Ensure your OutputFormat does not
>>> require one._
>>> 15/07/17 17:43:47 WARN util.NativeCodeLoader: Unable to load
>>> native-hadoop library for your platform... using
>>> builtin-java classes where applicable
>>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>>> mapreduce.job.counters.limit is deprecated. Instead, use
>>> mapreduce.job.counters.max
>>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>>> mapred.job.map.memory.mb is deprecated. Instead, use
>>> mapreduce.map.memory.mb
>>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>>> mapred.job.reduce.memory.mb is deprecated. Instead, use
>>> mapreduce.reduce.memory.mb
>>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>>> mapred.map.tasks.speculative.execution is deprecated.
>>> Instead, use mapreduce.map.speculative
>>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>>> mapreduce.user.classpath.first is deprecated. Instead, use
>>> mapreduce.job.user.classpath.first
>>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>>> mapred.map.max.attempts is deprecated. Instead, use
>>> mapreduce.map.maxattempts
>>> 15/07/17 17:43:47 INFO job.GiraphJob: run: Since
>>> checkpointing is disabled (default), do not allow any task
>>> retries (setting mapred.map.max.attempts = 1, old value = 4)
>>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>>> mapred.job.tracker is deprecated. Instead, use
>>> mapreduce.jobtracker.address
>>> Exception in thread "main"
>>> java.lang.IllegalArgumentException:
>>> checkLocalJobRunnerConfiguration: When using LocalJobRunner,
>>> you cannot run in split master / worker mode since there is
>>> only 1 task at a time!
>>> at
>>> org.apache.giraph.job.GiraphJob.checkLocalJobRunnerConfiguration(GiraphJob.java:167)
>>> at org.apache.giraph.job.GiraphJob.run(GiraphJob.java:235)
>>> at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:94)
>>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>>> at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>> at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:497)
>>> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>>> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>>>
>>> *
>>>
>>> Please help me out in resolving this issue. I am working in
>>> giraph 1.1.0
>>>
>>>
>>> --
>>> Regards,
>>> Vandana Bhatia
>>
>>
>>
>>
>> --
>> Regards,
>> Vandana Bhatia
>
>
>
>
> --
> Regards,
> Vandana Bhatia
Re: Problem with simple shortest path
Posted by vandana bhatia <vb...@gmail.com>.
hi Sonja
I tried release 1.1.0 also. I am using hadoop 2.6.0. Can we use giraph
1.1.0 with this release of hadoop? Also when i ask for mvn -version it
shows 2.2.1 . But when i ask for maven version, it shows 3.3.0 . Do you
have any idea why it is so?
On Sat, Jul 18, 2015 at 5:30 PM, Sonja Koenig <so...@uni-ulm.de>
wrote:
> Hi there!
>
> Suggestion:
> Try cloning the release 1.1.0. That solves a couple problems, maybe yours,
> too.
>
> I had several issues with the giraph 1.2.0 version.. I think it's not
> really finished yet. Don't know if you could actually call it "stable" :D
>
> Regards!
> Sonja
>
>
> Am 18.07.2015 um 12:17 schrieb vandana bhatia:
>
> Hi Alessio ,
>
> Sorry but it did not worked . The problem still exist.
>
> *No edge input format specified. Ensure your InputFormat does not
> require one.*
> *No edge output format specified. Ensure your OutputFormat does not
> require one.*
>
> It is asking for the above two things.
>
>
> On Fri, Jul 17, 2015 at 7:27 PM, Ing. Alessio Arleo <in...@icloud.com>
> wrote:
>
>> Hello Vandana
>>
>> If you are working on a single machine, you have to set not to split
>> the master and worker machines.
>>
>> To do so, add ‘-ca giraph.SplitMasterWorker=false’ to the command you
>> use to launch the job.
>>
>> Hope this helps.
>>
>> =============
>> Dr. Alessio Arleo
>>
>> PhD student in Industrial and Information Engineering @ University of
>> Perugia
>>
>> Doctor in Information and Automation Engineering
>>
>> Linkedin: it.linkedin.com/in/IngArleo
>> Skype: Ing. Alessio Arleo
>> E-Mail: ingarleo@icloud.com
>>
>> On 17 Jul 2015, at 14:19, vandana bhatia <vb...@gmail.com> wrote:
>>
>> *hi.*
>> *i just started working with giraph. i followed the same steps mentioned
>> in the quick start guide and tried the following command.*
>>
>> hadoop jar
>> $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.2.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar
>> org.apache.giraph.GiraphRunner
>> org.apache.giraph.examples.SimpleShortestPathsComputation -vif
>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
>> -vip /user/input/tiny_graph.txt -vof
>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
>> /user/output/shortestpaths -w 1
>>
>> *but getting an error while running it *
>>
>> * 15/07/17 17:43:47 INFO utils.ConfigurationUtils: No edge input format
>> specified. Ensure your InputFormat does not require one. 15/07/17 17:43:47
>> INFO utils.ConfigurationUtils: No edge output format specified. Ensure your
>> OutputFormat does not require one. 15/07/17 17:43:47 WARN
>> util.NativeCodeLoader: Unable to load native-hadoop library for your
>> platform... using builtin-java classes where applicable 15/07/17 17:43:47
>> INFO Configuration.deprecation: mapreduce.job.counters.limit is deprecated.
>> Instead, use mapreduce.job.counters.max 15/07/17 17:43:47 INFO
>> Configuration.deprecation: mapred.job.map.memory.mb is deprecated. Instead,
>> use mapreduce.map.memory.mb 15/07/17 17:43:47 INFO
>> Configuration.deprecation: mapred.job.reduce.memory.mb is deprecated.
>> Instead, use mapreduce.reduce.memory.mb 15/07/17 17:43:47 INFO
>> Configuration.deprecation: mapred.map.tasks.speculative.execution is
>> deprecated. Instead, use mapreduce.map.speculative 15/07/17 17:43:47 INFO
>> Configuration.deprecation: mapreduce.user.classpath.first is deprecated.
>> Instead, use mapreduce.job.user.classpath.first 15/07/17 17:43:47 INFO
>> Configuration.deprecation: mapred.map.max.attempts is deprecated. Instead,
>> use mapreduce.map.maxattempts 15/07/17 17:43:47 INFO job.GiraphJob: run:
>> Since checkpointing is disabled (default), do not allow any task retries
>> (setting mapred.map.max.attempts = 1, old value = 4) 15/07/17 17:43:47 INFO
>> Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use
>> mapreduce.jobtracker.address Exception in thread "main"
>> java.lang.IllegalArgumentException: checkLocalJobRunnerConfiguration: When
>> using LocalJobRunner, you cannot run in split master / worker mode since
>> there is only 1 task at a time! at
>> org.apache.giraph.job.GiraphJob.checkLocalJobRunnerConfiguration(GiraphJob.java:167)
>> at org.apache.giraph.job.GiraphJob.run(GiraphJob.java:235) at
>> org.apache.giraph.GiraphRunner.run(GiraphRunner.java:94) at
>> org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at
>> org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) at
>> org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124) at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:497) at
>> org.apache.hadoop.util.RunJar.run(RunJar.java:221) at
>> org.apache.hadoop.util.RunJar.main(RunJar.java:136) *
>>
>> Please help me out in resolving this issue. I am working in giraph 1.1.0
>>
>>
>> --
>> Regards,
>> Vandana Bhatia
>>
>>
>>
>
>
> --
> Regards,
> Vandana Bhatia
>
>
>
--
Regards,
Vandana Bhatia
Re: Problem with simple shortest path
Posted by Sonja Koenig <so...@uni-ulm.de>.
Hi there!
Suggestion:
Try cloning the release 1.1.0. That solves a couple problems, maybe
yours, too.
I had several issues with the giraph 1.2.0 version.. I think it's not
really finished yet. Don't know if you could actually call it "stable" :D
Regards!
Sonja
Am 18.07.2015 um 12:17 schrieb vandana bhatia:
> Hi Alessio ,
>
> Sorry but it did not worked . The problem still exist.
>
> *No edge input format specified. Ensure your InputFormat does not
> require one.*
> *No edge output format specified. Ensure your OutputFormat does not
> require one.*
>
> It is asking for the above two things.
>
>
> On Fri, Jul 17, 2015 at 7:27 PM, Ing. Alessio Arleo
> <ingarleo@icloud.com <ma...@icloud.com>> wrote:
>
> Hello Vandana
>
> If you are working on a single machine, you have to set not to
> split the master and worker machines.
>
> To do so, add ‘-ca giraph.SplitMasterWorker=false’ to the command
> you use to launch the job.
>
> Hope this helps.
>
> =============
> Dr. Alessio Arleo
>
> PhD student in Industrial and Information Engineering @ University
> of Perugia
>
> Doctor in Information and Automation Engineering
>
> Linkedin: it.linkedin.com/in/IngArleo
> <http://it.linkedin.com/in/IngArleo>
> Skype: Ing. Alessio Arleo
> E-Mail: ingarleo@icloud.com <ma...@icloud.com>
>
>> On 17 Jul 2015, at 14:19, vandana bhatia <vbhatia91@gmail.com
>> <ma...@gmail.com>> wrote:
>>
>> *hi.*
>> *i just started working with giraph. i followed the same steps
>> mentioned in the quick start guide and tried the following command.*
>>
>> hadoop jar
>> $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.2.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar
>> org.apache.giraph.GiraphRunner
>> org.apache.giraph.examples.SimpleShortestPathsComputation -vif
>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
>> -vip /user/input/tiny_graph.txt -vof
>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
>> /user/output/shortestpaths -w 1
>>
>> *but getting an error while running it *
>> *
>> 15/07/17 17:43:47 INFO utils.ConfigurationUtils: _No edge input
>> format specified. Ensure your InputFormat does not require one._
>> 15/07/17 17:43:47 INFO utils.ConfigurationUtils: _No edge output
>> format specified. Ensure your OutputFormat does not require one._
>> 15/07/17 17:43:47 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java
>> classes where applicable
>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>> mapreduce.job.counters.limit is deprecated. Instead, use
>> mapreduce.job.counters.max
>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>> mapred.job.map.memory.mb is deprecated. Instead, use
>> mapreduce.map.memory.mb
>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>> mapred.job.reduce.memory.mb is deprecated. Instead, use
>> mapreduce.reduce.memory.mb
>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>> mapred.map.tasks.speculative.execution is deprecated. Instead,
>> use mapreduce.map.speculative
>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>> mapreduce.user.classpath.first is deprecated. Instead, use
>> mapreduce.job.user.classpath.first
>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>> mapred.map.max.attempts is deprecated. Instead, use
>> mapreduce.map.maxattempts
>> 15/07/17 17:43:47 INFO job.GiraphJob: run: Since checkpointing is
>> disabled (default), do not allow any task retries (setting
>> mapred.map.max.attempts = 1, old value = 4)
>> 15/07/17 17:43:47 INFO Configuration.deprecation:
>> mapred.job.tracker is deprecated. Instead, use
>> mapreduce.jobtracker.address
>> Exception in thread "main" java.lang.IllegalArgumentException:
>> checkLocalJobRunnerConfiguration: When using LocalJobRunner, you
>> cannot run in split master / worker mode since there is only 1
>> task at a time!
>> at
>> org.apache.giraph.job.GiraphJob.checkLocalJobRunnerConfiguration(GiraphJob.java:167)
>> at org.apache.giraph.job.GiraphJob.run(GiraphJob.java:235)
>> at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:94)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>> at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:497)
>> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>>
>> *
>>
>> Please help me out in resolving this issue. I am working in
>> giraph 1.1.0
>>
>>
>> --
>> Regards,
>> Vandana Bhatia
>
>
>
>
> --
> Regards,
> Vandana Bhatia
Re: Problem with simple shortest path
Posted by vandana bhatia <vb...@gmail.com>.
Hi Alessio ,
Sorry but it did not worked . The problem still exist.
*No edge input format specified. Ensure your InputFormat does not require
one.*
*No edge output format specified. Ensure your OutputFormat does not require
one.*
It is asking for the above two things.
On Fri, Jul 17, 2015 at 7:27 PM, Ing. Alessio Arleo <in...@icloud.com>
wrote:
> Hello Vandana
>
> If you are working on a single machine, you have to set not to split the
> master and worker machines.
>
> To do so, add ‘-ca giraph.SplitMasterWorker=false’ to the command you use
> to launch the job.
>
> Hope this helps.
>
> =============
> Dr. Alessio Arleo
>
> PhD student in Industrial and Information Engineering @ University of
> Perugia
>
> Doctor in Information and Automation Engineering
>
> Linkedin: it.linkedin.com/in/IngArleo
> Skype: Ing. Alessio Arleo
> E-Mail: ingarleo@icloud.com
>
> On 17 Jul 2015, at 14:19, vandana bhatia <vb...@gmail.com> wrote:
>
> *hi.*
> *i just started working with giraph. i followed the same steps mentioned
> in the quick start guide and tried the following command.*
>
> hadoop jar
> $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.2.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar
> org.apache.giraph.GiraphRunner
> org.apache.giraph.examples.SimpleShortestPathsComputation -vif
> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
> -vip /user/input/tiny_graph.txt -vof
> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
> /user/output/shortestpaths -w 1
>
> *but getting an error while running it *
>
> *15/07/17 17:43:47 INFO utils.ConfigurationUtils: No edge input format
> specified. Ensure your InputFormat does not require one.15/07/17 17:43:47
> INFO utils.ConfigurationUtils: No edge output format specified. Ensure your
> OutputFormat does not require one.15/07/17 17:43:47 WARN
> util.NativeCodeLoader: Unable to load native-hadoop library for your
> platform... using builtin-java classes where applicable15/07/17 17:43:47
> INFO Configuration.deprecation: mapreduce.job.counters.limit is deprecated.
> Instead, use mapreduce.job.counters.max15/07/17 17:43:47 INFO
> Configuration.deprecation: mapred.job.map.memory.mb is deprecated. Instead,
> use mapreduce.map.memory.mb15/07/17 17:43:47 INFO
> Configuration.deprecation: mapred.job.reduce.memory.mb is deprecated.
> Instead, use mapreduce.reduce.memory.mb15/07/17 17:43:47 INFO
> Configuration.deprecation: mapred.map.tasks.speculative.execution is
> deprecated. Instead, use mapreduce.map.speculative15/07/17 17:43:47 INFO
> Configuration.deprecation: mapreduce.user.classpath.first is deprecated.
> Instead, use mapreduce.job.user.classpath.first15/07/17 17:43:47 INFO
> Configuration.deprecation: mapred.map.max.attempts is deprecated. Instead,
> use mapreduce.map.maxattempts15/07/17 17:43:47 INFO job.GiraphJob: run:
> Since checkpointing is disabled (default), do not allow any task retries
> (setting mapred.map.max.attempts = 1, old value = 4)15/07/17 17:43:47 INFO
> Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use
> mapreduce.jobtracker.addressException in thread "main"
> java.lang.IllegalArgumentException: checkLocalJobRunnerConfiguration: When
> using LocalJobRunner, you cannot run in split master / worker mode since
> there is only 1 task at a time! at
> org.apache.giraph.job.GiraphJob.checkLocalJobRunnerConfiguration(GiraphJob.java:167)
> at org.apache.giraph.job.GiraphJob.run(GiraphJob.java:235) at
> org.apache.giraph.GiraphRunner.run(GiraphRunner.java:94) at
> org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at
> org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) at
> org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124) at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497) at
> org.apache.hadoop.util.RunJar.run(RunJar.java:221) at
> org.apache.hadoop.util.RunJar.main(RunJar.java:136)*
>
> Please help me out in resolving this issue. I am working in giraph 1.1.0
>
>
> --
> Regards,
> Vandana Bhatia
>
>
>
--
Regards,
Vandana Bhatia
Re: Problem with simple shortest path
Posted by "Ing. Alessio Arleo" <in...@icloud.com>.
Hello Vandana
If you are working on a single machine, you have to set not to split the master and worker machines.
To do so, add ‘-ca giraph.SplitMasterWorker=false’ to the command you use to launch the job.
Hope this helps.
=============
Dr. Alessio Arleo
PhD student in Industrial and Information Engineering @ University of Perugia
Doctor in Information and Automation Engineering
Linkedin: it.linkedin.com/in/IngArleo
Skype: Ing. Alessio Arleo
E-Mail: ingarleo@icloud.com
> On 17 Jul 2015, at 14:19, vandana bhatia <vb...@gmail.com> wrote:
>
> hi.
> i just started working with giraph. i followed the same steps mentioned in the quick start guide and tried the following command.
>
> hadoop jar $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.2.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/input/tiny_graph.txt -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/output/shortestpaths -w 1
>
> but getting an error while running it
> 15/07/17 17:43:47 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your InputFormat does not require one.
> 15/07/17 17:43:47 INFO utils.ConfigurationUtils: No edge output format specified. Ensure your OutputFormat does not require one.
> 15/07/17 17:43:47 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 15/07/17 17:43:47 INFO Configuration.deprecation: mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
> 15/07/17 17:43:47 INFO Configuration.deprecation: mapred.job.map.memory.mb is deprecated. Instead, use mapreduce.map.memory.mb
> 15/07/17 17:43:47 INFO Configuration.deprecation: mapred.job.reduce.memory.mb is deprecated. Instead, use mapreduce.reduce.memory.mb
> 15/07/17 17:43:47 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
> 15/07/17 17:43:47 INFO Configuration.deprecation: mapreduce.user.classpath.first is deprecated. Instead, use mapreduce.job.user.classpath.first
> 15/07/17 17:43:47 INFO Configuration.deprecation: mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
> 15/07/17 17:43:47 INFO job.GiraphJob: run: Since checkpointing is disabled (default), do not allow any task retries (setting mapred.map.max.attempts = 1, old value = 4)
> 15/07/17 17:43:47 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
> Exception in thread "main" java.lang.IllegalArgumentException: checkLocalJobRunnerConfiguration: When using LocalJobRunner, you cannot run in split master / worker mode since there is only 1 task at a time!
> at org.apache.giraph.job.GiraphJob.checkLocalJobRunnerConfiguration(GiraphJob.java:167)
> at org.apache.giraph.job.GiraphJob.run(GiraphJob.java:235)
> at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:94)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>
>
> Please help me out in resolving this issue. I am working in giraph 1.1.0
>
>
> --
> Regards,
> Vandana Bhatia