You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@giraph.apache.org by Chahinez BENKOUSSAS <ch...@lsis.org> on 2014/09/21 13:47:01 UTC

Empty Output when running Shortest Path Algorithm !!

Hi,

I'm a new Giraph user. I installed Hadoop 1.2.1 with Giraph 1.0.0. I'd 
testing a tiny graph obtained from this blog: 
http://www.sbarjatiya.com/notes_wiki/index.php/Install_giraph_in_hadoop_node 
which use the Shortest Path algorithm but when checking the output, the 
file is empty.

The line command is :

../hadoop/bin/hadoop jar 
/opt/hadoop/giraph/giraph-examples/target/giraph-examples-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar 
org.apache.giraph.GiraphRunner  
org.apache.giraph.examples.SimpleShortestPathsVertex -vif 
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat 
-vip /user/hduser/input/tiny_graph.txt -of 
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op 
/user/hduser/output/shortestpaths2 -w 1

On the terminal I have this :


14/09/21 13:34:03 INFO utils.ConfigurationUtils: No edge input format 
specified. Ensure your InputFormat does not require one.
14/09/21 13:34:03 WARN job.GiraphConfigurationValidator: Output format 
vertex index type is not known
14/09/21 13:34:03 WARN job.GiraphConfigurationValidator: Output format 
vertex value type is not known
14/09/21 13:34:03 WARN job.GiraphConfigurationValidator: Output format 
edge value type is not known
14/09/21 13:34:03 INFO job.GiraphJob: run: Since checkpointing is 
disabled (default), do not allow any task retries (setting 
mapred.map.max.attempts = 0, old value = 4)
14/09/21 13:34:04 INFO mapred.JobClient: Running job: 
job_201409211311_0003
14/09/21 13:34:05 INFO mapred.JobClient:  map 0% reduce 0%
14/09/21 13:34:15 INFO mapred.JobClient:  map 100% reduce 0%
14/09/21 13:34:16 INFO mapred.JobClient: Job complete: 
job_201409211311_0003
14/09/21 13:34:16 INFO mapred.JobClient: Counters: 29
14/09/21 13:34:16 INFO mapred.JobClient:   Map-Reduce Framework
14/09/21 13:34:16 INFO mapred.JobClient:     Spilled Records=0
14/09/21 13:34:16 INFO mapred.JobClient:     Virtual memory (bytes) 
snapshot=3841761280
14/09/21 13:34:16 INFO mapred.JobClient:     Map input records=2
14/09/21 13:34:16 INFO mapred.JobClient:     SPLIT_RAW_BYTES=88
14/09/21 13:34:16 INFO mapred.JobClient:     Map output records=0
14/09/21 13:34:16 INFO mapred.JobClient:     Physical memory (bytes) 
snapshot=228786176
14/09/21 13:34:16 INFO mapred.JobClient:     CPU time spent (ms)=2210
14/09/21 13:34:16 INFO mapred.JobClient:     Total committed heap usage 
(bytes)=249561088
14/09/21 13:34:16 INFO mapred.JobClient:   Giraph Timers
14/09/21 13:34:16 INFO mapred.JobClient:     Total (milliseconds)=969
14/09/21 13:34:16 INFO mapred.JobClient:     Shutdown (milliseconds)=161
14/09/21 13:34:16 INFO mapred.JobClient:     Input superstep 
(milliseconds)=339
14/09/21 13:34:16 INFO mapred.JobClient:     Setup (milliseconds)=467
14/09/21 13:34:16 INFO mapred.JobClient:   File Input Format Counters
14/09/21 13:34:16 INFO mapred.JobClient:     Bytes Read=0
14/09/21 13:34:16 INFO mapred.JobClient:   Giraph Stats
14/09/21 13:34:16 INFO mapred.JobClient:     Aggregate finished 
vertices=0
14/09/21 13:34:16 INFO mapred.JobClient:     Aggregate edges=0
14/09/21 13:34:16 INFO mapred.JobClient:     Sent messages=0
14/09/21 13:34:16 INFO mapred.JobClient:     Current workers=1
14/09/21 13:34:16 INFO mapred.JobClient:     Last checkpointed 
superstep=0
14/09/21 13:34:16 INFO mapred.JobClient:     Current master task 
partition=0
14/09/21 13:34:16 INFO mapred.JobClient:     Superstep=0
14/09/21 13:34:16 INFO mapred.JobClient:     Aggregate vertices=0
14/09/21 13:34:16 INFO mapred.JobClient:   FileSystemCounters
14/09/21 13:34:16 INFO mapred.JobClient:     HDFS_BYTES_READ=88
14/09/21 13:34:16 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=112468
14/09/21 13:34:16 INFO mapred.JobClient:   Job Counters
14/09/21 13:34:16 INFO mapred.JobClient:     Launched map tasks=2
14/09/21 13:34:16 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
14/09/21 13:34:16 INFO mapred.JobClient:     Total time spent by all 
reduces waiting after reserving slots (ms)=0
14/09/21 13:34:16 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=13452
14/09/21 13:34:16 INFO mapred.JobClient:     Total time spent by all 
maps waiting after reserving slots (ms)=0
14/09/21 13:34:16 INFO mapred.JobClient:   File Output Format Counters
14/09/21 13:34:16 INFO mapred.JobClient:     Bytes Written=0


Can anybody help me and indicate me if I'm doing it wrong !!

Best Regards,
Chahinez

Re: Empty Output when running Shortest Path Algorithm !!

Posted by Roman Shaposhnik <ro...@shaposhnik.org>.

I this should should give you some clue:

> 14/09/21 13:34:03 WARN job.GiraphConfigurationValidator: Output format
> vertex index type is not known
> 14/09/21 13:34:03 WARN job.GiraphConfigurationValidator: Output format
> vertex value type is not known
> 14/09/21 13:34:03 WARN job.GiraphConfigurationValidator: Output format edge
> value type is not known

At this point, what I would recommend though is to try
the same experiment with our Giraph 1.1.0 RC0 available
from the following URL:
   http://people.apache.org/~rvs/giraph-1.1.0-RC0/giraph-dist-1.1.0-bin.tar.gz

Thanks,
Roman.