You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@giraph.apache.org by rodrigo zerbini <ro...@gmail.com> on 2012/10/01 03:58:35 UTC

Re: Shortest Paths Example

I was running the command in the directory named trunk. I made another
attempt trying to run it in the directory named target, where
giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar is.

When I tried

hadoop jar
giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
org.apache.giraph.examples.SimpleShortestPathsVertex
shortestPathsInputGraph shortestPathsOutputGraph 0 3

I got this:

Exception in thread "main" java.lang.NoSuchMethodException:
org.apache.giraph.examples.SimpleShortestPathsVertex.main([Ljava.lang.String;)
    at java.lang.Class.getMethod(Class.java:1605)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:150)

When I tried

hadoop jar
giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.SimpleShortestPathsVertex -if
org.apache.giraph.lib.JsonBase64VertexInputFormat -ip
shortestPathsInputGraph -of
org.apache.giraph.lib.JsonBase64VertexOutputFormat -op
shortestPathsOutputGraph -w 3

I got this:

Exception in thread "main" java.lang.ClassNotFoundException:
org.apache.giraph.lib.JsonBase64VertexInputFormat
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:169)
    at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:164)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
    at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:247)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)


What do these errors mean?
Did anyone have success in running this example?
If yes, could you help me, please?




2012/9/29 rodrigo zerbini <ro...@gmail.com>

> Hello. I'm trying to run the Shortest Paths Example but it doesn't work.
>
> I'm doing:
>
> hadoop jar
> giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> org.apache.giraph.examples.SimpleShortestPathsVertex
> shortestPathsInputGraph shortestPathsOutputGraph 0 3
>
> I got this error:
>
> Exception in thread "main" java.io.IOException: Error opening job jar:
> giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> at org.apache.hadoop.util.RunJar.main(RunJar.java:90)
> Caused by: java.util.zip.ZipException: error in opening zip file
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.<init>(ZipFile.java:127)
>  at java.util.jar.JarFile.<init>(JarFile.java:135)
> at java.util.jar.JarFile.<init>(JarFile.java:72)
>  at org.apache.hadoop.util.RunJar.main(RunJar.java:88)
>
>
> Could anyone help me, please?
>
> Thanks in advance.
>
> Rodrigo Zerbini
>
> Computer science student in University of São Paulo
>
>

Re: Shortest Paths Example

Posted by rodrigo zerbini <ro...@gmail.com>.
Thank you too, Jaeho! I tried your suggestion, but I got:


12/10/01 10:29:30 WARN graph.GiraphTypeValidator: Input format vertex index
type is not known
12/10/01 10:29:30 WARN graph.GiraphTypeValidator: Input format vertex value
type is not known
12/10/01 10:29:30 WARN graph.GiraphTypeValidator: Input format edge value
type is not known
12/10/01 10:29:30 WARN graph.GiraphTypeValidator: Output format vertex
index type is not known
12/10/01 10:29:30 WARN graph.GiraphTypeValidator: Output format vertex
value type is not known
12/10/01 10:29:30 WARN graph.GiraphTypeValidator: Output format edge value
type is not known
12/10/01 10:29:32 INFO mapred.JobClient: Running job: job_201210011022_0001
12/10/01 10:29:33 INFO mapred.JobClient:  map 0% reduce 0%
12/10/01 10:30:44 INFO mapred.JobClient:  map 25% reduce 0%
12/10/01 10:35:52 INFO mapred.JobClient: Job complete: job_201210011022_0001
12/10/01 10:35:52 INFO mapred.JobClient: Counters: 5
12/10/01 10:35:52 INFO mapred.JobClient:   Job Counters
12/10/01 10:35:52 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=684226
12/10/01 10:35:52 INFO mapred.JobClient:     Total time spent by all
reduces waiting after reserving slots (ms)=0
12/10/01 10:35:52 INFO mapred.JobClient:     Total time spent by all maps
waiting after reserving slots (ms)=0
12/10/01 10:35:52 INFO mapred.JobClient:     Launched map tasks=2
12/10/01 10:35:52 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=7050

hadoop fs -ls shortestPathsOutputGraph

Found 1 items
drwxr-xr-x   - ro supergroup          0 2012-10-01 10:29
/user/ro/shortestPathsOutputGraph/_logs

It looks like that the output is still incomplete =/
Besides that, there's something wrong because of these warnings.

Re: Shortest Paths Example

Posted by rodrigo zerbini <ro...@gmail.com>.
Venkata, thank you! I tried your suggestion and it worked, but not at all.
At least I'm doing some progress! :)

I got:

12/10/01 11:18:27 INFO mapred.JobClient: Running job: job_201210011112_0001
12/10/01 11:18:28 INFO mapred.JobClient:  map 0% reduce 0%
12/10/01 11:20:49 INFO mapred.JobClient:  map 25% reduce 0%
12/10/01 11:26:03 INFO mapred.JobClient: Job complete: job_201210011112_0001
12/10/01 11:26:05 INFO mapred.JobClient: Counters: 5
12/10/01 11:26:05 INFO mapred.JobClient:   Job Counters
12/10/01 11:26:05 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=723771
12/10/01 11:26:05 INFO mapred.JobClient:     Total time spent by all
reduces waiting after reserving slots (ms)=0
12/10/01 11:26:05 INFO mapred.JobClient:     Total time spent by all maps
waiting after reserving slots (ms)=0
12/10/01 11:26:05 INFO mapred.JobClient:     Launched map tasks=2
12/10/01 11:26:05 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=6601

Well, this log above is different of the example's log. And when I tried to
check the results doing

hadoop fs -ls shortestPathsOutputGraph

I found just 1 item:

Found 1 items
drwxr-xr-x   - ro supergroup          0 2012-10-01 11:18
/user/ro/shortestPathsOutputGraph/_logs

This output is incomplete. Shouldn't I find 5 items?

Observations:
- I'm doing hadoop fs -copyFromLocal shortestPathsInputGraph
shortestPathsInputGraph from the directory where shortestPathsInputGraph is
(which contains part-m-00001, part-m-00002, part-m-00003). Is it right?



2012/10/1 Jaeho Shin <Ja...@stanford.edu>

> Hi Rodrigo,
>
> Looks like you need to change org.apache.giraph.lib -> .io
>
> hadoop jar
> target/giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> org.apache.giraph.GiraphRunner
> org.apache.giraph.examples.SimpleShortestPathsVertex -if
> org.apache.giraph.io.JsonBase64VertexInputFormat -ip
> shortestPathsInputGraph -of
> org.apache.giraph.io.JsonBase64VertexOutputFormat -op
> shortestPathsOutputGraph -w 3
>
>
> Giraph codebase moves fast, so documents are easily outdated.
>
> Hope it helps,
>
> ~Jaeho
>
>
> On Sep 30, 2012, at 18:58 , rodrigo zerbini <ro...@gmail.com>
> wrote:
>
> I was running the command in the directory named trunk. I made another
> attempt trying to run it in the directory named target, where
> giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar is.
>
> When I tried
>
> hadoop jar
> giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> org.apache.giraph.examples.SimpleShortestPathsVertex
> shortestPathsInputGraph shortestPathsOutputGraph 0 3
>
> I got this:
>
> Exception in thread "main" java.lang.NoSuchMethodException:
> org.apache.giraph.examples.SimpleShortestPathsVertex.main([Ljava.lang.String;)
>     at java.lang.Class.getMethod(Class.java:1605)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:150)
>
> When I tried
>
> hadoop jar
> giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> org.apache.giraph.GiraphRunner
> org.apache.giraph.examples.SimpleShortestPathsVertex -if
> org.apache.giraph.lib.JsonBase64VertexInputFormat -ip
> shortestPathsInputGraph -of
> org.apache.giraph.lib.JsonBase64VertexOutputFormat -op
> shortestPathsOutputGraph -w 3
>
> I got this:
>
> Exception in thread "main" java.lang.ClassNotFoundException:
> org.apache.giraph.lib.JsonBase64VertexInputFormat
>     at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>     at java.lang.Class.forName0(Native Method)
>     at java.lang.Class.forName(Class.java:169)
>     at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:164)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>     at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:247)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>
>
> What do these errors mean?
> Did anyone have success in running this example?
> If yes, could you help me, please?
>
>
>
>
> 2012/9/29 rodrigo zerbini <ro...@gmail.com>
>
>> Hello. I'm trying to run the Shortest Paths Example but it doesn't work.
>>
>> I'm doing:
>>
>> hadoop jar
>> giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>> org.apache.giraph.examples.SimpleShortestPathsVertex
>> shortestPathsInputGraph shortestPathsOutputGraph 0 3
>>
>> I got this error:
>>
>> Exception in thread "main" java.io.IOException: Error opening job jar:
>> giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>> at org.apache.hadoop.util.RunJar.main(RunJar.java:90)
>> Caused by: java.util.zip.ZipException: error in opening zip file
>> at java.util.zip.ZipFile.open(Native Method)
>> at java.util.zip.ZipFile.<init>(ZipFile.java:127)
>>  at java.util.jar.JarFile.<init>(JarFile.java:135)
>> at java.util.jar.JarFile.<init>(JarFile.java:72)
>>  at org.apache.hadoop.util.RunJar.main(RunJar.java:88)
>>
>>
>> Could anyone help me, please?
>>
>> Thanks in advance.
>>
>> Rodrigo Zerbini
>>
>> Computer science student in University of São Paulo
>>
>>
>
>

Re: Shortest Paths Example

Posted by Jaeho Shin <Ja...@Stanford.EDU>.
Hi Rodrigo,

Looks like you need to change org.apache.giraph.lib -> .io

hadoop jar target/giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsVertex -if org.apache.giraph.io.JsonBase64VertexInputFormat -ip shortestPathsInputGraph -of org.apache.giraph.io.JsonBase64VertexOutputFormat -op shortestPathsOutputGraph -w 3


Giraph codebase moves fast, so documents are easily outdated.

Hope it helps,

~Jaeho


On Sep 30, 2012, at 18:58 , rodrigo zerbini <ro...@gmail.com> wrote:

> I was running the command in the directory named trunk. I made another attempt trying to run it in the directory named target, where giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar is.
> 
> When I tried
> 
> hadoop jar giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar org.apache.giraph.examples.SimpleShortestPathsVertex shortestPathsInputGraph shortestPathsOutputGraph 0 3
> 
> I got this:
> 
> Exception in thread "main" java.lang.NoSuchMethodException: org.apache.giraph.examples.SimpleShortestPathsVertex.main([Ljava.lang.String;)
>     at java.lang.Class.getMethod(Class.java:1605)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:150)
> 
> When I tried
> 
> hadoop jar giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsVertex -if org.apache.giraph.lib.JsonBase64VertexInputFormat -ip shortestPathsInputGraph -of org.apache.giraph.lib.JsonBase64VertexOutputFormat -op shortestPathsOutputGraph -w 3
> 
> I got this:
> 
> Exception in thread "main" java.lang.ClassNotFoundException: org.apache.giraph.lib.JsonBase64VertexInputFormat
>     at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>     at java.lang.Class.forName0(Native Method)
>     at java.lang.Class.forName(Class.java:169)
>     at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:164)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>     at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:247)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> 
> 
> What do these errors mean?
> Did anyone have success in running this example? 
> If yes, could you help me, please?
> 
> 
> 
> 
> 2012/9/29 rodrigo zerbini <ro...@gmail.com>
> Hello. I'm trying to run the Shortest Paths Example but it doesn't work.
> 
> I'm doing:
> 
> hadoop jar giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar org.apache.giraph.examples.SimpleShortestPathsVertex shortestPathsInputGraph shortestPathsOutputGraph 0 3
> 
> I got this error:
> 
> Exception in thread "main" java.io.IOException: Error opening job jar:
> giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> at org.apache.hadoop.util.RunJar.main(RunJar.java:90)
> Caused by: java.util.zip.ZipException: error in opening zip file
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.<init>(ZipFile.java:127)
>  at java.util.jar.JarFile.<init>(JarFile.java:135)
> at java.util.jar.JarFile.<init>(JarFile.java:72)
>  at org.apache.hadoop.util.RunJar.main(RunJar.java:88)
> 
> Could anyone help me, please? 
> Thanks in advance.
> Rodrigo Zerbini
> Computer science student in University of São Paulo
>