You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Edward J. Yoon (Updated) (JIRA)" <ji...@apache.org> on 2011/12/07 07:12:40 UTC
[jira] [Updated] (HAMA-443) SSSP doesn't works with multi-tasks
[ https://issues.apache.org/jira/browse/HAMA-443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon updated HAMA-443:
--------------------------------
Attachment: test.patch
This is my just test.
I expected, two messages will be delivered in each superstep but there seems a framework bug.
{code}
11/12/07 14:55:06 INFO message.HadoopMessageManagerImpl: BSPPeer address:slave.udanax.org port:61000
11/12/07 14:55:34 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 1
11/12/07 14:55:34 INFO examples.ShortestPaths: >>> send 0 to master task at 1
11/12/07 14:55:34 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:55:36 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 2
11/12/07 14:55:36 INFO examples.ShortestPaths: >>> send 0 to master task at 2
11/12/07 14:55:37 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:55:39 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 3
11/12/07 14:55:39 INFO examples.ShortestPaths: >>> send 0 to master task at 3
11/12/07 14:55:39 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:55:41 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 4
11/12/07 14:55:41 INFO examples.ShortestPaths: >>> send 1 to master task at 4
11/12/07 14:55:41 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:55:43 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 5
11/12/07 14:55:43 INFO examples.ShortestPaths: >>> send 0 to master task at 5
11/12/07 14:55:44 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:55:46 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 6
11/12/07 14:55:46 INFO examples.ShortestPaths: >>> send 0 to master task at 6
11/12/07 14:55:46 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:55:48 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 7
11/12/07 14:55:48 INFO examples.ShortestPaths: >>> send 0 to master task at 7
11/12/07 14:55:48 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:55:50 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 8
11/12/07 14:55:50 INFO examples.ShortestPaths: >>> send 1 to master task at 8
11/12/07 14:55:50 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:55:52 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 9
11/12/07 14:55:52 INFO examples.ShortestPaths: >>> send 0 to master task at 9
11/12/07 14:55:52 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:55:54 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 10
11/12/07 14:55:54 INFO examples.ShortestPaths: >>> send 0 to master task at 10
11/12/07 14:55:54 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:55:56 INFO zookeeper.ZooKeeper: Session: 0x1339fd70a5b03c2 closed
11/12/07 14:52:54 INFO message.HadoopMessageManagerImpl: BSPPeer address:tweetple.com port:61000
11/12/07 14:52:54 INFO ipc.Server: IPC Server handler 0 on 61000: starting
11/12/07 14:53:21 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 1
11/12/07 14:53:21 INFO examples.ShortestPaths: >>> send 0 to master task at 1
11/12/07 14:53:21 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:53:23 INFO examples.ShortestPaths: >>> from 1 superstep and 0 - 2
11/12/07 14:53:23 INFO examples.ShortestPaths: >>> from 1 superstep and 0 - 2
11/12/07 14:53:23 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 2
11/12/07 14:53:23 INFO examples.ShortestPaths: >>> send 1 to master task at 2
11/12/07 14:53:25 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:53:27 INFO examples.ShortestPaths: >>> from 2 superstep and 0 - 3
11/12/07 14:53:27 INFO examples.ShortestPaths: >>> from 2 superstep and 1 - 3
11/12/07 14:53:27 INFO examples.ShortestPaths: xxx previous updates counts: 1 at 3
11/12/07 14:53:27 INFO examples.ShortestPaths: >>> send 0 to master task at 3
11/12/07 14:53:27 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:53:29 INFO examples.ShortestPaths: >>> from 3 superstep and 0 - 4
11/12/07 14:53:29 INFO examples.ShortestPaths: >>> from 3 superstep and 0 - 4
11/12/07 14:53:29 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 4
11/12/07 14:53:29 INFO examples.ShortestPaths: >>> send 0 to master task at 4
11/12/07 14:53:29 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:53:31 INFO examples.ShortestPaths: >>> from 4 superstep and 0 - 5
11/12/07 14:53:31 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 5
11/12/07 14:53:31 INFO examples.ShortestPaths: >>> send 0 to master task at 5
11/12/07 14:53:31 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:53:33 INFO examples.ShortestPaths: >>> from 4 superstep and 1 - 6
11/12/07 14:53:33 INFO examples.ShortestPaths: >>> from 5 superstep and 0 - 6
11/12/07 14:53:33 INFO examples.ShortestPaths: >>> from 5 superstep and 0 - 6
11/12/07 14:53:33 INFO examples.ShortestPaths: xxx previous updates counts: 1 at 6
11/12/07 14:53:33 INFO examples.ShortestPaths: >>> send 1 to master task at 6
11/12/07 14:53:33 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:53:35 INFO examples.ShortestPaths: >>> from 6 superstep and 1 - 7
11/12/07 14:53:35 INFO examples.ShortestPaths: xxx previous updates counts: 1 at 7
11/12/07 14:53:35 INFO examples.ShortestPaths: >>> send 1 to master task at 7
11/12/07 14:53:35 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:53:37 INFO examples.ShortestPaths: >>> from 6 superstep and 0 - 8
11/12/07 14:53:37 INFO examples.ShortestPaths: >>> from 7 superstep and 0 - 8
11/12/07 14:53:37 INFO examples.ShortestPaths: >>> from 7 superstep and 1 - 8
11/12/07 14:53:37 INFO examples.ShortestPaths: xxx previous updates counts: 1 at 8
11/12/07 14:53:37 INFO examples.ShortestPaths: >>> send 0 to master task at 8
11/12/07 14:53:38 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:53:40 INFO examples.ShortestPaths: >>> from 8 superstep and 0 - 9
11/12/07 14:53:40 INFO examples.ShortestPaths: xxx previous updates counts: 0 at 9
11/12/07 14:53:40 INFO examples.ShortestPaths: >>> send 0 to master task at 9
11/12/07 14:53:40 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:53:42 INFO examples.ShortestPaths: >>> from 8 superstep and 1 - 10
11/12/07 14:53:42 INFO examples.ShortestPaths: >>> from 9 superstep and 0 - 10
11/12/07 14:53:42 INFO examples.ShortestPaths: xxx previous updates counts: 1 at 10
11/12/07 14:53:42 INFO examples.ShortestPaths: >>> send 1 to master task at 10
11/12/07 14:53:42 INFO examples.ShortestPaths: ----------------------------------------------------------------
11/12/07 14:53:44 INFO zookeeper.ZooKeeper: Session: 0x1339fd70a5b03c3 closed
{code}
> SSSP doesn't works with multi-tasks
> -----------------------------------
>
> Key: HAMA-443
> URL: https://issues.apache.org/jira/browse/HAMA-443
> Project: Hama
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.4.0
>
> Attachments: HAMA-443.patch, HAMA-443_1.patch, HAMA-443_v2.patch, HAMA-443_v3.patch, HAMA-443_v4.patch, HAMA-443_v5.patch, mapToList.patch, patch.txt, refactor.patch, test.patch
>
>
> {code}
> root@Cnode1:/usr/local/src/hama-trunk# core/bin/hama jar examples/target/hama-examples-0.4.0-incubating-SNAPSHOT.jar sssp Klewno xx /user/root/edward/sssp-adjacencylist.txt
> Single Source Shortest Path Example:
> <Startvertex name> <optional: output path> <optional: path to own adjacency list textfile!>
> Setting default start vertex to "Frankfurt"!
> Setting start vertex to Klewno!
> Using new output folder: xx
> 11/09/26 09:46:24 INFO graph.ShortestPaths: Starting data partitioning...
> 11/09/26 09:47:12 INFO graph.ShortestPaths: Finished!
> 11/09/26 09:47:12 INFO bsp.BSPJobClient: Running job: job_201109260929_0004
> 11/09/26 09:47:15 INFO bsp.BSPJobClient: Current supersteps number: 0
> 11/09/26 09:47:21 INFO bsp.BSPJobClient: Current supersteps number: 1
> 11/09/26 09:47:33 INFO bsp.BSPJobClient: The total number of supersteps: 1
> Job Finished in 21.553 seconds
> -------------------- RESULTS --------------------
> java.lang.NullPointerException
> at org.apache.hama.examples.graph.ShortestPathsBase.printOutput(ShortestPathsBase.java:93)
> at org.apache.hama.examples.graph.ShortestPaths.main(ShortestPaths.java:239)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
> at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
> at org.apache.hama.examples.ExampleDriver.main(ExampleDriver.java:37)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hama.util.RunJar.main(RunJar.java:145)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira