You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Hyunsik Choi (JIRA)" <ji...@apache.org> on 2011/09/14 10:26:08 UTC
[jira] [Created] (GIRAPH-32) Implement benchmarks to evaluate the
performance of message passing
Implement benchmarks to evaluate the performance of message passing
--------------------------------------------------------------------
Key: GIRAPH-32
URL: https://issues.apache.org/jira/browse/GIRAPH-32
Project: Giraph
Issue Type: Task
Components: benchmark
Reporter: Hyunsik Choi
Assignee: Hyunsik Choi
Fix For: 0.70.0
Message passing framework plays an important role in Giraph.
We need some benchmark programs to evaluate the improvement related to message passing method.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (GIRAPH-32) Implement benchmarks to evaluate the
performance of message passing
Posted by "Hyunsik Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-32?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyunsik Choi resolved GIRAPH-32.
--------------------------------
Resolution: Fixed
Because this issue got +1, I just committed.
> Implement benchmarks to evaluate the performance of message passing
> --------------------------------------------------------------------
>
> Key: GIRAPH-32
> URL: https://issues.apache.org/jira/browse/GIRAPH-32
> Project: Giraph
> Issue Type: Task
> Components: benchmark
> Reporter: Hyunsik Choi
> Assignee: Hyunsik Choi
> Fix For: 0.70.0
>
> Attachments: GIRAPH-32.patch, GIRAPH-32_2.patch
>
>
> Message passing framework plays an important role in Giraph.
> We need some benchmark programs to evaluate the improvement related to message passing method.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-32) Implement benchmarks to evaluate the
performance of message passing
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-32?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107794#comment-13107794 ]
Hudson commented on GIRAPH-32:
------------------------------
Integrated in Giraph-trunk-Commit #9 (See [https://builds.apache.org/job/Giraph-trunk-Commit/9/])
GIRAPH-32: Implement benchmarks to evaluate the performance of message passing
hyunsik : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1172605
Files :
* /incubator/giraph/trunk/CHANGELOG
* /incubator/giraph/trunk/src/main/java/org/apache/giraph/benchmark/RandomMessageBenchmark.java
> Implement benchmarks to evaluate the performance of message passing
> --------------------------------------------------------------------
>
> Key: GIRAPH-32
> URL: https://issues.apache.org/jira/browse/GIRAPH-32
> Project: Giraph
> Issue Type: Task
> Components: benchmark
> Reporter: Hyunsik Choi
> Assignee: Hyunsik Choi
> Fix For: 0.70.0
>
> Attachments: GIRAPH-32.patch, GIRAPH-32_2.patch
>
>
> Message passing framework plays an important role in Giraph.
> We need some benchmark programs to evaluate the improvement related to message passing method.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-32) Implement benchmarks to evaluate the
performance of message passing
Posted by "Hyunsik Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-32?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyunsik Choi updated GIRAPH-32:
-------------------------------
Attachment: GIRAPH-32.patch
I attach the patch about this issue.
This patch includes a benchmark class. In this benchmark, for each vertex, the compute function sends a meaningless message into all edges of the vertex. Actually, I intend this benchmark to send messages into random workers. PseudoRandomVertexInputFormat already generates random edges. I employed it.
This benchmark allows users to set the size of message bytes and the number of sending messages per edge. This is because I think they are basic factors to evaluate the behavior and performance of some message delivery system. Besides, users can adjust the number of edges per vertex rather than adjusting the number of sending messages per. It allows users to make the sending pattern either more spread or more skewed.
Anyone can review this?
> Implement benchmarks to evaluate the performance of message passing
> --------------------------------------------------------------------
>
> Key: GIRAPH-32
> URL: https://issues.apache.org/jira/browse/GIRAPH-32
> Project: Giraph
> Issue Type: Task
> Components: benchmark
> Reporter: Hyunsik Choi
> Assignee: Hyunsik Choi
> Fix For: 0.70.0
>
> Attachments: GIRAPH-32.patch
>
>
> Message passing framework plays an important role in Giraph.
> We need some benchmark programs to evaluate the improvement related to message passing method.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-32) Implement benchmarks to evaluate the
performance of message passing
Posted by "Avery Ching (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-32?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107188#comment-13107188 ]
Avery Ching commented on GIRAPH-32:
-----------------------------------
+1, only minor comment is the 'for(' -> 'for (' to fit other code conventions. I imagine that this benchmark will evolve over time (i.e. allows Jake's power law distributed input (GIRAPH-26) to be chosen as input instead of the random edges. But looks good to me! Hopefully it will help you guys in your communication testing.
> Implement benchmarks to evaluate the performance of message passing
> --------------------------------------------------------------------
>
> Key: GIRAPH-32
> URL: https://issues.apache.org/jira/browse/GIRAPH-32
> Project: Giraph
> Issue Type: Task
> Components: benchmark
> Reporter: Hyunsik Choi
> Assignee: Hyunsik Choi
> Fix For: 0.70.0
>
> Attachments: GIRAPH-32.patch
>
>
> Message passing framework plays an important role in Giraph.
> We need some benchmark programs to evaluate the improvement related to message passing method.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-32) Implement benchmarks to evaluate the
performance of message passing
Posted by "Hyunsik Choi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GIRAPH-32?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyunsik Choi updated GIRAPH-32:
-------------------------------
Attachment: GIRAPH-32_2.patch
Good idea! According to which InputFormat we use, we could choose the distribution of destination vertices.
I attach the patch that corrected coding convention.
> Implement benchmarks to evaluate the performance of message passing
> --------------------------------------------------------------------
>
> Key: GIRAPH-32
> URL: https://issues.apache.org/jira/browse/GIRAPH-32
> Project: Giraph
> Issue Type: Task
> Components: benchmark
> Reporter: Hyunsik Choi
> Assignee: Hyunsik Choi
> Fix For: 0.70.0
>
> Attachments: GIRAPH-32.patch, GIRAPH-32_2.patch
>
>
> Message passing framework plays an important role in Giraph.
> We need some benchmark programs to evaluate the improvement related to message passing method.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira