[jira] [Commented] (HAMA-526) Multi-threaded vertex processing

["Thomas Jungblut (Commented) (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HAMA-526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236902#comment-13236902 ] 

Thomas Jungblut commented on HAMA-526:
--------------------------------------

bq.Do you think we can run Vertex processing concurrently using multi-threads?
Well, everything is possible.

bq.Then what's the advantages or disadvantages of using multi-threading?

Advantage would be that it maybe faster if there is no context switch. E.g if a user configures a single task per groom server and let the graph processing be done by multiple threads rather than multiple tasks.
The drawback is the memory usage, it will need more memory.

I actually like the Multithreaded Mapper design in MapReduce, do you think we can add some kind of MultithreadedBSP?

                
> Multi-threaded vertex processing
> --------------------------------
>
>                 Key: HAMA-526
>                 URL: https://issues.apache.org/jira/browse/HAMA-526
>             Project: Hama
>          Issue Type: Improvement
>          Components: bsp, graph
>            Reporter: Edward J. Yoon
>
> {code}
>   public void bsp(BSPPeer peer) throws IOException, SyncException,
>       InterruptedException {
>  
>       ...
>       while (updated && iteration < maxIteration) {
>         peer.sync();
>         ...
>         for (Map.Entry<String, LinkedList<Writable>> e : msgMap.entrySet()) {
>           if (e.getValue().size() > 0) {
>             vertices.get(e.getKey()).compute(e.getValue().iterator());
>           }
>         }
>       ...
>       }
> {code}
> Above code will run Vertex sequentially. Do you think we can run Vertex processing concurrently using multi-threads?
> Then what's the advantages or disadvantages of using multi-threading?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira