[jira] [Comment Edited] (HAMA-901) Multi-job configuration interface for communicate among jobs.

["Edward J. Yoon (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HAMA-901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651271#comment-14651271 ] 

Edward J. Yoon edited comment on HAMA-901 at 8/2/15 11:31 PM:
--------------------------------------------------------------

Here's another idea. Instead of launching two jobs, at first superstep, we can split the tasks into 2 more worker groups, and manage them as an logical two different BSP jobs using regional barrier synchronizations. This idea can be used for HAMA-961. DistBelief uses BSP paradigm among small worker groups for model parallel.


was (Author: udanax):
Here's another idea. Instead of launching two jobs, at first superstep, we can split the tasks into 2 more worker groups, and manage them as an logical two different BSP jobs. This idea can be used for HAMA-961. DistBelief uses BSP paradigm among small worker groups for model parallel.

> Multi-job configuration interface for communicate among jobs.
> -------------------------------------------------------------
>
>                 Key: HAMA-901
>                 URL: https://issues.apache.org/jira/browse/HAMA-901
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp core
>    Affects Versions: 0.7.0
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>             Fix For: 0.8.0
>
>
> I'm thinking about adding multi-job configuration interface for communicate among multiple jobs. My main purpose is for launching two infinite real-time data processing BSP job and incremental learning BSP job.
> I guess it's not difficult since we don't have message security yet.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)