[jira] [Comment Edited] (REEF-33) Support pushing Task messages from Evaluator to Driver.

["Byung-Gon Chun (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/REEF-33?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220675#comment-14220675 ] 

Byung-Gon Chun edited comment on REEF-33 at 11/21/14 8:33 AM:
--------------------------------------------------------------

[~johnyangk] We can address class and method names (if needed) when we do code review. Please go ahead and implement it.


was (Author: bgchun):
[~johnyangk] We can address class and method names (if needed) when we do code review. Please go ahead to implement it.

> Support pushing Task messages from Evaluator to Driver.
> -------------------------------------------------------
>
>                 Key: REEF-33
>                 URL: https://issues.apache.org/jira/browse/REEF-33
>             Project: REEF
>          Issue Type: New Feature
>            Reporter: Byung-Gon Chun
>            Assignee: John Yang
>            Priority: Critical
>
> Currently REEF supports sending Task messages by piggybacking them to heartbeats from Evaluator to Driver. This is great for scalability, but there are cases where Task needs to send messages immediately. This question has been asked multiple times in the dev mailing list; our experience of building Surf, an in-memory caching service on REEF, confirms it. 
> Although the default way of sending Task messages should use the heartbeat mechanism, we should provide an option to push a TaskMessage from Evaluator to Driver. Otherwise, we have to set up a separate channel (RemoteManager) between Evaluator and Driver, which does not make sense.
> A good approach is to reuse REEF RemoteManager between Evaluator and Driver and to provide an interface to push TaskMessages (as an option). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)