You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by "Markus Weimer (JIRA)" <ji...@apache.org> on 2016/05/16 21:57:13 UTC
[jira] [Commented] (REEF-1223) IMRU Fault Tolerance - restart
failed evaluators
[ https://issues.apache.org/jira/browse/REEF-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15285497#comment-15285497 ]
Markus Weimer commented on REEF-1223:
-------------------------------------
One question on the approach: Do we plan to make a *new* IMRU Driver that implements fault tolerance or do we want to evolve the current one to become fault tolerant?
> IMRU Fault Tolerance - restart failed evaluators
> ------------------------------------------------
>
> Key: REEF-1223
> URL: https://issues.apache.org/jira/browse/REEF-1223
> Project: REEF
> Issue Type: New Feature
> Components: IMRU, REEF.NET
> Reporter: Julia
> Assignee: Julia
> Labels: FT
> Attachments: REEF Fault Tolerant Technical design.docx
>
>
> Currently in .Net Group Communication and IMRU scenario, if one of the Evaluator failed for whatever reason, all the Evaluators will be killed by the driver.
> There are multiple levels of fault tolerant. The scenario we would like to support in this JIRA is:
> * When an evaluator failed, this failed evaluator will be killed and other good Evaluators will stay, but all the tasks running on those Evaluators will be stopped.
> * A new Evaluator will be requested and started with the original task.
> * Same tasks will be resubmitted to the rest the Evaluators
> * The topology of those tasks will be kept in the same group communication as before
> * The data that have been downloaded in those good Evaluators will stay.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)