You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by "Mariia Mykhailova (JIRA)" <ji...@apache.org> on 2016/04/27 21:43:13 UTC
[jira] [Commented] (REEF-1304) Create tests which use .NET Poison
to validate evaluator failure scenarios
[ https://issues.apache.org/jira/browse/REEF-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260809#comment-15260809 ]
Mariia Mykhailova commented on REEF-1304:
-----------------------------------------
I agree that we need to have similar coverage for Task failure. Let's keep this JIRA for Evaluator failures, since there are already a lot of scenarios which need separate tests, and cover Task failures next in REEF-1366.
> Create tests which use .NET Poison to validate evaluator failure scenarios
> --------------------------------------------------------------------------
>
> Key: REEF-1304
> URL: https://issues.apache.org/jira/browse/REEF-1304
> Project: REEF
> Issue Type: Test
> Components: REEF.NET
> Reporter: Mariia Mykhailova
> Assignee: Mariia Mykhailova
> Labels: FT
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> There are multiple scenarios of failures in our system. We should use REEF.NET Poison (delayed fault injection mechanism) to simulate these scenarios in test and to validate the response of our system to them.
> Here is initial list of tests we need to have.
> *Evaluator Failure*
> We expect to receive only {{FailedEvaluator}} event, no {{FailedContext}} and no {{FailedTask}}
> || N || Failure injected at || Additional verification ||
> | 1 | ON_EVALUATOR_ALLOCATED | |
> | 2 | between ON_EVALUATOR_ALLOCATED and ON_CONTEXT_ACTIVE | |
> | 3 | ON_CONTEXT_ACTIVE | FailedEvaluator should have FailedContexts filled |
> | 4 | between ON_CONTEXT_ACTIVE and ON_TASK_RUNNING | FailedEvaluator should have FailedContexts filled |
> | 5 | ON_TASK_RUNNING | FailedEvaluator should have FailedContexts and FailedTask filled |
> | 6 | between ON_TASK_RUNNING and ON_TASK_COMPLETED | FailedEvaluator should have FailedContexts and FailedTask filled |
> | 7 | ON_TASK_COMPLETED | FailedEvaluator should have FailedContexts filled |
> | 8 | after ON_TASK_COMPLETED | race against evaluator completion |
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)