[jira] [Commented] (REEF-1271) Add better test reporting APIs to REEF.NET

["Markus Weimer (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/REEF-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234514#comment-16234514 ] 

Markus Weimer commented on REEF-1271:
-------------------------------------

This is blocked by [REEF-1942], as we have no way of knowing when to retrieve the assert logs.

> Add better test reporting APIs to REEF.NET
> ------------------------------------------
>
>                 Key: REEF-1271
>                 URL: https://issues.apache.org/jira/browse/REEF-1271
>             Project: REEF
>          Issue Type: Improvement
>          Components: REEF.NET, Tests
>            Reporter: Markus Weimer
>            Assignee: Markus Weimer
>            Priority: Critical
>
> REEF.NET currently relies on parsing Driver and Evaluator logs to determine whether a functional (integration) test passed. The test puts a specific message into the log, which is parsed after the Driver finishes. 
> This works OK for tests on the local runtime, but is undesirable for tests on clusters. On the Java side, we rely on REEF's forwarding of exceptions from the Evaluator to the Driver and the Driver to the Client: A test indicates failure by throwing {{DriverSideFailure}} or {{EvaluatorSideFailure}} exceptions.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)