[jira] [Commented] (REEF-574) Eliminate Task Configuration deserialization/serialization at Java side

["Markus Weimer (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/REEF-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679485#comment-14679485 ] 

Markus Weimer commented on REEF-574:
------------------------------------

{quote}
A proposed solution is to pass it directly to the .Net evaluator and let .Net Evaluator to desterilize it. Then there won't have any cross language issue. 
{quote}

This promotes a {{string}} based API over what used to be a very tightly typed one. I am not saying we should not do that, but we should at least spend some time thinking about alternatives. The root cause of the current issue is, as I understand, an issue with the C# implementation of Avro. Correct?

If so, what would it take to have that fixed instead?

> Eliminate Task Configuration deserialization/serialization at Java side
> -----------------------------------------------------------------------
>
>                 Key: REEF-574
>                 URL: https://issues.apache.org/jira/browse/REEF-574
>             Project: REEF
>          Issue Type: Improvement
>          Components: REEF, REEF Bridge, REEF-Common
>            Reporter: Julia
>            Assignee: Julia
>
> Currently Task configuration is passed over the bridge as a string. At Java side, it is deserialized into a Configuration object with C# class hierarchy. Before it is passed over to Evaluator, it is serialized again into a string. 
> There are two issues:
> 1. When Task class contains a generic type, Java is not able to understand the class hierarchy from C#. That causes deserialization fail. 
> 2. Performance hit. It is not necessary to deseralize the Task Configuration and then serialize it again. 
> A proposed solution is to pass it directly to the .Net evaluator and let .Net Evaluator to desterilize it. Then there won't have any cross language issue. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)