You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Yi Pan (Data Infrastructure) (JIRA)" <ji...@apache.org> on 2018/04/23 06:55:00 UTC

[jira] [Updated] (SAMZA-1659) Making user functions serializable in high-level APIs

     [ https://issues.apache.org/jira/browse/SAMZA-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yi Pan (Data Infrastructure) updated SAMZA-1659:
------------------------------------------------
    Attachment: Serialization of OperatorSpec.pdf

> Making user functions serializable in high-level APIs
> -----------------------------------------------------
>
>                 Key: SAMZA-1659
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1659
>             Project: Samza
>          Issue Type: Improvement
>            Reporter: Yi Pan (Data Infrastructure)
>            Priority: Major
>              Labels: fluent-api
>             Fix For: 0.15.0
>
>         Attachments: Serialization of OperatorSpec.pdf
>
>
> In order to be able to fully serialize the user DAG in high-level APIs, we need to make sure that the user-supplied functions are serializable as well. This will enable:
>  # Deserialize and instantiation of per-task user functions become completely managed by the system. No need to invoke StreamApplication.init() in each task
>  # Fully serialized user DAG can be distributed across the network to multiple containers
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)