[jira] [Updated] (SAMZA-448) Pass config from JobRunner to JobCoordinator via ConfigStream

["Chris Riccomini (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SAMZA-448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Riccomini updated SAMZA-448:
----------------------------------
    Attachment: SAMZA-448-4.patch

Attaching latest patch with [~martinkl]. RB at:

https://reviews.apache.org/r/27649/

* Made serdes pluggable for coordinator consumer and producer, but stick to JSON serdes.
* Re-added JSON serde (was deleted by accident).
* Switched keys to be lists for coordinator stream instead of maps, per suggestion from Martin.
* Rebased off of master. Had to merge in Yan's appender with the latest coordinator changes.

> Pass config from JobRunner to JobCoordinator via ConfigStream
> -------------------------------------------------------------
>
>                 Key: SAMZA-448
>                 URL: https://issues.apache.org/jira/browse/SAMZA-448
>             Project: Samza
>          Issue Type: Sub-task
>          Components: container
>    Affects Versions: 0.9.0
>            Reporter: Chris Riccomini
>            Assignee: Chris Riccomini
>             Fix For: 0.9.0
>
>         Attachments: SAMZA-448-0.patch, SAMZA-448-1.patch, SAMZA-448-2.patch, SAMZA-448-3.patch, SAMZA-448-4.patch
>
>
> SAMZA-438 modified the AM/local job factories (job coordinator) to pass configuration to SamzaContainer via an HTTP server. This ticket is to modify the other half of the pipeline: the config passing from the JobRunner to the job coordinator to be done via a ConfigStream, rather than an environment variable.
> The goal of this ticket is to make the change as transparent as possible. {{control-job.sh}} won't be introduced in this ticket. Instead, we'll continue using the ConfigFactories that we have, but pass the resolved config to the coordinator using the ConfigStream rather than the environment variable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)