[jira] [Created] (SAMZA-2604) Job coordinator High availability - Data model change to write/read physical execution container id mapping to logical Samza processor Id

["Lakshmi Manasa Gaduputi (Jira)" <ji...@apache.org>]

Lakshmi Manasa Gaduputi created SAMZA-2604:
----------------------------------------------

             Summary: Job coordinator High availability - Data model change to write/read physical execution container id mapping to logical Samza processor Id
                 Key: SAMZA-2604
                 URL: https://issues.apache.org/jira/browse/SAMZA-2604
             Project: Samza
          Issue Type: New Feature
            Reporter: Lakshmi Manasa Gaduputi
            Assignee: Lakshmi Manasa Gaduputi


Job coordinator (AM) High availability (HA) will bring up a new AM which can connect to already running containers of the job. This ticket is to capture the physical execution environment container id (ex:yarn container id "container_123") mapping to samza logical processor id (ex: 0,1,..).

Each container should write its mapping of physical id to logical id and AM should read this mapping. This mapping will be written to coordinator stream.

New AM coming up under HA will use this mapping to associate the already running yarn containers list handed to it from the ResourceManager. New AM using this mapping is part of future work and not a deliverable for this task.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)