[GitHub] [samza] shanthoosh opened a new pull request #990: SAMZA-2161: Move ChangelogPartitionManager and CoordinatorStream ConfigReader to MetadataStore.

[GitBox <gi...@apache.org>]

shanthoosh opened a new pull request #990: SAMZA-2161: Move ChangelogPartitionManager and CoordinatorStream ConfigReader to MetadataStore.
URL: https://github.com/apache/samza/pull/990
 
 
   Currently the metadata of a samza job is stored into a kafka topic named coordinator stream.
   
   In samza-yarn `ApplicationMaster`, the same coordinator stream is read twice as a part of the `ApplicationMaster` startup sequence. This duplicate read unnecessarily prolongs the startup time of the application master and makes the container allocation take longer than usual. This inadvertently incurs a substantial increase in input stream processing delay depending upon the size of the coordinator stream. 
   
   To mitigate this problem, the two util classes in samza viz `ChangelogPartitionManager`, `Config` should be moved to use the MetadataStore abstraction. This ticket tracks the work involved in the migration. 
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services