[jira] [Updated] (SAMZA-719) Auto-scaling containers in Samza

["Shadi A. Noghabi (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SAMZA-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shadi A. Noghabi updated SAMZA-719:
-----------------------------------
    Attachment: DESIGN-SAMZA-719.pdf

> Auto-scaling containers in Samza
> --------------------------------
>
>                 Key: SAMZA-719
>                 URL: https://issues.apache.org/jira/browse/SAMZA-719
>             Project: Samza
>          Issue Type: New Feature
>            Reporter: Shadi A. Noghabi
>            Assignee: Shadi A. Noghabi
>              Labels: design
>         Attachments: DESIGN-SAMZA-719.pdf
>
>
> Currently, a fixed number of containers is assigned to a job as an input configuration parameter. However, with this design jobs can fail due to lack of enough resources (such as memory), or they can become a bottleneck in a workflow containing many jobs. While auto-scaling is much broader term, the goal of this project will be to enable a Samza job to automatically scale its containers such that there is improved job performance. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)