You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Sanil Jain (Confluence)" <no...@apache.org> on 2020/06/01 16:30:00 UTC

[CONF] Apache Samza > SEP-22: Container Placements in Samza

There's **1 new edit** on this page  
---  
|  
---  
|  | [![page icon](cid:page-
icon)](https://cwiki.apache.org/confluence/display/SAMZA/SEP-22%3A+Container+Placements+in+Samza?src=mail&src.mail.product=confluence-
server&src.mail.timestamp=1591029000671&src.mail.notification=com.atlassian.confluence.plugins.confluence-
notifications-batch-plugin%3Abatching-
notification&src.mail.recipient=8aa980875bf24635015c82a7d09902ac&src.mail.action=view
"page icon")  
---  
[SEP-22: Container Placements in
Samza](https://cwiki.apache.org/confluence/display/SAMZA/SEP-22%3A+Container+Placements+in+Samza?src=mail&src.mail.product=confluence-
server&src.mail.timestamp=1591029000671&src.mail.notification=com.atlassian.confluence.plugins.confluence-
notifications-batch-plugin%3Abatching-
notification&src.mail.recipient=8aa980875bf24635015c82a7d09902ac&src.mail.action=view
"SEP-22: Container Placements in Samza")  
|  |  |  |  | ![](cid:avatar_5056a43ede8596254d91f5801238c5df) |  | Sanil Jain
edited this page  
---  
|  
|  | Here's what changed:  
---  
|

#  **Status**

**Current state** : ** ** [ UNDER DISCUSSION ]ACCEPTED

**Discussion thread** : <http://mail-archives.apache.org/mod_mbox/samza-
dev/202001.mbox/browser> _  
_

**JIRA** : [SAMZA-2373](https://issues.apache.org/jira/browse/SAMZA-2373)

**Released: TBDSamza 1.5**

#  **Problem**

Samza operates in a multi-tenant environment with cluster managers like
[Yarn](https://samza.apache.org/learn/documentation/latest/deployment/deployment-
model.html) and Mesos where a single host can run multiple Samza containers.
Often due to soft limits configured for cluster managers like Yarn and no
notion of dynamic workload balancing in Samza a host lands in a situation
where it is underperforming and it is desired to move one or more containers
from that host to other hosts. Today this is not possible without affecting
other jobs on the hot host or restarting the affected job manually. In other
use cases like resetting
[checkpoints](https://samza.apache.org/learn/documentation/latest/container/checkpointing.html)
of a single container or supporting canary or rolling bounces the ability to
restart a single or a subset of containers without restarting the whole job is
highly desirable.

...  
  
---  
|  |  | [Go to page
history](https://cwiki.apache.org/confluence/pages/viewpreviousversions.action?pageId=135860312&src=mail&src.mail.product=confluence-
server&src.mail.timestamp=1591029000671&src.mail.notification=com.atlassian.confluence.plugins.confluence-
notifications-batch-plugin%3Abatching-
notification&src.mail.recipient=8aa980875bf24635015c82a7d09902ac "Go to page
history")  
---  
---  
| [View
page](https://cwiki.apache.org/confluence/display/SAMZA/SEP-22%3A+Container+Placements+in+Samza?src=mail&src.mail.product=confluence-
server&src.mail.timestamp=1591029000671&src.mail.notification=com.atlassian.confluence.plugins.confluence-
notifications-batch-plugin%3Abatching-
notification&src.mail.recipient=8aa980875bf24635015c82a7d09902ac&src.mail.action=view)  
---  
  
|  | [Stop watching
space](https://cwiki.apache.org/confluence/users/removespacenotification.action?spaceKey=SAMZA&src=mail&src.mail.product=confluence-
server&src.mail.timestamp=1591029000671&src.mail.notification=com.atlassian.confluence.plugins.confluence-
notifications-batch-plugin%3Abatching-
notification&src.mail.recipient=8aa980875bf24635015c82a7d09902ac&src.mail.action=stop-
watching&jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJ4c3JmOjhhYTk4MDg3NWJmMjQ2MzUwMTVjODJhN2QwOTkwMmFjIiwicXNoIjoiMjEwZTY1MzdjZWEwNDM4ODYzMzkyODNiYmUyYmU4NzY2OTRjMWMyYjcxN2ZjZmI2MDMzOWNiZGVhMjc3ODBjNCIsImlzcyI6ImNvbmZsdWVuY2Vfbm90aWZpY2F0aW9uc0FSRUgtWFVEMS1QT1FHLUNTQU8iLCJleHAiOjE1OTE2MzM4MDAsImlhdCI6MTU5MTAyOTAwMH0.x5eaO5T64pO14dZpGiABEbK8e5HACat4sAqYfmWV4jQ)
| •  
---|---  
[Manage
notifications](https://cwiki.apache.org/confluence/users/editmyemailsettings.action?src=mail&src.mail.product=confluence-
server&src.mail.timestamp=1591029000671&src.mail.notification=com.atlassian.confluence.plugins.confluence-
notifications-batch-plugin%3Abatching-
notification&src.mail.recipient=8aa980875bf24635015c82a7d09902ac&src.mail.action=manage)  
---  
| ![Confluence logo big](cid:footer-desktop-logo)  
---  
This message was sent by Atlassian Confluence 7.5.0  
![](cid:footer-mobile-logo)  
---