[jira] [Updated] (STORM-2122) Supervisor V2 can use a lot more memory

["Jungtaek Lim (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/STORM-2122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jungtaek Lim updated STORM-2122:
--------------------------------
    Issue Type: Improvement  (was: Bug)

> Supervisor V2 can use a lot more memory
> ---------------------------------------
>
>                 Key: STORM-2122
>                 URL: https://issues.apache.org/jira/browse/STORM-2122
>             Project: Apache Storm
>          Issue Type: Improvement
>          Components: storm-core
>            Reporter: Robert Joseph Evans
>            Assignee: Robert Joseph Evans
>             Fix For: 2.0.0
>
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> When launching a worker the supervisor will read in the complete topology to get a small amount of data out of it.  This can be very large.  In the past we would launch the workers one at a time, so we only needed enough memory to read it in once, now we are doing it in parallel, and lots of these tend to show up very close to one another.  We need to find a way to make it so that we read the data one, and ideally cache it someplace that everyone can share.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)