[jira] [Created] (STORM-2122) Supervisor V2 can use a lot more memory

["Robert Joseph Evans (JIRA)" <ji...@apache.org>]

Robert Joseph Evans created STORM-2122:
------------------------------------------

             Summary: Supervisor V2 can use a lot more memory
                 Key: STORM-2122
                 URL: https://issues.apache.org/jira/browse/STORM-2122
             Project: Apache Storm
          Issue Type: Bug
          Components: storm-core
            Reporter: Robert Joseph Evans
            Assignee: Robert Joseph Evans


When launching a worker the supervisor will read in the complete topology to get a small amount of data out of it.  This can be very large.  In the past we would launch the workers one at a time, so we only needed enough memory to read it in once, now we are doing it in parallel, and lots of these tend to show up very close to one another.  We need to find a way to make it so that we read the data one, and ideally cache it someplace that everyone can share.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)