You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@metron.apache.org by "Nick Allen (JIRA)" <ji...@apache.org> on 2018/11/20 15:43:02 UTC

[jira] [Created] (METRON-1888) Default Topology Settings in MPack Cause Profiler to Stall

Nick Allen created METRON-1888:
----------------------------------

             Summary: Default Topology Settings in MPack Cause Profiler to Stall
                 Key: METRON-1888
                 URL: https://issues.apache.org/jira/browse/METRON-1888
             Project: Metron
          Issue Type: Bug
            Reporter: Nick Allen
            Assignee: Nick Allen


The default max spout pending set by the Mpack for the Profiler topology is 300. This value is too low and causes the topology to stall and stop consuming messages.

 

The Profiler topology is the only Metron topology that uses Storm's windowing support.  Storm will queue up messages for the window length (by default 30 seconds) and process each of those windows.

 

This causes Storm to need to "hang on" to tuples longer than the other topologies and this requires a much greater max spout pending value.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)