You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@metron.apache.org by "Nick Allen (JIRA)" <ji...@apache.org> on 2016/08/17 19:40:21 UTC

[jira] [Created] (METRON-377) Enable Profiles that Use Non-Single Pass Summary Functions

Nick Allen created METRON-377:
---------------------------------

             Summary: Enable Profiles that Use Non-Single Pass Summary Functions
                 Key: METRON-377
                 URL: https://issues.apache.org/jira/browse/METRON-377
             Project: Metron
          Issue Type: Improvement
            Reporter: Nick Allen
            Assignee: Nick Allen


As of METRON-372, Profiles can be built using many statistical summaries that only require a single-pass over the data.  This is less memory intensive and more scalable for high volume loads.

Unfortunately, not all functions can be calculated in a single pass.  In particular, the skewness, ketosis and percentiles require all data to be stored in memory for the calculation to occur.

The platform needs enhanced so that a user can leverage skewness, ketosis and percentiles. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)