[jira] [Created] (METRON-416) Provide the ability to store mergeable data structures for summarizing data on-line

["Casey Stella (JIRA)" <ji...@apache.org>]

Casey Stella created METRON-416:
-----------------------------------

             Summary: Provide the ability to store mergeable data structures for summarizing data on-line
                 Key: METRON-416
                 URL: https://issues.apache.org/jira/browse/METRON-416
             Project: Metron
          Issue Type: Improvement
            Reporter: Casey Stella
            Assignee: Casey Stella


With the currently worked on profiler, we it will be advantageous for us to be able to store more than just numeric data as a profile.  In particular, adding some common data structures that can be merged will allow us to store data at a fixed tick-rate, but merge the results from hbase across multiple ticks.

As a first cut, the following structures should be supported:
* An implementation of the STATS stellar functions which is backed by an online and mergeable class using distributional sketches for querying distribution.
* An implementation of bloom filters so that probabalistic existence queries can be made



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)