[jira] [Created] (METRON-579) Add a LRU cache to the Profiler client

["Casey Stella (JIRA)" <ji...@apache.org>]

Casey Stella created METRON-579:
-----------------------------------

             Summary: Add a LRU cache to the Profiler client
                 Key: METRON-579
                 URL: https://issues.apache.org/jira/browse/METRON-579
             Project: Metron
          Issue Type: Improvement
            Reporter: Casey Stella


The traditional approach that we have taken to cache based on input into the stellar functions (i.e. we inspect the variables and if we have the result of the stellar expressions in the cache based on the inputs, we return the cached output rather than recomputing).

This does not work in situations like the profiler where the input is implicit (i.e. the current time).  For instance, when we do a PROFILE_GET which is intended to look back for a fixed window, we will make that HBase call every single time, despite if the message directly before made the exact same calls.

We could save a network hop by adding a LRU cache based on hbase key in the profiler client which would trim down or remove the HBase multiget.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)