You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tuweni.apache.org by GitBox <gi...@apache.org> on 2020/03/28 07:31:36 UTC

[GitHub] [incubator-tuweni] atoulme opened a new issue #70: Move from using a LRU map to a bloom filter

atoulme opened a new issue #70: Move from using a LRU map to a bloom filter
URL: https://github.com/apache/incubator-tuweni/issues/70
 
 
   The current plumtree implementation keeps track of the state of the last 1000000 messages it received.
   
   This is rather memory intensive - and can be gamed by adversarial behaviors by recycling and running replay attacks with a bigger batch of messages.
   
   We can use bloom filters to identify messages instead.
   
   The work consists in:
   
   -Find a bloom filter in java or implement one. (there is a bloom filter in the eth component that can be generalized under its own library, maybe?)
   
   -Use it to identify messages as an option to the LRU map
   
   -Test the tests still pass
   
   -Allow that bloom filters need to still be rotated over time.
   
    
   
   Would be also good to move the existing LRU map to a mechanism external to plumtree state, so it can be backed by a DB or a cache specified by the user.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tuweni.apache.org
For additional commands, e-mail: dev-help@tuweni.apache.org