[GitHub] [activemq-artemis] ryeats edited a comment on pull request #3281: ARTEMIS-1884 add plugin API for message level authorization policies

[GitBox <gi...@apache.org>]

ryeats edited a comment on pull request #3281:
URL: https://github.com/apache/activemq-artemis/pull/3281#issuecomment-740243430


   Hacked at the Perf test to try out a few cases. Turns out Roles are stored in the javax.security.auth.Subject as a "Set" thats really backed by linked list so they do effect performance which is disappointing. I tried to run the test in a way that made the worst case take place every time so canAccept returns true on the 100th role on the 100th consumer.
   
   **Performance Test on a Queue**:
   Baseline performance
   4743.47 msg/s (250000 messages in 52.70s
   Role\Consumers | 1|11|101
   ------------ | ------------- | ------------- | ------------- 
   2  |56.10s|56.64s|66.37s
   11 |57.53s|58.96s|68.48s
   101|56.23s|60.53s|84.66s
   
   I also tested against a topic worst case 50 consumers have the role and it is their 100th role. Had some trouble hitting memory or other system limits on this one so adjusted the consumers down to avoid that noise but it still wasn't super consistent.
   **Performance Test on a Topic with durability off**:
   Baseline Performance
   1 consumers 83084.08 msg/s (250000 messages in 3.01s)
   10 consumers  21347.45 msg/s (250000 messages in 11.71s)
   50 consumers 21396.78 msg/s (250000 messages in 11.68s)
   
   **Performance Test on a Topic**:
   Role\Consumers | 1|11|51
   ------------ | ------------- | ------------- | ------------- 
   2|3.84s|8.16s|13.15s
   11|2.49s|12.20s|18.93s
   101|3.08s|11.58s|25.01s
   
   The numbers were not super consistent but do seem to show a trend towards higher with more consumers and roles. I think there has to be some expectation of a trade off in performance when doing message level authentication though. It is disappointing that java's role principles are not backed by a hash lookup but the number of roles is normally small. 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org