[jira] [Commented] (OAK-4364) Initial Benchmarks for oak-auth-external

["angela (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/OAK-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282701#comment-15282701 ] 

angela commented on OAK-4364:
-----------------------------

Revision 1743674 initial setup within oak-run that allows to write benchmarks for _oak-auth-external_. The change introduces a separate package {{authentication.external}} as the amount of benchmarks keeps growing and find it hard to spot the right test i am looking for. that package contains:

h6. {{AbstractExternalTest}}
- creating the JCR repository with a whiteboard that has the relevant pieces from _oak-auth-external_ registered
- setting up a test-IDP that "knows" the configured amount of users and groups ({{numberofUsers}}, {{numberofGroups}}, the latter effectively defines the membershipSize of each user)
- setting a default syncConfig; NOTE: currently on the {{expirationTime}} is picked from the benchmark options
- abstract method {{createConfiguration}} that allows specific the desired JAAS configuration

h6. {{ExternalLoginTest}}
- based on {{AbstractExternalTest}}
- JAAS config with {{LoginModuleImpl}} and {{ExternalLoginModule}}
- performs {{RepositoryLogin}} with random users known to the IDP

h6. {{SyncAllExternalUsersTest}}
- based on {{AbstractExternalTest}}
- performs {{SynchronizationMBean#syncAllExternalUsers()}}

h6. {{SyncExternalUsersTest}}
- based on {{AbstractExternalTest}}
- performs {{SynchronizationMBean#syncExternalUsers(String[])}} for random users known to the IDP
- configuration option {{batchSize}} allows to specify the size of the String[] array

[~baedke], [~reschke], [~tripod], maybe you want to take a look at that initial setup in order to help me verifying that the benchmarks based on {{AbstractExternalTest}} could actually be used to produce reliable information for _oak-auth-external_. So far I didn't invest a lot of time running the benchmarks and looking at the numbers. It might well be that they are not yet very sensible as my initial goal was to have _something_ that we can tweak according to our needs.
Feedback and review very welcome! 


> Initial Benchmarks for oak-auth-external
> ----------------------------------------
>
>                 Key: OAK-4364
>                 URL: https://issues.apache.org/jira/browse/OAK-4364
>             Project: Jackrabbit Oak
>          Issue Type: Task
>          Components: auth-external, run
>            Reporter: angela
>            Assignee: angela
>
> in order to properly measure performance improvements we should have benchmarks for oak-auth-external module



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)