[GitHub] [couchdb] garrensmith edited a comment on pull request #3164: Feature ebtree views

[GitBox <gi...@apache.org>]

garrensmith edited a comment on pull request #3164:
URL: https://github.com/apache/couchdb/pull/3164#issuecomment-698725027


   I did a quick group_level benchmarking this morning to compare it to the map + ebtree work I built-in #3018. The benchmark builds a view with keys that are a group_level = 3. Group_levels 1 and 2 will group results. 
   
   One thing to note is that the ebtree in #3018 is a much older version and doesn't caching or the batch updates.
   
   The full ebtree builds a lot faster, which is great. And queries for group_level = 1 and group_level = 2 are very similar. But when doing a reduce query for group_level = 3 the full ebtree is noticeably slower.
   
   Example results for 300K docs:
   full ebtree (this PR):
   ```
   Insert Time  71435.896557 ms
   Querying:
   Group 1 Time 12.577319 ms
   Result Length 5
   Group 2 Time 20.666643 ms
   Result Length 20
   Group 3 Time 3712.46744 ms
   Result Length 300002
   ```
   
   Map + ebtree reduce (PR #3018):
   ```
   Insert Time  362359.221368 ms
   Querying:
   Group 1 Time 13.821064 ms
   Result Length 5
   Group 2 Time 23.708709 ms
   Result Length 20
   Group 3 Time 2672.549299 ms
   Result Length 300002
   ```
   
   Code for the benchmarking is here https://gist.github.com/garrensmith/9bd090cb00f6b641e58a3c490b2300e7
   Same warning as Paul's this is run locally on my machine. 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org