You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ranger.apache.org by Steven Ramirez <13...@gmail.com> on 2021/08/31 21:15:32 UTC

Review Request 73561: RANGER-3379: Performance Analysis tool for Ranger Policy REST API

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73561/
-----------------------------------------------------------

Review request for ranger.


Bugs: RANGER-3379
    https://issues.apache.org/jira/browse/RANGER-3379


Repository: ranger


Description
-------

As part of ranger tools, I added a set of scripts that can test the perfomrance/stability of ranger policy API. This tool measures request latency and cpu utilization of ranger admin process. This tool provides options to run an exact amount of requests or run at a given rate over a set duration.


Diffs
-----

  distro/src/main/assembly/ranger-tools.xml 3ae890c1e 
  ranger-tools/scripts/load_generator.sh PRE-CREATION 
  ranger-tools/scripts/log_parser.py PRE-CREATION 
  ranger-tools/scripts/parse_logs.sh PRE-CREATION 
  ranger-tools/scripts/policy_create_write_API.py PRE-CREATION 
  ranger-tools/scripts/policy_delete_write_API.py PRE-CREATION 
  ranger-tools/scripts/policy_get_write_API.py PRE-CREATION 
  ranger-tools/scripts/policy_update_write_API.py PRE-CREATION 


Diff: https://reviews.apache.org/r/73561/diff/1/


Testing
-------

- verified the tool is part of the ranger tools packaging 
- tested for an hour at 24 requests per second 
- ran over an entire weekend at 12 requests per second
- tested for a burst of 400 api requests


Thanks,

Steven Ramirez