You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ranger.apache.org by Gautam Borad <gb...@gmail.com> on 2015/08/19 12:39:09 UTC
Review Request 37577: RANGER-618 : KMS gets slower in key creation
once Database grows
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37577/
-----------------------------------------------------------
Review request for ranger, Alok Lal, Don Bosco Durai, Madhan Neethiraj, Ramesh Mani, Selvamohan Neethiraj, and Velmurugan Periasamy.
Bugs: RANGER-618
https://issues.apache.org/jira/browse/RANGER-618
Repository: ranger
Description
-------
The creation of key takes longer time as database grow with single or three kms instance. Initially it take 2-3 seconds. For 1000'th key it takes around 55-58 seconds.
Diffs
-----
kms/src/main/java/org/apache/hadoop/crypto/key/RangerKeyStore.java dc8efde6e254f964cc2d28df31e7b429e3bdb383
Diff: https://reviews.apache.org/r/37577/diff/
Testing
-------
Tested on a instance having single KMS as well as for multiple KMS for performance testing having more than 1000 keys.
Thanks,
Gautam Borad
Re: Review Request 37577: RANGER-618 : KMS gets slower in key
creation once Database grows
Posted by Don Bosco Durai <bo...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37577/#review96304
-----------------------------------------------------------
Ship it!
Ship It!
- Don Bosco Durai
On Aug. 19, 2015, 10:39 a.m., Gautam Borad wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37577/
> -----------------------------------------------------------
>
> (Updated Aug. 19, 2015, 10:39 a.m.)
>
>
> Review request for ranger, Alok Lal, Don Bosco Durai, Madhan Neethiraj, Ramesh Mani, Selvamohan Neethiraj, and Velmurugan Periasamy.
>
>
> Bugs: RANGER-618
> https://issues.apache.org/jira/browse/RANGER-618
>
>
> Repository: ranger
>
>
> Description
> -------
>
> The creation of key takes longer time as database grow with single or three kms instance. Initially it take 2-3 seconds. For 1000'th key it takes around 55-58 seconds.
>
>
> Diffs
> -----
>
> kms/src/main/java/org/apache/hadoop/crypto/key/RangerKeyStore.java dc8efde6e254f964cc2d28df31e7b429e3bdb383
>
> Diff: https://reviews.apache.org/r/37577/diff/
>
>
> Testing
> -------
>
> Tested on a instance having single KMS as well as for multiple KMS for performance testing having more than 1000 keys.
>
>
> Thanks,
>
> Gautam Borad
>
>
Re: Review Request 37577: RANGER-618 : KMS gets slower in key
creation once Database grows
Posted by Gautam Borad <gb...@gmail.com>.
> On Aug. 20, 2015, 4:39 a.m., Don Bosco Durai wrote:
> > What is the new number after this change? Also, I think having 1000 keys shouldn't take by any means. Whether it is DB or in-memory. What is the root cause we thik it is?
After the change the new number is near about 1 sec to create a new key irrespective of number of already existing keys in db.
Currently it was taking time as we used the common hashtable, so even for create it was using that and so the processing time was more.
- Gautam
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37577/#review95911
-----------------------------------------------------------
On Aug. 19, 2015, 10:39 a.m., Gautam Borad wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37577/
> -----------------------------------------------------------
>
> (Updated Aug. 19, 2015, 10:39 a.m.)
>
>
> Review request for ranger, Alok Lal, Don Bosco Durai, Madhan Neethiraj, Ramesh Mani, Selvamohan Neethiraj, and Velmurugan Periasamy.
>
>
> Bugs: RANGER-618
> https://issues.apache.org/jira/browse/RANGER-618
>
>
> Repository: ranger
>
>
> Description
> -------
>
> The creation of key takes longer time as database grow with single or three kms instance. Initially it take 2-3 seconds. For 1000'th key it takes around 55-58 seconds.
>
>
> Diffs
> -----
>
> kms/src/main/java/org/apache/hadoop/crypto/key/RangerKeyStore.java dc8efde6e254f964cc2d28df31e7b429e3bdb383
>
> Diff: https://reviews.apache.org/r/37577/diff/
>
>
> Testing
> -------
>
> Tested on a instance having single KMS as well as for multiple KMS for performance testing having more than 1000 keys.
>
>
> Thanks,
>
> Gautam Borad
>
>
Re: Review Request 37577: RANGER-618 : KMS gets slower in key
creation once Database grows
Posted by Don Bosco Durai <bo...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37577/#review95911
-----------------------------------------------------------
What is the new number after this change? Also, I think having 1000 keys shouldn't take by any means. Whether it is DB or in-memory. What is the root cause we thik it is?
- Don Bosco Durai
On Aug. 19, 2015, 10:39 a.m., Gautam Borad wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37577/
> -----------------------------------------------------------
>
> (Updated Aug. 19, 2015, 10:39 a.m.)
>
>
> Review request for ranger, Alok Lal, Don Bosco Durai, Madhan Neethiraj, Ramesh Mani, Selvamohan Neethiraj, and Velmurugan Periasamy.
>
>
> Bugs: RANGER-618
> https://issues.apache.org/jira/browse/RANGER-618
>
>
> Repository: ranger
>
>
> Description
> -------
>
> The creation of key takes longer time as database grow with single or three kms instance. Initially it take 2-3 seconds. For 1000'th key it takes around 55-58 seconds.
>
>
> Diffs
> -----
>
> kms/src/main/java/org/apache/hadoop/crypto/key/RangerKeyStore.java dc8efde6e254f964cc2d28df31e7b429e3bdb383
>
> Diff: https://reviews.apache.org/r/37577/diff/
>
>
> Testing
> -------
>
> Tested on a instance having single KMS as well as for multiple KMS for performance testing having more than 1000 keys.
>
>
> Thanks,
>
> Gautam Borad
>
>