You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ranger.apache.org by Abhay Kulkarni <ak...@hortonworks.com> on 2021/06/04 20:11:09 UTC
Review Request 73407: RANGER-3309: Support batch upload of tags to
Ranger
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73407/
-----------------------------------------------------------
Review request for ranger, Madhan Neethiraj, Ramesh Mani, and Velmurugan Periasamy.
Bugs: RANGER-3309
https://issues.apache.org/jira/browse/RANGER-3309
Repository: ranger
Description
-------
Currently, tagsync uploads tags received through Kafka events to Ranger one event at a time. Batched upload of tags will help in improving performance of tag ingress into Ranger.
This patch adds support for a env variable to specify the maximum size of events that can be uploaded in one interaction with Ranger; viz. 'ranger.tagsync.dest.ranger.max.batch.size' which defaults to value 1.
Diffs
-----
security-admin/src/main/java/org/apache/ranger/rest/ServiceTagsProcessor.java 67ae77926
security-admin/src/main/java/org/apache/ranger/service/RangerTagService.java 5fdefe5a3
tagsync/src/main/java/org/apache/ranger/tagsync/model/AbstractTagSource.java da4c5cbd3
tagsync/src/main/java/org/apache/ranger/tagsync/process/TagSyncConfig.java 9245fdfc9
tagsync/src/main/java/org/apache/ranger/tagsync/source/atlas/AtlasNotificationMapper.java ed4ba1704
tagsync/src/main/java/org/apache/ranger/tagsync/source/atlas/AtlasTagSource.java 21a22cdc5
tagsync/src/main/java/org/apache/ranger/tagsync/source/atlasrest/AtlasRESTTagSource.java 8b12affe2
tagsync/src/main/java/org/apache/ranger/tagsync/source/file/FileTagSource.java 62a5f7382
tagsync/src/main/resources/ranger-tagsync-default.xml 1034bc6e5
Diff: https://reviews.apache.org/r/73407/diff/1/
Testing
-------
Passes all unit tests.
Thanks,
Abhay Kulkarni