You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ranger.apache.org by Ramesh Mani <rm...@apache.org> on 2023/02/04 22:42:39 UTC
Re: Planning for Apache Ranger 2.4.0 release
+1 for Apache Ranger 2.4.0 release activities.
Thanks
Ramesh
On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj <sn...@apache.org>
wrote:
> Dear Ranger Community members, There are various features and critical
> bug fixes done in the Apache Ranger project since the release of Apache
> Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes
> were made from the last release. Now with that Ranger community is
> expecting a release to adapt those changes and hence planning this
> release. Please review and provide your opinion.
>
> Thanks, Selva-
>
> _*Improvements & New Features addressed in 2.4.0*_
>
> Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is missing
> in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in
> Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of
> RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable
> anonymous download of policy/role/tag Improvement,RANGER-3633,Remove
> eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : Add
> refresh functionality on kms key listing page.
> Improvement,RANGER-3763,The max limit of the requested entities is not
> configurable in tagsync Improvement,RANGER-3767,Add text message in HDFS
> and YARN policy pages to highlight the fallback ACL option
> Improvement,RANGER-3787,Non-daemon threads started by
> ElasticSearchAuditDestination cause Spark application hanging
> Improvement,RANGER-3794,Improve performance of delete users/groups
> utility Improvement,RANGER-3796,Enhancement to support multiple resource
> sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2
> Improvement,RANGER-3822,RangerService outputs password information in
> plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get,
> create, edit and delete roles" Improvement,RANGER-3856,Ranger admin
> client option to work with non-kerberized server
> Improvement,RANGER-3865,support for using user attributes in masking
> expressions Improvement,RANGER-3900,"Roles deletion Takes time in Apache
> Ranger when there are more users,groups,roles"
> Improvement,RANGER-3902,dbLoadTime is not added correctly in
> RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is
> broken for knox sso Improvement,RANGER-3934,improve tag cache handling
> to reduce resource usage Improvement,RANGER-3940,"Add javascript
> includes(), intersects() polyfills for array prototype to
> RangerCommonConstants" Improvement,RANGER-3948,update serialization to
> skip empty values Improvement,RANGER-3951,optimize memory used for tags
> in plugins and server Improvement,RANGER-3955,optimization to reduce
> duplicate strings Improvement,RANGER-3973,LDAP incremental search not
> always available Improvement,RANGER-3978,Docker setup to run Ranger KMS
> Improvement,RANGER-3982,Python client for Ranger KMS REST APIs
> Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in
> Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name
> when creating tables Improvement,RANGER-3986,Upgrade trino guice
> dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should
> differntiate between views and tables Improvement,RANGER-3997,option to
> use default value when user/group/tag does not have the attribute
> Improvement,RANGER-4004,"During the service deletion also, we can clear
> the in-memory cache for that service which got deleted on the ranger
> side" Improvement,RANGER-4011,option to disable creation of default
> policies per hierarchy New Feature,RANGER-3852,Performance and
> scalability analyzer tool for Ranger New
> Feature,RANGER-3855,RangerExternalUserStoreRetriever class New
> Feature,RANGER-4028,Ranger - Upgrade bootbox.js.
>
> _*BUGS addressed in 2.4.0*_
>
> Bug,RANGER-2737,Ranger REST API returns different infomation when GET
> user by id and by name Bug,RANGER-3080,"A service administrator should
> be allowed to set ""excludes"" flag for a policy resource"
> Bug,RANGER-3108,NPE in RangerPolicyRepository.init
> Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too much
> `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL
> Bug,RANGER-3500,Ranger policy list doesn't support sorting by field
> Bug,RANGER-3670,Policy update creates unnecessary entries in transaction
> log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB schema
> to database Bug,RANGER-3719,Can not create mysql table with charset
> utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by
> RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7
> Bug,RANGER-3790,Ranger tagsync module should not depend on kafka server
> Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of JVM""
> does not update." Bug,RANGER-3806,Group's users mapping entry failing
> whenever primary key auto-increment is not set to 1 in db
> Bug,RANGER-3807,getUserRoles API gives 200 for non existing user passed
> to this API Bug,RANGER-3813,Fix ConcurrentModificationException in
> UnixUserGroupBuilder Bug,RANGER-3814,IS_IN_ROLE(roleName) condition
> always returns false Bug,RANGER-3816,update getResourceACLs() API to
> handle macros in resource names Bug,RANGER-3819,Upgrade springframework
> version Bug,RANGER-3820,Upgrade Netty version to 4.1.78.Final
> Bug,RANGER-3824,[Ranger] : /service/tags/resources error message is not
> proper for duplicate resource & not able to update resource resource
> Bug,RANGER-3825,Ranger internal user is unable to change his password
> after the upgrade. Bug,RANGER-3829,Incremental Sync value is always true
> under Ranger Audit (Usersync) Bug,RANGER-3840,SHOW DATABASES command
> should list databases owned by the user Bug,RANGER-3846,Ranger DB patch
> 058 failing when multiple policies having same resourceSignature
> Bug,RANGER-3847,[Ranger] : Http status & Error message is not correct
> for /xaudit/trx_log Bug,RANGER-3848,RangerClient does not auto renew
> Kerberos ticket after ticket lifetime expired Bug,RANGER-3853,Ranger
> java patch J10054 takes time Bug,RANGER-3854,Ranger Java patch J10056
> takes time Bug,RANGER-3857,Ranger java patch J10055 takes time
> Bug,RANGER-3863,Ranger Failed to run on Apple M1 macOS (Apple Silicon)
> Bug,RANGER-3883,emailchange and passwordchange User REST API's work even
> when invalid user id is used in the url Bug,RANGER-3885,User REST API
> /users/firstnames returns only null with status code 204
> Bug,RANGER-3894,Application is 'unknown' for metastore in plugin status
> page Bug,RANGER-3897,RangerUserStore cache improvement Bug,RANGER-3898,
> Ranger Roles cache Improvement Bug,RANGER-3907,Skip auditing of
> operation like monitorHealth in HDFS Ranger Plugin audit handler
> Bug,RANGER-3911,NPE fix in RangerDefaultPolicyEvaluator Bug,RANGER-3912,
> Ranger Policy report for a given user should fetch policies maintained
> for roles belonging to that user and groups Bug,RANGER-3914,Change
> sync_source column's datatype from varchar to text
> Bug,RANGER-3918,Namespace policy that is created in Ranger by HBase
> Grant command not getting honored Bug,RANGER-3920,"When sync'ing users
> from Ldap, intermittent User/Group/UserGroup membership is missing"
> Bug,RANGER-3925,Enhancing /roles/{id}/addUsersAndGroups api to
> add/update/replace Group to a Role. Bug,RANGER-3941,optimize cache
> refresh in RangerUserStoreCache Bug,RANGER-3946,ranger-yarn-plugin
> missing commons-lang-2.6.jar Bug,RANGER-3953,potential NPE during
> policy-engine initialization Bug,RANGER-3956,Upgrade Commons Text to
> 1.10.0 Bug,RANGER-3959,condition expression validation
> Bug,RANGER-3966,incorrect roles used in policy evaluation for custom
> RangerAccessRequest impl Bug,RANGER-3969,Remove os.path.join causing
> incorrect windows path Bug,RANGER-3970,Expression evaluation
> improvements Bug,RANGER-3977,Fix Ranger TagRest API
> deleteTagResourceMapByGuid Bug,RANGER-3989,KMS APIs fail due to
> ConcurrentModificationException Bug,RANGER-4000,unit test failure in
> JDK17 Bug,RANGER-4008,RangerTagEnricher to ignore invalid resources
> Bug,RANGER-4014,update getResourceACLs() API to handle resource names
> having macros in row-filter/masking policies Bug,RANGER-4018,Ranger src
> packaging should exclude generated/unnecessary files
> Bug,RANGER-4029,Ranger cannot build with HBase 2.5.x versions because
> preBalance coprocessor hook syntax changed in HBASE-26147
> Bug,RANGER-4035,"support for policies to refer access-types using
> category, like Create/Read/Update/Delete/Manage" Bug,RANGER-4044,Publish
> official docker images for ranger to dockerhub
>
Re: Planning for Apache Ranger 2.4.0 release
Posted by "rajeshbabu@apache.org" <ch...@gmail.com>.
Thanks Ramesh.
Thanks,
Rajeshbabu.
On Mon, Feb 13, 2023, 11:16 AM Ramesh Mani <rm...@apache.org> wrote:
> Hi Rajesh,
>
> Thanks for reaching out on
> https://issues.apache.org/jira/browse/RANGER-4029
> Currently we are reviewing / testing this patch and should update on this.
>
> Thanks,
> Ramesh
>
> On Sun, Feb 12, 2023 at 9:16 PM rajeshbabu@apache.org <
> chrajeshbabu32@gmail.com> wrote:
>
> > Hi Team,
> >
> >
> > I would like to include
> https://issues.apache.org/jira/browse/RANGER-4029
> > as part of 2.4.0 release. I have uploaded patch at review board as well
> > after testing the changes in cluster.
> >
> > https://reviews.apache.org/r/74299/
> >
> > Without the changes the HBase plugin with 2.5.x versions cannot be used.
> > Which is a blocker.
> >
> > Thanks,
> > Rajeshbabu.
> >
> > On Wed, Feb 8, 2023, 12:46 PM Nixon Rodrigues <ni...@atlan.com.invalid>
> > wrote:
> >
> > > +1 for Ranger 2.4.0 release.
> > > Thanks Selva for initiating release process
> > >
> > > Regards
> > > Nixon
> > >
> > > On Wed, 8 Feb 2023 at 07:09, Sailaja Polavarapu
> > > <sp...@cloudera.com.invalid> wrote:
> > >
> > > > +1 for Apache Ranger 2.4.0 release.
> > > > Thanks Selva for initiating this.
> > > >
> > > > - Sailaja
> > > >
> > > > On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani <rm...@apache.org> wrote:
> > > >
> > > > > +1 for Apache Ranger 2.4.0 release activities.
> > > > >
> > > > > Thanks
> > > > > Ramesh
> > > > >
> > > > > On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj <
> > > > sneethir@apache.org>
> > > > > wrote:
> > > > >
> > > > > > Dear Ranger Community members, There are various features and
> > > critical
> > > > > > bug fixes done in the Apache Ranger project since the release of
> > > Apache
> > > > > > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug
> > fixes
> > > > > > were made from the last release. Now with that Ranger community
> is
> > > > > > expecting a release to adapt those changes and hence planning
> this
> > > > > > release. Please review and provide your opinion.
> > > > > >
> > > > > > Thanks, Selva-
> > > > > >
> > > > > > _*Improvements & New Features addressed in 2.4.0*_
> > > > > >
> > > > > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is
> > > > missing
> > > > > > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch
> version
> > > in
> > > > > > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of
> > > > > > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to
> > enable
> > > > > > anonymous download of policy/role/tag
> > Improvement,RANGER-3633,Remove
> > > > > > eclipse .project file from git Improvement,RANGER-3664,Ranger
> KMS :
> > > Add
> > > > > > refresh functionality on kms key listing page.
> > > > > > Improvement,RANGER-3763,The max limit of the requested entities
> is
> > > not
> > > > > > configurable in tagsync Improvement,RANGER-3767,Add text message
> in
> > > > HDFS
> > > > > > and YARN policy pages to highlight the fallback ACL option
> > > > > > Improvement,RANGER-3787,Non-daemon threads started by
> > > > > > ElasticSearchAuditDestination cause Spark application hanging
> > > > > > Improvement,RANGER-3794,Improve performance of delete
> users/groups
> > > > > > utility Improvement,RANGER-3796,Enhancement to support multiple
> > > > resource
> > > > > > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2
> > > > > > Improvement,RANGER-3822,RangerService outputs password
> information
> > in
> > > > > > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to
> get,
> > > > > > create, edit and delete roles" Improvement,RANGER-3856,Ranger
> admin
> > > > > > client option to work with non-kerberized server
> > > > > > Improvement,RANGER-3865,support for using user attributes in
> > masking
> > > > > > expressions Improvement,RANGER-3900,"Roles deletion Takes time in
> > > > Apache
> > > > > > Ranger when there are more users,groups,roles"
> > > > > > Improvement,RANGER-3902,dbLoadTime is not added correctly in
> > > > > > RangerServicePoliciesCache Improvement,RANGER-3910,API
> > Documentation
> > > is
> > > > > > broken for knox sso Improvement,RANGER-3934,improve tag cache
> > > handling
> > > > > > to reduce resource usage Improvement,RANGER-3940,"Add javascript
> > > > > > includes(), intersects() polyfills for array prototype to
> > > > > > RangerCommonConstants" Improvement,RANGER-3948,update
> serialization
> > > to
> > > > > > skip empty values Improvement,RANGER-3951,optimize memory used
> for
> > > tags
> > > > > > in plugins and server Improvement,RANGER-3955,optimization to
> > reduce
> > > > > > duplicate strings Improvement,RANGER-3973,LDAP incremental search
> > not
> > > > > > always available Improvement,RANGER-3978,Docker setup to run
> Ranger
> > > KMS
> > > > > > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs
> > > > > > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters
> in
> > > > > > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table
> > name
> > > > > > when creating tables Improvement,RANGER-3986,Upgrade trino guice
> > > > > > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should
> > > > > > differntiate between views and tables
> > Improvement,RANGER-3997,option
> > > to
> > > > > > use default value when user/group/tag does not have the attribute
> > > > > > Improvement,RANGER-4004,"During the service deletion also, we can
> > > clear
> > > > > > the in-memory cache for that service which got deleted on the
> > ranger
> > > > > > side" Improvement,RANGER-4011,option to disable creation of
> default
> > > > > > policies per hierarchy New Feature,RANGER-3852,Performance and
> > > > > > scalability analyzer tool for Ranger New
> > > > > > Feature,RANGER-3855,RangerExternalUserStoreRetriever class New
> > > > > > Feature,RANGER-4028,Ranger - Upgrade bootbox.js.
> > > > > >
> > > > > > _*BUGS addressed in 2.4.0*_
> > > > > >
> > > > > > Bug,RANGER-2737,Ranger REST API returns different infomation when
> > GET
> > > > > > user by id and by name Bug,RANGER-3080,"A service administrator
> > > should
> > > > > > be allowed to set ""excludes"" flag for a policy resource"
> > > > > > Bug,RANGER-3108,NPE in RangerPolicyRepository.init
> > > > > > Bug,RANGER-3387,Ranger Admin Header Validation.
> Bug,RANGER-3394,Too
> > > > much
> > > > > > `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL
> > > > > > Bug,RANGER-3500,Ranger policy list doesn't support sorting by
> field
> > > > > > Bug,RANGER-3670,Policy update creates unnecessary entries in
> > > > transaction
> > > > > > log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB
> > > schema
> > > > > > to database Bug,RANGER-3719,Can not create mysql table with
> charset
> > > > > > utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly
> modified
> > by
> > > > > > RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7
> > > > > > Bug,RANGER-3790,Ranger tagsync module should not depend on kafka
> > > server
> > > > > > Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of
> > JVM""
> > > > > > does not update." Bug,RANGER-3806,Group's users mapping entry
> > failing
> > > > > > whenever primary key auto-increment is not set to 1 in db
> > > > > > Bug,RANGER-3807,getUserRoles API gives 200 for non existing user
> > > passed
> > > > > > to this API Bug,RANGER-3813,Fix ConcurrentModificationException
> in
> > > > > > UnixUserGroupBuilder Bug,RANGER-3814,IS_IN_ROLE(roleName)
> condition
> > > > > > always returns false Bug,RANGER-3816,update getResourceACLs() API
> > to
> > > > > > handle macros in resource names Bug,RANGER-3819,Upgrade
> > > springframework
> > > > > > version Bug,RANGER-3820,Upgrade Netty version to 4.1.78.Final
> > > > > > Bug,RANGER-3824,[Ranger] : /service/tags/resources error message
> is
> > > not
> > > > > > proper for duplicate resource & not able to update resource
> > resource
> > > > > > Bug,RANGER-3825,Ranger internal user is unable to change his
> > password
> > > > > > after the upgrade. Bug,RANGER-3829,Incremental Sync value is
> always
> > > > true
> > > > > > under Ranger Audit (Usersync) Bug,RANGER-3840,SHOW DATABASES
> > command
> > > > > > should list databases owned by the user Bug,RANGER-3846,Ranger DB
> > > patch
> > > > > > 058 failing when multiple policies having same resourceSignature
> > > > > > Bug,RANGER-3847,[Ranger] : Http status & Error message is not
> > correct
> > > > > > for /xaudit/trx_log Bug,RANGER-3848,RangerClient does not auto
> > renew
> > > > > > Kerberos ticket after ticket lifetime expired
> > Bug,RANGER-3853,Ranger
> > > > > > java patch J10054 takes time Bug,RANGER-3854,Ranger Java patch
> > J10056
> > > > > > takes time Bug,RANGER-3857,Ranger java patch J10055 takes time
> > > > > > Bug,RANGER-3863,Ranger Failed to run on Apple M1 macOS (Apple
> > > Silicon)
> > > > > > Bug,RANGER-3883,emailchange and passwordchange User REST API's
> work
> > > > even
> > > > > > when invalid user id is used in the url Bug,RANGER-3885,User REST
> > API
> > > > > > /users/firstnames returns only null with status code 204
> > > > > > Bug,RANGER-3894,Application is 'unknown' for metastore in plugin
> > > status
> > > > > > page Bug,RANGER-3897,RangerUserStore cache improvement
> > > Bug,RANGER-3898,
> > > > > > Ranger Roles cache Improvement Bug,RANGER-3907,Skip auditing of
> > > > > > operation like monitorHealth in HDFS Ranger Plugin audit handler
> > > > > > Bug,RANGER-3911,NPE fix in RangerDefaultPolicyEvaluator
> > > > Bug,RANGER-3912,
> > > > > > Ranger Policy report for a given user should fetch policies
> > > maintained
> > > > > > for roles belonging to that user and groups
> Bug,RANGER-3914,Change
> > > > > > sync_source column's datatype from varchar to text
> > > > > > Bug,RANGER-3918,Namespace policy that is created in Ranger by
> HBase
> > > > > > Grant command not getting honored Bug,RANGER-3920,"When sync'ing
> > > users
> > > > > > from Ldap, intermittent User/Group/UserGroup membership is
> > missing"
> > > > > > Bug,RANGER-3925,Enhancing /roles/{id}/addUsersAndGroups api to
> > > > > > add/update/replace Group to a Role. Bug,RANGER-3941,optimize
> cache
> > > > > > refresh in RangerUserStoreCache
> Bug,RANGER-3946,ranger-yarn-plugin
> > > > > > missing commons-lang-2.6.jar Bug,RANGER-3953,potential NPE during
> > > > > > policy-engine initialization Bug,RANGER-3956,Upgrade Commons Text
> > to
> > > > > > 1.10.0 Bug,RANGER-3959,condition expression validation
> > > > > > Bug,RANGER-3966,incorrect roles used in policy evaluation for
> > custom
> > > > > > RangerAccessRequest impl Bug,RANGER-3969,Remove os.path.join
> > causing
> > > > > > incorrect windows path Bug,RANGER-3970,Expression evaluation
> > > > > > improvements Bug,RANGER-3977,Fix Ranger TagRest API
> > > > > > deleteTagResourceMapByGuid Bug,RANGER-3989,KMS APIs fail due to
> > > > > > ConcurrentModificationException Bug,RANGER-4000,unit test failure
> > in
> > > > > > JDK17 Bug,RANGER-4008,RangerTagEnricher to ignore invalid
> resources
> > > > > > Bug,RANGER-4014,update getResourceACLs() API to handle resource
> > names
> > > > > > having macros in row-filter/masking policies
> Bug,RANGER-4018,Ranger
> > > src
> > > > > > packaging should exclude generated/unnecessary files
> > > > > > Bug,RANGER-4029,Ranger cannot build with HBase 2.5.x versions
> > because
> > > > > > preBalance coprocessor hook syntax changed in HBASE-26147
> > > > > > Bug,RANGER-4035,"support for policies to refer access-types using
> > > > > > category, like Create/Read/Update/Delete/Manage"
> > > > Bug,RANGER-4044,Publish
> > > > > > official docker images for ranger to dockerhub
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: Planning for Apache Ranger 2.4.0 release
Posted by Ramesh Mani <rm...@apache.org>.
Hi Rajesh,
Thanks for reaching out on https://issues.apache.org/jira/browse/RANGER-4029
Currently we are reviewing / testing this patch and should update on this.
Thanks,
Ramesh
On Sun, Feb 12, 2023 at 9:16 PM rajeshbabu@apache.org <
chrajeshbabu32@gmail.com> wrote:
> Hi Team,
>
>
> I would like to include https://issues.apache.org/jira/browse/RANGER-4029
> as part of 2.4.0 release. I have uploaded patch at review board as well
> after testing the changes in cluster.
>
> https://reviews.apache.org/r/74299/
>
> Without the changes the HBase plugin with 2.5.x versions cannot be used.
> Which is a blocker.
>
> Thanks,
> Rajeshbabu.
>
> On Wed, Feb 8, 2023, 12:46 PM Nixon Rodrigues <ni...@atlan.com.invalid>
> wrote:
>
> > +1 for Ranger 2.4.0 release.
> > Thanks Selva for initiating release process
> >
> > Regards
> > Nixon
> >
> > On Wed, 8 Feb 2023 at 07:09, Sailaja Polavarapu
> > <sp...@cloudera.com.invalid> wrote:
> >
> > > +1 for Apache Ranger 2.4.0 release.
> > > Thanks Selva for initiating this.
> > >
> > > - Sailaja
> > >
> > > On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani <rm...@apache.org> wrote:
> > >
> > > > +1 for Apache Ranger 2.4.0 release activities.
> > > >
> > > > Thanks
> > > > Ramesh
> > > >
> > > > On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj <
> > > sneethir@apache.org>
> > > > wrote:
> > > >
> > > > > Dear Ranger Community members, There are various features and
> > critical
> > > > > bug fixes done in the Apache Ranger project since the release of
> > Apache
> > > > > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug
> fixes
> > > > > were made from the last release. Now with that Ranger community is
> > > > > expecting a release to adapt those changes and hence planning this
> > > > > release. Please review and provide your opinion.
> > > > >
> > > > > Thanks, Selva-
> > > > >
> > > > > _*Improvements & New Features addressed in 2.4.0*_
> > > > >
> > > > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is
> > > missing
> > > > > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version
> > in
> > > > > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of
> > > > > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to
> enable
> > > > > anonymous download of policy/role/tag
> Improvement,RANGER-3633,Remove
> > > > > eclipse .project file from git Improvement,RANGER-3664,Ranger KMS :
> > Add
> > > > > refresh functionality on kms key listing page.
> > > > > Improvement,RANGER-3763,The max limit of the requested entities is
> > not
> > > > > configurable in tagsync Improvement,RANGER-3767,Add text message in
> > > HDFS
> > > > > and YARN policy pages to highlight the fallback ACL option
> > > > > Improvement,RANGER-3787,Non-daemon threads started by
> > > > > ElasticSearchAuditDestination cause Spark application hanging
> > > > > Improvement,RANGER-3794,Improve performance of delete users/groups
> > > > > utility Improvement,RANGER-3796,Enhancement to support multiple
> > > resource
> > > > > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2
> > > > > Improvement,RANGER-3822,RangerService outputs password information
> in
> > > > > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get,
> > > > > create, edit and delete roles" Improvement,RANGER-3856,Ranger admin
> > > > > client option to work with non-kerberized server
> > > > > Improvement,RANGER-3865,support for using user attributes in
> masking
> > > > > expressions Improvement,RANGER-3900,"Roles deletion Takes time in
> > > Apache
> > > > > Ranger when there are more users,groups,roles"
> > > > > Improvement,RANGER-3902,dbLoadTime is not added correctly in
> > > > > RangerServicePoliciesCache Improvement,RANGER-3910,API
> Documentation
> > is
> > > > > broken for knox sso Improvement,RANGER-3934,improve tag cache
> > handling
> > > > > to reduce resource usage Improvement,RANGER-3940,"Add javascript
> > > > > includes(), intersects() polyfills for array prototype to
> > > > > RangerCommonConstants" Improvement,RANGER-3948,update serialization
> > to
> > > > > skip empty values Improvement,RANGER-3951,optimize memory used for
> > tags
> > > > > in plugins and server Improvement,RANGER-3955,optimization to
> reduce
> > > > > duplicate strings Improvement,RANGER-3973,LDAP incremental search
> not
> > > > > always available Improvement,RANGER-3978,Docker setup to run Ranger
> > KMS
> > > > > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs
> > > > > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in
> > > > > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table
> name
> > > > > when creating tables Improvement,RANGER-3986,Upgrade trino guice
> > > > > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should
> > > > > differntiate between views and tables
> Improvement,RANGER-3997,option
> > to
> > > > > use default value when user/group/tag does not have the attribute
> > > > > Improvement,RANGER-4004,"During the service deletion also, we can
> > clear
> > > > > the in-memory cache for that service which got deleted on the
> ranger
> > > > > side" Improvement,RANGER-4011,option to disable creation of default
> > > > > policies per hierarchy New Feature,RANGER-3852,Performance and
> > > > > scalability analyzer tool for Ranger New
> > > > > Feature,RANGER-3855,RangerExternalUserStoreRetriever class New
> > > > > Feature,RANGER-4028,Ranger - Upgrade bootbox.js.
> > > > >
> > > > > _*BUGS addressed in 2.4.0*_
> > > > >
> > > > > Bug,RANGER-2737,Ranger REST API returns different infomation when
> GET
> > > > > user by id and by name Bug,RANGER-3080,"A service administrator
> > should
> > > > > be allowed to set ""excludes"" flag for a policy resource"
> > > > > Bug,RANGER-3108,NPE in RangerPolicyRepository.init
> > > > > Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too
> > > much
> > > > > `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL
> > > > > Bug,RANGER-3500,Ranger policy list doesn't support sorting by field
> > > > > Bug,RANGER-3670,Policy update creates unnecessary entries in
> > > transaction
> > > > > log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB
> > schema
> > > > > to database Bug,RANGER-3719,Can not create mysql table with charset
> > > > > utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified
> by
> > > > > RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7
> > > > > Bug,RANGER-3790,Ranger tagsync module should not depend on kafka
> > server
> > > > > Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of
> JVM""
> > > > > does not update." Bug,RANGER-3806,Group's users mapping entry
> failing
> > > > > whenever primary key auto-increment is not set to 1 in db
> > > > > Bug,RANGER-3807,getUserRoles API gives 200 for non existing user
> > passed
> > > > > to this API Bug,RANGER-3813,Fix ConcurrentModificationException in
> > > > > UnixUserGroupBuilder Bug,RANGER-3814,IS_IN_ROLE(roleName) condition
> > > > > always returns false Bug,RANGER-3816,update getResourceACLs() API
> to
> > > > > handle macros in resource names Bug,RANGER-3819,Upgrade
> > springframework
> > > > > version Bug,RANGER-3820,Upgrade Netty version to 4.1.78.Final
> > > > > Bug,RANGER-3824,[Ranger] : /service/tags/resources error message is
> > not
> > > > > proper for duplicate resource & not able to update resource
> resource
> > > > > Bug,RANGER-3825,Ranger internal user is unable to change his
> password
> > > > > after the upgrade. Bug,RANGER-3829,Incremental Sync value is always
> > > true
> > > > > under Ranger Audit (Usersync) Bug,RANGER-3840,SHOW DATABASES
> command
> > > > > should list databases owned by the user Bug,RANGER-3846,Ranger DB
> > patch
> > > > > 058 failing when multiple policies having same resourceSignature
> > > > > Bug,RANGER-3847,[Ranger] : Http status & Error message is not
> correct
> > > > > for /xaudit/trx_log Bug,RANGER-3848,RangerClient does not auto
> renew
> > > > > Kerberos ticket after ticket lifetime expired
> Bug,RANGER-3853,Ranger
> > > > > java patch J10054 takes time Bug,RANGER-3854,Ranger Java patch
> J10056
> > > > > takes time Bug,RANGER-3857,Ranger java patch J10055 takes time
> > > > > Bug,RANGER-3863,Ranger Failed to run on Apple M1 macOS (Apple
> > Silicon)
> > > > > Bug,RANGER-3883,emailchange and passwordchange User REST API's work
> > > even
> > > > > when invalid user id is used in the url Bug,RANGER-3885,User REST
> API
> > > > > /users/firstnames returns only null with status code 204
> > > > > Bug,RANGER-3894,Application is 'unknown' for metastore in plugin
> > status
> > > > > page Bug,RANGER-3897,RangerUserStore cache improvement
> > Bug,RANGER-3898,
> > > > > Ranger Roles cache Improvement Bug,RANGER-3907,Skip auditing of
> > > > > operation like monitorHealth in HDFS Ranger Plugin audit handler
> > > > > Bug,RANGER-3911,NPE fix in RangerDefaultPolicyEvaluator
> > > Bug,RANGER-3912,
> > > > > Ranger Policy report for a given user should fetch policies
> > maintained
> > > > > for roles belonging to that user and groups Bug,RANGER-3914,Change
> > > > > sync_source column's datatype from varchar to text
> > > > > Bug,RANGER-3918,Namespace policy that is created in Ranger by HBase
> > > > > Grant command not getting honored Bug,RANGER-3920,"When sync'ing
> > users
> > > > > from Ldap, intermittent User/Group/UserGroup membership is
> missing"
> > > > > Bug,RANGER-3925,Enhancing /roles/{id}/addUsersAndGroups api to
> > > > > add/update/replace Group to a Role. Bug,RANGER-3941,optimize cache
> > > > > refresh in RangerUserStoreCache Bug,RANGER-3946,ranger-yarn-plugin
> > > > > missing commons-lang-2.6.jar Bug,RANGER-3953,potential NPE during
> > > > > policy-engine initialization Bug,RANGER-3956,Upgrade Commons Text
> to
> > > > > 1.10.0 Bug,RANGER-3959,condition expression validation
> > > > > Bug,RANGER-3966,incorrect roles used in policy evaluation for
> custom
> > > > > RangerAccessRequest impl Bug,RANGER-3969,Remove os.path.join
> causing
> > > > > incorrect windows path Bug,RANGER-3970,Expression evaluation
> > > > > improvements Bug,RANGER-3977,Fix Ranger TagRest API
> > > > > deleteTagResourceMapByGuid Bug,RANGER-3989,KMS APIs fail due to
> > > > > ConcurrentModificationException Bug,RANGER-4000,unit test failure
> in
> > > > > JDK17 Bug,RANGER-4008,RangerTagEnricher to ignore invalid resources
> > > > > Bug,RANGER-4014,update getResourceACLs() API to handle resource
> names
> > > > > having macros in row-filter/masking policies Bug,RANGER-4018,Ranger
> > src
> > > > > packaging should exclude generated/unnecessary files
> > > > > Bug,RANGER-4029,Ranger cannot build with HBase 2.5.x versions
> because
> > > > > preBalance coprocessor hook syntax changed in HBASE-26147
> > > > > Bug,RANGER-4035,"support for policies to refer access-types using
> > > > > category, like Create/Read/Update/Delete/Manage"
> > > Bug,RANGER-4044,Publish
> > > > > official docker images for ranger to dockerhub
> > > > >
> > > >
> > >
> >
>
Re: Planning for Apache Ranger 2.4.0 release
Posted by "rajeshbabu@apache.org" <ch...@gmail.com>.
Hi Team,
I would like to include https://issues.apache.org/jira/browse/RANGER-4029
as part of 2.4.0 release. I have uploaded patch at review board as well
after testing the changes in cluster.
https://reviews.apache.org/r/74299/
Without the changes the HBase plugin with 2.5.x versions cannot be used.
Which is a blocker.
Thanks,
Rajeshbabu.
On Wed, Feb 8, 2023, 12:46 PM Nixon Rodrigues <ni...@atlan.com.invalid>
wrote:
> +1 for Ranger 2.4.0 release.
> Thanks Selva for initiating release process
>
> Regards
> Nixon
>
> On Wed, 8 Feb 2023 at 07:09, Sailaja Polavarapu
> <sp...@cloudera.com.invalid> wrote:
>
> > +1 for Apache Ranger 2.4.0 release.
> > Thanks Selva for initiating this.
> >
> > - Sailaja
> >
> > On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani <rm...@apache.org> wrote:
> >
> > > +1 for Apache Ranger 2.4.0 release activities.
> > >
> > > Thanks
> > > Ramesh
> > >
> > > On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj <
> > sneethir@apache.org>
> > > wrote:
> > >
> > > > Dear Ranger Community members, There are various features and
> critical
> > > > bug fixes done in the Apache Ranger project since the release of
> Apache
> > > > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes
> > > > were made from the last release. Now with that Ranger community is
> > > > expecting a release to adapt those changes and hence planning this
> > > > release. Please review and provide your opinion.
> > > >
> > > > Thanks, Selva-
> > > >
> > > > _*Improvements & New Features addressed in 2.4.0*_
> > > >
> > > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is
> > missing
> > > > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version
> in
> > > > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of
> > > > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable
> > > > anonymous download of policy/role/tag Improvement,RANGER-3633,Remove
> > > > eclipse .project file from git Improvement,RANGER-3664,Ranger KMS :
> Add
> > > > refresh functionality on kms key listing page.
> > > > Improvement,RANGER-3763,The max limit of the requested entities is
> not
> > > > configurable in tagsync Improvement,RANGER-3767,Add text message in
> > HDFS
> > > > and YARN policy pages to highlight the fallback ACL option
> > > > Improvement,RANGER-3787,Non-daemon threads started by
> > > > ElasticSearchAuditDestination cause Spark application hanging
> > > > Improvement,RANGER-3794,Improve performance of delete users/groups
> > > > utility Improvement,RANGER-3796,Enhancement to support multiple
> > resource
> > > > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2
> > > > Improvement,RANGER-3822,RangerService outputs password information in
> > > > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get,
> > > > create, edit and delete roles" Improvement,RANGER-3856,Ranger admin
> > > > client option to work with non-kerberized server
> > > > Improvement,RANGER-3865,support for using user attributes in masking
> > > > expressions Improvement,RANGER-3900,"Roles deletion Takes time in
> > Apache
> > > > Ranger when there are more users,groups,roles"
> > > > Improvement,RANGER-3902,dbLoadTime is not added correctly in
> > > > RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation
> is
> > > > broken for knox sso Improvement,RANGER-3934,improve tag cache
> handling
> > > > to reduce resource usage Improvement,RANGER-3940,"Add javascript
> > > > includes(), intersects() polyfills for array prototype to
> > > > RangerCommonConstants" Improvement,RANGER-3948,update serialization
> to
> > > > skip empty values Improvement,RANGER-3951,optimize memory used for
> tags
> > > > in plugins and server Improvement,RANGER-3955,optimization to reduce
> > > > duplicate strings Improvement,RANGER-3973,LDAP incremental search not
> > > > always available Improvement,RANGER-3978,Docker setup to run Ranger
> KMS
> > > > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs
> > > > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in
> > > > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name
> > > > when creating tables Improvement,RANGER-3986,Upgrade trino guice
> > > > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should
> > > > differntiate between views and tables Improvement,RANGER-3997,option
> to
> > > > use default value when user/group/tag does not have the attribute
> > > > Improvement,RANGER-4004,"During the service deletion also, we can
> clear
> > > > the in-memory cache for that service which got deleted on the ranger
> > > > side" Improvement,RANGER-4011,option to disable creation of default
> > > > policies per hierarchy New Feature,RANGER-3852,Performance and
> > > > scalability analyzer tool for Ranger New
> > > > Feature,RANGER-3855,RangerExternalUserStoreRetriever class New
> > > > Feature,RANGER-4028,Ranger - Upgrade bootbox.js.
> > > >
> > > > _*BUGS addressed in 2.4.0*_
> > > >
> > > > Bug,RANGER-2737,Ranger REST API returns different infomation when GET
> > > > user by id and by name Bug,RANGER-3080,"A service administrator
> should
> > > > be allowed to set ""excludes"" flag for a policy resource"
> > > > Bug,RANGER-3108,NPE in RangerPolicyRepository.init
> > > > Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too
> > much
> > > > `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL
> > > > Bug,RANGER-3500,Ranger policy list doesn't support sorting by field
> > > > Bug,RANGER-3670,Policy update creates unnecessary entries in
> > transaction
> > > > log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB
> schema
> > > > to database Bug,RANGER-3719,Can not create mysql table with charset
> > > > utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by
> > > > RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7
> > > > Bug,RANGER-3790,Ranger tagsync module should not depend on kafka
> server
> > > > Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of JVM""
> > > > does not update." Bug,RANGER-3806,Group's users mapping entry failing
> > > > whenever primary key auto-increment is not set to 1 in db
> > > > Bug,RANGER-3807,getUserRoles API gives 200 for non existing user
> passed
> > > > to this API Bug,RANGER-3813,Fix ConcurrentModificationException in
> > > > UnixUserGroupBuilder Bug,RANGER-3814,IS_IN_ROLE(roleName) condition
> > > > always returns false Bug,RANGER-3816,update getResourceACLs() API to
> > > > handle macros in resource names Bug,RANGER-3819,Upgrade
> springframework
> > > > version Bug,RANGER-3820,Upgrade Netty version to 4.1.78.Final
> > > > Bug,RANGER-3824,[Ranger] : /service/tags/resources error message is
> not
> > > > proper for duplicate resource & not able to update resource resource
> > > > Bug,RANGER-3825,Ranger internal user is unable to change his password
> > > > after the upgrade. Bug,RANGER-3829,Incremental Sync value is always
> > true
> > > > under Ranger Audit (Usersync) Bug,RANGER-3840,SHOW DATABASES command
> > > > should list databases owned by the user Bug,RANGER-3846,Ranger DB
> patch
> > > > 058 failing when multiple policies having same resourceSignature
> > > > Bug,RANGER-3847,[Ranger] : Http status & Error message is not correct
> > > > for /xaudit/trx_log Bug,RANGER-3848,RangerClient does not auto renew
> > > > Kerberos ticket after ticket lifetime expired Bug,RANGER-3853,Ranger
> > > > java patch J10054 takes time Bug,RANGER-3854,Ranger Java patch J10056
> > > > takes time Bug,RANGER-3857,Ranger java patch J10055 takes time
> > > > Bug,RANGER-3863,Ranger Failed to run on Apple M1 macOS (Apple
> Silicon)
> > > > Bug,RANGER-3883,emailchange and passwordchange User REST API's work
> > even
> > > > when invalid user id is used in the url Bug,RANGER-3885,User REST API
> > > > /users/firstnames returns only null with status code 204
> > > > Bug,RANGER-3894,Application is 'unknown' for metastore in plugin
> status
> > > > page Bug,RANGER-3897,RangerUserStore cache improvement
> Bug,RANGER-3898,
> > > > Ranger Roles cache Improvement Bug,RANGER-3907,Skip auditing of
> > > > operation like monitorHealth in HDFS Ranger Plugin audit handler
> > > > Bug,RANGER-3911,NPE fix in RangerDefaultPolicyEvaluator
> > Bug,RANGER-3912,
> > > > Ranger Policy report for a given user should fetch policies
> maintained
> > > > for roles belonging to that user and groups Bug,RANGER-3914,Change
> > > > sync_source column's datatype from varchar to text
> > > > Bug,RANGER-3918,Namespace policy that is created in Ranger by HBase
> > > > Grant command not getting honored Bug,RANGER-3920,"When sync'ing
> users
> > > > from Ldap, intermittent User/Group/UserGroup membership is missing"
> > > > Bug,RANGER-3925,Enhancing /roles/{id}/addUsersAndGroups api to
> > > > add/update/replace Group to a Role. Bug,RANGER-3941,optimize cache
> > > > refresh in RangerUserStoreCache Bug,RANGER-3946,ranger-yarn-plugin
> > > > missing commons-lang-2.6.jar Bug,RANGER-3953,potential NPE during
> > > > policy-engine initialization Bug,RANGER-3956,Upgrade Commons Text to
> > > > 1.10.0 Bug,RANGER-3959,condition expression validation
> > > > Bug,RANGER-3966,incorrect roles used in policy evaluation for custom
> > > > RangerAccessRequest impl Bug,RANGER-3969,Remove os.path.join causing
> > > > incorrect windows path Bug,RANGER-3970,Expression evaluation
> > > > improvements Bug,RANGER-3977,Fix Ranger TagRest API
> > > > deleteTagResourceMapByGuid Bug,RANGER-3989,KMS APIs fail due to
> > > > ConcurrentModificationException Bug,RANGER-4000,unit test failure in
> > > > JDK17 Bug,RANGER-4008,RangerTagEnricher to ignore invalid resources
> > > > Bug,RANGER-4014,update getResourceACLs() API to handle resource names
> > > > having macros in row-filter/masking policies Bug,RANGER-4018,Ranger
> src
> > > > packaging should exclude generated/unnecessary files
> > > > Bug,RANGER-4029,Ranger cannot build with HBase 2.5.x versions because
> > > > preBalance coprocessor hook syntax changed in HBASE-26147
> > > > Bug,RANGER-4035,"support for policies to refer access-types using
> > > > category, like Create/Read/Update/Delete/Manage"
> > Bug,RANGER-4044,Publish
> > > > official docker images for ranger to dockerhub
> > > >
> > >
> >
>
Re: Planning for Apache Ranger 2.4.0 release
Posted by Nixon Rodrigues <ni...@atlan.com.INVALID>.
+1 for Ranger 2.4.0 release.
Thanks Selva for initiating release process
Regards
Nixon
On Wed, 8 Feb 2023 at 07:09, Sailaja Polavarapu
<sp...@cloudera.com.invalid> wrote:
> +1 for Apache Ranger 2.4.0 release.
> Thanks Selva for initiating this.
>
> - Sailaja
>
> On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani <rm...@apache.org> wrote:
>
> > +1 for Apache Ranger 2.4.0 release activities.
> >
> > Thanks
> > Ramesh
> >
> > On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj <
> sneethir@apache.org>
> > wrote:
> >
> > > Dear Ranger Community members, There are various features and critical
> > > bug fixes done in the Apache Ranger project since the release of Apache
> > > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes
> > > were made from the last release. Now with that Ranger community is
> > > expecting a release to adapt those changes and hence planning this
> > > release. Please review and provide your opinion.
> > >
> > > Thanks, Selva-
> > >
> > > _*Improvements & New Features addressed in 2.4.0*_
> > >
> > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is
> missing
> > > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in
> > > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of
> > > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable
> > > anonymous download of policy/role/tag Improvement,RANGER-3633,Remove
> > > eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : Add
> > > refresh functionality on kms key listing page.
> > > Improvement,RANGER-3763,The max limit of the requested entities is not
> > > configurable in tagsync Improvement,RANGER-3767,Add text message in
> HDFS
> > > and YARN policy pages to highlight the fallback ACL option
> > > Improvement,RANGER-3787,Non-daemon threads started by
> > > ElasticSearchAuditDestination cause Spark application hanging
> > > Improvement,RANGER-3794,Improve performance of delete users/groups
> > > utility Improvement,RANGER-3796,Enhancement to support multiple
> resource
> > > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2
> > > Improvement,RANGER-3822,RangerService outputs password information in
> > > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get,
> > > create, edit and delete roles" Improvement,RANGER-3856,Ranger admin
> > > client option to work with non-kerberized server
> > > Improvement,RANGER-3865,support for using user attributes in masking
> > > expressions Improvement,RANGER-3900,"Roles deletion Takes time in
> Apache
> > > Ranger when there are more users,groups,roles"
> > > Improvement,RANGER-3902,dbLoadTime is not added correctly in
> > > RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is
> > > broken for knox sso Improvement,RANGER-3934,improve tag cache handling
> > > to reduce resource usage Improvement,RANGER-3940,"Add javascript
> > > includes(), intersects() polyfills for array prototype to
> > > RangerCommonConstants" Improvement,RANGER-3948,update serialization to
> > > skip empty values Improvement,RANGER-3951,optimize memory used for tags
> > > in plugins and server Improvement,RANGER-3955,optimization to reduce
> > > duplicate strings Improvement,RANGER-3973,LDAP incremental search not
> > > always available Improvement,RANGER-3978,Docker setup to run Ranger KMS
> > > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs
> > > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in
> > > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name
> > > when creating tables Improvement,RANGER-3986,Upgrade trino guice
> > > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should
> > > differntiate between views and tables Improvement,RANGER-3997,option to
> > > use default value when user/group/tag does not have the attribute
> > > Improvement,RANGER-4004,"During the service deletion also, we can clear
> > > the in-memory cache for that service which got deleted on the ranger
> > > side" Improvement,RANGER-4011,option to disable creation of default
> > > policies per hierarchy New Feature,RANGER-3852,Performance and
> > > scalability analyzer tool for Ranger New
> > > Feature,RANGER-3855,RangerExternalUserStoreRetriever class New
> > > Feature,RANGER-4028,Ranger - Upgrade bootbox.js.
> > >
> > > _*BUGS addressed in 2.4.0*_
> > >
> > > Bug,RANGER-2737,Ranger REST API returns different infomation when GET
> > > user by id and by name Bug,RANGER-3080,"A service administrator should
> > > be allowed to set ""excludes"" flag for a policy resource"
> > > Bug,RANGER-3108,NPE in RangerPolicyRepository.init
> > > Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too
> much
> > > `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL
> > > Bug,RANGER-3500,Ranger policy list doesn't support sorting by field
> > > Bug,RANGER-3670,Policy update creates unnecessary entries in
> transaction
> > > log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB schema
> > > to database Bug,RANGER-3719,Can not create mysql table with charset
> > > utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by
> > > RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7
> > > Bug,RANGER-3790,Ranger tagsync module should not depend on kafka server
> > > Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of JVM""
> > > does not update." Bug,RANGER-3806,Group's users mapping entry failing
> > > whenever primary key auto-increment is not set to 1 in db
> > > Bug,RANGER-3807,getUserRoles API gives 200 for non existing user passed
> > > to this API Bug,RANGER-3813,Fix ConcurrentModificationException in
> > > UnixUserGroupBuilder Bug,RANGER-3814,IS_IN_ROLE(roleName) condition
> > > always returns false Bug,RANGER-3816,update getResourceACLs() API to
> > > handle macros in resource names Bug,RANGER-3819,Upgrade springframework
> > > version Bug,RANGER-3820,Upgrade Netty version to 4.1.78.Final
> > > Bug,RANGER-3824,[Ranger] : /service/tags/resources error message is not
> > > proper for duplicate resource & not able to update resource resource
> > > Bug,RANGER-3825,Ranger internal user is unable to change his password
> > > after the upgrade. Bug,RANGER-3829,Incremental Sync value is always
> true
> > > under Ranger Audit (Usersync) Bug,RANGER-3840,SHOW DATABASES command
> > > should list databases owned by the user Bug,RANGER-3846,Ranger DB patch
> > > 058 failing when multiple policies having same resourceSignature
> > > Bug,RANGER-3847,[Ranger] : Http status & Error message is not correct
> > > for /xaudit/trx_log Bug,RANGER-3848,RangerClient does not auto renew
> > > Kerberos ticket after ticket lifetime expired Bug,RANGER-3853,Ranger
> > > java patch J10054 takes time Bug,RANGER-3854,Ranger Java patch J10056
> > > takes time Bug,RANGER-3857,Ranger java patch J10055 takes time
> > > Bug,RANGER-3863,Ranger Failed to run on Apple M1 macOS (Apple Silicon)
> > > Bug,RANGER-3883,emailchange and passwordchange User REST API's work
> even
> > > when invalid user id is used in the url Bug,RANGER-3885,User REST API
> > > /users/firstnames returns only null with status code 204
> > > Bug,RANGER-3894,Application is 'unknown' for metastore in plugin status
> > > page Bug,RANGER-3897,RangerUserStore cache improvement Bug,RANGER-3898,
> > > Ranger Roles cache Improvement Bug,RANGER-3907,Skip auditing of
> > > operation like monitorHealth in HDFS Ranger Plugin audit handler
> > > Bug,RANGER-3911,NPE fix in RangerDefaultPolicyEvaluator
> Bug,RANGER-3912,
> > > Ranger Policy report for a given user should fetch policies maintained
> > > for roles belonging to that user and groups Bug,RANGER-3914,Change
> > > sync_source column's datatype from varchar to text
> > > Bug,RANGER-3918,Namespace policy that is created in Ranger by HBase
> > > Grant command not getting honored Bug,RANGER-3920,"When sync'ing users
> > > from Ldap, intermittent User/Group/UserGroup membership is missing"
> > > Bug,RANGER-3925,Enhancing /roles/{id}/addUsersAndGroups api to
> > > add/update/replace Group to a Role. Bug,RANGER-3941,optimize cache
> > > refresh in RangerUserStoreCache Bug,RANGER-3946,ranger-yarn-plugin
> > > missing commons-lang-2.6.jar Bug,RANGER-3953,potential NPE during
> > > policy-engine initialization Bug,RANGER-3956,Upgrade Commons Text to
> > > 1.10.0 Bug,RANGER-3959,condition expression validation
> > > Bug,RANGER-3966,incorrect roles used in policy evaluation for custom
> > > RangerAccessRequest impl Bug,RANGER-3969,Remove os.path.join causing
> > > incorrect windows path Bug,RANGER-3970,Expression evaluation
> > > improvements Bug,RANGER-3977,Fix Ranger TagRest API
> > > deleteTagResourceMapByGuid Bug,RANGER-3989,KMS APIs fail due to
> > > ConcurrentModificationException Bug,RANGER-4000,unit test failure in
> > > JDK17 Bug,RANGER-4008,RangerTagEnricher to ignore invalid resources
> > > Bug,RANGER-4014,update getResourceACLs() API to handle resource names
> > > having macros in row-filter/masking policies Bug,RANGER-4018,Ranger src
> > > packaging should exclude generated/unnecessary files
> > > Bug,RANGER-4029,Ranger cannot build with HBase 2.5.x versions because
> > > preBalance coprocessor hook syntax changed in HBASE-26147
> > > Bug,RANGER-4035,"support for policies to refer access-types using
> > > category, like Create/Read/Update/Delete/Manage"
> Bug,RANGER-4044,Publish
> > > official docker images for ranger to dockerhub
> > >
> >
>
Re: Planning for Apache Ranger 2.4.0 release
Posted by Sailaja Polavarapu <sp...@cloudera.com.INVALID>.
+1 for Apache Ranger 2.4.0 release.
Thanks Selva for initiating this.
- Sailaja
On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani <rm...@apache.org> wrote:
> +1 for Apache Ranger 2.4.0 release activities.
>
> Thanks
> Ramesh
>
> On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj <sn...@apache.org>
> wrote:
>
> > Dear Ranger Community members, There are various features and critical
> > bug fixes done in the Apache Ranger project since the release of Apache
> > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes
> > were made from the last release. Now with that Ranger community is
> > expecting a release to adapt those changes and hence planning this
> > release. Please review and provide your opinion.
> >
> > Thanks, Selva-
> >
> > _*Improvements & New Features addressed in 2.4.0*_
> >
> > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is missing
> > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in
> > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of
> > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable
> > anonymous download of policy/role/tag Improvement,RANGER-3633,Remove
> > eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : Add
> > refresh functionality on kms key listing page.
> > Improvement,RANGER-3763,The max limit of the requested entities is not
> > configurable in tagsync Improvement,RANGER-3767,Add text message in HDFS
> > and YARN policy pages to highlight the fallback ACL option
> > Improvement,RANGER-3787,Non-daemon threads started by
> > ElasticSearchAuditDestination cause Spark application hanging
> > Improvement,RANGER-3794,Improve performance of delete users/groups
> > utility Improvement,RANGER-3796,Enhancement to support multiple resource
> > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2
> > Improvement,RANGER-3822,RangerService outputs password information in
> > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get,
> > create, edit and delete roles" Improvement,RANGER-3856,Ranger admin
> > client option to work with non-kerberized server
> > Improvement,RANGER-3865,support for using user attributes in masking
> > expressions Improvement,RANGER-3900,"Roles deletion Takes time in Apache
> > Ranger when there are more users,groups,roles"
> > Improvement,RANGER-3902,dbLoadTime is not added correctly in
> > RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is
> > broken for knox sso Improvement,RANGER-3934,improve tag cache handling
> > to reduce resource usage Improvement,RANGER-3940,"Add javascript
> > includes(), intersects() polyfills for array prototype to
> > RangerCommonConstants" Improvement,RANGER-3948,update serialization to
> > skip empty values Improvement,RANGER-3951,optimize memory used for tags
> > in plugins and server Improvement,RANGER-3955,optimization to reduce
> > duplicate strings Improvement,RANGER-3973,LDAP incremental search not
> > always available Improvement,RANGER-3978,Docker setup to run Ranger KMS
> > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs
> > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in
> > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name
> > when creating tables Improvement,RANGER-3986,Upgrade trino guice
> > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should
> > differntiate between views and tables Improvement,RANGER-3997,option to
> > use default value when user/group/tag does not have the attribute
> > Improvement,RANGER-4004,"During the service deletion also, we can clear
> > the in-memory cache for that service which got deleted on the ranger
> > side" Improvement,RANGER-4011,option to disable creation of default
> > policies per hierarchy New Feature,RANGER-3852,Performance and
> > scalability analyzer tool for Ranger New
> > Feature,RANGER-3855,RangerExternalUserStoreRetriever class New
> > Feature,RANGER-4028,Ranger - Upgrade bootbox.js.
> >
> > _*BUGS addressed in 2.4.0*_
> >
> > Bug,RANGER-2737,Ranger REST API returns different infomation when GET
> > user by id and by name Bug,RANGER-3080,"A service administrator should
> > be allowed to set ""excludes"" flag for a policy resource"
> > Bug,RANGER-3108,NPE in RangerPolicyRepository.init
> > Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too much
> > `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL
> > Bug,RANGER-3500,Ranger policy list doesn't support sorting by field
> > Bug,RANGER-3670,Policy update creates unnecessary entries in transaction
> > log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB schema
> > to database Bug,RANGER-3719,Can not create mysql table with charset
> > utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by
> > RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7
> > Bug,RANGER-3790,Ranger tagsync module should not depend on kafka server
> > Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of JVM""
> > does not update." Bug,RANGER-3806,Group's users mapping entry failing
> > whenever primary key auto-increment is not set to 1 in db
> > Bug,RANGER-3807,getUserRoles API gives 200 for non existing user passed
> > to this API Bug,RANGER-3813,Fix ConcurrentModificationException in
> > UnixUserGroupBuilder Bug,RANGER-3814,IS_IN_ROLE(roleName) condition
> > always returns false Bug,RANGER-3816,update getResourceACLs() API to
> > handle macros in resource names Bug,RANGER-3819,Upgrade springframework
> > version Bug,RANGER-3820,Upgrade Netty version to 4.1.78.Final
> > Bug,RANGER-3824,[Ranger] : /service/tags/resources error message is not
> > proper for duplicate resource & not able to update resource resource
> > Bug,RANGER-3825,Ranger internal user is unable to change his password
> > after the upgrade. Bug,RANGER-3829,Incremental Sync value is always true
> > under Ranger Audit (Usersync) Bug,RANGER-3840,SHOW DATABASES command
> > should list databases owned by the user Bug,RANGER-3846,Ranger DB patch
> > 058 failing when multiple policies having same resourceSignature
> > Bug,RANGER-3847,[Ranger] : Http status & Error message is not correct
> > for /xaudit/trx_log Bug,RANGER-3848,RangerClient does not auto renew
> > Kerberos ticket after ticket lifetime expired Bug,RANGER-3853,Ranger
> > java patch J10054 takes time Bug,RANGER-3854,Ranger Java patch J10056
> > takes time Bug,RANGER-3857,Ranger java patch J10055 takes time
> > Bug,RANGER-3863,Ranger Failed to run on Apple M1 macOS (Apple Silicon)
> > Bug,RANGER-3883,emailchange and passwordchange User REST API's work even
> > when invalid user id is used in the url Bug,RANGER-3885,User REST API
> > /users/firstnames returns only null with status code 204
> > Bug,RANGER-3894,Application is 'unknown' for metastore in plugin status
> > page Bug,RANGER-3897,RangerUserStore cache improvement Bug,RANGER-3898,
> > Ranger Roles cache Improvement Bug,RANGER-3907,Skip auditing of
> > operation like monitorHealth in HDFS Ranger Plugin audit handler
> > Bug,RANGER-3911,NPE fix in RangerDefaultPolicyEvaluator Bug,RANGER-3912,
> > Ranger Policy report for a given user should fetch policies maintained
> > for roles belonging to that user and groups Bug,RANGER-3914,Change
> > sync_source column's datatype from varchar to text
> > Bug,RANGER-3918,Namespace policy that is created in Ranger by HBase
> > Grant command not getting honored Bug,RANGER-3920,"When sync'ing users
> > from Ldap, intermittent User/Group/UserGroup membership is missing"
> > Bug,RANGER-3925,Enhancing /roles/{id}/addUsersAndGroups api to
> > add/update/replace Group to a Role. Bug,RANGER-3941,optimize cache
> > refresh in RangerUserStoreCache Bug,RANGER-3946,ranger-yarn-plugin
> > missing commons-lang-2.6.jar Bug,RANGER-3953,potential NPE during
> > policy-engine initialization Bug,RANGER-3956,Upgrade Commons Text to
> > 1.10.0 Bug,RANGER-3959,condition expression validation
> > Bug,RANGER-3966,incorrect roles used in policy evaluation for custom
> > RangerAccessRequest impl Bug,RANGER-3969,Remove os.path.join causing
> > incorrect windows path Bug,RANGER-3970,Expression evaluation
> > improvements Bug,RANGER-3977,Fix Ranger TagRest API
> > deleteTagResourceMapByGuid Bug,RANGER-3989,KMS APIs fail due to
> > ConcurrentModificationException Bug,RANGER-4000,unit test failure in
> > JDK17 Bug,RANGER-4008,RangerTagEnricher to ignore invalid resources
> > Bug,RANGER-4014,update getResourceACLs() API to handle resource names
> > having macros in row-filter/masking policies Bug,RANGER-4018,Ranger src
> > packaging should exclude generated/unnecessary files
> > Bug,RANGER-4029,Ranger cannot build with HBase 2.5.x versions because
> > preBalance coprocessor hook syntax changed in HBASE-26147
> > Bug,RANGER-4035,"support for policies to refer access-types using
> > category, like Create/Read/Update/Delete/Manage" Bug,RANGER-4044,Publish
> > official docker images for ranger to dockerhub
> >
>