You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ranger.apache.org by Madhan Neethiraj <ma...@apache.org> on 2021/07/21 08:03:48 UTC

Ranger admin server startup fails in latest master

 

 

Rangers,

 

Starting the latest Ranger admin server (in master branch) using the docker setup in dev-support/ranger-docker fails with the following error. Anyone else hit this issue? This is a regression..

 

Thanks,

Madhan 

 

 

2021-07-21 07:50:49,243  [I] Ranger all admins default password change request is in process..

ERROR StatusLogger Reconfiguration failed: No configuration found for '532760d8' at 'null' in 'null'

07:50:56.952 [main] ERROR org.apache.ranger.plugin.store.AbstractServiceStore - AbstractServiceStore.updateTagServiceDefForUpdatingAccessTypeshdfs): could not find TAG ServiceDef..

javax.ws.rs.WebApplicationException: null

        at org.apache.ranger.common.RESTErrorUtil.createRESTException(RESTErrorUtil.java:56) ~[classes/:3.0.0-SNAPSHOT]

        at org.apache.ranger.common.RESTErrorUtil.createRESTException(RESTErrorUtil.java:301) ~[classes/:3.0.0-SNAPSHOT]

        at org.apache.ranger.service.RangerBaseModelService.read(RangerBaseModelService.java:240) ~[classes/:?]

        at org.apache.ranger.biz.ServiceDBStore.getServiceDef(ServiceDBStore.java:1379) ~[classes/:?]

        at org.apache.ranger.plugin.store.AbstractServiceStore.updateTagServiceDefForUpdatingAccessTypes(AbstractServiceStore.java:288) ~[ranger-plugins-common-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]

        at org.apache.ranger.plugin.store.AbstractServiceStore.postCreate(AbstractServiceStore.java:128) ~[ranger-plugins-common-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]

        at org.apache.ranger.biz.ServiceDBStore.createServiceDef(ServiceDBStore.java:675) ~[classes/:?]

        at org.apache.ranger.plugin.store.EmbeddedServiceDefsUtil.getOrCreateServiceDef(EmbeddedServiceDefsUtil.java:295) ~[ranger-plugins-common-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]

        at org.apache.ranger.plugin.store.EmbeddedServiceDefsUtil.init(EmbeddedServiceDefsUtil.java:147) ~[ranger-plugins-common-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]

        at org.apache.ranger.biz.ServiceDBStore$1.doInTransaction(ServiceDBStore.java:398) ~[classes/:?]

        at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140) ~[spring-tx-5.3.7.jar:5.3.7]

        at org.apache.ranger.biz.ServiceDBStore.initStore(ServiceDBStore.java:395) ~[classes/:?]

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_282]

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_282]

...

        at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:144) [spring-context-5.3.7.jar:5.3.7]

        at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:95) [spring-context-5.3.7.jar:5.3.7]

        at org.apache.ranger.util.CLIUtil.init(CLIUtil.java:54) [classes/:?]

        at org.apache.ranger.util.CLIUtil.getBean(CLIUtil.java:62) [classes/:?]

        at org.apache.ranger.patch.cliutil.ChangePasswordUtil.main(ChangePasswordUtil.java:55) [classes/:?]

Re: Ranger admin server startup fails in latest master

Posted by Bhavik Patel <bh...@gmail.com>.
Hi Madhan,

This is might be due to htrace support is removed from the Hadoop end; not
sure that is related to this issue or not.

On Wed, Jul 21, 2021, 1:34 PM Madhan Neethiraj <ma...@apache.org> wrote:

>
>
>
>
> Rangers,
>
>
>
> Starting the latest Ranger admin server (in master branch) using the
> docker setup in dev-support/ranger-docker fails with the following error.
> Anyone else hit this issue? This is a regression..
>
>
>
> Thanks,
>
> Madhan
>
>
>
>
>
> 2021-07-21 07:50:49,243  [I] Ranger all admins default password change
> request is in process..
>
> ERROR StatusLogger Reconfiguration failed: No configuration found for
> '532760d8' at 'null' in 'null'
>
> 07:50:56.952 [main] ERROR
> org.apache.ranger.plugin.store.AbstractServiceStore -
> AbstractServiceStore.updateTagServiceDefForUpdatingAccessTypeshdfs): could
> not find TAG ServiceDef..
>
> javax.ws.rs.WebApplicationException: null
>
>         at
> org.apache.ranger.common.RESTErrorUtil.createRESTException(RESTErrorUtil.java:56)
> ~[classes/:3.0.0-SNAPSHOT]
>
>         at
> org.apache.ranger.common.RESTErrorUtil.createRESTException(RESTErrorUtil.java:301)
> ~[classes/:3.0.0-SNAPSHOT]
>
>         at
> org.apache.ranger.service.RangerBaseModelService.read(RangerBaseModelService.java:240)
> ~[classes/:?]
>
>         at org.apache.ranger.biz.ServiceDBStore.getServiceDef(ServiceDBStore.java:1379)
> ~[classes/:?]
>
>         at
> org.apache.ranger.plugin.store.AbstractServiceStore.updateTagServiceDefForUpdatingAccessTypes(AbstractServiceStore.java:288)
> ~[ranger-plugins-common-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
>
>         at
> org.apache.ranger.plugin.store.AbstractServiceStore.postCreate(AbstractServiceStore.java:128)
> ~[ranger-plugins-common-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
>
>         at org.apache.ranger.biz.ServiceDBStore.createServiceDef(ServiceDBStore.java:675)
> ~[classes/:?]
>
>         at
> org.apache.ranger.plugin.store.EmbeddedServiceDefsUtil.getOrCreateServiceDef(EmbeddedServiceDefsUtil.java:295)
> ~[ranger-plugins-common-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
>
>         at
> org.apache.ranger.plugin.store.EmbeddedServiceDefsUtil.init(EmbeddedServiceDefsUtil.java:147)
> ~[ranger-plugins-common-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
>
>         at org.apache.ranger.biz.ServiceDBStore$1.doInTransaction(ServiceDBStore.java:398)
> ~[classes/:?]
>
>         at
> org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)
> ~[spring-tx-5.3.7.jar:5.3.7]
>
>         at org.apache.ranger.biz.ServiceDBStore.initStore(ServiceDBStore.java:395)
> ~[classes/:?]
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:1.8.0_282]
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_282]
>
> ...
>
>         at
> org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:144)
> [spring-context-5.3.7.jar:5.3.7]
>
>         at
> org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:95)
> [spring-context-5.3.7.jar:5.3.7]
>
>         at org.apache.ranger.util.CLIUtil.init(CLIUtil.java:54)
> [classes/:?]
>
>         at org.apache.ranger.util.CLIUtil.getBean(CLIUtil.java:62)
> [classes/:?]
>
>         at
> org.apache.ranger.patch.cliutil.ChangePasswordUtil.main(ChangePasswordUtil.java:55)
> [classes/:?]
>
>
>
>

Re: Ranger admin server startup fails in latest master

Posted by Madhan Neethiraj <ma...@apache.org>.
The same issue exists in ranger-2.2 branch as well. Looking at catalina.out (below), this might be due to following recent change:

   RANGER-3340:Remove htrace-core.jar from Ranger modules where it is not required

 

Ramesh – can you please look into this?

 

Thanks,

Madhan

 

catalina.out:

  SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".

  SLF4J: Defaulting to no-operation (NOP) logger implementation

  SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.

  Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/htrace/core/Tracer$Builder

        at org.apache.hadoop.fs.FsTracer.get(FsTracer.java:42)

        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3407)

        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:158)

        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3474)

        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3442)

        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:524)

        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:365)

        at org.apache.hadoop.security.alias.JavaKeyStoreProvider.initFileSystem(JavaKeyStoreProvider.java:89)

        at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.<init>(AbstractJavaKeyStoreProvider.java:85)

        at org.apache.hadoop.security.alias.JavaKeyStoreProvider.<init>(JavaKeyStoreProvider.java:49)

        at org.apache.hadoop.security.alias.JavaKeyStoreProvider.<init>(JavaKeyStoreProvider.java:41)

        at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100)

        at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73)

        at org.apache.ranger.credentialapi.CredentialReader.getDecryptedString(CredentialReader.java:74)

        at org.apache.ranger.server.tomcat.EmbeddedServer.getKeyManagers(EmbeddedServer.java:443)

        at org.apache.ranger.server.tomcat.EmbeddedServer.getSSLContext(EmbeddedServer.java:417)

        at org.apache.ranger.server.tomcat.EmbeddedServer.start(EmbeddedServer.java:113)

        at org.apache.ranger.server.tomcat.EmbeddedServer.main(EmbeddedServer.java:88)

  Caused by: java.lang.ClassNotFoundException: org.apache.htrace.core.Tracer$Builder

        at java.net.URLClassLoader.findClass(URLClassLoader.java:382)

        at java.lang.ClassLoader.loadClass(ClassLoader.java:418)

        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)

        at java.lang.ClassLoader.loadClass(ClassLoader.java:351)

        ... 18 more

 

 

From: Madhan Neethiraj <ma...@apache.org>
Date: Wednesday, July 21, 2021 at 1:03 AM
To: "dev@ranger.apache.org" <de...@ranger.apache.org>
Subject: Ranger admin server startup fails in latest master

 

 

 

Rangers,

 

Starting the latest Ranger admin server (in master branch) using the docker setup in dev-support/ranger-docker fails with the following error. Anyone else hit this issue? This is a regression..

 

Thanks,

Madhan 

 

 

2021-07-21 07:50:49,243  [I] Ranger all admins default password change request is in process..

ERROR StatusLogger Reconfiguration failed: No configuration found for '532760d8' at 'null' in 'null'

07:50:56.952 [main] ERROR org.apache.ranger.plugin.store.AbstractServiceStore - AbstractServiceStore.updateTagServiceDefForUpdatingAccessTypeshdfs): could not find TAG ServiceDef..

javax.ws.rs.WebApplicationException: null

        at org.apache.ranger.common.RESTErrorUtil.createRESTException(RESTErrorUtil.java:56) ~[classes/:3.0.0-SNAPSHOT]

        at org.apache.ranger.common.RESTErrorUtil.createRESTException(RESTErrorUtil.java:301) ~[classes/:3.0.0-SNAPSHOT]

        at org.apache.ranger.service.RangerBaseModelService.read(RangerBaseModelService.java:240) ~[classes/:?]

        at org.apache.ranger.biz.ServiceDBStore.getServiceDef(ServiceDBStore.java:1379) ~[classes/:?]

        at org.apache.ranger.plugin.store.AbstractServiceStore.updateTagServiceDefForUpdatingAccessTypes(AbstractServiceStore.java:288) ~[ranger-plugins-common-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]

        at org.apache.ranger.plugin.store.AbstractServiceStore.postCreate(AbstractServiceStore.java:128) ~[ranger-plugins-common-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]

        at org.apache.ranger.biz.ServiceDBStore.createServiceDef(ServiceDBStore.java:675) ~[classes/:?]

        at org.apache.ranger.plugin.store.EmbeddedServiceDefsUtil.getOrCreateServiceDef(EmbeddedServiceDefsUtil.java:295) ~[ranger-plugins-common-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]

        at org.apache.ranger.plugin.store.EmbeddedServiceDefsUtil.init(EmbeddedServiceDefsUtil.java:147) ~[ranger-plugins-common-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]

        at org.apache.ranger.biz.ServiceDBStore$1.doInTransaction(ServiceDBStore.java:398) ~[classes/:?]

        at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140) ~[spring-tx-5.3.7.jar:5.3.7]

        at org.apache.ranger.biz.ServiceDBStore.initStore(ServiceDBStore.java:395) ~[classes/:?]

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_282]

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_282]

...

        at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:144) [spring-context-5.3.7.jar:5.3.7]

        at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:95) [spring-context-5.3.7.jar:5.3.7]

        at org.apache.ranger.util.CLIUtil.init(CLIUtil.java:54) [classes/:?]

        at org.apache.ranger.util.CLIUtil.getBean(CLIUtil.java:62) [classes/:?]

        at org.apache.ranger.patch.cliutil.ChangePasswordUtil.main(ChangePasswordUtil.java:55) [classes/:?]