You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2020/01/13 22:12:46 UTC
[GitHub] [druid] ccaominh opened a new issue #9176: hdfs-storage extension
is missing org.codehaus.jackson.map.ObjectMapper
ccaominh opened a new issue #9176: hdfs-storage extension is missing org.codehaus.jackson.map.ObjectMapper
URL: https://github.com/apache/druid/issues/9176
### Affected Version
master and 0.17.0
### Description
`extensions-core/hdfs-storage/pom.xml` currently excludes `jackson-mapper-asl` to remove a security vulnerability, but `jackson-mapper-asl` is needed to provide `org.codehaus.jackson.map.ObjectMapper`:
```
2020-01-13T16:00:06,327 WARN [qtp415793386-164] org.apache.druid.segment.indexing.DataSchema - No granularitySpec has been specified. Using UniformGranularitySpec as default.
2020-01-13T16:00:06,327 WARN [qtp415793386-164] org.apache.druid.segment.indexing.DataSchema - No metricsSpec has been specified. Are you sure this is what you want?
2020-01-13T16:00:06,356 INFO [qtp415793386-164] org.apache.hadoop.hdfs.DFSClient - Created HDFS_DELEGATION_TOKEN token 161877450 for druid on ha-hdfs:titan
2020-01-13T16:00:06,393 ERROR [qtp415793386-164] com.sun.jersey.spi.container.ContainerResponse - The exception contained within MappableContainerException could not be mapped to a response, re-throwing to the HTTP container
java.lang.NoClassDefFoundError: org/codehaus/jackson/map/ObjectMapper
at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator.doDelegationTokenOperation(DelegationTokenAuthenticator.java:320) ~[?:?]
at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator.getDelegationToken(DelegationTokenAuthenticator.java:182) ~[?:?]
at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticatedURL.getDelegationToken(DelegationTokenAuthenticatedURL.java:382) ~[?:?]
at org.apache.hadoop.crypto.key.kms.KMSClientProvider$4.run(KMSClientProvider.java:1029) ~[?:?]
at org.apache.hadoop.crypto.key.kms.KMSClientProvider$4.run(KMSClientProvider.java:1023) ~[?:?]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_222]
at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_222]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1844) ~[?:?]
at org.apache.hadoop.crypto.key.kms.KMSClientProvider.addDelegationTokens(KMSClientProvider.java:1023 ~[?:?]
at org.apache.hadoop.crypto.key.kms.LoadBalancingKMSClientProvider$1.call(LoadBalancingKMSClientProvider.java:193) ~[?:?]
at org.apache.hadoop.crypto.key.kms.LoadBalancingKMSClientProvider$1.call(LoadBalancingKMSClientProvider.java:190) ~[?:?]
at org.apache.hadoop.crypto.key.kms.LoadBalancingKMSClientProvider.doOp(LoadBalancingKMSClientProvider.java:123) ~[?:?]
at org.apache.hadoop.crypto.key.kms.LoadBalancingKMSClientProvider.addDelegationTokens(LoadBalancingKMSClientProvider.java:190) ~[?:?]
at org.apache.hadoop.crypto.key.KeyProviderDelegationTokenExtension.addDelegationTokens(KeyProviderDelegationTokenExtension.java:110) ~[?:?]
at org.apache.hadoop.hdfs.HdfsKMSUtil.addDelegationTokensForKeyProvider(HdfsKMSUtil.java:83) ~[?:?]
at org.apache.hadoop.hdfs.DistributedFileSystem.addDelegationTokens(DistributedFileSystem.java:2516) ~[?:?]
at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:143) ~[?:?]
at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:102) ~[?:?]
at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:81) ~[?:?]
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:249) ~[?:?]
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:393) ~[?:?]
at org.apache.druid.inputsource.hdfs.HdfsInputSource.getPaths(HdfsInputSource.java:113) ~[?:?]
at org.apache.druid.inputsource.hdfs.HdfsInputSource.cachePathsIfNeeded(HdfsInputSource.java:199) ~[?:?]
at org.apache.druid.inputsource.hdfs.HdfsInputSource.createSplits(HdfsInputSource.java:173) ~[?:?]
at org.apache.druid.inputsource.hdfs.HdfsInputSource.formattableReader(HdfsInputSource.java:155) ~[?:?]
at org.apache.druid.data.input.AbstractInputSource.reader(AbstractInputSource.java:42) ~[druid-core-0.17.0-incubating-iap-preview4.jar:0.17.0-incubating-iap-preview4]
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] jihoonson commented on issue #9176: hdfs-storage extension
is missing org.codehaus.jackson.map.ObjectMapper
Posted by GitBox <gi...@apache.org>.
jihoonson commented on issue #9176: hdfs-storage extension is missing org.codehaus.jackson.map.ObjectMapper
URL: https://github.com/apache/druid/issues/9176#issuecomment-573930058
This doesn't happen with a simple Hadoop cluster, but happens with a secured Hadoop cluster with Kerberos.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] jihoonson closed issue #9176: hdfs-storage extension is
missing org.codehaus.jackson.map.ObjectMapper
Posted by GitBox <gi...@apache.org>.
jihoonson closed issue #9176: hdfs-storage extension is missing org.codehaus.jackson.map.ObjectMapper
URL: https://github.com/apache/druid/issues/9176
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org