You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2018/11/28 08:06:41 UTC
[GitHub] Tagar opened a new issue #6675: Kerberos support for Hadoop indexer?
Tagar opened a new issue #6675: Kerberos support for Hadoop indexer?
URL: https://github.com/apache/incubator-druid/issues/6675
Getting following error when trying to run hadoop indexer
> 2018-11-28T08:01:52,341 ERROR [main] io.druid.cli.CliHadoopIndexer - failure!!!!
> java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_162]
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_162]
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_162]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_162]
> at io.druid.cli.CliHadoopIndexer.run(CliHadoopIndexer.java:117) [druid-services-0.12.3.jar:0.12.3]
> at io.druid.cli.Main.main(Main.java:116) [druid-services-0.12.3.jar:0.12.3]
> Caused by: java.lang.RuntimeException: org.apache.hadoop.security.AccessControlException: SIMPLE authentication is not enabled. Available:[TOKEN, KERBEROS]
> at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.1.jar:?]
> at io.druid.indexer.DetermineHashedPartitionsJob.run(DetermineHashedPartitionsJob.java:209) ~[druid-indexing-hadoop-0.12.3.jar:0.12.3]
> at io.druid.indexer.JobHelper.runJobs(JobHelper.java:369) ~[druid-indexing-hadoop-0.12.3.jar:0.12.3]
> at io.druid.indexer.HadoopDruidDetermineConfigurationJob.run(HadoopDruidDetermineConfigurationJob.java:91) ~[druid-indexing-hadoop-0.12.3.jar:0.12.3]
> at io.druid.indexer.JobHelper.runJobs(JobHelper.java:369) ~[druid-indexing-hadoop-0.12.3.jar:0.12.3]
> at io.druid.cli.CliInternalHadoopIndexer.run(CliInternalHadoopIndexer.java:132) ~[druid-services-0.12.3.jar:0.12.3]
> at io.druid.cli.Main.main(Main.java:116) ~[druid-services-0.12.3.jar:0.12.3]
> ... 6 more
> Caused by: org.apache.hadoop.security.AccessControlException: SIMPLE authentication is not enabled. Available:[TOKEN, KERBEROS]
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_162]
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:1.8.0_162]
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:1.8.0_162]
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[?:1.8.0_162]
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) ~[hadoop-common-2.6.5.jar:?]
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73) ~[hadoop-common-2.6.5.jar:?]
> at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1960) ~[hadoop-hdfs-2.6.5.jar:?]
> at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1941) ~[hadoop-hdfs-2.6.5.jar:?]
> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:693) ~[hadoop-hdfs-2.6.5.jar:?]
> at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:105) ~[hadoop-hdfs-2.6.5.jar:?]
> at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:755) ~[hadoop-hdfs-2.6.5.jar:?]
> at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:751) ~[hadoop-hdfs-2.6.5.jar:?]
> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) ~[hadoop-common-2.6.5.jar:?]
> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:751) ~[hadoop-hdfs-2.6.5.jar:?]
> at org.apache.hadoop.fs.Globber.listStatus(Globber.java:69) ~[hadoop-common-2.6.5.jar:?]
> at org.apache.hadoop.fs.Globber.glob(Globber.java:217) ~[hadoop-common-2.6.5.jar:?]
> at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1644) ~[hadoop-common-2.6.5.jar:?]
>
Our Hadoop is secured / kerberized, so it seems Druid Hadoop Indexer doesn't try to use Kerberos for authentication..
We do have `druid.hadoop.security.kerberos.principal` and `druid.hadoop.security.kerberos.keytab`
set accordingly..
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org