You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by Gareth Poulton <gp...@gmail.com> on 2017/08/15 11:35:00 UTC
Kerberos installation
Hi,
I'm trying to find documentation on the steps needed to ensure Ignite will
work on a kerberized HDP cluster, but have not had much luck with the
official docs or with Google. Can anyone advise on this please?
I'm sure the steps are probably relatively simple, but we need to know
specifically what they are in advance for project reasons.
thanks,
Gareth
Re: Kerberos installation
Posted by Raghav <pu...@gmail.com>.
Hello Ravi,
Were you able to solve this issue?
If so, kindly request you to post the correct configurations for Kerberos
enabled Ignite Installation.
Thanks in Advance!!!
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Kerberos installation
Posted by ravi <me...@gmail.com>.
Hi Evgenii,
Thanks for the reply. We wanted to use ignite on top of the existing
kerberized hadoop/hive deployment with out any code change(Means used HDFS
as secondary file system and refer ignite specific config files while
accessing hdfs and not writing any java code).
In this case can you provide the needed ignite config file which has
KerberosHadoopFileSystemFactory and its allowed properties?. We are not
finding the enough documentation.
Please reply.
Regards
Ravi
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Kerberos-installation-tp16200p16440.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Kerberos installation
Posted by Evgenii Zhuravlev <e....@gmail.com>.
Hi, take a look for a KerberosHadoopFileSystemFactory,it can be used in
kerberized hadoop env:
KerberosHadoopFileSystemFactory delegate = new
KerberosHadoopFileSystemFactory();
delegate.setKeyTab("foo.keytab");
delegate.setKeyTabPrincipal("foo");
delegate.setReloginInterval(0);
Evgenii
2017-08-26 18:09 GMT+03:00 ravi <me...@gmail.com>:
> Hi,
> I have kerberos enabled zookeeper based hadoop HA environment. With out
> ignite, I am able to access my hadoop file system with valid kerberos
> ticket.
> However by running the below command, I am getting below exception. Is
> there anything i am missing in default-config.xml?. Can u provide some
> proper documentation to make hdfs as secondary file system ( kerberos
> enabled hadoop environment ) to ignite?.
>
> $HADOOP_HOME/bin/hdfs --config /$HADOOP_HOME/ignite_conf dfs -mkdir /tut1
>
> Ignote default-config.xml:- (Hadoop as secondary file system)
>
> <property name="secondaryFileSystem">
> <bean
> class="org.apache.ignite.hadoop.fs.IgniteHadoopIgfsSecondaryFileSystem">
> <property name="fileSystemFactory">
> <bean
> class="org.apache.ignite.hadoop.fs.CachingHadoopFileSystemFactory">
> <property name="uri"
> value="hdfs://192.168.126.207:8020/"/>
> <property name="configPaths">
> <list>
>
> <value>/opt/Ignite2/ignite-hadoop-2.1.0/config/hadoop/
> core-site.xml</value>
> </list>
> </property>
> </bean>
> </property>
> </bean>
> </property>
>
>
>
> Stack Trace:-
>
> Caused by:
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.
> AccessControlException):
> SIMPLE authentication is not enabled. Available:[TOKEN, KERBEROS]
> at org.apache.hadoop.ipc.Client.call(Client.java:1475)
> [2017-08-26 18:50:11,731][ERROR][igfs-igfs-ipc-#63%null%][IgfsImpl] File
> info operation in DUAL mode failed [path=/tut1]
> class org.apache.ignite.igfs.IgfsException: Failed to get file status
> [path=/tut1]
>
>
>
>
> --
> View this message in context: http://apache-ignite-users.
> 70518.x6.nabble.com/Kerberos-installation-tp16200p16427.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>
Re: Kerberos installation
Posted by ravi <me...@gmail.com>.
Hi,
I have kerberos enabled zookeeper based hadoop HA environment. With out
ignite, I am able to access my hadoop file system with valid kerberos
ticket.
However by running the below command, I am getting below exception. Is
there anything i am missing in default-config.xml?. Can u provide some
proper documentation to make hdfs as secondary file system ( kerberos
enabled hadoop environment ) to ignite?.
$HADOOP_HOME/bin/hdfs --config /$HADOOP_HOME/ignite_conf dfs -mkdir /tut1
Ignote default-config.xml:- (Hadoop as secondary file system)
<property name="secondaryFileSystem">
<bean
class="org.apache.ignite.hadoop.fs.IgniteHadoopIgfsSecondaryFileSystem">
<property name="fileSystemFactory">
<bean
class="org.apache.ignite.hadoop.fs.CachingHadoopFileSystemFactory">
<property name="uri"
value="hdfs://192.168.126.207:8020/"/>
<property name="configPaths">
<list>
<value>/opt/Ignite2/ignite-hadoop-2.1.0/config/hadoop/core-site.xml</value>
</list>
</property>
</bean>
</property>
</bean>
</property>
Stack Trace:-
Caused by:
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException):
SIMPLE authentication is not enabled. Available:[TOKEN, KERBEROS]
at org.apache.hadoop.ipc.Client.call(Client.java:1475)
[2017-08-26 18:50:11,731][ERROR][igfs-igfs-ipc-#63%null%][IgfsImpl] File
info operation in DUAL mode failed [path=/tut1]
class org.apache.ignite.igfs.IgfsException: Failed to get file status
[path=/tut1]
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Kerberos-installation-tp16200p16427.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Kerberos installation
Posted by ezhuravlev <e....@gmail.com>.
Have you checked this link:
https://apacheignite-fs.readme.io/docs/file-system ?
You need to configure IGFS for hadoop and Ignite should use Hadoop api to
work with Kerberos
Evgenii
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Kerberos-installation-tp16200p16204.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.