You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by DomenicPuzio <do...@capitalone.com> on 2015/09/30 18:38:52 UTC
PutHDFS Configuration Issue
Hello,
I am trying to set up the PutHDFS processor on NiFi, and I am running into
an issue. I have the Hadoop Configuration Resources set and pointing to my
core-site.xml and hdfs-site.xml, and I have a Kerberos Principal and Keytab
file. However, I am getting the error below.
'Kerberos Principle' is invalid because you are missing the
nifi.kerberos.krb5.file property in nifi.properties.
However, in my
nifi/nifi-assembly/target/nifi-0.3.0-SNAPSHOT-bin/nifi-0.3.0-SNAPSHOT/conf/nifi.properties
file, I have a line saying "nifi.kerberos.krb5.file=/path/to/my/key.keytab"
(where I provide the actual path).
Can you provide any assistance? I'd truly appreciate it!
Thank you very much!
Domenic
--
View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/PutHDFS-Configuration-Issue-tp2998.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
Re: PutHDFS Configuration Issue
Posted by Ricky Saltzer <ri...@cloudera.com>.
Hey Domenic -
Since it looks like you're going to be using Kerberos, you should probably
be aware of NIFI-997 <https://issues.apache.org/jira/browse/NIFI-997>,
which I recently posted a patch to fix. Please let us know if any other
issues come up.
Ricky
On Wed, Sep 30, 2015 at 2:01 PM, Bryan Bende <bb...@gmail.com> wrote:
> Glad that first issue was resolved! I am by no means a kerberos expert, but
> having set this up once before, the setup should be something like the
> following:
>
> nifi.kerberos.krb5.file=/etc/krb5.conf (or wherever your conf file is)
>
> This is the file that would have your realms defined. Then on PutHDFS your
> properties would be something like:
>
> Kerberos Principal = myprinicpal@MYREALM
> Kerberos Keytab = /etc/security/keytabs/myprinciapl.keytab
>
> MYREALM would have to be defined in krb5.conf.
>
> -Bryan
>
>
> On Wed, Sep 30, 2015 at 1:04 PM, DomenicPuzio <
> domenic.puzio@capitalone.com>
> wrote:
>
> > Thank you so much for the quick reply! Restarting NiFi resolved the
> issue!
> > I
> > had not thought of that.
> >
> > However, a new issue was raised that I am currently working through:
> "Can't
> > find Kerberos realm". Do you have any idea where this should be set and
> > what
> > value it is looking for?
> >
> > I really appreciate the help!
> >
> >
> >
> > --
> > View this message in context:
> >
> http://apache-nifi-developer-list.39713.n7.nabble.com/PutHDFS-Configuration-Issue-tp2998p3003.html
> > Sent from the Apache NiFi Developer List mailing list archive at
> > Nabble.com.
> >
>
--
Ricky Saltzer
http://www.cloudera.com
Re: PutHDFS Configuration Issue
Posted by Bryan Bende <bb...@gmail.com>.
Glad that first issue was resolved! I am by no means a kerberos expert, but
having set this up once before, the setup should be something like the
following:
nifi.kerberos.krb5.file=/etc/krb5.conf (or wherever your conf file is)
This is the file that would have your realms defined. Then on PutHDFS your
properties would be something like:
Kerberos Principal = myprinicpal@MYREALM
Kerberos Keytab = /etc/security/keytabs/myprinciapl.keytab
MYREALM would have to be defined in krb5.conf.
-Bryan
On Wed, Sep 30, 2015 at 1:04 PM, DomenicPuzio <do...@capitalone.com>
wrote:
> Thank you so much for the quick reply! Restarting NiFi resolved the issue!
> I
> had not thought of that.
>
> However, a new issue was raised that I am currently working through: "Can't
> find Kerberos realm". Do you have any idea where this should be set and
> what
> value it is looking for?
>
> I really appreciate the help!
>
>
>
> --
> View this message in context:
> http://apache-nifi-developer-list.39713.n7.nabble.com/PutHDFS-Configuration-Issue-tp2998p3003.html
> Sent from the Apache NiFi Developer List mailing list archive at
> Nabble.com.
>
Re: PutHDFS Configuration Issue
Posted by DomenicPuzio <do...@capitalone.com>.
Thank you so much for the quick reply! Restarting NiFi resolved the issue! I
had not thought of that.
However, a new issue was raised that I am currently working through: "Can't
find Kerberos realm". Do you have any idea where this should be set and what
value it is looking for?
I really appreciate the help!
--
View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/PutHDFS-Configuration-Issue-tp2998p3003.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
Re: PutHDFS Configuration Issue
Posted by Bryan Bende <bb...@gmail.com>.
Sorry, hit send too soon, was going to say...
Also, there is a second check in the validation to make sure the keytab
file is readable, but I don't think that is the issue here because it would
produce a more specific error message.
-Bryan
On Wed, Sep 30, 2015 at 1:24 PM, Bryan Bende <bb...@gmail.com> wrote:
> Hi Domenic,
>
> It sounds like you are on the right path... just to confirm, did you
> restart NiFi after setting nifi.kerberos.krb5.file in nifi.properties?
>
> It will only pick up changes to nifi.properties on a restart.
>
> Also,
>
> On Wed, Sep 30, 2015 at 12:38 PM, DomenicPuzio <
> domenic.puzio@capitalone.com> wrote:
>
>> Hello,
>>
>> I am trying to set up the PutHDFS processor on NiFi, and I am running into
>> an issue. I have the Hadoop Configuration Resources set and pointing to my
>> core-site.xml and hdfs-site.xml, and I have a Kerberos Principal and
>> Keytab
>> file. However, I am getting the error below.
>>
>> 'Kerberos Principle' is invalid because you are missing the
>> nifi.kerberos.krb5.file property in nifi.properties.
>>
>> However, in my
>>
>> nifi/nifi-assembly/target/nifi-0.3.0-SNAPSHOT-bin/nifi-0.3.0-SNAPSHOT/conf/nifi.properties
>> file, I have a line saying
>> "nifi.kerberos.krb5.file=/path/to/my/key.keytab"
>> (where I provide the actual path).
>>
>> Can you provide any assistance? I'd truly appreciate it!
>>
>> Thank you very much!
>>
>> Domenic
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-nifi-developer-list.39713.n7.nabble.com/PutHDFS-Configuration-Issue-tp2998.html
>> Sent from the Apache NiFi Developer List mailing list archive at
>> Nabble.com.
>>
>
>
Re: PutHDFS Configuration Issue
Posted by Bryan Bende <bb...@gmail.com>.
Hi Domenic,
It sounds like you are on the right path... just to confirm, did you
restart NiFi after setting nifi.kerberos.krb5.file in nifi.properties?
It will only pick up changes to nifi.properties on a restart.
Also,
On Wed, Sep 30, 2015 at 12:38 PM, DomenicPuzio <domenic.puzio@capitalone.com
> wrote:
> Hello,
>
> I am trying to set up the PutHDFS processor on NiFi, and I am running into
> an issue. I have the Hadoop Configuration Resources set and pointing to my
> core-site.xml and hdfs-site.xml, and I have a Kerberos Principal and Keytab
> file. However, I am getting the error below.
>
> 'Kerberos Principle' is invalid because you are missing the
> nifi.kerberos.krb5.file property in nifi.properties.
>
> However, in my
>
> nifi/nifi-assembly/target/nifi-0.3.0-SNAPSHOT-bin/nifi-0.3.0-SNAPSHOT/conf/nifi.properties
> file, I have a line saying "nifi.kerberos.krb5.file=/path/to/my/key.keytab"
> (where I provide the actual path).
>
> Can you provide any assistance? I'd truly appreciate it!
>
> Thank you very much!
>
> Domenic
>
>
>
> --
> View this message in context:
> http://apache-nifi-developer-list.39713.n7.nabble.com/PutHDFS-Configuration-Issue-tp2998.html
> Sent from the Apache NiFi Developer List mailing list archive at
> Nabble.com.
>