Re: Nifi Clustering not working

[Peter Wilcsinszky <pe...@gmail.com>]

Jonathan,

I think the issue is with how you apply the overrides in the properties
file. I've removed the trailing comments from the overriden lines and it
seems to be working.

Peter

On Fri, Apr 20, 2018 at 11:01 AM, Peter Wilcsinszky <
peterwilcsinszky@gmail.com> wrote:

> Hi,
>
> I've tested your statefulset and it seems it doesn't even try to connect
> to zookeeper to form a cluster, although the config looks good. I'm still
> new to this, but will dig deeper later.
>
> Peter
>
> On Tue, Apr 17, 2018 at 6:55 PM, Jonathan Kosgei <
> jonathan@saharacluster.com> wrote:
>
>> Thank you for the tips.
>>
>>
>>
>> I've tried setting the fqdn as the hosts and made sure each was pingeable
>> from all the other nodes with no luck.
>>
>>
>>
>> In particular I see this error a lot;
>>
>>
>>
>>
>>
>> Unable to locate group with id 'd4779129-0162-1000-982f-9436d01eb801'.
>>
>>
>>
>> I'm wondering if I might have a port closed that should be open, is there
>> any list of all official ports? Looking in my logs the bootstrap port seems
>> to be different each time and I wonder if maybe they need to be accessible
>> for each pod?
>>
>>
>>
>> Here's a trimmed down version of my logs (not in DEBUG mode);
>>
>>
>>
>> nifi-app.log
>>
>> https://gist.github.com/jonathan-kosgei/81936b7e59a563f55111bfe5be06e8bc
>>
>>
>>
>> nifi-user.log
>>
>> https://gist.github.com/jonathan-kosgei/19ce9929a764a40ac74a84fdcac2b3e2
>>
>>
>>
>> nifi-bootrap.log
>>
>> https://gist.github.com/jonathan-kosgei/e7396f558cbcd9a20cf6c0dca72c2728
>>
>>
>>
>> My Statefulset and Services
>>
>> https://gist.github.com/jonathan-kosgei/49a628edab109ba39da8598caf0e4f1e
>>
>>
>>
>> Thanks!
>>
>>
>