You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@zookeeper.apache.org by Ronald Fenner <rf...@gamecircus.com> on 2019/11/20 01:18:40 UTC

Invalid config for 3.5.6 works in 3.4.13

I'm trying to migrate from 3.4.13 to 3.5.6 with exhibitor.

The following config generate by exhibitor work in 3.4.13 but I get an invalid config in 3.5.6

#Auto-generated by Exhibitor - Wed Nov 20 01:11:36 UTC 2019
#Wed Nov 20 01:11:36 UTC 2019
server.29=ip-172-30-10-149\:2888\:3888
server.30=ip-172-30-11-254\:2888\:3888
server.28=ip-172-30-12-46\:2888\:3888
initLimit=10
syncLimit=5
clientPort=2181
tickTime=2000
dataDir=/opt/zookeeper/snapshots
dataLogDir=/opt/zookeeper/logs

The log reads as

log4j:WARN No appenders could be found for logger (org.apache.zookeeper.server.quorum.QuorumPeerConfig).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

I've been trying to get more info from zookeeper on why it doesn't like the file but haven't been able to get anything else.

Ronald Fenner
Network Architect
Game Circus LLC.

rfenner@gamecircus.com


Re: Invalid config for 3.5.6 works in 3.4.13

Posted by Ronald Fenner <rf...@gamecircus.com>.
> On Nov 20, 2019, at 12:17 AM, Enrico Olivelli <eo...@gmail.com> wrote:
> 
> Hello Ronald,
> 
> Il mer 20 nov 2019, 02:18 Ronald Fenner <rfenner@gamecircus.com <ma...@gamecircus.com>> ha scritto:
> 
>> I'm trying to migrate from 3.4.13 to 3.5.6 with exhibitor.
>> 
>> The following config generate by exhibitor work in 3.4.13 but I get an
>> invalid config in 3.5.6
>> 
>> #Auto-generated by Exhibitor - Wed Nov 20 01:11:36 UTC 2019
>> #Wed Nov 20 01:11:36 UTC 2019
>> server.29=ip-172-30-10-149\:2888\:3888
>> 
> These '\' look a bit strange to me
> 
I tried removing them but it didn't help and the 3.4 branch runs with them in the config.

> server.30=ip-172-30-11-254\:2888\:3888
>> server.28=ip-172-30-12-46\:2888\:3888
>> initLimit=10
>> syncLimit=5
>> clientPort=2181
>> tickTime=2000
>> dataDir=/opt/zookeeper/snapshots
>> dataLogDir=/opt/zookeeper/logs
>> 
>> The log reads as
>> 
>> log4j:WARN No appenders could be found for logger
>> (org.apache.zookeeper.server.quorum.QuorumPeerConfig).
>> log4j:WARN Please initialize the log4j system properly.
>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
>> more info.
>> 
> 
> How did you update the server?
> It looks like you are missing the log4j configuration, did you change the
> startup scripts?
> 
> Enrico
> 

After some more troubleshooting and looking at the docs on server I found that exhibitor had yet to assign an id to the server so the myid file was missing. Adding the file and adding an entry in the server list for the current server with eh id I assigned, zookeeper was able to start.

A future enchantment would be better error messaging for invalid configuration as something specifying why it's invalid would have helped narrow the issue sooner.


> 
> 
>> I've been trying to get more info from zookeeper on why it doesn't like
>> the file but haven't been able to get anything else.
>> 
>> Ronald Fenner
>> Network Architect
>> Game Circus LLC.
>> 
>> rfenner@gamecircus.com <ma...@gamecircus.com>
Ronald Fenner
Network Architect
Game Circus LLC.

rfenner@gamecircus.com



Re: Invalid config for 3.5.6 works in 3.4.13

Posted by Enrico Olivelli <eo...@gmail.com>.
Hello Ronald,

Il mer 20 nov 2019, 02:18 Ronald Fenner <rf...@gamecircus.com> ha scritto:

> I'm trying to migrate from 3.4.13 to 3.5.6 with exhibitor.
>
> The following config generate by exhibitor work in 3.4.13 but I get an
> invalid config in 3.5.6
>
> #Auto-generated by Exhibitor - Wed Nov 20 01:11:36 UTC 2019
> #Wed Nov 20 01:11:36 UTC 2019
> server.29=ip-172-30-10-149\:2888\:3888
>
These '\' look a bit strange to me

server.30=ip-172-30-11-254\:2888\:3888
> server.28=ip-172-30-12-46\:2888\:3888
> initLimit=10
> syncLimit=5
> clientPort=2181
> tickTime=2000
> dataDir=/opt/zookeeper/snapshots
> dataLogDir=/opt/zookeeper/logs
>
> The log reads as
>
> log4j:WARN No appenders could be found for logger
> (org.apache.zookeeper.server.quorum.QuorumPeerConfig).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
>

How did you update the server?
It looks like you are missing the log4j configuration, did you change the
startup scripts?

Enrico



> I've been trying to get more info from zookeeper on why it doesn't like
> the file but haven't been able to get anything else.
>
> Ronald Fenner
> Network Architect
> Game Circus LLC.
>
> rfenner@gamecircus.com
>
>

Re: Invalid config for 3.5.6 works in 3.4.13

Posted by Ronald Fenner <rf...@gamecircus.com>.
Unfortunately I don't really have the time to try and work on it and java isn't my primary language not that I couldn't figure it out as I had to dive into the code to figure out the white listing and four letter word issue.

For now it works as is for me and isn't completely broken.

If you want you can add me and if I find time to add some updates to better handle the admin server and 4 letter words issues automatically then I can do that. 

Ronald Fenner
Network Architect
Game Circus LLC.

rfenner@gamecircus.com

> On Nov 20, 2019, at 1:08 PM, Jordan Zimmerman <jo...@jordanzimmerman.com> wrote:
> 
> I don't know. If you want to - Exhibitor is open to the community. I can add you as a committer to it.
> 
>> On Nov 20, 2019, at 2:06 PM, Ronald Fenner <rf...@gamecircus.com> wrote:
>> 
>> Agreed there hasn't been much done to develop exhibitor more since I started using it. I was able to get it to work with 3.5.6 mainly after enabling the 4 letter words on the whitelist.
>> 
>> Any suggestion on a replacement for exhibitor as I'm in the process up updating my cluster to 3.5.x from 3.4.x.
>> 
>> Ronald Fenner
>> Network Architect
>> Game Circus LLC.
>> 
>> rfenner@gamecircus.com
>> 
>>> On Nov 20, 2019, at 9:58 AM, Jordan Zimmerman <jo...@jordanzimmerman.com> wrote:
>>> 
>>> As far as I know, Exhibitor is a dead project. I abandoned it years ago and gave it to the community. It hasn't had much support since then.
>>> 
>>> FYI
>>> 
>>> -Jordan
>>> 
>>>> On Nov 19, 2019, at 8:18 PM, Ronald Fenner <rf...@gamecircus.com> wrote:
>>>> 
>>>> I'm trying to migrate from 3.4.13 to 3.5.6 with exhibitor.
>>>> 
>>>> The following config generate by exhibitor work in 3.4.13 but I get an invalid config in 3.5.6
>>>> 
>>>> #Auto-generated by Exhibitor - Wed Nov 20 01:11:36 UTC 2019
>>>> #Wed Nov 20 01:11:36 UTC 2019
>>>> server.29=ip-172-30-10-149\:2888\:3888
>>>> server.30=ip-172-30-11-254\:2888\:3888
>>>> server.28=ip-172-30-12-46\:2888\:3888
>>>> initLimit=10
>>>> syncLimit=5
>>>> clientPort=2181
>>>> tickTime=2000
>>>> dataDir=/opt/zookeeper/snapshots
>>>> dataLogDir=/opt/zookeeper/logs
>>>> 
>>>> The log reads as
>>>> 
>>>> log4j:WARN No appenders could be found for logger (org.apache.zookeeper.server.quorum.QuorumPeerConfig).
>>>> log4j:WARN Please initialize the log4j system properly.
>>>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
>>>> 
>>>> I've been trying to get more info from zookeeper on why it doesn't like the file but haven't been able to get anything else.
>>>> 
>>>> Ronald Fenner
>>>> Network Architect
>>>> Game Circus LLC.
>>>> 
>>>> rfenner@gamecircus.com
>>>> 
>>> 
>> 
> 


Re: Invalid config for 3.5.6 works in 3.4.13

Posted by Jordan Zimmerman <jo...@jordanzimmerman.com>.
I don't know. If you want to - Exhibitor is open to the community. I can add you as a committer to it.

> On Nov 20, 2019, at 2:06 PM, Ronald Fenner <rf...@gamecircus.com> wrote:
> 
> Agreed there hasn't been much done to develop exhibitor more since I started using it. I was able to get it to work with 3.5.6 mainly after enabling the 4 letter words on the whitelist.
> 
> Any suggestion on a replacement for exhibitor as I'm in the process up updating my cluster to 3.5.x from 3.4.x.
> 
> Ronald Fenner
> Network Architect
> Game Circus LLC.
> 
> rfenner@gamecircus.com
> 
>> On Nov 20, 2019, at 9:58 AM, Jordan Zimmerman <jo...@jordanzimmerman.com> wrote:
>> 
>> As far as I know, Exhibitor is a dead project. I abandoned it years ago and gave it to the community. It hasn't had much support since then.
>> 
>> FYI
>> 
>> -Jordan
>> 
>>> On Nov 19, 2019, at 8:18 PM, Ronald Fenner <rf...@gamecircus.com> wrote:
>>> 
>>> I'm trying to migrate from 3.4.13 to 3.5.6 with exhibitor.
>>> 
>>> The following config generate by exhibitor work in 3.4.13 but I get an invalid config in 3.5.6
>>> 
>>> #Auto-generated by Exhibitor - Wed Nov 20 01:11:36 UTC 2019
>>> #Wed Nov 20 01:11:36 UTC 2019
>>> server.29=ip-172-30-10-149\:2888\:3888
>>> server.30=ip-172-30-11-254\:2888\:3888
>>> server.28=ip-172-30-12-46\:2888\:3888
>>> initLimit=10
>>> syncLimit=5
>>> clientPort=2181
>>> tickTime=2000
>>> dataDir=/opt/zookeeper/snapshots
>>> dataLogDir=/opt/zookeeper/logs
>>> 
>>> The log reads as
>>> 
>>> log4j:WARN No appenders could be found for logger (org.apache.zookeeper.server.quorum.QuorumPeerConfig).
>>> log4j:WARN Please initialize the log4j system properly.
>>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
>>> 
>>> I've been trying to get more info from zookeeper on why it doesn't like the file but haven't been able to get anything else.
>>> 
>>> Ronald Fenner
>>> Network Architect
>>> Game Circus LLC.
>>> 
>>> rfenner@gamecircus.com
>>> 
>> 
> 


Re: Invalid config for 3.5.6 works in 3.4.13

Posted by Ronald Fenner <rf...@gamecircus.com>.
Agreed there hasn't been much done to develop exhibitor more since I started using it. I was able to get it to work with 3.5.6 mainly after enabling the 4 letter words on the whitelist.

Any suggestion on a replacement for exhibitor as I'm in the process up updating my cluster to 3.5.x from 3.4.x.

Ronald Fenner
Network Architect
Game Circus LLC.

rfenner@gamecircus.com

> On Nov 20, 2019, at 9:58 AM, Jordan Zimmerman <jo...@jordanzimmerman.com> wrote:
> 
> As far as I know, Exhibitor is a dead project. I abandoned it years ago and gave it to the community. It hasn't had much support since then.
> 
> FYI
> 
> -Jordan
> 
>> On Nov 19, 2019, at 8:18 PM, Ronald Fenner <rf...@gamecircus.com> wrote:
>> 
>> I'm trying to migrate from 3.4.13 to 3.5.6 with exhibitor.
>> 
>> The following config generate by exhibitor work in 3.4.13 but I get an invalid config in 3.5.6
>> 
>> #Auto-generated by Exhibitor - Wed Nov 20 01:11:36 UTC 2019
>> #Wed Nov 20 01:11:36 UTC 2019
>> server.29=ip-172-30-10-149\:2888\:3888
>> server.30=ip-172-30-11-254\:2888\:3888
>> server.28=ip-172-30-12-46\:2888\:3888
>> initLimit=10
>> syncLimit=5
>> clientPort=2181
>> tickTime=2000
>> dataDir=/opt/zookeeper/snapshots
>> dataLogDir=/opt/zookeeper/logs
>> 
>> The log reads as
>> 
>> log4j:WARN No appenders could be found for logger (org.apache.zookeeper.server.quorum.QuorumPeerConfig).
>> log4j:WARN Please initialize the log4j system properly.
>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
>> 
>> I've been trying to get more info from zookeeper on why it doesn't like the file but haven't been able to get anything else.
>> 
>> Ronald Fenner
>> Network Architect
>> Game Circus LLC.
>> 
>> rfenner@gamecircus.com
>> 
> 


Re: Invalid config for 3.5.6 works in 3.4.13

Posted by Jordan Zimmerman <jo...@jordanzimmerman.com>.
As far as I know, Exhibitor is a dead project. I abandoned it years ago and gave it to the community. It hasn't had much support since then.

FYI

-Jordan

> On Nov 19, 2019, at 8:18 PM, Ronald Fenner <rf...@gamecircus.com> wrote:
> 
> I'm trying to migrate from 3.4.13 to 3.5.6 with exhibitor.
> 
> The following config generate by exhibitor work in 3.4.13 but I get an invalid config in 3.5.6
> 
> #Auto-generated by Exhibitor - Wed Nov 20 01:11:36 UTC 2019
> #Wed Nov 20 01:11:36 UTC 2019
> server.29=ip-172-30-10-149\:2888\:3888
> server.30=ip-172-30-11-254\:2888\:3888
> server.28=ip-172-30-12-46\:2888\:3888
> initLimit=10
> syncLimit=5
> clientPort=2181
> tickTime=2000
> dataDir=/opt/zookeeper/snapshots
> dataLogDir=/opt/zookeeper/logs
> 
> The log reads as
> 
> log4j:WARN No appenders could be found for logger (org.apache.zookeeper.server.quorum.QuorumPeerConfig).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
> 
> I've been trying to get more info from zookeeper on why it doesn't like the file but haven't been able to get anything else.
> 
> Ronald Fenner
> Network Architect
> Game Circus LLC.
> 
> rfenner@gamecircus.com
>