You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@zookeeper.apache.org by Dan Simoes <da...@tcell.io> on 2018/06/28 14:27:54 UTC
3.4.6 to 3.4.12 weird issue
New to the list, howdy.
I've read about the issue with dataLogDir and dataDir in 3.4.10 (
https://issues.apache.org/jira/browse/ZOOKEEPER-2960) and how it's fixed in
3.4.12.
I have a running cluster with 3.4.6, with defined:
dataDir=/var/lib/zookeeper
dataLogDir=/mnt/zookeeper
My running 3.4.6 looks like this:
zookeep+ 15096 1 5 06:42 pts/2 00:00:04
/usr/lib/jvm/java-8-oracle/bin/java -Dzookeeper.log.dir=/var/log/zookeeper
-Dzookeeper.root.logger=INFO,ROLLINGFILE -cp
/opt/zookeeper/bin/../build/classes:/opt/zookeeper/bin/../build/lib/*.jar:/opt/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/opt/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/opt/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/zookeeper/bin/../lib/jline-0.9.94.jar:/opt/zookeeper/bin/../zookeeper-3.4.6.jar:/opt/zookeeper/bin/../src/java/lib/*.jar:/opt/zookeeper/bin/../conf:
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.local.only=false
org.apache.zookeeper.server.quorum.QuorumPeerMain
/opt/zookeeper/bin/../conf/zoo.cfg
When I start 3.4.12 with the same config file (zoo.cfg) this is how it
appears:
zookeep+ 1385 1 5 06:40 pts/2 00:00:04
/usr/lib/jvm/java-8-oracle/bin/java -Dzookeeper.log.dir=.
-Dzookeeper.root.logger=INFO,CONSOLE -cp
/opt/zookeeper/bin/../build/classes:/opt/zookeeper/bin/../build/lib/*.jar:/opt/zookeeper/bin/../lib/slf4j-log4j12-1.7.25.jar:/opt/zookeeper/bin/../lib/slf4j-api-1.7.25.jar:/opt/zookeeper/bin/../lib/netty-3.10.6.Final.jar:/opt/zookeeper/bin/../lib/log4j-1.2.17.jar:/opt/zookeeper/bin/../lib/jline-0.9.94.jar:/opt/zookeeper/bin/../lib/audience-annotations-0.5.0.jar:/opt/zookeeper/bin/../zookeeper-3.4.12.jar:/opt/zookeeper/bin/../src/java/lib/*.jar:/opt/zookeeper/bin/../conf:
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.local.only=false
org.apache.zookeeper.server.quorum.QuorumPeerMain
/opt/zookeeper/bin/../conf/zoo.cfg
Notice that first D flag on 3.4.12 - Dzookeeper.log.dir=.
Why is it ignoring what I have set in zoo.cfg?
Any insight would be appreciated. Thanks.
Dan
Re: 3.4.6 to 3.4.12 weird issue
Posted by Dan Simoes <da...@tcell.io>.
Yes. Another odd thing - I didn’t see this issue on our staging cluster which has the same code and configs.
> On Jun 28, 2018, at 10:27 AM, Camille Fournier <ca...@apache.org> wrote:
>
> How are you launching the cluster? Are you using zkServer.sh to run it?
>
>> On Thu, Jun 28, 2018 at 2:28 PM Dan Simoes <da...@tcell.io> wrote:
>>
>> New to the list, howdy.
>> I've read about the issue with dataLogDir and dataDir in 3.4.10 (
>> https://issues.apache.org/jira/browse/ZOOKEEPER-2960) and how it's fixed
>> in
>> 3.4.12.
>>
>> I have a running cluster with 3.4.6, with defined:
>> dataDir=/var/lib/zookeeper
>> dataLogDir=/mnt/zookeeper
>>
>> My running 3.4.6 looks like this:
>> zookeep+ 15096 1 5 06:42 pts/2 00:00:04
>> /usr/lib/jvm/java-8-oracle/bin/java -Dzookeeper.log.dir=/var/log/zookeeper
>> -Dzookeeper.root.logger=INFO,ROLLINGFILE -cp
>>
>> /opt/zookeeper/bin/../build/classes:/opt/zookeeper/bin/../build/lib/*.jar:/opt/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/opt/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/opt/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/zookeeper/bin/../lib/jline-0.9.94.jar:/opt/zookeeper/bin/../zookeeper-3.4.6.jar:/opt/zookeeper/bin/../src/java/lib/*.jar:/opt/zookeeper/bin/../conf:
>> -Dcom.sun.management.jmxremote
>> -Dcom.sun.management.jmxremote.local.only=false
>> org.apache.zookeeper.server.quorum.QuorumPeerMain
>> /opt/zookeeper/bin/../conf/zoo.cfg
>>
>> When I start 3.4.12 with the same config file (zoo.cfg) this is how it
>> appears:
>> zookeep+ 1385 1 5 06:40 pts/2 00:00:04
>> /usr/lib/jvm/java-8-oracle/bin/java -Dzookeeper.log.dir=.
>> -Dzookeeper.root.logger=INFO,CONSOLE -cp
>>
>> /opt/zookeeper/bin/../build/classes:/opt/zookeeper/bin/../build/lib/*.jar:/opt/zookeeper/bin/../lib/slf4j-log4j12-1.7.25.jar:/opt/zookeeper/bin/../lib/slf4j-api-1.7.25.jar:/opt/zookeeper/bin/../lib/netty-3.10.6.Final.jar:/opt/zookeeper/bin/../lib/log4j-1.2.17.jar:/opt/zookeeper/bin/../lib/jline-0.9.94.jar:/opt/zookeeper/bin/../lib/audience-annotations-0.5.0.jar:/opt/zookeeper/bin/../zookeeper-3.4.12.jar:/opt/zookeeper/bin/../src/java/lib/*.jar:/opt/zookeeper/bin/../conf:
>> -Dcom.sun.management.jmxremote
>> -Dcom.sun.management.jmxremote.local.only=false
>> org.apache.zookeeper.server.quorum.QuorumPeerMain
>> /opt/zookeeper/bin/../conf/zoo.cfg
>>
>> Notice that first D flag on 3.4.12 - Dzookeeper.log.dir=.
>> Why is it ignoring what I have set in zoo.cfg?
>>
>> Any insight would be appreciated. Thanks.
>> Dan
>>
Re: 3.4.6 to 3.4.12 weird issue
Posted by Andor Molnar <an...@cloudera.com.INVALID>.
Hi Dan,
Your issue is probably not related to the dataLogDir issue that you
referenced.
"-Dzookeeper.log.dir=/var/log/zookeeper" is the folder where ZooKeeper log
files will be stored, but dataLogDir is for *transaction *log files. (and
dataDir is for snapshots)
Anyway, I'd like to know how exactly do you run your server. I suspect
there's an environment variable which have been lost during the upgrade.
Regards,
Andor
On Thu, Jun 28, 2018 at 7:43 PM, s n <sv...@gmail.com> wrote:
> isn't this limited to 3.4.11 and not found in 3.4.10 ?
>
> On Thu, Jun 28, 2018 at 10:27 AM, Camille Fournier <ca...@apache.org>
> wrote:
>
> > How are you launching the cluster? Are you using zkServer.sh to run it?
> >
> > On Thu, Jun 28, 2018 at 2:28 PM Dan Simoes <da...@tcell.io> wrote:
> >
> > > New to the list, howdy.
> > > I've read about the issue with dataLogDir and dataDir in 3.4.10 (
> > > https://issues.apache.org/jira/browse/ZOOKEEPER-2960) and how it's
> fixed
> > > in
> > > 3.4.12.
> > >
> > > I have a running cluster with 3.4.6, with defined:
> > > dataDir=/var/lib/zookeeper
> > > dataLogDir=/mnt/zookeeper
> > >
> > > My running 3.4.6 looks like this:
> > > zookeep+ 15096 1 5 06:42 pts/2 00:00:04
> > > /usr/lib/jvm/java-8-oracle/bin/java -Dzookeeper.log.dir=/var/log/
> > zookeeper
> > > -Dzookeeper.root.logger=INFO,ROLLINGFILE -cp
> > >
> > > /opt/zookeeper/bin/../build/classes:/opt/zookeeper/bin/../
> > build/lib/*.jar:/opt/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/
> > zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/opt/zookeeper/
> > bin/../lib/netty-3.7.0.Final.jar:/opt/zookeeper/bin/../lib/
> > log4j-1.2.16.jar:/opt/zookeeper/bin/../lib/jline-0.
> > 9.94.jar:/opt/zookeeper/bin/../zookeeper-3.4.6.jar:/opt/
> > zookeeper/bin/../src/java/lib/*.jar:/opt/zookeeper/bin/../conf:
> > > -Dcom.sun.management.jmxremote
> > > -Dcom.sun.management.jmxremote.local.only=false
> > > org.apache.zookeeper.server.quorum.QuorumPeerMain
> > > /opt/zookeeper/bin/../conf/zoo.cfg
> > >
> > > When I start 3.4.12 with the same config file (zoo.cfg) this is how it
> > > appears:
> > > zookeep+ 1385 1 5 06:40 pts/2 00:00:04
> > > /usr/lib/jvm/java-8-oracle/bin/java -Dzookeeper.log.dir=.
> > > -Dzookeeper.root.logger=INFO,CONSOLE -cp
> > >
> > > /opt/zookeeper/bin/../build/classes:/opt/zookeeper/bin/../
> > build/lib/*.jar:/opt/zookeeper/bin/../lib/slf4j-log4j12-1.7.25.jar:/opt/
> > zookeeper/bin/../lib/slf4j-api-1.7.25.jar:/opt/zookeeper/
> > bin/../lib/netty-3.10.6.Final.jar:/opt/zookeeper/bin/../lib/
> > log4j-1.2.17.jar:/opt/zookeeper/bin/../lib/jline-0.
> > 9.94.jar:/opt/zookeeper/bin/../lib/audience-annotations-0.5.
> > 0.jar:/opt/zookeeper/bin/../zookeeper-3.4.12.jar:/opt/
> > zookeeper/bin/../src/java/lib/*.jar:/opt/zookeeper/bin/../conf:
> > > -Dcom.sun.management.jmxremote
> > > -Dcom.sun.management.jmxremote.local.only=false
> > > org.apache.zookeeper.server.quorum.QuorumPeerMain
> > > /opt/zookeeper/bin/../conf/zoo.cfg
> > >
> > > Notice that first D flag on 3.4.12 - Dzookeeper.log.dir=.
> > > Why is it ignoring what I have set in zoo.cfg?
> > >
> > > Any insight would be appreciated. Thanks.
> > > Dan
> > >
> >
>
Re: 3.4.6 to 3.4.12 weird issue
Posted by s n <sv...@gmail.com>.
isn't this limited to 3.4.11 and not found in 3.4.10 ?
On Thu, Jun 28, 2018 at 10:27 AM, Camille Fournier <ca...@apache.org>
wrote:
> How are you launching the cluster? Are you using zkServer.sh to run it?
>
> On Thu, Jun 28, 2018 at 2:28 PM Dan Simoes <da...@tcell.io> wrote:
>
> > New to the list, howdy.
> > I've read about the issue with dataLogDir and dataDir in 3.4.10 (
> > https://issues.apache.org/jira/browse/ZOOKEEPER-2960) and how it's fixed
> > in
> > 3.4.12.
> >
> > I have a running cluster with 3.4.6, with defined:
> > dataDir=/var/lib/zookeeper
> > dataLogDir=/mnt/zookeeper
> >
> > My running 3.4.6 looks like this:
> > zookeep+ 15096 1 5 06:42 pts/2 00:00:04
> > /usr/lib/jvm/java-8-oracle/bin/java -Dzookeeper.log.dir=/var/log/
> zookeeper
> > -Dzookeeper.root.logger=INFO,ROLLINGFILE -cp
> >
> > /opt/zookeeper/bin/../build/classes:/opt/zookeeper/bin/../
> build/lib/*.jar:/opt/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/
> zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/opt/zookeeper/
> bin/../lib/netty-3.7.0.Final.jar:/opt/zookeeper/bin/../lib/
> log4j-1.2.16.jar:/opt/zookeeper/bin/../lib/jline-0.
> 9.94.jar:/opt/zookeeper/bin/../zookeeper-3.4.6.jar:/opt/
> zookeeper/bin/../src/java/lib/*.jar:/opt/zookeeper/bin/../conf:
> > -Dcom.sun.management.jmxremote
> > -Dcom.sun.management.jmxremote.local.only=false
> > org.apache.zookeeper.server.quorum.QuorumPeerMain
> > /opt/zookeeper/bin/../conf/zoo.cfg
> >
> > When I start 3.4.12 with the same config file (zoo.cfg) this is how it
> > appears:
> > zookeep+ 1385 1 5 06:40 pts/2 00:00:04
> > /usr/lib/jvm/java-8-oracle/bin/java -Dzookeeper.log.dir=.
> > -Dzookeeper.root.logger=INFO,CONSOLE -cp
> >
> > /opt/zookeeper/bin/../build/classes:/opt/zookeeper/bin/../
> build/lib/*.jar:/opt/zookeeper/bin/../lib/slf4j-log4j12-1.7.25.jar:/opt/
> zookeeper/bin/../lib/slf4j-api-1.7.25.jar:/opt/zookeeper/
> bin/../lib/netty-3.10.6.Final.jar:/opt/zookeeper/bin/../lib/
> log4j-1.2.17.jar:/opt/zookeeper/bin/../lib/jline-0.
> 9.94.jar:/opt/zookeeper/bin/../lib/audience-annotations-0.5.
> 0.jar:/opt/zookeeper/bin/../zookeeper-3.4.12.jar:/opt/
> zookeeper/bin/../src/java/lib/*.jar:/opt/zookeeper/bin/../conf:
> > -Dcom.sun.management.jmxremote
> > -Dcom.sun.management.jmxremote.local.only=false
> > org.apache.zookeeper.server.quorum.QuorumPeerMain
> > /opt/zookeeper/bin/../conf/zoo.cfg
> >
> > Notice that first D flag on 3.4.12 - Dzookeeper.log.dir=.
> > Why is it ignoring what I have set in zoo.cfg?
> >
> > Any insight would be appreciated. Thanks.
> > Dan
> >
>
Re: 3.4.6 to 3.4.12 weird issue
Posted by Camille Fournier <ca...@apache.org>.
How are you launching the cluster? Are you using zkServer.sh to run it?
On Thu, Jun 28, 2018 at 2:28 PM Dan Simoes <da...@tcell.io> wrote:
> New to the list, howdy.
> I've read about the issue with dataLogDir and dataDir in 3.4.10 (
> https://issues.apache.org/jira/browse/ZOOKEEPER-2960) and how it's fixed
> in
> 3.4.12.
>
> I have a running cluster with 3.4.6, with defined:
> dataDir=/var/lib/zookeeper
> dataLogDir=/mnt/zookeeper
>
> My running 3.4.6 looks like this:
> zookeep+ 15096 1 5 06:42 pts/2 00:00:04
> /usr/lib/jvm/java-8-oracle/bin/java -Dzookeeper.log.dir=/var/log/zookeeper
> -Dzookeeper.root.logger=INFO,ROLLINGFILE -cp
>
> /opt/zookeeper/bin/../build/classes:/opt/zookeeper/bin/../build/lib/*.jar:/opt/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/opt/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/opt/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/zookeeper/bin/../lib/jline-0.9.94.jar:/opt/zookeeper/bin/../zookeeper-3.4.6.jar:/opt/zookeeper/bin/../src/java/lib/*.jar:/opt/zookeeper/bin/../conf:
> -Dcom.sun.management.jmxremote
> -Dcom.sun.management.jmxremote.local.only=false
> org.apache.zookeeper.server.quorum.QuorumPeerMain
> /opt/zookeeper/bin/../conf/zoo.cfg
>
> When I start 3.4.12 with the same config file (zoo.cfg) this is how it
> appears:
> zookeep+ 1385 1 5 06:40 pts/2 00:00:04
> /usr/lib/jvm/java-8-oracle/bin/java -Dzookeeper.log.dir=.
> -Dzookeeper.root.logger=INFO,CONSOLE -cp
>
> /opt/zookeeper/bin/../build/classes:/opt/zookeeper/bin/../build/lib/*.jar:/opt/zookeeper/bin/../lib/slf4j-log4j12-1.7.25.jar:/opt/zookeeper/bin/../lib/slf4j-api-1.7.25.jar:/opt/zookeeper/bin/../lib/netty-3.10.6.Final.jar:/opt/zookeeper/bin/../lib/log4j-1.2.17.jar:/opt/zookeeper/bin/../lib/jline-0.9.94.jar:/opt/zookeeper/bin/../lib/audience-annotations-0.5.0.jar:/opt/zookeeper/bin/../zookeeper-3.4.12.jar:/opt/zookeeper/bin/../src/java/lib/*.jar:/opt/zookeeper/bin/../conf:
> -Dcom.sun.management.jmxremote
> -Dcom.sun.management.jmxremote.local.only=false
> org.apache.zookeeper.server.quorum.QuorumPeerMain
> /opt/zookeeper/bin/../conf/zoo.cfg
>
> Notice that first D flag on 3.4.12 - Dzookeeper.log.dir=.
> Why is it ignoring what I have set in zoo.cfg?
>
> Any insight would be appreciated. Thanks.
> Dan
>