You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@zookeeper.apache.org by kuldeep singh <ku...@gmail.com> on 2020/06/22 10:50:18 UTC
Re: upgrade from 3.4.5 to 3.5.6
Hi Team,
How we will do secure communication between the Curator framework and
zookeeper 3.5.6 ?
I didn't get any solution right now.
I appreciate it if someone could help me with the same.
Thanks,
---------------------
Kuldeep Singh Budania
Software Architect
On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <sz...@gmail.com>
wrote:
> Hello Kuldeep,
>
> did you download the source from the ZooKeeper webpage, or checked out from
> git?
> Anyway, the following commands should work:
>
> wget
>
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
> cd apache-zookeeper-3.5.7
> mvn clean install -DskipTests
>
> I tested it with OpenJDK 8u424 and maven 3.6.0.
>
> Kind regards,
> Mate
>
>
> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <ku...@gmail.com>
> wrote:
>
> > Hi All,
> >
> > I have download the zookeeper source code and run the mvn command for
> > packaging but get problem on "zookeeper-server" directory.
> >
> > *command :- mvn clean package*
> >
> > [ERROR] Failed to execute goal
> > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > (default-compile) on project zookeeper: Fatal error compiling:
> > java.lang.NullPointerException -> [Help 1]
> > org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> > goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > (default-compile) on project zookeeper: Fatal error compiling
> > at
> >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> > at
> >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> > at
> >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> > at
> >
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> > at
> >
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> > at
> >
> >
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> > at
> >
> >
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> > at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> > at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> > at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> > at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> > at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:498)
> > at
> >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> > at
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> > at
> >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> > at
> > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> > Caused by: org.apache.maven.plugin.MojoExecutionException: Fatal error
> > compiling
> > at
> >
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> > at
> >
> >
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> > at
> >
> >
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> > at
> >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> > ... 19 more
> > Caused by: org.codehaus.plexus.compiler.CompilerException:
> > java.lang.NullPointerException
> > at
> >
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> > at
> >
> >
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> > at
> >
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> > ... 22 more
> > Caused by: java.lang.RuntimeException: java.lang.NullPointerException
> > at com.sun.tools.javac.main.Main.compile(Main.java:559)
> > at
> > com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> > at
> > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> > at
> >
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> > ... 24 more
> > Caused by: java.lang.NullPointerException
> > at
> >
> >
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> > at com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> > at com.sun.tools.doclint.Checker.scan(Checker.java:144)
> > at com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> > at
> > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> > at
> > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > at
> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > at
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > at
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > at
> > com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> > at
> > com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> > at
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > at
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > at
> > com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> > at
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> > at
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> > at
> > com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> > at
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > at
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > at com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > at
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > at
> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> > at
> > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> > at
> > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > at
> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > at
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > at com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > at
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > at
> >
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> > at
> >
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> > at
> >
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> > at
> > com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> > at
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > at com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> > at
> >
> >
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> > at
> >
> >
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> > at
> > com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> > at
> > com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> > at
> > com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> > at com.sun.tools.javac.main.Main.compile(Main.java:523)
> > ... 27 more
> > [ERROR]
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > [ERROR]
> > [ERROR] For more information about the errors and possible solutions,
> > please read the following articles:
> > [ERROR] [Help 1]
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> >
> > Can someone help me on this issue?
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> >
> >
> >
> > On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
> > szalay.beko.mate@gmail.com>
> > wrote:
> >
> > > these exceptions can mean many things... I think this can be even
> normal
> > > duding rolling restart (as some connections get broken in this case)
> > >
> > > However, I saw cases already when exceptions like these killed receiver
> > or
> > > sender threads in QuorumCnxManager / Leader Election in such a way that
> > > they were not able to recover, so the node was unable to connect to any
> > > quorum until restart. I remember seeing this in 3.4 too.
> > >
> > > Do you see these exceptions in the second server (the one which you
> just
> > > upgraded in step 3)?
> > > Is this issue reproducible?
> > >
> > > What is the tickTime and initLimit you use? Maybe the server just
> require
> > > more time to sync?
> > >
> > > I would need more logs to really see what happened. Can you create a
> Jira
> > > issue and upload the logs and also the ZooKeeper configs? I am happy to
> > > take a closer look.
> > > (if you need to re-run the test to collect the logs, then enabling
> DEBUG
> > > logs would be great. The INFO level logs are usually enough for these
> > > problems, but one can never know...)
> > >
> > > Kind regards,
> > > Mate
> > >
> > >
> > > On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
> kuldeep.singh08@gmail.com
> > >
> > > wrote:
> > >
> > > > Hi Team,
> > > >
> > > > I have done some POC on rolling upgrade and found below result.
> > > >
> > > >
> > > > 1. On 1st node upgrade zookeeper . Traffic was running fine
> because
> > 2
> > > > nodes are already on old zookeeper.
> > > > 2. On 1st node upgrade our application and didn’t find any issue
> > > > 3. On 2nd node upgrade zookeeper but got below error and zookeeper
> > is
> > > > not taking any requests
> > > > 4.
> > > >
> > > > java.io.EOFException
> > > >
> > > > at java.io.DataInputStream.readInt(DataInputStream.java:392)
> > > >
> > > > at
> > > >
> > > >
> > >
> >
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> > > >
> > > > 2020-03-30 14:19:55,587 - WARN
> > > > [RecvWorker:1:QuorumCnxManager$RecvWorker@765] - Interrupting
> > SendWorker
> > > >
> > > > 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/192.168.44.73:33754
> > > > :LearnerHandler@562] - Unexpected exception causing shutdown while
> > sock
> > > > still open
> > > >
> > > > java.io.EOFException
> > > >
> > > > at java.io.DataInputStream.readInt(DataInputStream.java:392)
> > > >
> > > > at
> > > >
> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> > > >
> > > > at
> > > >
> > > >
> > >
> >
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> > > >
> > > > at
> > > >
> > >
> >
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> > > >
> > > > at
> > > >
> > > >
> > >
> >
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> > > >
> > > > 2020-03-30 14:19:55,588 - WARN
> > > > [SendWorker:1:QuorumCnxManager$SendWorker@679] - Interrupted while
> > > waiting
> > > > for message on queue
> > > >
> > > > Please let me know is this the known issue or this is different issue
> > > which
> > > > is mention in Apache zookeeper documentation when upgrading from
> 3.4.5
> > to
> > > > 3.5.6
> > > >
> > > > Thanks,
> > > > ---------------------
> > > > Kuldeep Singh Budania
> > > > Software Architect
> > > >
> > > >
> > > >
> > > > On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer <sh...@gmail.com>
> > > > wrote:
> > > >
> > > > > +1 to what Mate said (I wrote the quoted instructions).
> > > > >
> > > > >
> > > > >
> > > > > On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő Máté <
> > > > > szalay.beko.mate@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Hi Kuldeep,
> > > > > >
> > > > > > I just want to provide you some background info about our
> > > > documentation.
> > > > > > The reason to upgrade to 3.4.6 first is to avoid the following
> > error:
> > > > > >
> > > > > > > 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
> > 127.0.0.1:2784
> > > > > > :QuorumCnxManager@349] - Invalid server id: -65536
> > > > > >
> > > > > > This error comes because of the protocol changes between
> ZooKeeper
> > > > server
> > > > > > nodes during connection initiation for leader election. In
> > ZooKeeper
> > > > 3.5
> > > > > a
> > > > > > protocol version was introduced (see ZOOKEEPER-107) and since
> that
> > > time
> > > > > the
> > > > > > fist long value sent in the initial message is not the server ID
> > but
> > > > the
> > > > > > protocol version (-65536). In ZooKeeper 3.4.6 we made the old 3.4
> > > > > > ZooKeepers backward compatible, so they are able to parse both
> the
> > > old
> > > > > and
> > > > > > the new protocol format (see ZOOKEEPER-1633). This issue happens
> > only
> > > > > when
> > > > > > you need to use old (3.4.0 - 3.4.5) and new (3.5.0+) ZooKeeper
> > > servers
> > > > > > together in the same cluster. During a rolling upgrade, this is
> > > usually
> > > > > the
> > > > > > case to have old and new ZooKeepers present together.
> > > > > >
> > > > > > The fact that you haven't seen any issues might be caused by the
> > > order
> > > > of
> > > > > > the servers. In ZooKeeper the connection initiation between the
> > > servers
> > > > > > during the leader election follows a specific rule. As far as I
> > > > remember
> > > > > > always the server with the larger ID 'wins the challenge', so it
> is
> > > > > > possible, that the old server didn't need to parse any initial
> > > message
> > > > > (if
> > > > > > it had the largest ID) and this is why you haven't seen the
> issue.
> > > Also
> > > > > > having 2 nodes up from the 3 nodes cluster still makes the
> cluster
> > > work
> > > > > (so
> > > > > > you should also check if all the servers are part of the quorum).
> > > > > >
> > > > > > I agree with Enrico and Norbert, the safest and most stable way
> is
> > > > > upgrade
> > > > > > first to 3.4.latest, then go to 3.5.latest. Still, if you don't
> see
> > > > that
> > > > > > you would hit this specific issue (e.g. no "Invalid server id" in
> > the
> > > > log
> > > > > > files), and all the three servers can handle traffic, then maybe
> > you
> > > > > don't
> > > > > > need to upgrade first to 3.4.latest, it is your decision.
> > Definitely
> > > > you
> > > > > > should test it first, as suggested by the others.
> > > > > >
> > > > > > Kind regards,
> > > > > > Mate
> > > > > >
> > > > > > On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
> > > > > > <nk...@cloudera.com.invalid> wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > That guide is to upgrade to 3.5.0, which was an alpha version.
> A
> > > lot
> > > > > has
> > > > > > > changed for the first stable release of 3.5.5 and then a few
> > more,
> > > > even
> > > > > > > rolling upgrade issues have been fixed for 3.5.6.
> > > > > > > This is a more up-to-date guide:
> > > > > > >
> > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> > > > > > >
> > > > > > > If you have done your testing (with prod snapshot!), then you
> can
> > > > skip
> > > > > > 3.4
> > > > > > > latest upgrade, but keep in mind we do our recommendations for
> a
> > > > > reason.
> > > > > > > There were issues reported and/or found during testing. Some
> are
> > > > fixed
> > > > > > with
> > > > > > > 3.5.6, some only happens if certain conditions stand
> > (IOException:
> > > No
> > > > > > > snapshot found - mentioned in the guide, fixed in 3.5.6).
> > > > > > >
> > > > > > > So it is up to you, I would still recommend to do an 3.4
> upgrade
> > > > first,
> > > > > > if
> > > > > > > it's feasible.
> > > > > > >
> > > > > > > Regards,
> > > > > > > Norbert
> > > > > > >
> > > > > > > On Tue, Mar 24, 2020 at 11:45 AM kuldeep singh <
> > > > > > kuldeep.singh08@gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > Current Zookeeper version :- 3.4.5
> > > > > > > > Upgraded version :- 3.5.6
> > > > > > > >
> > > > > > > > We are not going with 3.5.7. Our final decision is zookeeper
> > > > version
> > > > > is
> > > > > > > > 3.5.6
> > > > > > > > as per your reply first we need to move latest version of
> > 3.4.x,
> > > > like
> > > > > > > below
> > > > > > > >
> > > > > > > > 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am wrong here)
> > > > > > > >
> > > > > > > > But if We are not facing any problem that i have shared you
> > that
> > > we
> > > > > > have
> > > > > > > > set up of 3 node cluster where 2 node are on 3.5.6 version
> and
> > 1
> > > > node
> > > > > > on
> > > > > > > > 3.4.5, Everything is running fine and didn't get any issue,
> So
> > > what
> > > > > > other
> > > > > > > > problem we can face if we directly move to 3.5.6
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > ---------------------
> > > > > > > > Kuldeep Singh Budania
> > > > > > > > Software Architect
> > > > > > > >
> > > > > > > >
> > > > > > > > On Tue, Mar 24, 2020 at 3:58 PM Enrico Olivelli <
> > > > eolivelli@gmail.com
> > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi
> > > > > > > > > You have to upgrade to latest 3.4.x Zookeeper then you will
> > > > upgrade
> > > > > > to
> > > > > > > > > 3.5.7.
> > > > > > > > > All should run well without issues
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Enrico
> > > > > > > > >
> > > > > > > > > Il Mar 24 Mar 2020, 10:18 kuldeep singh <
> > > > kuldeep.singh08@gmail.com
> > > > > >
> > > > > > ha
> > > > > > > > > scritto:
> > > > > > > > >
> > > > > > > > > > Hi Team,
> > > > > > > > > >
> > > > > > > > > > We are upgrading zookeeper from 3.4.5 to 3.5.6. I have
> set
> > > up 3
> > > > > > node
> > > > > > > > > > cluster where 2 node are on 3.5.6 version and 1 node on
> > > 3.4.5.
> > > > > > > > > >
> > > > > > > > > > Everything is running fine and didn't get any issue on my
> > > > system.
> > > > > > > > > >
> > > > > > > > > > but I found something on apache site that first we need
> to
> > > > > upgrade
> > > > > > > on
> > > > > > > > > > 3.4.6 than we can upgrade to 3.5.6. So is it mandatory
> to
> > go
> > > > on
> > > > > > > 3.4.6
> > > > > > > > > > first.
> > > > > > > > > >
> > > > > > > > > > *Upgrading to 3.5.0*
> > > > > > > > > >
> > > > > > > > > > Upgrading a running ZooKeeper ensemble to 3.5.0 should be
> > > done
> > > > > only
> > > > > > > > after
> > > > > > > > > > upgrading your ensemble to the 3.4.6 release. Note that
> > this
> > > is
> > > > > > only
> > > > > > > > > > necessary for rolling upgrades (if you're fine with
> > shutting
> > > > down
> > > > > > the
> > > > > > > > > > system completely, you don't have to go through 3.4.6).
> If
> > > you
> > > > > > > attempt
> > > > > > > > a
> > > > > > > > > > rolling upgrade without going through 3.4.6 (for example
> > from
> > > > > > 3.4.5),
> > > > > > > > you
> > > > > > > > > > may get the following error:
> > > > > > > > > >
> > > > > > > > > > 2013-01-30 11:32:10,663 [myid:2] - INFO [localhost/
> > > > > 127.0.0.1:2784
> > > > > > > > > > :QuorumCnxManager$Listener@498] - Received connection
> > > request
> > > > /
> > > > > > > > > > 127.0.0.1:60876
> > > > > > > > > >
> > > > > > > > > > 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
> > > > > 127.0.0.1:2784
> > > > > > > > > > :QuorumCnxManager@349] - Invalid server id: -65536
> > > > > > > > > >
> > > > > > > > > > During a rolling upgrade, each server is taken down in
> turn
> > > and
> > > > > > > > rebooted
> > > > > > > > > > with the new 3.5.0 binaries. Before starting the server
> > with
> > > > > 3.5.0
> > > > > > > > > > binaries, we highly recommend updating the configuration
> > file
> > > > so
> > > > > > that
> > > > > > > > all
> > > > > > > > > > server statements "server.x=..." contain client ports
> (see
> > > the
> > > > > > > section
> > > > > > > > > > Specifying
> > > > > > > > > > the client port). As explained earlier you may leave the
> > > > > > > configuration
> > > > > > > > > in a
> > > > > > > > > > single file, as well as leave the
> > > clientPort/clientPortAddress
> > > > > > > > statements
> > > > > > > > > > (although if you specify client ports in the new format,
> > > these
> > > > > > > > statements
> > > > > > > > > > are now redundant).
> > > > > > > > > >
> > > > > > > > > > Could you please let me know about this case. Appreciate
> if
> > > > > respond
> > > > > > > > soon.
> > > > > > > > > >
> > > > > > > > > > Thanks,
> > > > > > > > > > ---------------------
> > > > > > > > > > Kuldeep Singh Budania
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Hi,
I appreciate if I will get a response as soon as possible, as I am stuck at
this point.
Thanks,
---------------------
Kuldeep Singh Budania
Software Architect
On Wed, Jun 24, 2020 at 10:47 PM kuldeep singh <ku...@gmail.com>
wrote:
> Hi,
>
> I got below error while setting SSL properties in zkEnv.sh
>
>
>
>
> ==========================================================================================
>
> 2020-06-24 15:49:35,864 - INFO [main:QuorumPeerConfig@133] - Reading
> configuration from: /etc/zookeeper/zoo.cfg
>
> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@385] -
> clientPortAddress is 0.0.0.0/0.0.0.0:10181
>
> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@399] -
> secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
>
> 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] - Setting -D
> jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated
> TLS renegotiation
>
> 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@78] -
> autopurge.snapRetainCount set to 3
>
> 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@79] -
> autopurge.purgeInterval set to 1
>
> 2020-06-24 15:49:35,898 - INFO [
> PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge task started.
>
> 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] - Log4j found with
> jmx enabled.
>
> 2020-06-24 15:49:35,903 - INFO [PurgeTask:FileTxnSnapLog@103] -
> zookeeper.snapshot.trust.empty : false
>
> 2020-06-24 15:49:35,910 - INFO [
> PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge task completed.
>
> 2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141] - Starting
> quorum peer
>
> 2020-06-24 15:49:35,983 - INFO [main:ServerCnxnFactory@135] - Using
> org.apache.zookeeper.server.NIOServerCnxnFactory as server connection
> factory
>
> 2020-06-24 15:49:35,986 - INFO [main:NIOServerCnxnFactory@673] -
> Configuring NIO connection handler with 10s sessionless connection timeout,
> 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
>
> 2020-06-24 15:49:35,992 - INFO [main:NIOServerCnxnFactory@686] - binding
> to port 0.0.0.0/0.0.0.0:10181
>
> 2020-06-24 15:49:35,994 - INFO [main:ServerCnxnFactory@135] - Using
> org.apache.zookeeper.server.NIOServerCnxnFactory as server connection
> factory
>
> 2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101] - Unexpected
> exception, exiting abnormally
>
> java.lang.UnsupportedOperationException: SSL isn't supported in
> NIOServerCnxn
>
> at
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
>
> at
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
>
> at
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
>
> at
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
>
>
>
>
>
> I have set the following properties in SERVER_JVMFLAGS in zkEnv.sh file :
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <
> jordan@jordanzimmerman.com> wrote:
>
>> It's the same as the normal ZooKeeper client:
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> <
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> >
>>
>> -Jordan
>>
>> > On Jun 22, 2020, at 5:50 AM, kuldeep singh <ku...@gmail.com>
>> wrote:
>> >
>> > Hi Team,
>> > How we will do secure communication between the Curator framework and
>> > zookeeper 3.5.6 ?
>> > I didn't get any solution right now.
>> > I appreciate it if someone could help me with the same.
>> >
>> > Thanks,
>> > ---------------------
>> > Kuldeep Singh Budania
>> > Software Architect
>> >
>> >
>> > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
>> szalay.beko.mate@gmail.com>
>> > wrote:
>> >
>> >> Hello Kuldeep,
>> >>
>> >> did you download the source from the ZooKeeper webpage, or checked out
>> from
>> >> git?
>> >> Anyway, the following commands should work:
>> >>
>> >> wget
>> >>
>> >>
>> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
>> >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
>> >> cd apache-zookeeper-3.5.7
>> >> mvn clean install -DskipTests
>> >>
>> >> I tested it with OpenJDK 8u424 and maven 3.6.0.
>> >>
>> >> Kind regards,
>> >> Mate
>> >>
>> >>
>> >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
>> kuldeep.singh08@gmail.com>
>> >> wrote:
>> >>
>> >>> Hi All,
>> >>>
>> >>> I have download the zookeeper source code and run the mvn command for
>> >>> packaging but get problem on "zookeeper-server" directory.
>> >>>
>> >>> *command :- mvn clean package*
>> >>>
>> >>> [ERROR] Failed to execute goal
>> >>> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> >>> (default-compile) on project zookeeper: Fatal error compiling:
>> >>> java.lang.NullPointerException -> [Help 1]
>> >>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
>> execute
>> >>> goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> >>> (default-compile) on project zookeeper: Fatal error compiling
>> >>> at
>> >>>
>> >>>
>> >>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
>> >>> at
>> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
>> >>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
>> >>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
>> >>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
>> >>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
>> >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >>> at
>> >>>
>> >>>
>> >>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> >>> at
>> >>>
>> >>>
>> >>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >>> at java.lang.reflect.Method.invoke(Method.java:498)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>> >>> at
>> >>>
>> >>
>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>> >>> at
>> >>>
>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>> >>> Caused by: org.apache.maven.plugin.MojoExecutionException: Fatal error
>> >>> compiling
>> >>> at
>> >>>
>> >>>
>> >>
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>> >>> ... 19 more
>> >>> Caused by: org.codehaus.plexus.compiler.CompilerException:
>> >>> java.lang.NullPointerException
>> >>> at
>> >>>
>> >>>
>> >>
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
>> >>> ... 22 more
>> >>> Caused by: java.lang.RuntimeException: java.lang.NullPointerException
>> >>> at com.sun.tools.javac.main.Main.compile(Main.java:559)
>> >>> at
>> >>> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
>> >>> at
>> >>> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
>> >>> at
>> >>>
>> >>>
>> >>
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
>> >>> ... 24 more
>> >>> Caused by: java.lang.NullPointerException
>> >>> at
>> >>>
>> >>>
>> >>
>> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
>> >>> at com.sun.tools.doclint.Env.setCurrent(Env.java:155)
>> >>> at com.sun.tools.doclint.Checker.scan(Checker.java:144)
>> >>> at com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
>> >>> at
>> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
>> >>> at
>> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> >>> at
>> >>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> >>> at
>> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >>> at
>> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> >>> at
>> >>> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
>> >>> at
>> >>> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
>> >>> at
>> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >>> at
>> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> >>> at
>> >>> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
>> >>> at
>> >>>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
>> >>> at
>> >>>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
>> >>> at
>> >>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
>> >>> at
>> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >>> at
>> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> >>> at com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> >>> at
>> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> >>> at
>> >> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
>> >>> at
>> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
>> >>> at
>> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> >>> at
>> >>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> >>> at
>> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >>> at com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> >>> at
>> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> >>> at
>> >>>
>> >>
>> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
>> >>> at
>> >>>
>> >>>
>> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
>> >>> at
>> >>>
>> >>>
>> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
>> >>> at
>> >>>
>> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
>> >>> at
>> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >>> at com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
>> >>> at
>> >>>
>> >>>
>> >>
>> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
>> >>> at
>> >>>
>> >>>
>> >>
>> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
>> >>> at
>> >>>
>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
>> >>> at
>> >>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
>> >>> at
>> >>> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
>> >>> at com.sun.tools.javac.main.Main.compile(Main.java:523)
>> >>> ... 27 more
>> >>> [ERROR]
>> >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> >>> [ERROR]
>> >>> [ERROR] For more information about the errors and possible solutions,
>> >>> please read the following articles:
>> >>> [ERROR] [Help 1]
>> >>>
>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>> >>>
>> >>> Can someone help me on this issue?
>> >>>
>> >>> Thanks,
>> >>> ---------------------
>> >>> Kuldeep Singh Budania
>> >>>
>> >>>
>> >>>
>> >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
>> >>> szalay.beko.mate@gmail.com>
>> >>> wrote:
>> >>>
>> >>>> these exceptions can mean many things... I think this can be even
>> >> normal
>> >>>> duding rolling restart (as some connections get broken in this case)
>> >>>>
>> >>>> However, I saw cases already when exceptions like these killed
>> receiver
>> >>> or
>> >>>> sender threads in QuorumCnxManager / Leader Election in such a way
>> that
>> >>>> they were not able to recover, so the node was unable to connect to
>> any
>> >>>> quorum until restart. I remember seeing this in 3.4 too.
>> >>>>
>> >>>> Do you see these exceptions in the second server (the one which you
>> >> just
>> >>>> upgraded in step 3)?
>> >>>> Is this issue reproducible?
>> >>>>
>> >>>> What is the tickTime and initLimit you use? Maybe the server just
>> >> require
>> >>>> more time to sync?
>> >>>>
>> >>>> I would need more logs to really see what happened. Can you create a
>> >> Jira
>> >>>> issue and upload the logs and also the ZooKeeper configs? I am happy
>> to
>> >>>> take a closer look.
>> >>>> (if you need to re-run the test to collect the logs, then enabling
>> >> DEBUG
>> >>>> logs would be great. The INFO level logs are usually enough for these
>> >>>> problems, but one can never know...)
>> >>>>
>> >>>> Kind regards,
>> >>>> Mate
>> >>>>
>> >>>>
>> >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
>> >> kuldeep.singh08@gmail.com
>> >>>>
>> >>>> wrote:
>> >>>>
>> >>>>> Hi Team,
>> >>>>>
>> >>>>> I have done some POC on rolling upgrade and found below result.
>> >>>>>
>> >>>>>
>> >>>>> 1. On 1st node upgrade zookeeper . Traffic was running fine
>> >> because
>> >>> 2
>> >>>>> nodes are already on old zookeeper.
>> >>>>> 2. On 1st node upgrade our application and didn’t find any issue
>> >>>>> 3. On 2nd node upgrade zookeeper but got below error and zookeeper
>> >>> is
>> >>>>> not taking any requests
>> >>>>> 4.
>> >>>>>
>> >>>>> java.io.EOFException
>> >>>>>
>> >>>>> at java.io.DataInputStream.readInt(DataInputStream.java:392)
>> >>>>>
>> >>>>> at
>> >>>>>
>> >>>>>
>> >>>>
>> >>>
>> >>
>> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
>> >>>>>
>> >>>>> 2020-03-30 14:19:55,587 - WARN
>> >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765] - Interrupting
>> >>> SendWorker
>> >>>>>
>> >>>>> 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/
>> 192.168.44.73:33754
>> >>>>> :LearnerHandler@562] - Unexpected exception causing shutdown while
>> >>> sock
>> >>>>> still open
>> >>>>>
>> >>>>> java.io.EOFException
>> >>>>>
>> >>>>> at java.io.DataInputStream.readInt(DataInputStream.java:392)
>> >>>>>
>> >>>>> at
>> >>>>>
>> >> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
>> >>>>>
>> >>>>> at
>> >>>>>
>> >>>>>
>> >>>>
>> >>>
>> >>
>> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
>> >>>>>
>> >>>>> at
>> >>>>>
>> >>>>
>> >>>
>> >>
>> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
>> >>>>>
>> >>>>> at
>> >>>>>
>> >>>>>
>> >>>>
>> >>>
>> >>
>> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
>> >>>>>
>> >>>>> 2020-03-30 14:19:55,588 - WARN
>> >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679] - Interrupted while
>> >>>> waiting
>> >>>>> for message on queue
>> >>>>>
>> >>>>> Please let me know is this the known issue or this is different
>> issue
>> >>>> which
>> >>>>> is mention in Apache zookeeper documentation when upgrading from
>> >> 3.4.5
>> >>> to
>> >>>>> 3.5.6
>> >>>>>
>> >>>>> Thanks,
>> >>>>> ---------------------
>> >>>>> Kuldeep Singh Budania
>> >>>>> Software Architect
>> >>>>>
>> >>>>>
>> >>>>>
>> >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer <shralex@gmail.com
>> >
>> >>>>> wrote:
>> >>>>>
>> >>>>>> +1 to what Mate said (I wrote the quoted instructions).
>> >>>>>>
>> >>>>>>
>> >>>>>>
>> >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő Máté <
>> >>>>>> szalay.beko.mate@gmail.com>
>> >>>>>> wrote:
>> >>>>>>
>> >>>>>>> Hi Kuldeep,
>> >>>>>>>
>> >>>>>>> I just want to provide you some background info about our
>> >>>>> documentation.
>> >>>>>>> The reason to upgrade to 3.4.6 first is to avoid the following
>> >>> error:
>> >>>>>>>
>> >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
>> >>> 127.0.0.1:2784
>> >>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
>> >>>>>>>
>> >>>>>>> This error comes because of the protocol changes between
>> >> ZooKeeper
>> >>>>> server
>> >>>>>>> nodes during connection initiation for leader election. In
>> >>> ZooKeeper
>> >>>>> 3.5
>> >>>>>> a
>> >>>>>>> protocol version was introduced (see ZOOKEEPER-107) and since
>> >> that
>> >>>> time
>> >>>>>> the
>> >>>>>>> fist long value sent in the initial message is not the server ID
>> >>> but
>> >>>>> the
>> >>>>>>> protocol version (-65536). In ZooKeeper 3.4.6 we made the old 3.4
>> >>>>>>> ZooKeepers backward compatible, so they are able to parse both
>> >> the
>> >>>> old
>> >>>>>> and
>> >>>>>>> the new protocol format (see ZOOKEEPER-1633). This issue happens
>> >>> only
>> >>>>>> when
>> >>>>>>> you need to use old (3.4.0 - 3.4.5) and new (3.5.0+) ZooKeeper
>> >>>> servers
>> >>>>>>> together in the same cluster. During a rolling upgrade, this is
>> >>>> usually
>> >>>>>> the
>> >>>>>>> case to have old and new ZooKeepers present together.
>> >>>>>>>
>> >>>>>>> The fact that you haven't seen any issues might be caused by the
>> >>>> order
>> >>>>> of
>> >>>>>>> the servers. In ZooKeeper the connection initiation between the
>> >>>> servers
>> >>>>>>> during the leader election follows a specific rule. As far as I
>> >>>>> remember
>> >>>>>>> always the server with the larger ID 'wins the challenge', so it
>> >> is
>> >>>>>>> possible, that the old server didn't need to parse any initial
>> >>>> message
>> >>>>>> (if
>> >>>>>>> it had the largest ID) and this is why you haven't seen the
>> >> issue.
>> >>>> Also
>> >>>>>>> having 2 nodes up from the 3 nodes cluster still makes the
>> >> cluster
>> >>>> work
>> >>>>>> (so
>> >>>>>>> you should also check if all the servers are part of the quorum).
>> >>>>>>>
>> >>>>>>> I agree with Enrico and Norbert, the safest and most stable way
>> >> is
>> >>>>>> upgrade
>> >>>>>>> first to 3.4.latest, then go to 3.5.latest. Still, if you don't
>> >> see
>> >>>>> that
>> >>>>>>> you would hit this specific issue (e.g. no "Invalid server id" in
>> >>> the
>> >>>>> log
>> >>>>>>> files), and all the three servers can handle traffic, then maybe
>> >>> you
>> >>>>>> don't
>> >>>>>>> need to upgrade first to 3.4.latest, it is your decision.
>> >>> Definitely
>> >>>>> you
>> >>>>>>> should test it first, as suggested by the others.
>> >>>>>>>
>> >>>>>>> Kind regards,
>> >>>>>>> Mate
>> >>>>>>>
>> >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
>> >>>>>>> <nk...@cloudera.com.invalid> wrote:
>> >>>>>>>
>> >>>>>>>> Hi,
>> >>>>>>>>
>> >>>>>>>> That guide is to upgrade to 3.5.0, which was an alpha version.
>> >> A
>> >>>> lot
>> >>>>>> has
>> >>>>>>>> changed for the first stable release of 3.5.5 and then a few
>> >>> more,
>> >>>>> even
>> >>>>>>>> rolling upgrade issues have been fixed for 3.5.6.
>> >>>>>>>> This is a more up-to-date guide:
>> >>>>>>>>
>> >>> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
>> >>>>>>>>
>> >>>>>>>> If you have done your testing (with prod snapshot!), then you
>> >> can
>> >>>>> skip
>> >>>>>>> 3.4
>> >>>>>>>> latest upgrade, but keep in mind we do our recommendations for
>> >> a
>> >>>>>> reason.
>> >>>>>>>> There were issues reported and/or found during testing. Some
>> >> are
>> >>>>> fixed
>> >>>>>>> with
>> >>>>>>>> 3.5.6, some only happens if certain conditions stand
>> >>> (IOException:
>> >>>> No
>> >>>>>>>> snapshot found - mentioned in the guide, fixed in 3.5.6).
>> >>>>>>>>
>> >>>>>>>> So it is up to you, I would still recommend to do an 3.4
>> >> upgrade
>> >>>>> first,
>> >>>>>>> if
>> >>>>>>>> it's feasible.
>> >>>>>>>>
>> >>>>>>>> Regards,
>> >>>>>>>> Norbert
>> >>>>>>>>
>> >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep singh <
>> >>>>>>> kuldeep.singh08@gmail.com>
>> >>>>>>>> wrote:
>> >>>>>>>>
>> >>>>>>>>> Hi,
>> >>>>>>>>>
>> >>>>>>>>> Current Zookeeper version :- 3.4.5
>> >>>>>>>>> Upgraded version :- 3.5.6
>> >>>>>>>>>
>> >>>>>>>>> We are not going with 3.5.7. Our final decision is zookeeper
>> >>>>> version
>> >>>>>> is
>> >>>>>>>>> 3.5.6
>> >>>>>>>>> as per your reply first we need to move latest version of
>> >>> 3.4.x,
>> >>>>> like
>> >>>>>>>> below
>> >>>>>>>>>
>> >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am wrong here)
>> >>>>>>>>>
>> >>>>>>>>> But if We are not facing any problem that i have shared you
>> >>> that
>> >>>> we
>> >>>>>>> have
>> >>>>>>>>> set up of 3 node cluster where 2 node are on 3.5.6 version
>> >> and
>> >>> 1
>> >>>>> node
>> >>>>>>> on
>> >>>>>>>>> 3.4.5, Everything is running fine and didn't get any issue,
>> >> So
>> >>>> what
>> >>>>>>> other
>> >>>>>>>>> problem we can face if we directly move to 3.5.6
>> >>>>>>>>>
>> >>>>>>>>> Thanks,
>> >>>>>>>>> ---------------------
>> >>>>>>>>> Kuldeep Singh Budania
>> >>>>>>>>> Software Architect
>> >>>>>>>>>
>> >>>>>>>>>
>> >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico Olivelli <
>> >>>>> eolivelli@gmail.com
>> >>>>>>>
>> >>>>>>>>> wrote:
>> >>>>>>>>>
>> >>>>>>>>>> Hi
>> >>>>>>>>>> You have to upgrade to latest 3.4.x Zookeeper then you will
>> >>>>> upgrade
>> >>>>>>> to
>> >>>>>>>>>> 3.5.7.
>> >>>>>>>>>> All should run well without issues
>> >>>>>>>>>>
>> >>>>>>>>>>
>> >>>>>>>>>> Enrico
>> >>>>>>>>>>
>> >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
>> >>>>> kuldeep.singh08@gmail.com
>> >>>>>>>
>> >>>>>>> ha
>> >>>>>>>>>> scritto:
>> >>>>>>>>>>
>> >>>>>>>>>>> Hi Team,
>> >>>>>>>>>>>
>> >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to 3.5.6. I have
>> >> set
>> >>>> up 3
>> >>>>>>> node
>> >>>>>>>>>>> cluster where 2 node are on 3.5.6 version and 1 node on
>> >>>> 3.4.5.
>> >>>>>>>>>>>
>> >>>>>>>>>>> Everything is running fine and didn't get any issue on my
>> >>>>> system.
>> >>>>>>>>>>>
>> >>>>>>>>>>> but I found something on apache site that first we need
>> >> to
>> >>>>>> upgrade
>> >>>>>>>> on
>> >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is it mandatory
>> >> to
>> >>> go
>> >>>>> on
>> >>>>>>>> 3.4.6
>> >>>>>>>>>>> first.
>> >>>>>>>>>>>
>> >>>>>>>>>>> *Upgrading to 3.5.0*
>> >>>>>>>>>>>
>> >>>>>>>>>>> Upgrading a running ZooKeeper ensemble to 3.5.0 should be
>> >>>> done
>> >>>>>> only
>> >>>>>>>>> after
>> >>>>>>>>>>> upgrading your ensemble to the 3.4.6 release. Note that
>> >>> this
>> >>>> is
>> >>>>>>> only
>> >>>>>>>>>>> necessary for rolling upgrades (if you're fine with
>> >>> shutting
>> >>>>> down
>> >>>>>>> the
>> >>>>>>>>>>> system completely, you don't have to go through 3.4.6).
>> >> If
>> >>>> you
>> >>>>>>>> attempt
>> >>>>>>>>> a
>> >>>>>>>>>>> rolling upgrade without going through 3.4.6 (for example
>> >>> from
>> >>>>>>> 3.4.5),
>> >>>>>>>>> you
>> >>>>>>>>>>> may get the following error:
>> >>>>>>>>>>>
>> >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO [localhost/
>> >>>>>> 127.0.0.1:2784
>> >>>>>>>>>>> :QuorumCnxManager$Listener@498] - Received connection
>> >>>> request
>> >>>>> /
>> >>>>>>>>>>> 127.0.0.1:60876
>> >>>>>>>>>>>
>> >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
>> >>>>>> 127.0.0.1:2784
>> >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
>> >>>>>>>>>>>
>> >>>>>>>>>>> During a rolling upgrade, each server is taken down in
>> >> turn
>> >>>> and
>> >>>>>>>>> rebooted
>> >>>>>>>>>>> with the new 3.5.0 binaries. Before starting the server
>> >>> with
>> >>>>>> 3.5.0
>> >>>>>>>>>>> binaries, we highly recommend updating the configuration
>> >>> file
>> >>>>> so
>> >>>>>>> that
>> >>>>>>>>> all
>> >>>>>>>>>>> server statements "server.x=..." contain client ports
>> >> (see
>> >>>> the
>> >>>>>>>> section
>> >>>>>>>>>>> Specifying
>> >>>>>>>>>>> the client port). As explained earlier you may leave the
>> >>>>>>>> configuration
>> >>>>>>>>>> in a
>> >>>>>>>>>>> single file, as well as leave the
>> >>>> clientPort/clientPortAddress
>> >>>>>>>>> statements
>> >>>>>>>>>>> (although if you specify client ports in the new format,
>> >>>> these
>> >>>>>>>>> statements
>> >>>>>>>>>>> are now redundant).
>> >>>>>>>>>>>
>> >>>>>>>>>>> Could you please let me know about this case. Appreciate
>> >> if
>> >>>>>> respond
>> >>>>>>>>> soon.
>> >>>>>>>>>>>
>> >>>>>>>>>>> Thanks,
>> >>>>>>>>>>> ---------------------
>> >>>>>>>>>>> Kuldeep Singh Budania
>> >>>>>>>>>>>
>> >>>>>>>>>>
>> >>>>>>>>>
>> >>>>>>>>
>> >>>>>>>
>> >>>>>>
>> >>>>>
>> >>>>
>> >>>
>> >>
>>
>>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Hi,
in everytime JDK version is the same. Even all the things are same
including configuration, but I don't know why ZKCli is not able to connect.
1st case :- 3 node cluster without SSL is working fine
scaled the cluster till 5 node without SSL is also
working fine
after that when applying SSL on all 5 nodes then it is
also working
2nd case :- 3 node cluster with SSL is working fine
scaled the cluster till 5 node with SSL is not working
In both cases the configuration area is the same and certificate is also
the same. but 1st case is running perfect and 2nd case is not running.
Thanks,
---------------------
Kuldeep Singh Budania
On Wed, Oct 14, 2020 at 11:17 PM <Ma...@cognizant.com> wrote:
> Kuldeep,
> This issue could be mismatch of TLS version used for SSL . different
> version of zookeeper have different TLV version supported as default . What
> was jdk version you have on old host and new host .
> May be you can try to define TLS version in zoo.cfg .
>
>
>
> On 10/14/20, 7:33 AM, "kuldeep singh" <ku...@gmail.com> wrote:
>
> [External]
>
>
> Hi,
>
> Yes, all the configurations are the same on all 5 nodes. I have checked
> more than 10 times.
> Before scaling , 3 node cluster was working fine, but scaling from 3
> to 5
> node, then we are facing this problem.
>
> only question is on 3 node cluster it is working fine, but after
> scaling it
> is not working and zkcli is not able to connect.
>
> but one case I have seen.
>
> 1. if i remove all the SSL configuration from all the nodes and then
> applying again all SSL property then it is working fine.
>
> 2 cases
>
> 1st case :- 3 node cluster witout SSL is working fine
> scaled the cluster till 5 node without SSL is also
> working fine
> after that when applying SSL on all 5 nodes then it
> is
> also working
>
> 2nd case :- 3 node cluster with SSL is working fine
> scaled the cluster till 5 node with SSL is not
> working
>
> in both cases the configuration area same and certificate is also same.
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Wed, Oct 14, 2020 at 5:41 PM Szalay-Bekő Máté <
> szalay.beko.mate@gmail.com>
> wrote:
>
> > the config looks OK in general...
> >
> > - are you sure the same configs are used on all ZK servers?
> > - does the truststores accept all keys on the keystores? (if the
> > truststores of the old servers had to be modified, then did you
> restart the
> > old servers with the updated truststores?)
> > - did the 3 node ZK cluster work with SSL? (were you able to connect
> to it
> > with the client using SSL?)
> >
> > also: do you really need client authentication with SSL? (I see you
> are
> > using SASL too)
> > If you only need SSL for wire encryption, then you can try
> > with ssl.clientAuth=none (see the admin guide). Although that
> feature was
> > broken on 3.5.6, got fixed on 3.5.7 according to the doc.
> >
> > best regards,
> > Mate
> >
> > On Wed, Oct 14, 2020 at 1:10 PM kuldeep singh <
> kuldeep.singh08@gmail.com>
> > wrote:
> >
> > > Sorry,
> > > secureClientPort=2182
> > >
> > > Thanks,
> > > ---------------------
> > > Kuldeep Singh Budania
> > >
> > >
> > >
> > > On Wed, Oct 14, 2020 at 4:18 PM kuldeep singh <
> kuldeep.singh08@gmail.com
> > >
> > > wrote:
> > >
> > > > Thanks for reply
> > > >
> > > > zoo.cfg
> > > > -----------
> > > > secureClientPort=2181
> > > >
> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > > initLimit=10
> > > > syncLimit=5
> > > > dataDir= data directory (not mentioning exact path here)
> > > > tickTime=2000
> > > > autopurge.snapRetainCount=3
> > > > autopurge.purgeInterval=1
> > > > admin.enableServer=false
> > > > standaloneEnabled=false
> > > > jute.maxbuffer=2147483648
> > > > server.1=host1_priv:10288:10388
> > > > server.2=host2_priv:10288:10388
> > > > server.3=host3_priv:10288:10388
> > > > server.4=host4_priv:10288:10388
> > > > server.5=host5_priv:10288:10388
> > > > quorum.auth.enableSasl=true
> > > > quorum.auth.learnerRequireSasl=true
> > > > quorum.auth.serverRequireSasl=true
> > > > quorum.auth.learner.loginContext=QuorumLearner
> > > > quorum.auth.server.loginContext=QuorumServer
> > > > quorum.cnxn.threads.size=10
> > > > -------------------------------------------------------------
> > > > java.env
> > > >
> > > > export
> > > >
> > >
> >
> SERVER_JVMFLAGS="-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > > -Dzookeeper.ssl.keyStore.location=keystore.jks
> > > > -Dzookeeper.ssl.keyStore.password=<passwword>
> > > > -Dzookeeper.ssl.trustStore.location= keystore.jks
> > > > -Dzookeeper.ssl.trustStore.password= <passwword>
> > > > -Djava.security.auth.login.config=zookeeper-jaas.conf"
> > > >
> > > > export
> > > >
> > >
> >
> CLIENT_JVMFLAGS="-Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > > -Dzookeeper.client.secure=true -Dzookeeper.ssl.keyStore.location=
> > > > keystore.jks -Dzookeeper.ssl.keyStore.password= <passwword>
> > > > -Dzookeeper.ssl.trustStore.location=keystore.jks
> > > > -Dzookeeper.ssl.trustStore.password= <passwword>
> > > > -Dzookeeper.ssl.hostnameVerification=false"
> > > >
> > > > Thanks,
> > > > ---------------------
> > > > Kuldeep Singh Budania
> > > >
> > > >
> > > >
> > > > On Wed, Oct 14, 2020 at 4:12 PM Szalay-Bekő Máté <
> > > > szalay.beko.mate@gmail.com> wrote:
> > > >
> > > >> These log messages indicate that a client (or an other ZooKeeper
> > server)
> > > >> is
> > > >> trying to connect without SSL to a ZooKeeper process that
> expects SSL.
> > > >> I assume this will be a configuration issue then.
> > > >>
> > > >> Best regards,
> > > >> Mate
> > > >>
> > > >> On Wed, Oct 14, 2020 at 12:30 PM kuldeep singh <
> > > kuldeep.singh08@gmail.com
> > > >> >
> > > >> wrote:
> > > >>
> > > >> > Hi,
> > > >> >
> > > >> > more logs
> > > >> >
> > > >> > 2020-10-14 12:25:05,106 - ERROR
> > > >> >
> > > >> >
> > > >>
> > >
> >
> [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler$CertificateVerifier@257
> > > >> > ]
> > > >> > - Unsuccessful handshake with session 0x0
> > > >> >
> > > >> > 2020-10-14 12:25:05,107 - WARN
> > > >> >
> [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler@138
> > ]
> > > -
> > > >> > Exception caught
> > > >> >
> > > >> > io.netty.handler.codec.DecoderException:
> > > >> > io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS
> record:
> > > >> > 737276720a
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:475)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:283)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
> > > >> >
> > > >> > at
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
> > > >> >
> > > >> > at
> > > io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
> > > >> >
> > > >> > at
> > > >> >
> > > >>
> > >
> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> > > >> >
> > > >> > at java.lang.Thread.run(Thread.java:748)
> > > >> >
> > > >> > Caused by: io.netty.handler.ssl.NotSslRecordException: not an
> > SSL/TLS
> > > >> > record: 737276720a
> > > >> >
> > > >> > at
> > > >> >
> > > >>
> > >
> io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1203)
> > > >> >
> > > >> > at
> > > io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1271)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:505)
> > > >> >
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:444)
> > > >> >
> > > >> > ... 17 more
> > > >> >
> > > >> > Thanks,
> > > >> > ---------------------
> > > >> > Kuldeep Singh Budania
> > > >> > Software Architect
> > > >> >
> > > >> >
> > > >> >
> > > >> > On Wed, Oct 14, 2020 at 3:51 PM kuldeep singh <
> > > >> kuldeep.singh08@gmail.com>
> > > >> > wrote:
> > > >> >
> > > >> > > Hi,
> > > >> > >
> > > >> > >
> > > >> > > below error is coming on zookeeper logs on SSL.
> > > >> > >
> > > >> > > 2020-10-14 12:18:27,410 - WARN
> > > >> > [nioEventLoopGroup-4-16:NettyServerCnxn@540]
> > > >> > > - Closing connection to /127.0.0.1:49470
> > > >> > > java.io.IOException: Len error 369296128
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:533)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> org.apache.zookeeper.server.NettyServerCnxn.processMessage(NettyServerCnxn.java:360)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.channelRead(NettyServerCnxnFactory.java:184)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
> > > >> > > at
> > > >> io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
> > > >> > > at
> > > >> > >
> > > >>
> > >
> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > > >> > > at
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> > > >> > > at java.lang.Thread.run(Thread.java:748)
> > > >> > >
> > > >> > > Thanks,
> > > >> > > ---------------------
> > > >> > > Kuldeep Singh Budania
> > > >> > >
> > > >> > >
> > > >> > >
> > > >> > > On Thu, Oct 8, 2020 at 6:33 PM Szalay-Bekő Máté <
> > > >> > > szalay.beko.mate@gmail.com> wrote:
> > > >> > >
> > > >> > >> Sounds like a bug or a configuration issue...
> > > >> > >> can you share the configs (before and after the scale-up)
> and the
> > > >> logs?
> > > >> > >> also: does the truststores recognise all the keys used on
> all
> > the 5
> > > >> > >> nodes? (e.g. the truststores on the old nodes accept the
> new
> > keys?)
> > > >> > >>
> > > >> > >> Best Regards,
> > > >> > >> Mate
> > > >> > >>
> > > >> > >> On Thu, Oct 8, 2020 at 2:31 PM kuldeep singh <
> > > >> kuldeep.singh08@gmail.com
> > > >> > >
> > > >> > >> wrote:
> > > >> > >> >
> > > >> > >> > Hi,
> > > >> > >> >
> > > >> > >> > Yes, My client and server both are using certificate and
> have
> > > >> added in
> > > >> > >> ZK
> > > >> > >> > and client as well.
> > > >> > >> >
> > > >> > >> > Thanks,
> > > >> > >> > ---------------------
> > > >> > >> > Kuldeep Singh Budania
> > > >> > >> >
> > > >> > >> >
> > > >> > >> >
> > > >> > >> > On Thu, Oct 8, 2020 at 5:56 PM Enrico Olivelli <
> > > >> eolivelli@gmail.com>
> > > >> > >> wrote:
> > > >> > >> >
> > > >> > >> > > Il giorno gio 8 ott 2020 alle ore 14:17 kuldeep singh <
> > > >> > >> > > kuldeep.singh08@gmail.com> ha scritto:
> > > >> > >> > >
> > > >> > >> > > > Hi Team,
> > > >> > >> > > >
> > > >> > >> > > > I am facing one issue in SSL communication between
> client
> > and
> > > >> > >> zookeeper
> > > >> > >> > > > server.
> > > >> > >> > > >
> > > >> > >> > > > ZK 3.5.6 version
> > > >> > >> > > >
> > > >> > >> > > > 1. Mi on 3 node
> > > >> > >> > > > 2. Applying SSL and 3 nodes cluster is working fine
> > > >> > >> > > > 3. Scaled my cluster with 2 nodes and now my cluster
> have 5
> > > >> nodes
> > > >> > >> over
> > > >> > >> > > SSL
> > > >> > >> > > >
> > > >> > >> > > > but after scaling my SSL is not working between
> client and
> > ZK
> > > >> > >> server and
> > > >> > >> > > > even not able to login using zkCli as well.
> > > >> > >> > > >
> > > >> > >> > > > Can someone provide the details please why it is
> happening?
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >> > > Is your client configured to use SSL ?
> > > >> > >> > >
> > > >> > >> > > Enrico
> > > >> > >> > >
> > > >> > >> > >
> > > >> > >> > >
> > > >> > >> > > >
> > > >> > >> > > > Thanks,
> > > >> > >> > > > ---------------------
> > > >> > >> > > > Kuldeep Singh Budania
> > > >> > >> > > > Software Architect
> > > >> > >> > > >
> > > >> > >> > > >
> > > >> > >> > > >
> > > >> > >> > > > On Mon, Jul 13, 2020 at 2:19 PM Enrico Olivelli -
> Diennea
> > > >> > >> > > > <en...@diennea.com.invalid> wrote:
> > > >> > >> > > >
> > > >> > >> > > > > It looks like we ported it to 3.5.
> > > >> > >> > > > >
> > > >> > >> > > > > See the subtask
> > > >> > >> > > > >
> https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FZOOKEEPER-2792&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944574477&sdata=%2BkptxadCd6m2QyyFjeub%2FxNknSbEWQq3iSRCoePUm2I%3D&reserved=0
> > > >> > >> > > > >
> > > >> > >> > > > > Enrico
> > > >> > >> > > > >
> > > >> > >> > > > > Il giorno 13/07/20, 10:37 "kuldeep singh" <
> > > >> > >> kuldeep.singh08@gmail.com>
> > > >> > >> > > > ha
> > > >> > >> > > > > scritto:
> > > >> > >> > > > >
> > > >> > >> > > > > Hi Team,
> > > >> > >> > > > >
> > > >> > >> > > > > I appreciate it if I will get a response as
> soon as
> > > >> > possible,
> > > >> > >> as I
> > > >> > >> > > am
> > > >> > >> > > > > stuck
> > > >> > >> > > > > at this point.
> > > >> > >> > > > >
> > > >> > >> > > > > Thanks,
> > > >> > >> > > > > ---------------------
> > > >> > >> > > > > Kuldeep Singh Budania
> > > >> > >> > > > >
> > > >> > >> > > > >
> > > >> > >> > > > >
> > > >> > >> > > > > On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh
> <
> > > >> > >> > > > > kuldeep.singh08@gmail.com>
> > > >> > >> > > > > wrote:
> > > >> > >> > > > >
> > > >> > >> > > > > > Hi Team,
> > > >> > >> > > > > >
> > > >> > >> > > > > > Server to Server communication is not
> supported in
> > > >> 3.5.6
> > > >> > >> version
> > > >> > >> > > > as
> > > >> > >> > > > > per
> > > >> > >> > > > > > below JIRA issue?
> > > >> > >> > > > > >
> > > >> > >> > > > > >
> >
> https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FZOOKEEPER-2639&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944574477&sdata=M5Iv%2BGbgyVut%2FXb2EFZjAOsFCndIaai2Vl25uZzGKpk%3D&reserved=0
> > > >> > >> > > > > >
> > > >> > >> > > > > > Thanks,
> > > >> > >> > > > > > ---------------------
> > > >> > >> > > > > > Kuldeep Singh Budania
> > > >> > >> > > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > > > On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh
> <
> > > >> > >> > > > > kuldeep.singh08@gmail.com>
> > > >> > >> > > > > > wrote:
> > > >> > >> > > > > >
> > > >> > >> > > > > >> Thanks for the reply.
> > > >> > >> > > > > >>
> > > >> > >> > > > > >> Now my ZKCli cmd is working fine as we use
> some
> > our
> > > >> > >> customized
> > > >> > >> > > > > >> authentication and we resolve the issue.
> > > >> > >> > > > > >>
> > > >> > >> > > > > >> Now I am going to implement Server to Server
> > > >> > communication.
> > > >> > >> > > > > >>
> > > >> > >> > > > > >> Thanks,
> > > >> > >> > > > > >> ---------------------
> > > >> > >> > > > > >> Kuldeep Singh Budania
> > > >> > >> > > > > >>
> > > >> > >> > > > > >>
> > > >> > >> > > > > >>
> > > >> > >> > > > > >> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő
> Máté <
> > > >> > >> > > > > >> szalay.beko.mate@gmail.com> wrote:
> > > >> > >> > > > > >>
> > > >> > >> > > > > >>> I think SSL is working for you already...
> If you
> > > >> managed
> > > >> > >> to
> > > >> > >> > > start
> > > >> > >> > > > > the
> > > >> > >> > > > > >>> zkCli.sh and be able to connect to
> ZooKeeper on
> > the
> > > >> > >> secure port
> > > >> > >> > > > > and issue
> > > >> > >> > > > > >>> any kind of command (like: " ls / "), then
> the
> > wire
> > > >> > >> encryption
> > > >> > >> > > is
> > > >> > >> > > > > working
> > > >> > >> > > > > >>> and your server/client communication is
> secured
> > by
> > > >> > >> ZooKeeper.
> > > >> > >> > > > > >>>
> > > >> > >> > > > > >>> Why you want to run the following command?
> > > >> > >> > > > > >>> addauth ztpasswd zooadmin:<password>
> > > >> > >> > > > > >>>
> > > >> > >> > > > > >>> Do you also want to configure a
> superDigest user
> > in
> > > >> > >> ZooKeeper?
> > > >> > >> > > > > Please
> > > >> > >> > > > > >>> note
> > > >> > >> > > > > >>> that this command is independent from SSL.
> If you
> > > >> need
> > > >> > to
> > > >> > >> > > create
> > > >> > >> > > > a
> > > >> > >> > > > > >>> username-password pair for digest
> authentication
> > > then
> > > >> > >> please
> > > >> > >> > > use
> > > >> > >> > > > > the
> > > >> > >> > > > > >>> command in the following way:
> > > >> > >> > > > > >>> addauth digest
> zooadmin:yourSuperSecretPassword
> > > >> > >> > > > > >>>
> > > >> > >> > > > > >>> Kind regards,
> > > >> > >> > > > > >>> Mate
> > > >> > >> > > > > >>>
> > > >> > >> > > > > >>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep
> singh <
> > > >> > >> > > > > kuldeep.singh08@gmail.com>
> > > >> > >> > > > > >>> wrote:
> > > >> > >> > > > > >>>
> > > >> > >> > > > > >>> > 1. sh zkCli.sh --config /etc/zookeeper
> -server
> > > >> > >> localhost:2281
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>> > 2. addauth ztpasswd zooadmin:<password>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>> > Thanks,
> > > >> > >> > > > > >>> > ---------------------
> > > >> > >> > > > > >>> > Kuldeep Singh Budania
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep
> singh <
> > > >> > >> > > > > >>> kuldeep.singh08@gmail.com>
> > > >> > >> > > > > >>> > wrote:
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>> > > Hi Team,
> > > >> > >> > > > > >>> > >
> > > >> > >> > > > > >>> > > Any update on this?
> > > >> > >> > > > > >>> > >
> > > >> > >> > > > > >>> > > Thanks,
> > > >> > >> > > > > >>> > > ---------------------
> > > >> > >> > > > > >>> > > Kuldeep Singh Budania
> > > >> > >> > > > > >>> > >
> > > >> > >> > > > > >>> > >
> > > >> > >> > > > > >>> > >
> > > >> > >> > > > > >>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep
> singh
> > <
> > > >> > >> > > > > >>> kuldeep.singh08@gmail.com>
> > > >> > >> > > > > >>> > > wrote:
> > > >> > >> > > > > >>> > >
> > > >> > >> > > > > >>> > >> Sorry this is my bad, there were
> server
> > > setting
> > > >> > like
> > > >> > >> below
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >> export SERVER_JVMFLAGS="
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > >> > >> > > > > >>> > >>
> -Dzookeeper.ssl.keyStore.password=testpass
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > >> > >> > > > > >>> > >>
> > -Dzookeeper.ssl.trustStore.password=testpass"
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >> export CLIENT_JVMFLAGS="
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> >
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > >> > >> > > > > >>> > >> -Dzookeeper.client.secure=true
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > >> > >> > > > > >>> > >>
> -Dzookeeper.ssl.keyStore.password=testpass
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > >> > >> > > > > >>> > >>
> > -Dzookeeper.ssl.trustStore.password=testpass"
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >> I want to have SSL between client to
> server
> > > >> > >> communication
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >> I am already following the same link
> which
> > you
> > > >> have
> > > >> > >> shared
> > > >> > >> > > > > with me
> > > >> > >> > > > > >>> but
> > > >> > >> > > > > >>> > >> that is not working.
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >> Zoo.cfg
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >> secureClientPort=2281
> > > >> > >> > > > > >>> > >> initLimit=10
> > > >> > >> > > > > >>> > >> syncLimit=5
> > > >> > >> > > > > >>> > >> dataDir=/var/lib/zookeeper/data
> > > >> > >> > > > > >>> > >> tickTime=2000
> > > >> > >> > > > > >>> > >> autopurge.snapRetainCount=3
> > > >> > >> > > > > >>> > >> autopurge.purgeInterval=1
> > > >> > >> > > > > >>> > >> admin.enableServer=false
> > > >> > >> > > > > >>> > >> standaloneEnabled=false
> > > >> > >> > > > > >>> > >> jute.maxbuffer=2147483648
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > >
> > > >> > >>
> > >
> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > >> > >> > > > > >>> > >> server.1=host1_priv:10288:10388
> > > >> > >> > > > > >>> > >> server.2=host2_priv:10288:10388
> > > >> > >> > > > > >>> > >> server.3=host3_priv:10288:10388
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >> command to connect using zkcli
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >> 1. zkcli zoo.cfg localhost:2281
> > > >> > >> > > > > >>> > >> 2. addauth ztpasswd usernaem:password
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >> after second step we are getting
> below error
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >> WatchedEvent state:AuthFailed
> type:None
> > > >> path:null
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >> Zookeeper logs :- *2020-07-01
> 07:38:09,342 -
> > > >> WARN
> > > >> > >> > > > > >>> > >>
> [nioEventLoopGroup-4-2:ZooKeeperServer@1119
> > ]
> > > -
> > > >> No
> > > >> > >> > > > > authentication
> > > >> > >> > > > > >>> > provider
> > > >> > >> > > > > >>> > >> for scheme: ztpasswd has x509 ip
> digest*
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >> Thanks,
> > > >> > >> > > > > >>> > >> ---------------------
> > > >> > >> > > > > >>> > >> Kuldeep Singh Budania
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >> On Wed, Jul 1, 2020 at 6:25 PM
> Szalay-Bekő
> > > Máté
> > > >> <
> > > >> > >> > > > > >>> > >> szalay.beko.mate@gmail.com> wrote:
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> > >>> > No authentication provider for
> scheme:
> > > >> ztpasswd
> > > >> > >> has
> > > >> > >> > > x509
> > > >> > >> > > > > ip
> > > >> > >> > > > > >>> digest*
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> > >>> This suggest you have some
> configuration
> > > >> error...
> > > >> > >> Where
> > > >> > >> > > did
> > > >> > >> > > > > you
> > > >> > >> > > > > >>> use the
> > > >> > >> > > > > >>> > >>> "ztpasswd" string in your configs /
> > commands?
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> > >>> On Wed, Jul 1, 2020 at 2:53 PM
> Szalay-Bekő
> > > >> Máté <
> > > >> > >> > > > > >>> > >>> szalay.beko.mate@gmail.com>
> > > >> > >> > > > > >>> > >>> wrote:
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> > >>> > > My ZK server is up and running
> in
> > secure
> > > >> mode
> > > >> > >> > > > > >>> > >>> >
> > > >> > >> > > > > >>> > >>> > What is your goal? You want to
> setup
> > > >> > >> client-server SSL
> > > >> > >> > > > > >>> connection?
> > > >> > >> > > > > >>> > >>> >
> > > >> > >> > > > > >>> > >>> > see:
> > > >> > >> > > > > >>> > >>> >
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FZOOKEEPER%2FZooKeeper%2BSSL%2BUser%2BGuide&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944574477&sdata=waate39BEuc26%2B0RnjExbOsMzWTfCbhCYQmxwSdMFik%3D&reserved=0
> > > >> > >> > > > > >>> > >>> >
> > > >> > >> > > > > >>> > >>> > (or you want to have both SSL and
> SASL
> > > >> enabled?)
> > > >> > >> > > > > >>> > >>> >
> > > >> > >> > > > > >>> > >>> > Anyway, please remove the
> following line
> > > from
> > > >> > the
> > > >> > >> > > > > >>> SERVER_JVMFLAGS:
> > > >> > >> > > > > >>> > >>> >
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> >
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > >> > >> > > > > >>> > >>> > This is a configuration that makes
> sense
> > > only
> > > >> > for
> > > >> > >> the
> > > >> > >> > > > > ZooKeeper
> > > >> > >> > > > > >>> > client,
> > > >> > >> > > > > >>> > >>> > not for the server. For the
> server, use
> > the
> > > >> > >> following:
> > > >> > >> > > > > >>> > >>> >
> > > >> > >> > > > > >>> > >>> >
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > >> > >> > > > > >>> > >>> >
> > > >> > >> > > > > >>> > >>> > If it doesn't solve the issue,
> then can
> > you
> > > >> > >> please send
> > > >> > >> > > > > your
> > > >> > >> > > > > >>> zoo.cfg
> > > >> > >> > > > > >>> > >>> file?
> > > >> > >> > > > > >>> > >>> > Also can you please send the zkCli
> > command
> > > >> you
> > > >> > >> execute?
> > > >> > >> > > > > (you
> > > >> > >> > > > > >>> need to
> > > >> > >> > > > > >>> > >>> > connect to the secure ZooKeeper
> port,
> > > unless
> > > >> > >> > > > > portUnification is
> > > >> > >> > > > > >>> > >>> enabled)
> > > >> > >> > > > > >>> > >>> >
> > > >> > >> > > > > >>> > >>> > Kind regards,
> > > >> > >> > > > > >>> > >>> > Mate
> > > >> > >> > > > > >>> > >>> >
> > > >> > >> > > > > >>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM
> kuldeep
> > > singh
> > > >> <
> > > >> > >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> > > >> > >> > > > > >>> > >>> > wrote:
> > > >> > >> > > > > >>> > >>> >
> > > >> > >> > > > > >>> > >>> >> Hi,
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >> we have done below changes in
> java.env
> > > file
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >> export SERVER_JVMFLAGS="
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> >
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > >> > >> > > > > >>> > >>> >>
> > -Dzookeeper.ssl.keyStore.password=testpass
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > >> > >> > > > > >>> > >>> >>
> > > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >> export CLIENT_JVMFLAGS="
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> >
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > >> > >> > > > > >>> > >>> >> -Dzookeeper.client.secure=true
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > >> > >> > > > > >>> > >>> >>
> > -Dzookeeper.ssl.keyStore.password=testpass
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > >> > >> > > > > >>> > >>> >>
> > > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >> I have started the ZK server and
> it is
> > up
> > > >> > >> without any
> > > >> > >> > > > > issue.
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >> But now when I login to ZkCli
> then it
> > > gives
> > > >> the
> > > >> > >> below
> > > >> > >> > > > > error.
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >> WatchedEvent state:AuthFailed
> type:None
> > > >> > path:null
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >> Zookeeper logs :- *2020-07-01
> > > 07:38:09,342 -
> > > >> > WARN
> > > >> > >> > > > > >>> > >>> >>
> > > [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
> > > >> -
> > > >> > >> No
> > > >> > >> > > > > >>> authentication
> > > >> > >> > > > > >>> > >>> provider
> > > >> > >> > > > > >>> > >>> >> for scheme: ztpasswd has x509 ip
> digest*
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >> Please help me on this issue
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >> Thanks,
> > > >> > >> > > > > >>> > >>> >> ---------------------
> > > >> > >> > > > > >>> > >>> >> Kuldeep Singh Budania
> > > >> > >> > > > > >>> > >>> >> Software Architect
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM
> kuldeep
> > > >> singh <
> > > >> > >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> > > >> > >> > > > > >>> > >>> >> wrote:
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >> > Hi,
> > > >> > >> > > > > >>> > >>> >> >
> > > >> > >> > > > > >>> > >>> >> > My ZK server is up and running
> in
> > > secure
> > > >> > >> mode, But
> > > >> > >> > > > > When I am
> > > >> > >> > > > > >>> > >>> trying to
> > > >> > >> > > > > >>> > >>> >> > connect to the ZK server using
> ZKCli,
> > it
> > > >> > gives
> > > >> > >> the
> > > >> > >> > > > below
> > > >> > >> > > > > >>> error.
> > > >> > >> > > > > >>> > >>> >> >
> > > >> > >> > > > > >>> > >>> >> > WatchedEvent state:AuthFailed
> > type:None
> > > >> > >> path:null
> > > >> > >> > > > > >>> > >>> >> >
> > > >> > >> > > > > >>> > >>> >> >
> > > >> > >> > > > > >>> > >>> >> > Zookeeper logs :- *2020-07-01
> > > >> 07:38:09,342 -
> > > >> > >> WARN
> > > >> > >> > > > > >>> > >>> >> >
> > > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
> > > >> > >> - No
> > > >> > >> > > > > >>> authentication
> > > >> > >> > > > > >>> > >>> >> provider
> > > >> > >> > > > > >>> > >>> >> > for scheme: ztpasswd has x509 ip
> > digest*
> > > >> > >> > > > > >>> > >>> >> >
> > > >> > >> > > > > >>> > >>> >> > Can someone please help me on
> this
> > > issue.
> > > >> we
> > > >> > >> are
> > > >> > >> > > using
> > > >> > >> > > > > the
> > > >> > >> > > > > >>> 3.5.6
> > > >> > >> > > > > >>> > >>> >> version.
> > > >> > >> > > > > >>> > >>> >> >
> > > >> > >> > > > > >>> > >>> >> > I appreciate if I will get a
> response
> > as
> > > >> soon
> > > >> > >> as
> > > >> > >> > > > > possible, as
> > > >> > >> > > > > >>> I am
> > > >> > >> > > > > >>> > >>> stuck
> > > >> > >> > > > > >>> > >>> >> > at this point.
> > > >> > >> > > > > >>> > >>> >> >
> > > >> > >> > > > > >>> > >>> >> > Thanks,
> > > >> > >> > > > > >>> > >>> >> > ---------------------
> > > >> > >> > > > > >>> > >>> >> > Kuldeep Singh Budania
> > > >> > >> > > > > >>> > >>> >> > Software Architect
> > > >> > >> > > > > >>> > >>> >> >
> > > >> > >> > > > > >>> > >>> >> >
> > > >> > >> > > > > >>> > >>> >> >
> > > >> > >> > > > > >>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM
> > Enrico
> > > >> > >> Olivelli -
> > > >> > >> > > > > Diennea
> > > >> > >> > > > > >>> > >>> >> > <enrico.olivelli@diennea.com
> .invalid>
> > > >> wrote:
> > > >> > >> > > > > >>> > >>> >> >
> > > >> > >> > > > > >>> > >>> >> >> I mean in zoo.cfg
> > > >> > >> > > > > >>> > >>> >> >> Not as a system property
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> Enrico
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> Il giorno 25/06/20, 08:19
> "Enrico
> > > >> Olivelli -
> > > >> > >> > > > Diennea" <
> > > >> > >> > > > > >>> > >>> >> >> enrico.olivelli@diennea.com
> .INVALID>
> > > ha
> > > >> > >> scritto:
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> Hi
> > > >> > >> > > > > >>> > >>> >> >> You have to enable Netty
> on the
> > > >> server
> > > >> > >> side
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> Something like:
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> > >>
> > >
> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> Hope that helps
> > > >> > >> > > > > >>> > >>> >> >> Enrico
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> Il giorno 24/06/20, 19:17
> > "kuldeep
> > > >> > singh"
> > > >> > >> <
> > > >> > >> > > > > >>> > >>> >> kuldeep.singh08@gmail.com>
> > > >> > >> > > > > >>> > >>> >> >> ha scritto:
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> Hi,
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> I got below error while
> > setting
> > > >> SSL
> > > >> > >> > > > properties
> > > >> > >> > > > > in
> > > >> > >> > > > > >>> > zkEnv.sh
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> ==========================================================================================
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,864 -
> > INFO
> > > >> > >> > > > > >>> > [main:QuorumPeerConfig@133]
> > > >> > >> > > > > >>> > >>> -
> > > >> > >> > > > > >>> > >>> >> >> Reading
> > > >> > >> > > > > >>> > >>> >> >> configuration from:
> > > >> > >> /etc/zookeeper/zoo.cfg
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,874 -
> > INFO
> > > >> > >> > > > > >>> > [main:QuorumPeerConfig@385]
> > > >> > >> > > > > >>> > >>> -
> > > >> > >> > > > > >>> > >>> >> >> clientPortAddress is
> > > >> > >> 0.0.0.0/0.0.0.0:10181
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,874 -
> > INFO
> > > >> > >> > > > > >>> > [main:QuorumPeerConfig@399]
> > > >> > >> > > > > >>> > >>> -
> > > >> > >> > > > > >>> > >>> >> >>
> secureClientPortAddress is
> > > >> > >> > > > > 0.0.0.0/0.0.0.0:2281
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,878 -
> > INFO
> > > >> > >> > > > > [main:X509Util@79] -
> > > >> > >> > > > > >>> > >>> Setting
> > > >> > >> > > > > >>> > >>> >> -D
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > jdk.tls.rejectClientInitiatedRenegotiation=true to
> > > >> > >> > > > > >>> > disable
> > > >> > >> > > > > >>> > >>> >> >> client-initiated
> > > >> > >> > > > > >>> > >>> >> >> TLS renegotiation
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,897 -
> > INFO
> > > >> > >> > > > > >>> > >>> [main:DatadirCleanupManager@78]
> > > >> > >> > > > > >>> > >>> >> -
> > > >> > >> > > > > >>> > >>> >> >>
> autopurge.snapRetainCount set
> > > to
> > > >> 3
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,897 -
> > INFO
> > > >> > >> > > > > >>> > >>> [main:DatadirCleanupManager@79]
> > > >> > >> > > > > >>> > >>> >> -
> > > >> > >> > > > > >>> > >>> >> >>
> autopurge.purgeInterval set
> > to
> > > 1
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,898 -
> > > INFO [
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > PurgeTask:DatadirCleanupManager$PurgeTask@138
> > > >> > >> > > > ]
> > > >> > >> > > > > -
> > > >> > >> > > > > >>> Purge
> > > >> > >> > > > > >>> > >>> task
> > > >> > >> > > > > >>> > >>> >> >> started.
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,899 -
> > INFO
> > > >> > >> > > > > [main:ManagedUtil@46]
> > > >> > >> > > > > >>> -
> > > >> > >> > > > > >>> > >>> Log4j
> > > >> > >> > > > > >>> > >>> >> >> found with
> > > >> > >> > > > > >>> > >>> >> >> jmx enabled.
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,903 -
> > INFO
> > > >> > >> > > > > >>> > >>> [PurgeTask:FileTxnSnapLog@103]
> > > >> > >> > > > > >>> > >>> >> -
> > > >> > >> > > > > >>> > >>> >> >>
> > zookeeper.snapshot.trust.empty
> > > :
> > > >> > false
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,910 -
> > > INFO [
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > PurgeTask:DatadirCleanupManager$PurgeTask@144
> > > >> > >> > > > ]
> > > >> > >> > > > > -
> > > >> > >> > > > > >>> Purge
> > > >> > >> > > > > >>> > >>> task
> > > >> > >> > > > > >>> > >>> >> >> completed.
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,975 -
> > INFO
> > > >> > >> > > > > >>> [main:QuorumPeerMain@141
> > > >> > >> > > > > >>> > ]
> > > >> > >> > > > > >>> > >>> -
> > > >> > >> > > > > >>> > >>> >> >> Starting quorum
> > > >> > >> > > > > >>> > >>> >> >> peer
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,983 -
> > INFO
> > > >> > >> > > > > >>> > [main:ServerCnxnFactory@135]
> > > >> > >> > > > > >>> > >>> -
> > > >> > >> > > > > >>> > >>> >> >> Using
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory
> as
> > > >> > >> > > > > >>> > server
> > > >> > >> > > > > >>> > >>> >> >> connection
> > > >> > >> > > > > >>> > >>> >> >> factory
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,986 -
> > INFO
> > > >> > >> > > > > >>> > >>> [main:NIOServerCnxnFactory@673]
> > > >> > >> > > > > >>> > >>> >> -
> > > >> > >> > > > > >>> > >>> >> >> Configuring NIO
> connection
> > > >> handler
> > > >> > >> with 10s
> > > >> > >> > > > > >>> sessionless
> > > >> > >> > > > > >>> > >>> >> >> connection timeout,
> > > >> > >> > > > > >>> > >>> >> >> 2 selector thread(s),
> 16
> > worker
> > > >> > >> threads,
> > > >> > >> > > and
> > > >> > >> > > > > 64 kB
> > > >> > >> > > > > >>> direct
> > > >> > >> > > > > >>> > >>> >> buffers.
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,992 -
> > INFO
> > > >> > >> > > > > >>> > >>> [main:NIOServerCnxnFactory@686
> > > >> > >> > > > > >>> > >>> >> ]
> > > >> > >> > > > > >>> > >>> >> >> - binding
> > > >> > >> > > > > >>> > >>> >> >> to port
> > 0.0.0.0/0.0.0.0:10181
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,994 -
> > INFO
> > > >> > >> > > > > >>> > [main:ServerCnxnFactory@135]
> > > >> > >> > > > > >>> > >>> -
> > > >> > >> > > > > >>> > >>> >> >> Using
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory
> as
> > > >> > >> > > > > >>> > server
> > > >> > >> > > > > >>> > >>> >> >> connection
> > > >> > >> > > > > >>> > >>> >> >> factory
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> 2020-06-24
> 15:49:35,995 -
> > ERROR
> > > >> > >> > > > > >>> [main:QuorumPeerMain@101
> > > >> > >> > > > > >>> > ]
> > > >> > >> > > > > >>> > >>> -
> > > >> > >> > > > > >>> > >>> >> >> Unexpected
> > > >> > >> > > > > >>> > >>> >> >> exception, exiting
> abnormally
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> java.lang.UnsupportedOperationException:
> > > >> > >> > > SSL
> > > >> > >> > > > > isn't
> > > >> > >> > > > > >>> > >>> supported in
> > > >> > >> > > > > >>> > >>> >> >> NIOServerCnxn
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> I have set the
> following
> > > >> properties
> > > >> > in
> > > >> > >> > > > > >>> SERVER_JVMFLAGS in
> > > >> > >> > > > > >>> > >>> >> >> zkEnv.sh file :
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > >
> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> Thanks,
> > > >> > >> > > > > >>> > >>> >> >> ---------------------
> > > >> > >> > > > > >>> > >>> >> >> Kuldeep Singh Budania
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> On Mon, Jun 22, 2020
> at 8:08
> > PM
> > > >> > Jordan
> > > >> > >> > > > > Zimmerman <
> > > >> > >> > > > > >>> > >>> >> >> jordan@jordanzimmerman.com>
> > > >> > >> > > > > >>> > >>> >> >> wrote:
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> > It's the same as the
> normal
> > > >> > >> ZooKeeper
> > > >> > >> > > > client:
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fzookeeper.apache.org%2Fdoc%2Fr3.6.1%2FzookeeperAdmin.html%23sc_authOptions&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944584465&sdata=8TEDANpc0bdegW%2FdQSSybnsaNJ9om4oU8Gwvp%2F931SA%3D&reserved=0
> > > >> > >> > > > > >>> > >>> >> >> > <
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fzookeeper.apache.org%2Fdoc%2Fr3.6.1%2FzookeeperAdmin.html%23sc_authOptions&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944584465&sdata=8TEDANpc0bdegW%2FdQSSybnsaNJ9om4oU8Gwvp%2F931SA%3D&reserved=0
> > > >> > >> > > > > >>> > >>> >> >> > >
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >> > -Jordan
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >> > > On Jun 22, 2020,
> at 5:50
> > > AM,
> > > >> > >> kuldeep
> > > >> > >> > > > singh
> > > >> > >> > > > > <
> > > >> > >> > > > > >>> > >>> >> >> kuldeep.singh08@gmail.com>
> > > >> > >> > > > > >>> > >>> >> >> > wrote:
> > > >> > >> > > > > >>> > >>> >> >> > >
> > > >> > >> > > > > >>> > >>> >> >> > > Hi Team,
> > > >> > >> > > > > >>> > >>> >> >> > > How we will do
> secure
> > > >> > >> communication
> > > >> > >> > > > > between the
> > > >> > >> > > > > >>> > Curator
> > > >> > >> > > > > >>> > >>> >> >> framework and
> > > >> > >> > > > > >>> > >>> >> >> > > zookeeper 3.5.6 ?
> > > >> > >> > > > > >>> > >>> >> >> > > I didn't get any
> solution
> > > >> right
> > > >> > >> now.
> > > >> > >> > > > > >>> > >>> >> >> > > I appreciate it if
> > someone
> > > >> could
> > > >> > >> help
> > > >> > >> > > me
> > > >> > >> > > > > with the
> > > >> > >> > > > > >>> > same.
> > > >> > >> > > > > >>> > >>> >> >> > >
> > > >> > >> > > > > >>> > >>> >> >> > > Thanks,
> > > >> > >> > > > > >>> > >>> >> >> > >
> ---------------------
> > > >> > >> > > > > >>> > >>> >> >> > > Kuldeep Singh
> Budania
> > > >> > >> > > > > >>> > >>> >> >> > > Software Architect
> > > >> > >> > > > > >>> > >>> >> >> > >
> > > >> > >> > > > > >>> > >>> >> >> > >
> > > >> > >> > > > > >>> > >>> >> >> > > On Fri, Apr 17,
> 2020 at
> > > 4:53
> > > >> PM
> > > >> > >> > > > > Szalay-Bekő Máté
> > > >> > >> > > > > >>> <
> > > >> > >> > > > > >>> > >>> >> >> >
> szalay.beko.mate@gmail.com
> > >
> > > >> > >> > > > > >>> > >>> >> >> > > wrote:
> > > >> > >> > > > > >>> > >>> >> >> > >
> > > >> > >> > > > > >>> > >>> >> >> > >> Hello Kuldeep,
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> > >> did you download
> the
> > > source
> > > >> > from
> > > >> > >> the
> > > >> > >> > > > > ZooKeeper
> > > >> > >> > > > > >>> > >>> webpage, or
> > > >> > >> > > > > >>> > >>> >> >> checked out
> > > >> > >> > > > > >>> > >>> >> >> > from
> > > >> > >> > > > > >>> > >>> >> >> > >> git?
> > > >> > >> > > > > >>> > >>> >> >> > >> Anyway, the
> following
> > > >> commands
> > > >> > >> should
> > > >> > >> > > > > work:
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> > >> wget
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdownloads.apache.org%2Fzookeeper%2Fzookeeper-3.5.7%2Fapache-zookeeper-3.5.7.tar.gz&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944584465&sdata=QddyI0EG%2FV6Yk5DZQLO0HZOqAaY9CQJRpVPQXydBenQ%3D&reserved=0
> > > >> > >> > > > > >>> > >>> >> >> > >> tar xzvf
> > > >> > >> > > ./apache-zookeeper-3.5.7.tar.gz
> > > >> > >> > > > > >>> > >>> >> >> > >> cd
> > apache-zookeeper-3.5.7
> > > >> > >> > > > > >>> > >>> >> >> > >> mvn clean install
> > > >> -DskipTests
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> > >> I tested it with
> OpenJDK
> > > >> 8u424
> > > >> > >> and
> > > >> > >> > > maven
> > > >> > >> > > > > 3.6.0.
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> > >> Kind regards,
> > > >> > >> > > > > >>> > >>> >> >> > >> Mate
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> > >> On Fri, Apr 17,
> 2020 at
> > > >> 12:51
> > > >> > PM
> > > >> > >> > > kuldeep
> > > >> > >> > > > > singh <
> > > >> > >> > > > > >>> > >>> >> >> >
> kuldeep.singh08@gmail.com>
> > > >> > >> > > > > >>> > >>> >> >> > >> wrote:
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> > >>> Hi All,
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>> I have download
> the
> > > >> zookeeper
> > > >> > >> source
> > > >> > >> > > > > code and
> > > >> > >> > > > > >>> run
> > > >> > >> > > > > >>> > >>> the mvn
> > > >> > >> > > > > >>> > >>> >> >> command for
> > > >> > >> > > > > >>> > >>> >> >> > >>> packaging but get
> > problem
> > > >> on
> > > >> > >> > > > > "zookeeper-server"
> > > >> > >> > > > > >>> > >>> >> directory.
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>> *command :- mvn
> clean
> > > >> package*
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] Failed to
> > execute
> > > >> goal
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > >
> > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> (default-compile) on
> > > >> project
> > > >> > >> > > zookeeper:
> > > >> > >> > > > > Fatal
> > > >> > >> > > > > >>> error
> > > >> > >> > > > > >>> > >>> >> >> compiling:
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> java.lang.NullPointerException
> > > >> > >> ->
> > > >> > >> > > [Help
> > > >> > >> > > > > 1]
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> org.apache.maven.lifecycle.LifecycleExecutionException:
> > > >> > >> > > > > >>> > >>> >> >> Failed to
> > > >> > >> > > > > >>> > >>> >> >> > execute
> > > >> > >> > > > > >>> > >>> >> >> > >>> goal
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > >
> > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> (default-compile) on
> > > >> project
> > > >> > >> > > zookeeper:
> > > >> > >> > > > > Fatal
> > > >> > >> > > > > >>> error
> > > >> > >> > > > > >>> > >>> >> >> compiling
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > >
> > > >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > >
> > > org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > >
> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > >
> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > > >> > >> > > > > Method)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >>
> > > >> > java.lang.reflect.Method.invoke(Method.java:498)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> > > >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > > >> > >> > > > > >>> > >>> >>
> > > >> org.apache.maven.plugin.MojoExecutionException:
> > > >> > >> > > > > >>> > >>> >> >> Fatal error
> > > >> > >> > > > > >>> > >>> >> >> > >>> compiling
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> > > >> > >> > > > > >>> > >>> >> >> > >>> ... 19
> more
> > > >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > > >> > >> > > > > >>> > >>> >>
> > > >> org.codehaus.plexus.compiler.CompilerException:
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> java.lang.NullPointerException
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> > > >> > >> > > > > >>> > >>> >> >> > >>> ... 22
> more
> > > >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > > >> > >> > > java.lang.RuntimeException:
> > > >> > >> > > > > >>> > >>> >> >> java.lang.NullPointerException
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > com.sun.tools.javac.main.Main.compile(Main.java:559)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > >
> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> >
> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> > > >> > >> > > > > >>> > >>> >> >> > >>> ... 24
> more
> > > >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > > >> > >> > > > java.lang.NullPointerException
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > com.sun.tools.doclint.Checker.scan(Checker.java:144)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > >
> > com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> > >>
> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>>
> > > >> > >> > >
> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> > >>
> > com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> > >>
> > com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>>
> > > >> > >> > >
> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> > >>
> > com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>>
> > > >> > >> > >
> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > >
> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>>
> > > >> > >> > >
> > > com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> > >>
> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>>
> > > >> > >> > >
> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > >
> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>>
> > > >> > >> > >
> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > >
> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> >
> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > >
> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > >
> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> > > >> > >> > > > > >>> > >>> >> >> > >>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > com.sun.tools.javac.main.Main.compile(Main.java:523)
> > > >> > >> > > > > >>> > >>> >> >> > >>> ... 27
> more
> > > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR]
> > > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] Re-run
> Maven
> > > using
> > > >> the
> > > >> > >> -X
> > > >> > >> > > > switch
> > > >> > >> > > > > to
> > > >> > >> > > > > >>> enable
> > > >> > >> > > > > >>> > >>> full
> > > >> > >> > > > > >>> > >>> >> >> debug logging.
> > > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR]
> > > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] For more
> > > >> information
> > > >> > >> about
> > > >> > >> > > the
> > > >> > >> > > > > errors
> > > >> > >> > > > > >>> and
> > > >> > >> > > > > >>> > >>> >> possible
> > > >> > >> > > > > >>> > >>> >> >> solutions,
> > > >> > >> > > > > >>> > >>> >> >> > >>> please read the
> > following
> > > >> > >> articles:
> > > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] [Help 1]
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > >
> > > >> > >>
> > > >>
> >
> https://apc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMAVEN%2FMojoExecutionException&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944584465&sdata=gtUwAs%2BuGjN%2Fal5vqEYg%2FFCJGClvI1YsiaewmltZDpo%3D&reserved=0
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>> Can someone help
> me on
> > > this
> > > >> > >> issue?
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>> Thanks,
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> ---------------------
> > > >> > >> > > > > >>> > >>> >> >> > >>> Kuldeep Singh
> Budania
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>> On Sat, Apr 4,
> 2020 at
> > > >> 5:57 PM
> > > >> > >> > > > > Szalay-Bekő
> > > >> > >> > > > > >>> Máté <
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > szalay.beko.mate@gmail.com
> > > >> >
> > > >> > >> > > > > >>> > >>> >> >> > >>> wrote:
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>> these
> exceptions can
> > > mean
> > > >> > many
> > > >> > >> > > > > things... I
> > > >> > >> > > > > >>> think
> > > >> > >> > > > > >>> > >>> this
> > > >> > >> > > > > >>> > >>> >> can
> > > >> > >> > > > > >>> > >>> >> >> be even
> > > >> > >> > > > > >>> > >>> >> >> > >> normal
> > > >> > >> > > > > >>> > >>> >> >> > >>>> duding rolling
> restart
> > > (as
> > > >> > some
> > > >> > >> > > > > connections
> > > >> > >> > > > > >>> get
> > > >> > >> > > > > >>> > >>> broken
> > > >> > >> > > > > >>> > >>> >> in
> > > >> > >> > > > > >>> > >>> >> >> this case)
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>> However, I saw
> cases
> > > >> already
> > > >> > >> when
> > > >> > >> > > > > exceptions
> > > >> > >> > > > > >>> like
> > > >> > >> > > > > >>> > >>> these
> > > >> > >> > > > > >>> > >>> >> >> killed
> > > >> > >> > > > > >>> > >>> >> >> > receiver
> > > >> > >> > > > > >>> > >>> >> >> > >>> or
> > > >> > >> > > > > >>> > >>> >> >> > >>>> sender threads
> in
> > > >> > >> QuorumCnxManager /
> > > >> > >> > > > > Leader
> > > >> > >> > > > > >>> > >>> Election in
> > > >> > >> > > > > >>> > >>> >> >> such a way
> > > >> > >> > > > > >>> > >>> >> >> > that
> > > >> > >> > > > > >>> > >>> >> >> > >>>> they were not
> able to
> > > >> > recover,
> > > >> > >> so
> > > >> > >> > > the
> > > >> > >> > > > > node was
> > > >> > >> > > > > >>> > >>> unable to
> > > >> > >> > > > > >>> > >>> >> >> connect to
> > > >> > >> > > > > >>> > >>> >> >> > any
> > > >> > >> > > > > >>> > >>> >> >> > >>>> quorum until
> restart.
> > I
> > > >> > >> remember
> > > >> > >> > > > seeing
> > > >> > >> > > > > this
> > > >> > >> > > > > >>> in
> > > >> > >> > > > > >>> > 3.4
> > > >> > >> > > > > >>> > >>> too.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>> Do you see these
> > > >> exceptions
> > > >> > in
> > > >> > >> the
> > > >> > >> > > > > second
> > > >> > >> > > > > >>> server
> > > >> > >> > > > > >>> > >>> (the
> > > >> > >> > > > > >>> > >>> >> one
> > > >> > >> > > > > >>> > >>> >> >> which you
> > > >> > >> > > > > >>> > >>> >> >> > >> just
> > > >> > >> > > > > >>> > >>> >> >> > >>>> upgraded in
> step 3)?
> > > >> > >> > > > > >>> > >>> >> >> > >>>> Is this issue
> > > >> reproducible?
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>> What is the
> tickTime
> > and
> > > >> > >> initLimit
> > > >> > >> > > you
> > > >> > >> > > > > use?
> > > >> > >> > > > > >>> Maybe
> > > >> > >> > > > > >>> > >>> the
> > > >> > >> > > > > >>> > >>> >> >> server just
> > > >> > >> > > > > >>> > >>> >> >> > >> require
> > > >> > >> > > > > >>> > >>> >> >> > >>>> more time to
> sync?
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>> I would need
> more logs
> > > to
> > > >> > >> really see
> > > >> > >> > > > > what
> > > >> > >> > > > > >>> > happened.
> > > >> > >> > > > > >>> > >>> Can
> > > >> > >> > > > > >>> > >>> >> >> you create a
> > > >> > >> > > > > >>> > >>> >> >> > >> Jira
> > > >> > >> > > > > >>> > >>> >> >> > >>>> issue and
> upload the
> > > logs
> > > >> and
> > > >> > >> also
> > > >> > >> > > the
> > > >> > >> > > > > >>> ZooKeeper
> > > >> > >> > > > > >>> > >>> >> configs?
> > > >> > >> > > > > >>> > >>> >> >> I am happy
> > > >> > >> > > > > >>> > >>> >> >> > to
> > > >> > >> > > > > >>> > >>> >> >> > >>>> take a closer
> look.
> > > >> > >> > > > > >>> > >>> >> >> > >>>> (if you need to
> re-run
> > > the
> > > >> > >> test to
> > > >> > >> > > > > collect the
> > > >> > >> > > > > >>> > logs,
> > > >> > >> > > > > >>> > >>> >> then
> > > >> > >> > > > > >>> > >>> >> >> enabling
> > > >> > >> > > > > >>> > >>> >> >> > >> DEBUG
> > > >> > >> > > > > >>> > >>> >> >> > >>>> logs would be
> great.
> > The
> > > >> INFO
> > > >> > >> level
> > > >> > >> > > > > logs are
> > > >> > >> > > > > >>> > usually
> > > >> > >> > > > > >>> > >>> >> >> enough for these
> > > >> > >> > > > > >>> > >>> >> >> > >>>> problems, but
> one can
> > > >> never
> > > >> > >> know...)
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>> Kind regards,
> > > >> > >> > > > > >>> > >>> >> >> > >>>> Mate
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>> On Fri, Apr 3,
> 2020 at
> > > >> 10:05
> > > >> > AM
> > > >> > >> > > > kuldeep
> > > >> > >> > > > > singh
> > > >> > >> > > > > >>> <
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > kuldeep.singh08@gmail.com
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>> wrote:
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> Hi Team,
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> I have done
> some POC
> > on
> > > >> > >> rolling
> > > >> > >> > > > > upgrade and
> > > >> > >> > > > > >>> found
> > > >> > >> > > > > >>> > >>> below
> > > >> > >> > > > > >>> > >>> >> >> result.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> 1. On 1st
> node
> > > upgrade
> > > >> > >> zookeeper
> > > >> > >> > > .
> > > >> > >> > > > > Traffic
> > > >> > >> > > > > >>> was
> > > >> > >> > > > > >>> > >>> >> running
> > > >> > >> > > > > >>> > >>> >> >> fine
> > > >> > >> > > > > >>> > >>> >> >> > >> because
> > > >> > >> > > > > >>> > >>> >> >> > >>> 2
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> nodes are
> already
> > on
> > > >> old
> > > >> > >> > > zookeeper.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> 2. On 1st
> node
> > > upgrade
> > > >> our
> > > >> > >> > > > > application and
> > > >> > >> > > > > >>> > didn’t
> > > >> > >> > > > > >>> > >>> >> find
> > > >> > >> > > > > >>> > >>> >> >> any issue
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> 3. On 2nd
> node
> > > upgrade
> > > >> > >> zookeeper
> > > >> > >> > > > but
> > > >> > >> > > > > got
> > > >> > >> > > > > >>> below
> > > >> > >> > > > > >>> > >>> error
> > > >> > >> > > > > >>> > >>> >> >> and zookeeper
> > > >> > >> > > > > >>> > >>> >> >> > >>> is
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> not taking
> any
> > > requests
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> 4.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> java.io.EOFException
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > >
> java.io.DataInputStream.readInt(DataInputStream.java:392)
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30
> > > 14:19:55,587 -
> > > >> > WARN
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
> > > >> > >> > > > > >>> -
> > > >> > >> > > > > >>> > >>> >> >> Interrupting
> > > >> > >> > > > > >>> > >>> >> >> > >>> SendWorker
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30
> > > 14:19:55,588 -
> > > >> > >> ERROR
> > > >> > >> > > > > >>> [LearnerHandler-/
> > > >> > >> > > > > >>> > >>> >> >> 192.168.44.73:33754
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> :LearnerHandler@562]
> > -
> > > >> > >> Unexpected
> > > >> > >> > > > > exception
> > > >> > >> > > > > >>> > >>> causing
> > > >> > >> > > > > >>> > >>> >> >> shutdown while
> > > >> > >> > > > > >>> > >>> >> >> > >>> sock
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> still open
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> java.io.EOFException
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > >
> java.io.DataInputStream.readInt(DataInputStream.java:392)
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >>
> > > >>
> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30
> > > 14:19:55,588 -
> > > >> > WARN
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > [SendWorker:1:QuorumCnxManager$SendWorker@679]
> > > >> > >> > > > > >>> -
> > > >> > >> > > > > >>> > >>> >> >> Interrupted while
> > > >> > >> > > > > >>> > >>> >> >> > >>>> waiting
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> for message on
> queue
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> Please let me
> know is
> > > >> this
> > > >> > the
> > > >> > >> > > known
> > > >> > >> > > > > issue or
> > > >> > >> > > > > >>> > this
> > > >> > >> > > > > >>> > >>> is
> > > >> > >> > > > > >>> > >>> >> >> different issue
> > > >> > >> > > > > >>> > >>> >> >> > >>>> which
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> is mention in
> Apache
> > > >> > zookeeper
> > > >> > >> > > > > documentation
> > > >> > >> > > > > >>> when
> > > >> > >> > > > > >>> > >>> >> >> upgrading from
> > > >> > >> > > > > >>> > >>> >> >> > >> 3.4.5
> > > >> > >> > > > > >>> > >>> >> >> > >>> to
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> 3.5.6
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> Thanks,
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> ---------------------
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> Kuldeep Singh
> Budania
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> Software
> Architect
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> On Sun, Mar
> 29, 2020
> > at
> > > >> 9:06
> > > >> > >> AM
> > > >> > >> > > > > Alexander
> > > >> > >> > > > > >>> Shraer
> > > >> > >> > > > > >>> > <
> > > >> > >> > > > > >>> > >>> >> >> shralex@gmail.com>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> wrote:
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> +1 to what
> Mate said
> > > (I
> > > >> > >> wrote the
> > > >> > >> > > > > quoted
> > > >> > >> > > > > >>> > >>> >> instructions).
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> On Tue, Mar
> 24, 2020
> > > at
> > > >> > 7:03
> > > >> > >> AM
> > > >> > >> > > > > Szalay-Bekő
> > > >> > >> > > > > >>> > Máté <
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > > >> szalay.beko.mate@gmail.com
> > > >> > >
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> wrote:
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> Hi Kuldeep,
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> I just want
> to
> > > provide
> > > >> you
> > > >> > >> some
> > > >> > >> > > > > background
> > > >> > >> > > > > >>> info
> > > >> > >> > > > > >>> > >>> about
> > > >> > >> > > > > >>> > >>> >> >> our
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> documentation.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> The reason to
> > upgrade
> > > >> to
> > > >> > >> 3.4.6
> > > >> > >> > > > first
> > > >> > >> > > > > is to
> > > >> > >> > > > > >>> > avoid
> > > >> > >> > > > > >>> > >>> the
> > > >> > >> > > > > >>> > >>> >> >> following
> > > >> > >> > > > > >>> > >>> >> >> > >>> error:
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> 2013-01-30
> > > >> 11:32:10,663
> > > >> > >> > > [myid:2] -
> > > >> > >> > > > > WARN
> > > >> > >> > > > > >>> > >>> [localhost/
> > > >> > >> > > > > >>> > >>> >> >> > >>> 127.0.0.1:2784
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > :QuorumCnxManager@349
> > > ]
> > > >> -
> > > >> > >> Invalid
> > > >> > >> > > > > server
> > > >> > >> > > > > >>> id:
> > > >> > >> > > > > >>> > >>> -65536
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> This error
> comes
> > > >> because
> > > >> > of
> > > >> > >> the
> > > >> > >> > > > > protocol
> > > >> > >> > > > > >>> > changes
> > > >> > >> > > > > >>> > >>> >> between
> > > >> > >> > > > > >>> > >>> >> >> > >> ZooKeeper
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> server
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> nodes during
> > > connection
> > > >> > >> > > initiation
> > > >> > >> > > > > for
> > > >> > >> > > > > >>> leader
> > > >> > >> > > > > >>> > >>> >> election.
> > > >> > >> > > > > >>> > >>> >> >> In
> > > >> > >> > > > > >>> > >>> >> >> > >>> ZooKeeper
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> 3.5
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> a
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> protocol
> version
> > was
> > > >> > >> introduced
> > > >> > >> > > > (see
> > > >> > >> > > > > >>> > >>> ZOOKEEPER-107)
> > > >> > >> > > > > >>> > >>> >> and
> > > >> > >> > > > > >>> > >>> >> >> since
> > > >> > >> > > > > >>> > >>> >> >> > >> that
> > > >> > >> > > > > >>> > >>> >> >> > >>>> time
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> the
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> fist long
> value
> > sent
> > > in
> > > >> > the
> > > >> > >> > > initial
> > > >> > >> > > > > >>> message is
> > > >> > >> > > > > >>> > >>> not
> > > >> > >> > > > > >>> > >>> >> the
> > > >> > >> > > > > >>> > >>> >> >> server ID
> > > >> > >> > > > > >>> > >>> >> >> > >>> but
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> the
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> protocol
> version
> > > >> (-65536).
> > > >> > >> In
> > > >> > >> > > > > ZooKeeper
> > > >> > >> > > > > >>> 3.4.6
> > > >> > >> > > > > >>> > we
> > > >> > >> > > > > >>> > >>> made
> > > >> > >> > > > > >>> > >>> >> >> the old 3.4
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> ZooKeepers
> backward
> > > >> > >> compatible,
> > > >> > >> > > so
> > > >> > >> > > > > they are
> > > >> > >> > > > > >>> > able
> > > >> > >> > > > > >>> > >>> to
> > > >> > >> > > > > >>> > >>> >> >> parse both
> > > >> > >> > > > > >>> > >>> >> >> > >> the
> > > >> > >> > > > > >>> > >>> >> >> > >>>> old
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> and
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> the new
> protocol
> > > format
> > > >> > (see
> > > >> > >> > > > > >>> ZOOKEEPER-1633).
> > > >> > >> > > > > >>> > >>> This
> > > >> > >> > > > > >>> > >>> >> >> issue happens
> > > >> > >> > > > > >>> > >>> >> >> > >>> only
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> when
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> you need to
> use old
> > > >> > (3.4.0 -
> > > >> > >> > > 3.4.5)
> > > >> > >> > > > > and new
> > > >> > >> > > > > >>> > >>> (3.5.0+)
> > > >> > >> > > > > >>> > >>> >> >> ZooKeeper
> > > >> > >> > > > > >>> > >>> >> >> > >>>> servers
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> together in
> the
> > same
> > > >> > >> cluster.
> > > >> > >> > > > During
> > > >> > >> > > > > a
> > > >> > >> > > > > >>> rolling
> > > >> > >> > > > > >>> > >>> >> upgrade,
> > > >> > >> > > > > >>> > >>> >> >> this is
> > > >> > >> > > > > >>> > >>> >> >> > >>>> usually
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> the
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> case to have
> old
> > and
> > > >> new
> > > >> > >> > > ZooKeepers
> > > >> > >> > > > > present
> > > >> > >> > > > > >>> > >>> together.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> The fact
> that you
> > > >> haven't
> > > >> > >> seen
> > > >> > >> > > any
> > > >> > >> > > > > issues
> > > >> > >> > > > > >>> might
> > > >> > >> > > > > >>> > >>> be
> > > >> > >> > > > > >>> > >>> >> >> caused by the
> > > >> > >> > > > > >>> > >>> >> >> > >>>> order
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> of
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> the servers.
> In
> > > >> ZooKeeper
> > > >> > >> the
> > > >> > >> > > > > connection
> > > >> > >> > > > > >>> > >>> initiation
> > > >> > >> > > > > >>> > >>> >> >> between the
> > > >> > >> > > > > >>> > >>> >> >> > >>>> servers
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> during the
> leader
> > > >> election
> > > >> > >> > > follows
> > > >> > >> > > > a
> > > >> > >> > > > > >>> specific
> > > >> > >> > > > > >>> > >>> rule.
> > > >> > >> > > > > >>> > >>> >> As
> > > >> > >> > > > > >>> > >>> >> >> far as I
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> remember
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> always the
> server
> > > with
> > > >> the
> > > >> > >> larger
> > > >> > >> > > > ID
> > > >> > >> > > > > 'wins
> > > >> > >> > > > > >>> the
> > > >> > >> > > > > >>> > >>> >> >> challenge', so it
> > > >> > >> > > > > >>> > >>> >> >> > >> is
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> possible,
> that the
> > > old
> > > >> > >> server
> > > >> > >> > > > didn't
> > > >> > >> > > > > need
> > > >> > >> > > > > >>> to
> > > >> > >> > > > > >>> > >>> parse
> > > >> > >> > > > > >>> > >>> >> any
> > > >> > >> > > > > >>> > >>> >> >> initial
> > > >> > >> > > > > >>> > >>> >> >> > >>>> message
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> (if
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> it had the
> largest
> > > ID)
> > > >> and
> > > >> > >> this
> > > >> > >> > > is
> > > >> > >> > > > > why you
> > > >> > >> > > > > >>> > >>> haven't
> > > >> > >> > > > > >>> > >>> >> seen
> > > >> > >> > > > > >>> > >>> >> >> the
> > > >> > >> > > > > >>> > >>> >> >> > >> issue.
> > > >> > >> > > > > >>> > >>> >> >> > >>>> Also
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> having 2
> nodes up
> > > from
> > > >> > the 3
> > > >> > >> > > nodes
> > > >> > >> > > > > cluster
> > > >> > >> > > > > >>> > still
> > > >> > >> > > > > >>> > >>> >> makes
> > > >> > >> > > > > >>> > >>> >> >> the
> > > >> > >> > > > > >>> > >>> >> >> > >> cluster
> > > >> > >> > > > > >>> > >>> >> >> > >>>> work
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> (so
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> you should
> also
> > check
> > > >> if
> > > >> > >> all the
> > > >> > >> > > > > servers
> > > >> > >> > > > > >>> are
> > > >> > >> > > > > >>> > >>> part of
> > > >> > >> > > > > >>> > >>> >> >> the quorum).
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> I agree with
> Enrico
> > > and
> > > >> > >> Norbert,
> > > >> > >> > > > the
> > > >> > >> > > > > >>> safest and
> > > >> > >> > > > > >>> > >>> most
> > > >> > >> > > > > >>> > >>> >> >> stable way
> > > >> > >> > > > > >>> > >>> >> >> > >> is
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> upgrade
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> first to
> > 3.4.latest,
> > > >> then
> > > >> > >> go to
> > > >> > >> > > > > 3.5.latest.
> > > >> > >> > > > > >>> > >>> Still, if
> > > >> > >> > > > > >>> > >>> >> >> you don't
> > > >> > >> > > > > >>> > >>> >> >> > >> see
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> that
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> you would
> hit this
> > > >> > specific
> > > >> > >> issue
> > > >> > >> > > > > (e.g. no
> > > >> > >> > > > > >>> > >>> "Invalid
> > > >> > >> > > > > >>> > >>> >> >> server id" in
> > > >> > >> > > > > >>> > >>> >> >> > >>> the
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> log
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> files), and
> all the
> > > >> three
> > > >> > >> servers
> > > >> > >> > > > can
> > > >> > >> > > > > >>> handle
> > > >> > >> > > > > >>> > >>> traffic,
> > > >> > >> > > > > >>> > >>> >> >> then maybe
> > > >> > >> > > > > >>> > >>> >> >> > >>> you
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> don't
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> need to
> upgrade
> > first
> > > >> to
> > > >> > >> > > > 3.4.latest,
> > > >> > >> > > > > it is
> > > >> > >> > > > > >>> your
> > > >> > >> > > > > >>> > >>> >> >> decision.
> > > >> > >> > > > > >>> > >>> >> >> > >>> Definitely
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> you
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> should test
> it
> > first,
> > > >> as
> > > >> > >> > > suggested
> > > >> > >> > > > > by the
> > > >> > >> > > > > >>> > others.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> Kind regards,
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> Mate
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> On Tue, Mar
> 24,
> > 2020
> > > at
> > > >> > >> 12:29 PM
> > > >> > >> > > > > Norbert
> > > >> > >> > > > > >>> Kalmar
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > > >> > >> <nk...@cloudera.com.invalid>
> > > >> > >> > > > > wrote:
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> Hi,
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> That guide
> is to
> > > >> upgrade
> > > >> > to
> > > >> > >> > > 3.5.0,
> > > >> > >> > > > > which
> > > >> > >> > > > > >>> was
> > > >> > >> > > > > >>> > an
> > > >> > >> > > > > >>> > >>> >> alpha
> > > >> > >> > > > > >>> > >>> >> >> version.
> > > >> > >> > > > > >>> > >>> >> >> > >> A
> > > >> > >> > > > > >>> > >>> >> >> > >>>> lot
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> has
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> changed for
> the
> > > first
> > > >> > >> stable
> > > >> > >> > > > > release of
> > > >> > >> > > > > >>> 3.5.5
> > > >> > >> > > > > >>> > >>> and
> > > >> > >> > > > > >>> > >>> >> then
> > > >> > >> > > > > >>> > >>> >> >> a few
> > > >> > >> > > > > >>> > >>> >> >> > >>> more,
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> even
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> rolling
> upgrade
> > > issues
> > > >> > >> have been
> > > >> > >> > > > > fixed for
> > > >> > >> > > > > >>> > >>> 3.5.6.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> This is a
> more
> > > >> up-to-date
> > > >> > >> guide:
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > >
> > > >> >
> https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FZOOKEEPER%2FUpgrade%2BFAQ&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944584465&sdata=w4GCQg9UtiBX8dXk4b9%2BBWDY0OzRL37G0RDjnlPNxBk%3D&reserved=0
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> If you have
> done
> > > your
> > > >> > >> testing
> > > >> > >> > > > (with
> > > >> > >> > > > > prod
> > > >> > >> > > > > >>> > >>> snapshot!),
> > > >> > >> > > > > >>> > >>> >> >> then you
> > > >> > >> > > > > >>> > >>> >> >> > >> can
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> skip
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> 3.4
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> latest
> upgrade,
> > but
> > > >> keep
> > > >> > >> in mind
> > > >> > >> > > > we
> > > >> > >> > > > > do our
> > > >> > >> > > > > >>> > >>> >> >> recommendations for
> > > >> > >> > > > > >>> > >>> >> >> > >> a
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> reason.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> There were
> issues
> > > >> > reported
> > > >> > >> > > and/or
> > > >> > >> > > > > found
> > > >> > >> > > > > >>> during
> > > >> > >> > > > > >>> > >>> >> >> testing. Some
> > > >> > >> > > > > >>> > >>> >> >> > >> are
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> fixed
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> with
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> 3.5.6, some
> only
> > > >> happens
> > > >> > if
> > > >> > >> > > > certain
> > > >> > >> > > > > >>> conditions
> > > >> > >> > > > > >>> > >>> stand
> > > >> > >> > > > > >>> > >>> >> >> > >>> (IOException:
> > > >> > >> > > > > >>> > >>> >> >> > >>>> No
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> snapshot
> found -
> > > >> > mentioned
> > > >> > >> in
> > > >> > >> > > the
> > > >> > >> > > > > guide,
> > > >> > >> > > > > >>> fixed
> > > >> > >> > > > > >>> > >>> in
> > > >> > >> > > > > >>> > >>> >> >> 3.5.6).
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> So it is up
> to
> > you,
> > > I
> > > >> > would
> > > >> > >> > > still
> > > >> > >> > > > > >>> recommend to
> > > >> > >> > > > > >>> > >>> do an
> > > >> > >> > > > > >>> > >>> >> >> 3.4
> > > >> > >> > > > > >>> > >>> >> >> > >> upgrade
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> first,
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> if
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> it's
> feasible.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> Regards,
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> Norbert
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> On Tue, Mar
> 24,
> > 2020
> > > >> at
> > > >> > >> 11:45 AM
> > > >> > >> > > > > kuldeep
> > > >> > >> > > > > >>> > singh <
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > > >> kuldeep.singh08@gmail.com
> > > >> > >
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> wrote:
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Hi,
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Current
> Zookeeper
> > > >> > version
> > > >> > >> :-
> > > >> > >> > > > 3.4.5
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Upgraded
> version
> > > >> > >> > > > :-
> > > >> > >> > > > > 3.5.6
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> We are not
> going
> > > with
> > > >> > >> 3.5.7.
> > > >> > >> > > Our
> > > >> > >> > > > > final
> > > >> > >> > > > > >>> > >>> decision is
> > > >> > >> > > > > >>> > >>> >> >> zookeeper
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> version
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> is
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.5.6
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> as per
> your reply
> > > >> first
> > > >> > >> we need
> > > >> > >> > > > to
> > > >> > >> > > > > move
> > > >> > >> > > > > >>> > latest
> > > >> > >> > > > > >>> > >>> >> >> version of
> > > >> > >> > > > > >>> > >>> >> >> > >>> 3.4.x,
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> like
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> below
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5 ->
> 3.4.14
> > ->
> > > >> 3.5.6
> > > >> > >> > > (Correct
> > > >> > >> > > > > me if
> > > >> > >> > > > > >>> I am
> > > >> > >> > > > > >>> > >>> wrong
> > > >> > >> > > > > >>> > >>> >> >> here)
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> But if We
> are not
> > > >> facing
> > > >> > >> any
> > > >> > >> > > > > problem
> > > >> > >> > > > > >>> that i
> > > >> > >> > > > > >>> > >>> have
> > > >> > >> > > > > >>> > >>> >> >> shared you
> > > >> > >> > > > > >>> > >>> >> >> > >>> that
> > > >> > >> > > > > >>> > >>> >> >> > >>>> we
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> have
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> set up of
> 3 node
> > > >> cluster
> > > >> > >> where
> > > >> > >> > > 2
> > > >> > >> > > > > node
> > > >> > >> > > > > >>> are on
> > > >> > >> > > > > >>> > >>> 3.5.6
> > > >> > >> > > > > >>> > >>> >> >> version
> > > >> > >> > > > > >>> > >>> >> >> > >> and
> > > >> > >> > > > > >>> > >>> >> >> > >>> 1
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> node
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> on
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5,
> Everything
> > > is
> > > >> > >> running
> > > >> > >> > > fine
> > > >> > >> > > > > and
> > > >> > >> > > > > >>> didn't
> > > >> > >> > > > > >>> > >>> get
> > > >> > >> > > > > >>> > >>> >> any
> > > >> > >> > > > > >>> > >>> >> >> issue,
> > > >> > >> > > > > >>> > >>> >> >> > >> So
> > > >> > >> > > > > >>> > >>> >> >> > >>>> what
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> other
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> problem we
> can
> > face
> > > >> if
> > > >> > we
> > > >> > >> > > > directly
> > > >> > >> > > > > move
> > > >> > >> > > > > >>> to
> > > >> > >> > > > > >>> > >>> 3.5.6
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Thanks,
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > ---------------------
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Kuldeep
> Singh
> > > Budania
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Software
> > Architect
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> On Tue,
> Mar 24,
> > > 2020
> > > >> at
> > > >> > >> 3:58 PM
> > > >> > >> > > > > Enrico
> > > >> > >> > > > > >>> > >>> Olivelli <
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> eolivelli@gmail.com
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> wrote:
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Hi
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> You have
> to
> > > upgrade
> > > >> to
> > > >> > >> latest
> > > >> > >> > > > > 3.4.x
> > > >> > >> > > > > >>> > Zookeeper
> > > >> > >> > > > > >>> > >>> then
> > > >> > >> > > > > >>> > >>> >> >> you will
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> upgrade
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> to
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> 3.5.7.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> All
> should run
> > > well
> > > >> > >> without
> > > >> > >> > > > issues
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Enrico
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Il Mar 24
> Mar
> > > 2020,
> > > >> > 10:18
> > > >> > >> > > > kuldeep
> > > >> > >> > > > > singh
> > > >> > >> > > > > >>> <
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> kuldeep.singh08@gmail.com
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> ha
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> scritto:
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Hi Team,
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> We are
> > upgrading
> > > >> > >> zookeeper
> > > >> > >> > > from
> > > >> > >> > > > > 3.4.5
> > > >> > >> > > > > >>> to
> > > >> > >> > > > > >>> > >>> 3.5.6. I
> > > >> > >> > > > > >>> > >>> >> >> have
> > > >> > >> > > > > >>> > >>> >> >> > >> set
> > > >> > >> > > > > >>> > >>> >> >> > >>>> up 3
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> node
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> cluster
> where 2
> > > >> node
> > > >> > >> are on
> > > >> > >> > > > 3.5.6
> > > >> > >> > > > > >>> version
> > > >> > >> > > > > >>> > >>> and 1
> > > >> > >> > > > > >>> > >>> >> >> node on
> > > >> > >> > > > > >>> > >>> >> >> > >>>> 3.4.5.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> Everything is
> > > >> running
> > > >> > >> fine
> > > >> > >> > > and
> > > >> > >> > > > > didn't
> > > >> > >> > > > > >>> get
> > > >> > >> > > > > >>> > any
> > > >> > >> > > > > >>> > >>> >> issue
> > > >> > >> > > > > >>> > >>> >> >> on my
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> system.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> but I
> found
> > > >> something
> > > >> > on
> > > >> > >> > > apache
> > > >> > >> > > > > site
> > > >> > >> > > > > >>> that
> > > >> > >> > > > > >>> > >>> first
> > > >> > >> > > > > >>> > >>> >> we
> > > >> > >> > > > > >>> > >>> >> >> need
> > > >> > >> > > > > >>> > >>> >> >> > >> to
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> upgrade
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> on
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 3.4.6
> than we
> > can
> > > >> > >> upgrade to
> > > >> > >> > > > > 3.5.6. So
> > > >> > >> > > > > >>> is
> > > >> > >> > > > > >>> > it
> > > >> > >> > > > > >>> > >>> >> >> mandatory
> > > >> > >> > > > > >>> > >>> >> >> > >> to
> > > >> > >> > > > > >>> > >>> >> >> > >>> go
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> on
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> 3.4.6
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> first.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> *Upgrading to
> > > >> 3.5.0*
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> Upgrading a
> > > running
> > > >> > >> ZooKeeper
> > > >> > >> > > > > ensemble
> > > >> > >> > > > > >>> to
> > > >> > >> > > > > >>> > >>> 3.5.0
> > > >> > >> > > > > >>> > >>> >> >> should be
> > > >> > >> > > > > >>> > >>> >> >> > >>>> done
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> only
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> after
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> upgrading your
> > > >> > ensemble
> > > >> > >> to
> > > >> > >> > > the
> > > >> > >> > > > > 3.4.6
> > > >> > >> > > > > >>> > release.
> > > >> > >> > > > > >>> > >>> >> Note
> > > >> > >> > > > > >>> > >>> >> >> that
> > > >> > >> > > > > >>> > >>> >> >> > >>> this
> > > >> > >> > > > > >>> > >>> >> >> > >>>> is
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> only
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> necessary for
> > > >> rolling
> > > >> > >> > > upgrades
> > > >> > >> > > > > (if
> > > >> > >> > > > > >>> you're
> > > >> > >> > > > > >>> > >>> fine
> > > >> > >> > > > > >>> > >>> >> with
> > > >> > >> > > > > >>> > >>> >> >> > >>> shutting
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> down
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> the
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> system
> > > completely,
> > > >> you
> > > >> > >> don't
> > > >> > >> > > > > have to go
> > > >> > >> > > > > >>> > >>> through
> > > >> > >> > > > > >>> > >>> >> >> 3.4.6).
> > > >> > >> > > > > >>> > >>> >> >> > >> If
> > > >> > >> > > > > >>> > >>> >> >> > >>>> you
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> attempt
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> a
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> rolling
> upgrade
> > > >> > without
> > > >> > >> going
> > > >> > >> > > > > through
> > > >> > >> > > > > >>> 3.4.6
> > > >> > >> > > > > >>> > >>> (for
> > > >> > >> > > > > >>> > >>> >> >> example
> > > >> > >> > > > > >>> > >>> >> >> > >>> from
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> 3.4.5),
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> you
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> may get
> the
> > > >> following
> > > >> > >> error:
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> 2013-01-30
> > > >> > 11:32:10,663
> > > >> > >> > > > [myid:2]
> > > >> > >> > > > > - INFO
> > > >> > >> > > > > >>> > >>> >> [localhost/
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> 127.0.0.1:2784
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> > >> > > :QuorumCnxManager$Listener@498
> > > >> > >> > > > ]
> > > >> > >> > > > > -
> > > >> > >> > > > > >>> Received
> > > >> > >> > > > > >>> > >>> >> >> connection
> > > >> > >> > > > > >>> > >>> >> >> > >>>> request
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> /
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > 127.0.0.1:60876
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> 2013-01-30
> > > >> > 11:32:10,663
> > > >> > >> > > > [myid:2]
> > > >> > >> > > > > - WARN
> > > >> > >> > > > > >>> > >>> >> [localhost/
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> 127.0.0.1:2784
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> :QuorumCnxManager@349
> > > >> > ]
> > > >> > >> -
> > > >> > >> > > > Invalid
> > > >> > >> > > > > >>> server
> > > >> > >> > > > > >>> > id:
> > > >> > >> > > > > >>> > >>> >> -65536
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> During a
> > rolling
> > > >> > >> upgrade,
> > > >> > >> > > each
> > > >> > >> > > > > server
> > > >> > >> > > > > >>> is
> > > >> > >> > > > > >>> > >>> taken
> > > >> > >> > > > > >>> > >>> >> down
> > > >> > >> > > > > >>> > >>> >> >> in
> > > >> > >> > > > > >>> > >>> >> >> > >> turn
> > > >> > >> > > > > >>> > >>> >> >> > >>>> and
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> rebooted
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> with the
> new
> > > 3.5.0
> > > >> > >> binaries.
> > > >> > >> > > > > Before
> > > >> > >> > > > > >>> > starting
> > > >> > >> > > > > >>> > >>> the
> > > >> > >> > > > > >>> > >>> >> >> server
> > > >> > >> > > > > >>> > >>> >> >> > >>> with
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> 3.5.0
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> binaries, we
> > > highly
> > > >> > >> recommend
> > > >> > >> > > > > updating
> > > >> > >> > > > > >>> the
> > > >> > >> > > > > >>> > >>> >> >> configuration
> > > >> > >> > > > > >>> > >>> >> >> > >>> file
> > > >> > >> > > > > >>> > >>> >> >> > >>>>> so
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>> that
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> all
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> server
> > statements
> > > >> > >> > > > "server.x=..."
> > > >> > >> > > > > >>> contain
> > > >> > >> > > > > >>> > >>> client
> > > >> > >> > > > > >>> > >>> >> >> ports
> > > >> > >> > > > > >>> > >>> >> >> > >> (see
> > > >> > >> > > > > >>> > >>> >> >> > >>>> the
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> section
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> Specifying
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> the
> client
> > port).
> > > >> As
> > > >> > >> > > explained
> > > >> > >> > > > > earlier
> > > >> > >> > > > > >>> you
> > > >> > >> > > > > >>> > >>> may
> > > >> > >> > > > > >>> > >>> >> >> leave the
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> configuration
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> in a
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> single
> file, as
> > > >> well
> > > >> > as
> > > >> > >> leave
> > > >> > >> > > > the
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> clientPort/clientPortAddress
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> (although if
> > you
> > > >> > specify
> > > >> > >> > > client
> > > >> > >> > > > > ports
> > > >> > >> > > > > >>> in
> > > >> > >> > > > > >>> > the
> > > >> > >> > > > > >>> > >>> new
> > > >> > >> > > > > >>> > >>> >> >> format,
> > > >> > >> > > > > >>> > >>> >> >> > >>>> these
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> are now
> > > redundant).
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Could you
> > please
> > > >> let
> > > >> > me
> > > >> > >> know
> > > >> > >> > > > > about this
> > > >> > >> > > > > >>> > case.
> > > >> > >> > > > > >>> > >>> >> >> Appreciate
> > > >> > >> > > > > >>> > >>> >> >> > >> if
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>> respond
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> soon.
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Thanks,
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> ---------------------
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Kuldeep
> Singh
> > > >> Budania
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>>
> > > >> > >> > > > > >>> > >>> >> >> > >>>
> > > >> > >> > > > > >>> > >>> >> >> > >>
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >> >
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> ________________________________
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY
> NOTICE
> > > >> > >> > > > > >>> > >>> >> >> This e-mail (including any
> > > >> attachments)
> > > >> > is
> > > >> > >> > > > strictly
> > > >> > >> > > > > >>> > >>> confidential
> > > >> > >> > > > > >>> > >>> >> and
> > > >> > >> > > > > >>> > >>> >> >> may also contain privileged
> > > information.
> > > >> If
> > > >> > >> you are
> > > >> > >> > > > > not the
> > > >> > >> > > > > >>> > >>> intended
> > > >> > >> > > > > >>> > >>> >> >> recipient you are not
> authorised to
> > > read,
> > > >> > >> print,
> > > >> > >> > > > save,
> > > >> > >> > > > > >>> process or
> > > >> > >> > > > > >>> > >>> >> disclose
> > > >> > >> > > > > >>> > >>> >> >> this message. If you have
> received
> > this
> > > >> > >> message by
> > > >> > >> > > > > mistake,
> > > >> > >> > > > > >>> > please
> > > >> > >> > > > > >>> > >>> >> inform
> > > >> > >> > > > > >>> > >>> >> >> the sender immediately and
> destroy
> > this
> > > >> > >> e-mail, its
> > > >> > >> > > > > >>> attachments
> > > >> > >> > > > > >>> > >>> and any
> > > >> > >> > > > > >>> > >>> >> >> copies. Any use, distribution,
> > > >> reproduction
> > > >> > or
> > > >> > >> > > > > disclosure by
> > > >> > >> > > > > >>> any
> > > >> > >> > > > > >>> > >>> person
> > > >> > >> > > > > >>> > >>> >> >> other than the intended
> recipient is
> > > >> > strictly
> > > >> > >> > > > > prohibited and
> > > >> > >> > > > > >>> the
> > > >> > >> > > > > >>> > >>> person
> > > >> > >> > > > > >>> > >>> >> >> responsible may incur in
> penalties.
> > > >> > >> > > > > >>> > >>> >> >> The use of this e-mail is
> only
> > for
> > > >> > >> professional
> > > >> > >> > > > > purposes;
> > > >> > >> > > > > >>> > >>> there is
> > > >> > >> > > > > >>> > >>> >> no
> > > >> > >> > > > > >>> > >>> >> >> guarantee that the
> correspondence
> > > towards
> > > >> > this
> > > >> > >> > > e-mail
> > > >> > >> > > > > will be
> > > >> > >> > > > > >>> > read
> > > >> > >> > > > > >>> > >>> >> only by
> > > >> > >> > > > > >>> > >>> >> >> the recipient, because, under
> certain
> > > >> > >> > > circumstances,
> > > >> > >> > > > > there
> > > >> > >> > > > > >>> may
> > > >> > >> > > > > >>> > be a
> > > >> > >> > > > > >>> > >>> >> need to
> > > >> > >> > > > > >>> > >>> >> >> access this email by third
> subjects
> > > >> > belonging
> > > >> > >> to
> > > >> > >> > > the
> > > >> > >> > > > > Company.
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >>
> ________________________________
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY
> NOTICE
> > > >> > >> > > > > >>> > >>> >> >> This e-mail (including any
> > attachments)
> > > >> is
> > > >> > >> strictly
> > > >> > >> > > > > >>> confidential
> > > >> > >> > > > > >>> > >>> and
> > > >> > >> > > > > >>> > >>> >> may
> > > >> > >> > > > > >>> > >>> >> >> also contain privileged
> information.
> > If
> > > >> you
> > > >> > >> are not
> > > >> > >> > > > the
> > > >> > >> > > > > >>> intended
> > > >> > >> > > > > >>> > >>> >> recipient
> > > >> > >> > > > > >>> > >>> >> >> you are not authorised to read,
> > print,
> > > >> save,
> > > >> > >> > > process
> > > >> > >> > > > or
> > > >> > >> > > > > >>> disclose
> > > >> > >> > > > > >>> > >>> this
> > > >> > >> > > > > >>> > >>> >> >> message. If you have received
> this
> > > >> message
> > > >> > by
> > > >> > >> > > > mistake,
> > > >> > >> > > > > please
> > > >> > >> > > > > >>> > >>> inform
> > > >> > >> > > > > >>> > >>> >> the
> > > >> > >> > > > > >>> > >>> >> >> sender immediately and destroy
> this
> > > >> e-mail,
> > > >> > >> its
> > > >> > >> > > > > attachments
> > > >> > >> > > > > >>> and
> > > >> > >> > > > > >>> > any
> > > >> > >> > > > > >>> > >>> >> copies.
> > > >> > >> > > > > >>> > >>> >> >> Any use, distribution,
> reproduction
> > or
> > > >> > >> disclosure
> > > >> > >> > > by
> > > >> > >> > > > > any
> > > >> > >> > > > > >>> person
> > > >> > >> > > > > >>> > >>> other
> > > >> > >> > > > > >>> > >>> >> than
> > > >> > >> > > > > >>> > >>> >> >> the intended recipient is
> strictly
> > > >> > prohibited
> > > >> > >> and
> > > >> > >> > > the
> > > >> > >> > > > > person
> > > >> > >> > > > > >>> > >>> >> responsible
> > > >> > >> > > > > >>> > >>> >> >> may incur in penalties.
> > > >> > >> > > > > >>> > >>> >> >> The use of this e-mail is only
> for
> > > >> > >> professional
> > > >> > >> > > > > purposes;
> > > >> > >> > > > > >>> there
> > > >> > >> > > > > >>> > is
> > > >> > >> > > > > >>> > >>> no
> > > >> > >> > > > > >>> > >>> >> >> guarantee that the
> correspondence
> > > towards
> > > >> > this
> > > >> > >> > > e-mail
> > > >> > >> > > > > will be
> > > >> > >> > > > > >>> > read
> > > >> > >> > > > > >>> > >>> >> only by
> > > >> > >> > > > > >>> > >>> >> >> the recipient, because, under
> certain
> > > >> > >> > > circumstances,
> > > >> > >> > > > > there
> > > >> > >> > > > > >>> may
> > > >> > >> > > > > >>> > be a
> > > >> > >> > > > > >>> > >>> >> need to
> > > >> > >> > > > > >>> > >>> >> >> access this email by third
> subjects
> > > >> > belonging
> > > >> > >> to
> > > >> > >> > > the
> > > >> > >> > > > > Company.
> > > >> > >> > > > > >>> > >>> >> >>
> > > >> > >> > > > > >>> > >>> >> >
> > > >> > >> > > > > >>> > >>> >>
> > > >> > >> > > > > >>> > >>> >
> > > >> > >> > > > > >>> > >>>
> > > >> > >> > > > > >>> > >>
> > > >> > >> > > > > >>> >
> > > >> > >> > > > > >>>
> > > >> > >> > > > > >>
> > > >> > >> > > > >
> > > >> > >> > > > >
> > > >> > >> > > > > ________________________________
> > > >> > >> > > > >
> > > >> > >> > > > > CONFIDENTIALITY & PRIVACY NOTICE
> > > >> > >> > > > > This e-mail (including any attachments) is strictly
> > > >> confidential
> > > >> > >> and
> > > >> > >> > > may
> > > >> > >> > > > > also contain privileged information. If you are
> not the
> > > >> intended
> > > >> > >> > > > recipient
> > > >> > >> > > > > you are not authorised to read, print, save,
> process or
> > > >> disclose
> > > >> > >> this
> > > >> > >> > > > > message. If you have received this message by
> mistake,
> > > please
> > > >> > >> inform
> > > >> > >> > > the
> > > >> > >> > > > > sender immediately and destroy this e-mail, its
> > attachments
> > > >> and
> > > >> > >> any
> > > >> > >> > > > copies.
> > > >> > >> > > > > Any use, distribution, reproduction or disclosure
> by any
> > > >> person
> > > >> > >> other
> > > >> > >> > > > than
> > > >> > >> > > > > the intended recipient is strictly prohibited and
> the
> > > person
> > > >> > >> > > responsible
> > > >> > >> > > > > may incur in penalties.
> > > >> > >> > > > > The use of this e-mail is only for professional
> purposes;
> > > >> there
> > > >> > >> is no
> > > >> > >> > > > > guarantee that the correspondence towards this
> e-mail
> > will
> > > be
> > > >> > >> read only
> > > >> > >> > > > by
> > > >> > >> > > > > the recipient, because, under certain
> circumstances,
> > there
> > > >> may
> > > >> > be
> > > >> > >> a
> > > >> > >> > > need
> > > >> > >> > > > to
> > > >> > >> > > > > access this email by third subjects belonging to
> the
> > > Company.
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >>
> > > >> > >>
> > > >> >
> > > >>
> > > >
> > >
> >
>
>
> This e-mail and any files transmitted with it are for the sole use of the
> intended recipient(s) and may contain confidential and privileged
> information. If you are not the intended recipient(s), please reply to the
> sender and destroy all copies of the original message. Any unauthorized
> review, use, disclosure, dissemination, forwarding, printing or copying of
> this email, and/or any action taken in reliance on the contents of this
> e-mail is strictly prohibited and may be unlawful. Where permitted by
> applicable law, this e-mail and other e-mail communications sent to and
> from Cognizant e-mail addresses may be monitored.
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by Ma...@cognizant.com.
Kuldeep,
This issue could be mismatch of TLS version used for SSL . different version of zookeeper have different TLV version supported as default . What was jdk version you have on old host and new host .
May be you can try to define TLS version in zoo.cfg .
On 10/14/20, 7:33 AM, "kuldeep singh" <ku...@gmail.com> wrote:
[External]
Hi,
Yes, all the configurations are the same on all 5 nodes. I have checked
more than 10 times.
Before scaling , 3 node cluster was working fine, but scaling from 3 to 5
node, then we are facing this problem.
only question is on 3 node cluster it is working fine, but after scaling it
is not working and zkcli is not able to connect.
but one case I have seen.
1. if i remove all the SSL configuration from all the nodes and then
applying again all SSL property then it is working fine.
2 cases
1st case :- 3 node cluster witout SSL is working fine
scaled the cluster till 5 node without SSL is also
working fine
after that when applying SSL on all 5 nodes then it is
also working
2nd case :- 3 node cluster with SSL is working fine
scaled the cluster till 5 node with SSL is not working
in both cases the configuration area same and certificate is also same.
Thanks,
---------------------
Kuldeep Singh Budania
On Wed, Oct 14, 2020 at 5:41 PM Szalay-Bekő Máté <sz...@gmail.com>
wrote:
> the config looks OK in general...
>
> - are you sure the same configs are used on all ZK servers?
> - does the truststores accept all keys on the keystores? (if the
> truststores of the old servers had to be modified, then did you restart the
> old servers with the updated truststores?)
> - did the 3 node ZK cluster work with SSL? (were you able to connect to it
> with the client using SSL?)
>
> also: do you really need client authentication with SSL? (I see you are
> using SASL too)
> If you only need SSL for wire encryption, then you can try
> with ssl.clientAuth=none (see the admin guide). Although that feature was
> broken on 3.5.6, got fixed on 3.5.7 according to the doc.
>
> best regards,
> Mate
>
> On Wed, Oct 14, 2020 at 1:10 PM kuldeep singh <ku...@gmail.com>
> wrote:
>
> > Sorry,
> > secureClientPort=2182
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> >
> >
> >
> > On Wed, Oct 14, 2020 at 4:18 PM kuldeep singh <kuldeep.singh08@gmail.com
> >
> > wrote:
> >
> > > Thanks for reply
> > >
> > > zoo.cfg
> > > -----------
> > > secureClientPort=2181
> > > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > initLimit=10
> > > syncLimit=5
> > > dataDir= data directory (not mentioning exact path here)
> > > tickTime=2000
> > > autopurge.snapRetainCount=3
> > > autopurge.purgeInterval=1
> > > admin.enableServer=false
> > > standaloneEnabled=false
> > > jute.maxbuffer=2147483648
> > > server.1=host1_priv:10288:10388
> > > server.2=host2_priv:10288:10388
> > > server.3=host3_priv:10288:10388
> > > server.4=host4_priv:10288:10388
> > > server.5=host5_priv:10288:10388
> > > quorum.auth.enableSasl=true
> > > quorum.auth.learnerRequireSasl=true
> > > quorum.auth.serverRequireSasl=true
> > > quorum.auth.learner.loginContext=QuorumLearner
> > > quorum.auth.server.loginContext=QuorumServer
> > > quorum.cnxn.threads.size=10
> > > -------------------------------------------------------------
> > > java.env
> > >
> > > export
> > >
> >
> SERVER_JVMFLAGS="-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > -Dzookeeper.ssl.keyStore.location=keystore.jks
> > > -Dzookeeper.ssl.keyStore.password=<passwword>
> > > -Dzookeeper.ssl.trustStore.location= keystore.jks
> > > -Dzookeeper.ssl.trustStore.password= <passwword>
> > > -Djava.security.auth.login.config=zookeeper-jaas.conf"
> > >
> > > export
> > >
> >
> CLIENT_JVMFLAGS="-Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > -Dzookeeper.client.secure=true -Dzookeeper.ssl.keyStore.location=
> > > keystore.jks -Dzookeeper.ssl.keyStore.password= <passwword>
> > > -Dzookeeper.ssl.trustStore.location=keystore.jks
> > > -Dzookeeper.ssl.trustStore.password= <passwword>
> > > -Dzookeeper.ssl.hostnameVerification=false"
> > >
> > > Thanks,
> > > ---------------------
> > > Kuldeep Singh Budania
> > >
> > >
> > >
> > > On Wed, Oct 14, 2020 at 4:12 PM Szalay-Bekő Máté <
> > > szalay.beko.mate@gmail.com> wrote:
> > >
> > >> These log messages indicate that a client (or an other ZooKeeper
> server)
> > >> is
> > >> trying to connect without SSL to a ZooKeeper process that expects SSL.
> > >> I assume this will be a configuration issue then.
> > >>
> > >> Best regards,
> > >> Mate
> > >>
> > >> On Wed, Oct 14, 2020 at 12:30 PM kuldeep singh <
> > kuldeep.singh08@gmail.com
> > >> >
> > >> wrote:
> > >>
> > >> > Hi,
> > >> >
> > >> > more logs
> > >> >
> > >> > 2020-10-14 12:25:05,106 - ERROR
> > >> >
> > >> >
> > >>
> >
> [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler$CertificateVerifier@257
> > >> > ]
> > >> > - Unsuccessful handshake with session 0x0
> > >> >
> > >> > 2020-10-14 12:25:05,107 - WARN
> > >> > [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler@138
> ]
> > -
> > >> > Exception caught
> > >> >
> > >> > io.netty.handler.codec.DecoderException:
> > >> > io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record:
> > >> > 737276720a
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:475)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:283)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
> > >> >
> > >> > at
> > >> >
> > >>
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
> > >> >
> > >> > at
> > io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
> > >> >
> > >> > at
> > >> >
> > >>
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> > >> >
> > >> > at java.lang.Thread.run(Thread.java:748)
> > >> >
> > >> > Caused by: io.netty.handler.ssl.NotSslRecordException: not an
> SSL/TLS
> > >> > record: 737276720a
> > >> >
> > >> > at
> > >> >
> > >>
> > io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1203)
> > >> >
> > >> > at
> > io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1271)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:505)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:444)
> > >> >
> > >> > ... 17 more
> > >> >
> > >> > Thanks,
> > >> > ---------------------
> > >> > Kuldeep Singh Budania
> > >> > Software Architect
> > >> >
> > >> >
> > >> >
> > >> > On Wed, Oct 14, 2020 at 3:51 PM kuldeep singh <
> > >> kuldeep.singh08@gmail.com>
> > >> > wrote:
> > >> >
> > >> > > Hi,
> > >> > >
> > >> > >
> > >> > > below error is coming on zookeeper logs on SSL.
> > >> > >
> > >> > > 2020-10-14 12:18:27,410 - WARN
> > >> > [nioEventLoopGroup-4-16:NettyServerCnxn@540]
> > >> > > - Closing connection to /127.0.0.1:49470
> > >> > > java.io.IOException: Len error 369296128
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:533)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> org.apache.zookeeper.server.NettyServerCnxn.processMessage(NettyServerCnxn.java:360)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.channelRead(NettyServerCnxnFactory.java:184)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
> > >> > > at
> > >> io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
> > >> > > at
> > >> > >
> > >>
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> > >> > > at java.lang.Thread.run(Thread.java:748)
> > >> > >
> > >> > > Thanks,
> > >> > > ---------------------
> > >> > > Kuldeep Singh Budania
> > >> > >
> > >> > >
> > >> > >
> > >> > > On Thu, Oct 8, 2020 at 6:33 PM Szalay-Bekő Máté <
> > >> > > szalay.beko.mate@gmail.com> wrote:
> > >> > >
> > >> > >> Sounds like a bug or a configuration issue...
> > >> > >> can you share the configs (before and after the scale-up) and the
> > >> logs?
> > >> > >> also: does the truststores recognise all the keys used on all
> the 5
> > >> > >> nodes? (e.g. the truststores on the old nodes accept the new
> keys?)
> > >> > >>
> > >> > >> Best Regards,
> > >> > >> Mate
> > >> > >>
> > >> > >> On Thu, Oct 8, 2020 at 2:31 PM kuldeep singh <
> > >> kuldeep.singh08@gmail.com
> > >> > >
> > >> > >> wrote:
> > >> > >> >
> > >> > >> > Hi,
> > >> > >> >
> > >> > >> > Yes, My client and server both are using certificate and have
> > >> added in
> > >> > >> ZK
> > >> > >> > and client as well.
> > >> > >> >
> > >> > >> > Thanks,
> > >> > >> > ---------------------
> > >> > >> > Kuldeep Singh Budania
> > >> > >> >
> > >> > >> >
> > >> > >> >
> > >> > >> > On Thu, Oct 8, 2020 at 5:56 PM Enrico Olivelli <
> > >> eolivelli@gmail.com>
> > >> > >> wrote:
> > >> > >> >
> > >> > >> > > Il giorno gio 8 ott 2020 alle ore 14:17 kuldeep singh <
> > >> > >> > > kuldeep.singh08@gmail.com> ha scritto:
> > >> > >> > >
> > >> > >> > > > Hi Team,
> > >> > >> > > >
> > >> > >> > > > I am facing one issue in SSL communication between client
> and
> > >> > >> zookeeper
> > >> > >> > > > server.
> > >> > >> > > >
> > >> > >> > > > ZK 3.5.6 version
> > >> > >> > > >
> > >> > >> > > > 1. Mi on 3 node
> > >> > >> > > > 2. Applying SSL and 3 nodes cluster is working fine
> > >> > >> > > > 3. Scaled my cluster with 2 nodes and now my cluster have 5
> > >> nodes
> > >> > >> over
> > >> > >> > > SSL
> > >> > >> > > >
> > >> > >> > > > but after scaling my SSL is not working between client and
> ZK
> > >> > >> server and
> > >> > >> > > > even not able to login using zkCli as well.
> > >> > >> > > >
> > >> > >> > > > Can someone provide the details please why it is happening?
> > >> > >> > > >
> > >> > >> > >
> > >> > >> > > Is your client configured to use SSL ?
> > >> > >> > >
> > >> > >> > > Enrico
> > >> > >> > >
> > >> > >> > >
> > >> > >> > >
> > >> > >> > > >
> > >> > >> > > > Thanks,
> > >> > >> > > > ---------------------
> > >> > >> > > > Kuldeep Singh Budania
> > >> > >> > > > Software Architect
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > > > On Mon, Jul 13, 2020 at 2:19 PM Enrico Olivelli - Diennea
> > >> > >> > > > <en...@diennea.com.invalid> wrote:
> > >> > >> > > >
> > >> > >> > > > > It looks like we ported it to 3.5.
> > >> > >> > > > >
> > >> > >> > > > > See the subtask
> > >> > >> > > > > https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FZOOKEEPER-2792&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944574477&sdata=%2BkptxadCd6m2QyyFjeub%2FxNknSbEWQq3iSRCoePUm2I%3D&reserved=0
> > >> > >> > > > >
> > >> > >> > > > > Enrico
> > >> > >> > > > >
> > >> > >> > > > > Il giorno 13/07/20, 10:37 "kuldeep singh" <
> > >> > >> kuldeep.singh08@gmail.com>
> > >> > >> > > > ha
> > >> > >> > > > > scritto:
> > >> > >> > > > >
> > >> > >> > > > > Hi Team,
> > >> > >> > > > >
> > >> > >> > > > > I appreciate it if I will get a response as soon as
> > >> > possible,
> > >> > >> as I
> > >> > >> > > am
> > >> > >> > > > > stuck
> > >> > >> > > > > at this point.
> > >> > >> > > > >
> > >> > >> > > > > Thanks,
> > >> > >> > > > > ---------------------
> > >> > >> > > > > Kuldeep Singh Budania
> > >> > >> > > > >
> > >> > >> > > > >
> > >> > >> > > > >
> > >> > >> > > > > On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <
> > >> > >> > > > > kuldeep.singh08@gmail.com>
> > >> > >> > > > > wrote:
> > >> > >> > > > >
> > >> > >> > > > > > Hi Team,
> > >> > >> > > > > >
> > >> > >> > > > > > Server to Server communication is not supported in
> > >> 3.5.6
> > >> > >> version
> > >> > >> > > > as
> > >> > >> > > > > per
> > >> > >> > > > > > below JIRA issue?
> > >> > >> > > > > >
> > >> > >> > > > > >
> https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FZOOKEEPER-2639&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944574477&sdata=M5Iv%2BGbgyVut%2FXb2EFZjAOsFCndIaai2Vl25uZzGKpk%3D&reserved=0
> > >> > >> > > > > >
> > >> > >> > > > > > Thanks,
> > >> > >> > > > > > ---------------------
> > >> > >> > > > > > Kuldeep Singh Budania
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > > On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <
> > >> > >> > > > > kuldeep.singh08@gmail.com>
> > >> > >> > > > > > wrote:
> > >> > >> > > > > >
> > >> > >> > > > > >> Thanks for the reply.
> > >> > >> > > > > >>
> > >> > >> > > > > >> Now my ZKCli cmd is working fine as we use some
> our
> > >> > >> customized
> > >> > >> > > > > >> authentication and we resolve the issue.
> > >> > >> > > > > >>
> > >> > >> > > > > >> Now I am going to implement Server to Server
> > >> > communication.
> > >> > >> > > > > >>
> > >> > >> > > > > >> Thanks,
> > >> > >> > > > > >> ---------------------
> > >> > >> > > > > >> Kuldeep Singh Budania
> > >> > >> > > > > >>
> > >> > >> > > > > >>
> > >> > >> > > > > >>
> > >> > >> > > > > >> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
> > >> > >> > > > > >> szalay.beko.mate@gmail.com> wrote:
> > >> > >> > > > > >>
> > >> > >> > > > > >>> I think SSL is working for you already... If you
> > >> managed
> > >> > >> to
> > >> > >> > > start
> > >> > >> > > > > the
> > >> > >> > > > > >>> zkCli.sh and be able to connect to ZooKeeper on
> the
> > >> > >> secure port
> > >> > >> > > > > and issue
> > >> > >> > > > > >>> any kind of command (like: " ls / "), then the
> wire
> > >> > >> encryption
> > >> > >> > > is
> > >> > >> > > > > working
> > >> > >> > > > > >>> and your server/client communication is secured
> by
> > >> > >> ZooKeeper.
> > >> > >> > > > > >>>
> > >> > >> > > > > >>> Why you want to run the following command?
> > >> > >> > > > > >>> addauth ztpasswd zooadmin:<password>
> > >> > >> > > > > >>>
> > >> > >> > > > > >>> Do you also want to configure a superDigest user
> in
> > >> > >> ZooKeeper?
> > >> > >> > > > > Please
> > >> > >> > > > > >>> note
> > >> > >> > > > > >>> that this command is independent from SSL. If you
> > >> need
> > >> > to
> > >> > >> > > create
> > >> > >> > > > a
> > >> > >> > > > > >>> username-password pair for digest authentication
> > then
> > >> > >> please
> > >> > >> > > use
> > >> > >> > > > > the
> > >> > >> > > > > >>> command in the following way:
> > >> > >> > > > > >>> addauth digest zooadmin:yourSuperSecretPassword
> > >> > >> > > > > >>>
> > >> > >> > > > > >>> Kind regards,
> > >> > >> > > > > >>> Mate
> > >> > >> > > > > >>>
> > >> > >> > > > > >>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <
> > >> > >> > > > > kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> wrote:
> > >> > >> > > > > >>>
> > >> > >> > > > > >>> > 1. sh zkCli.sh --config /etc/zookeeper -server
> > >> > >> localhost:2281
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> > 2. addauth ztpasswd zooadmin:<password>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> > Thanks,
> > >> > >> > > > > >>> > ---------------------
> > >> > >> > > > > >>> > Kuldeep Singh Budania
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
> > >> > >> > > > > >>> kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > wrote:
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> > > Hi Team,
> > >> > >> > > > > >>> > >
> > >> > >> > > > > >>> > > Any update on this?
> > >> > >> > > > > >>> > >
> > >> > >> > > > > >>> > > Thanks,
> > >> > >> > > > > >>> > > ---------------------
> > >> > >> > > > > >>> > > Kuldeep Singh Budania
> > >> > >> > > > > >>> > >
> > >> > >> > > > > >>> > >
> > >> > >> > > > > >>> > >
> > >> > >> > > > > >>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh
> <
> > >> > >> > > > > >>> kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > > wrote:
> > >> > >> > > > > >>> > >
> > >> > >> > > > > >>> > >> Sorry this is my bad, there were server
> > setting
> > >> > like
> > >> > >> below
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> export SERVER_JVMFLAGS="
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> > >> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> > >> > > > > >>> > >>
> -Dzookeeper.ssl.trustStore.password=testpass"
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> export CLIENT_JVMFLAGS="
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >> > >> > > > > >>> > >> -Dzookeeper.client.secure=true
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> > >> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> > >> > > > > >>> > >>
> -Dzookeeper.ssl.trustStore.password=testpass"
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> I want to have SSL between client to server
> > >> > >> communication
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> I am already following the same link which
> you
> > >> have
> > >> > >> shared
> > >> > >> > > > > with me
> > >> > >> > > > > >>> but
> > >> > >> > > > > >>> > >> that is not working.
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> Zoo.cfg
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> secureClientPort=2281
> > >> > >> > > > > >>> > >> initLimit=10
> > >> > >> > > > > >>> > >> syncLimit=5
> > >> > >> > > > > >>> > >> dataDir=/var/lib/zookeeper/data
> > >> > >> > > > > >>> > >> tickTime=2000
> > >> > >> > > > > >>> > >> autopurge.snapRetainCount=3
> > >> > >> > > > > >>> > >> autopurge.purgeInterval=1
> > >> > >> > > > > >>> > >> admin.enableServer=false
> > >> > >> > > > > >>> > >> standaloneEnabled=false
> > >> > >> > > > > >>> > >> jute.maxbuffer=2147483648
> > >> > >> > > > > >>> > >>
> > >> > >> > > > >
> > >> > >>
> > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > >> > > > > >>> > >> server.1=host1_priv:10288:10388
> > >> > >> > > > > >>> > >> server.2=host2_priv:10288:10388
> > >> > >> > > > > >>> > >> server.3=host3_priv:10288:10388
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> command to connect using zkcli
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> 1. zkcli zoo.cfg localhost:2281
> > >> > >> > > > > >>> > >> 2. addauth ztpasswd usernaem:password
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> after second step we are getting below error
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> WatchedEvent state:AuthFailed type:None
> > >> path:null
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 -
> > >> WARN
> > >> > >> > > > > >>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119
> ]
> > -
> > >> No
> > >> > >> > > > > authentication
> > >> > >> > > > > >>> > provider
> > >> > >> > > > > >>> > >> for scheme: ztpasswd has x509 ip digest*
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> Thanks,
> > >> > >> > > > > >>> > >> ---------------------
> > >> > >> > > > > >>> > >> Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő
> > Máté
> > >> <
> > >> > >> > > > > >>> > >> szalay.beko.mate@gmail.com> wrote:
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>> > No authentication provider for scheme:
> > >> ztpasswd
> > >> > >> has
> > >> > >> > > x509
> > >> > >> > > > > ip
> > >> > >> > > > > >>> digest*
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> > >>> This suggest you have some configuration
> > >> error...
> > >> > >> Where
> > >> > >> > > did
> > >> > >> > > > > you
> > >> > >> > > > > >>> use the
> > >> > >> > > > > >>> > >>> "ztpasswd" string in your configs /
> commands?
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő
> > >> Máté <
> > >> > >> > > > > >>> > >>> szalay.beko.mate@gmail.com>
> > >> > >> > > > > >>> > >>> wrote:
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> > >>> > > My ZK server is up and running in
> secure
> > >> mode
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > What is your goal? You want to setup
> > >> > >> client-server SSL
> > >> > >> > > > > >>> connection?
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > see:
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FZOOKEEPER%2FZooKeeper%2BSSL%2BUser%2BGuide&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944574477&sdata=waate39BEuc26%2B0RnjExbOsMzWTfCbhCYQmxwSdMFik%3D&reserved=0
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > (or you want to have both SSL and SASL
> > >> enabled?)
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > Anyway, please remove the following line
> > from
> > >> > the
> > >> > >> > > > > >>> SERVER_JVMFLAGS:
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> > >>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >> > >> > > > > >>> > >>> > This is a configuration that makes sense
> > only
> > >> > for
> > >> > >> the
> > >> > >> > > > > ZooKeeper
> > >> > >> > > > > >>> > client,
> > >> > >> > > > > >>> > >>> > not for the server. For the server, use
> the
> > >> > >> following:
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > If it doesn't solve the issue, then can
> you
> > >> > >> please send
> > >> > >> > > > > your
> > >> > >> > > > > >>> zoo.cfg
> > >> > >> > > > > >>> > >>> file?
> > >> > >> > > > > >>> > >>> > Also can you please send the zkCli
> command
> > >> you
> > >> > >> execute?
> > >> > >> > > > > (you
> > >> > >> > > > > >>> need to
> > >> > >> > > > > >>> > >>> > connect to the secure ZooKeeper port,
> > unless
> > >> > >> > > > > portUnification is
> > >> > >> > > > > >>> > >>> enabled)
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > Kind regards,
> > >> > >> > > > > >>> > >>> > Mate
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep
> > singh
> > >> <
> > >> > >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > >>> > wrote:
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> >> Hi,
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> we have done below changes in java.env
> > file
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> export SERVER_JVMFLAGS="
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> > >> > > > > >>> > >>> >>
> -Dzookeeper.ssl.keyStore.password=testpass
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> > >> > > > > >>> > >>> >>
> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> export CLIENT_JVMFLAGS="
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >> > >> > > > > >>> > >>> >> -Dzookeeper.client.secure=true
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> > >> > > > > >>> > >>> >>
> -Dzookeeper.ssl.keyStore.password=testpass
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> > >> > > > > >>> > >>> >>
> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> I have started the ZK server and it is
> up
> > >> > >> without any
> > >> > >> > > > > issue.
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> But now when I login to ZkCli then it
> > gives
> > >> the
> > >> > >> below
> > >> > >> > > > > error.
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> WatchedEvent state:AuthFailed type:None
> > >> > path:null
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> Zookeeper logs :- *2020-07-01
> > 07:38:09,342 -
> > >> > WARN
> > >> > >> > > > > >>> > >>> >>
> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
> > >> -
> > >> > >> No
> > >> > >> > > > > >>> authentication
> > >> > >> > > > > >>> > >>> provider
> > >> > >> > > > > >>> > >>> >> for scheme: ztpasswd has x509 ip digest*
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> Please help me on this issue
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> Thanks,
> > >> > >> > > > > >>> > >>> >> ---------------------
> > >> > >> > > > > >>> > >>> >> Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>> >> Software Architect
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep
> > >> singh <
> > >> > >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > >>> >> wrote:
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> > Hi,
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > My ZK server is up and running in
> > secure
> > >> > >> mode, But
> > >> > >> > > > > When I am
> > >> > >> > > > > >>> > >>> trying to
> > >> > >> > > > > >>> > >>> >> > connect to the ZK server using ZKCli,
> it
> > >> > gives
> > >> > >> the
> > >> > >> > > > below
> > >> > >> > > > > >>> error.
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > WatchedEvent state:AuthFailed
> type:None
> > >> > >> path:null
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > Zookeeper logs :- *2020-07-01
> > >> 07:38:09,342 -
> > >> > >> WARN
> > >> > >> > > > > >>> > >>> >> >
> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
> > >> > >> - No
> > >> > >> > > > > >>> authentication
> > >> > >> > > > > >>> > >>> >> provider
> > >> > >> > > > > >>> > >>> >> > for scheme: ztpasswd has x509 ip
> digest*
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > Can someone please help me on this
> > issue.
> > >> we
> > >> > >> are
> > >> > >> > > using
> > >> > >> > > > > the
> > >> > >> > > > > >>> 3.5.6
> > >> > >> > > > > >>> > >>> >> version.
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > I appreciate if I will get a response
> as
> > >> soon
> > >> > >> as
> > >> > >> > > > > possible, as
> > >> > >> > > > > >>> I am
> > >> > >> > > > > >>> > >>> stuck
> > >> > >> > > > > >>> > >>> >> > at this point.
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > Thanks,
> > >> > >> > > > > >>> > >>> >> > ---------------------
> > >> > >> > > > > >>> > >>> >> > Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>> >> > Software Architect
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM
> Enrico
> > >> > >> Olivelli -
> > >> > >> > > > > Diennea
> > >> > >> > > > > >>> > >>> >> > <en...@diennea.com.invalid>
> > >> wrote:
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> >> I mean in zoo.cfg
> > >> > >> > > > > >>> > >>> >> >> Not as a system property
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Enrico
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico
> > >> Olivelli -
> > >> > >> > > > Diennea" <
> > >> > >> > > > > >>> > >>> >> >> enrico.olivelli@diennea.com.INVALID>
> > ha
> > >> > >> scritto:
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Hi
> > >> > >> > > > > >>> > >>> >> >> You have to enable Netty on the
> > >> server
> > >> > >> side
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Something like:
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Hope that helps
> > >> > >> > > > > >>> > >>> >> >> Enrico
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Il giorno 24/06/20, 19:17
> "kuldeep
> > >> > singh"
> > >> > >> <
> > >> > >> > > > > >>> > >>> >> kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > >>> >> >> ha scritto:
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Hi,
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> I got below error while
> setting
> > >> SSL
> > >> > >> > > > properties
> > >> > >> > > > > in
> > >> > >> > > > > >>> > zkEnv.sh
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> ==========================================================================================
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,864 -
> INFO
> > >> > >> > > > > >>> > [main:QuorumPeerConfig@133]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> Reading
> > >> > >> > > > > >>> > >>> >> >> configuration from:
> > >> > >> /etc/zookeeper/zoo.cfg
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 -
> INFO
> > >> > >> > > > > >>> > [main:QuorumPeerConfig@385]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> clientPortAddress is
> > >> > >> 0.0.0.0/0.0.0.0:10181
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 -
> INFO
> > >> > >> > > > > >>> > [main:QuorumPeerConfig@399]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> secureClientPortAddress is
> > >> > >> > > > > 0.0.0.0/0.0.0.0:2281
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,878 -
> INFO
> > >> > >> > > > > [main:X509Util@79] -
> > >> > >> > > > > >>> > >>> Setting
> > >> > >> > > > > >>> > >>> >> -D
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > jdk.tls.rejectClientInitiatedRenegotiation=true to
> > >> > >> > > > > >>> > disable
> > >> > >> > > > > >>> > >>> >> >> client-initiated
> > >> > >> > > > > >>> > >>> >> >> TLS renegotiation
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 -
> INFO
> > >> > >> > > > > >>> > >>> [main:DatadirCleanupManager@78]
> > >> > >> > > > > >>> > >>> >> -
> > >> > >> > > > > >>> > >>> >> >> autopurge.snapRetainCount set
> > to
> > >> 3
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 -
> INFO
> > >> > >> > > > > >>> > >>> [main:DatadirCleanupManager@79]
> > >> > >> > > > > >>> > >>> >> -
> > >> > >> > > > > >>> > >>> >> >> autopurge.purgeInterval set
> to
> > 1
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,898 -
> > INFO [
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > PurgeTask:DatadirCleanupManager$PurgeTask@138
> > >> > >> > > > ]
> > >> > >> > > > > -
> > >> > >> > > > > >>> Purge
> > >> > >> > > > > >>> > >>> task
> > >> > >> > > > > >>> > >>> >> >> started.
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,899 -
> INFO
> > >> > >> > > > > [main:ManagedUtil@46]
> > >> > >> > > > > >>> -
> > >> > >> > > > > >>> > >>> Log4j
> > >> > >> > > > > >>> > >>> >> >> found with
> > >> > >> > > > > >>> > >>> >> >> jmx enabled.
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,903 -
> INFO
> > >> > >> > > > > >>> > >>> [PurgeTask:FileTxnSnapLog@103]
> > >> > >> > > > > >>> > >>> >> -
> > >> > >> > > > > >>> > >>> >> >>
> zookeeper.snapshot.trust.empty
> > :
> > >> > false
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,910 -
> > INFO [
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > PurgeTask:DatadirCleanupManager$PurgeTask@144
> > >> > >> > > > ]
> > >> > >> > > > > -
> > >> > >> > > > > >>> Purge
> > >> > >> > > > > >>> > >>> task
> > >> > >> > > > > >>> > >>> >> >> completed.
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,975 -
> INFO
> > >> > >> > > > > >>> [main:QuorumPeerMain@141
> > >> > >> > > > > >>> > ]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> Starting quorum
> > >> > >> > > > > >>> > >>> >> >> peer
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,983 -
> INFO
> > >> > >> > > > > >>> > [main:ServerCnxnFactory@135]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> Using
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > >> > >> > > > > >>> > server
> > >> > >> > > > > >>> > >>> >> >> connection
> > >> > >> > > > > >>> > >>> >> >> factory
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,986 -
> INFO
> > >> > >> > > > > >>> > >>> [main:NIOServerCnxnFactory@673]
> > >> > >> > > > > >>> > >>> >> -
> > >> > >> > > > > >>> > >>> >> >> Configuring NIO connection
> > >> handler
> > >> > >> with 10s
> > >> > >> > > > > >>> sessionless
> > >> > >> > > > > >>> > >>> >> >> connection timeout,
> > >> > >> > > > > >>> > >>> >> >> 2 selector thread(s), 16
> worker
> > >> > >> threads,
> > >> > >> > > and
> > >> > >> > > > > 64 kB
> > >> > >> > > > > >>> direct
> > >> > >> > > > > >>> > >>> >> buffers.
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,992 -
> INFO
> > >> > >> > > > > >>> > >>> [main:NIOServerCnxnFactory@686
> > >> > >> > > > > >>> > >>> >> ]
> > >> > >> > > > > >>> > >>> >> >> - binding
> > >> > >> > > > > >>> > >>> >> >> to port
> 0.0.0.0/0.0.0.0:10181
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,994 -
> INFO
> > >> > >> > > > > >>> > [main:ServerCnxnFactory@135]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> Using
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > >> > >> > > > > >>> > server
> > >> > >> > > > > >>> > >>> >> >> connection
> > >> > >> > > > > >>> > >>> >> >> factory
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,995 -
> ERROR
> > >> > >> > > > > >>> [main:QuorumPeerMain@101
> > >> > >> > > > > >>> > ]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> Unexpected
> > >> > >> > > > > >>> > >>> >> >> exception, exiting abnormally
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> java.lang.UnsupportedOperationException:
> > >> > >> > > SSL
> > >> > >> > > > > isn't
> > >> > >> > > > > >>> > >>> supported in
> > >> > >> > > > > >>> > >>> >> >> NIOServerCnxn
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> I have set the following
> > >> properties
> > >> > in
> > >> > >> > > > > >>> SERVER_JVMFLAGS in
> > >> > >> > > > > >>> > >>> >> >> zkEnv.sh file :
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Thanks,
> > >> > >> > > > > >>> > >>> >> >> ---------------------
> > >> > >> > > > > >>> > >>> >> >> Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08
> PM
> > >> > Jordan
> > >> > >> > > > > Zimmerman <
> > >> > >> > > > > >>> > >>> >> >> jordan@jordanzimmerman.com>
> > >> > >> > > > > >>> > >>> >> >> wrote:
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> > It's the same as the normal
> > >> > >> ZooKeeper
> > >> > >> > > > client:
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fzookeeper.apache.org%2Fdoc%2Fr3.6.1%2FzookeeperAdmin.html%23sc_authOptions&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944584465&sdata=8TEDANpc0bdegW%2FdQSSybnsaNJ9om4oU8Gwvp%2F931SA%3D&reserved=0
> > >> > >> > > > > >>> > >>> >> >> > <
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fzookeeper.apache.org%2Fdoc%2Fr3.6.1%2FzookeeperAdmin.html%23sc_authOptions&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944584465&sdata=8TEDANpc0bdegW%2FdQSSybnsaNJ9om4oU8Gwvp%2F931SA%3D&reserved=0
> > >> > >> > > > > >>> > >>> >> >> > >
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >> > -Jordan
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >> > > On Jun 22, 2020, at 5:50
> > AM,
> > >> > >> kuldeep
> > >> > >> > > > singh
> > >> > >> > > > > <
> > >> > >> > > > > >>> > >>> >> >> kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > >>> >> >> > wrote:
> > >> > >> > > > > >>> > >>> >> >> > >
> > >> > >> > > > > >>> > >>> >> >> > > Hi Team,
> > >> > >> > > > > >>> > >>> >> >> > > How we will do secure
> > >> > >> communication
> > >> > >> > > > > between the
> > >> > >> > > > > >>> > Curator
> > >> > >> > > > > >>> > >>> >> >> framework and
> > >> > >> > > > > >>> > >>> >> >> > > zookeeper 3.5.6 ?
> > >> > >> > > > > >>> > >>> >> >> > > I didn't get any solution
> > >> right
> > >> > >> now.
> > >> > >> > > > > >>> > >>> >> >> > > I appreciate it if
> someone
> > >> could
> > >> > >> help
> > >> > >> > > me
> > >> > >> > > > > with the
> > >> > >> > > > > >>> > same.
> > >> > >> > > > > >>> > >>> >> >> > >
> > >> > >> > > > > >>> > >>> >> >> > > Thanks,
> > >> > >> > > > > >>> > >>> >> >> > > ---------------------
> > >> > >> > > > > >>> > >>> >> >> > > Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>> >> >> > > Software Architect
> > >> > >> > > > > >>> > >>> >> >> > >
> > >> > >> > > > > >>> > >>> >> >> > >
> > >> > >> > > > > >>> > >>> >> >> > > On Fri, Apr 17, 2020 at
> > 4:53
> > >> PM
> > >> > >> > > > > Szalay-Bekő Máté
> > >> > >> > > > > >>> <
> > >> > >> > > > > >>> > >>> >> >> > szalay.beko.mate@gmail.com
> >
> > >> > >> > > > > >>> > >>> >> >> > > wrote:
> > >> > >> > > > > >>> > >>> >> >> > >
> > >> > >> > > > > >>> > >>> >> >> > >> Hello Kuldeep,
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >> did you download the
> > source
> > >> > from
> > >> > >> the
> > >> > >> > > > > ZooKeeper
> > >> > >> > > > > >>> > >>> webpage, or
> > >> > >> > > > > >>> > >>> >> >> checked out
> > >> > >> > > > > >>> > >>> >> >> > from
> > >> > >> > > > > >>> > >>> >> >> > >> git?
> > >> > >> > > > > >>> > >>> >> >> > >> Anyway, the following
> > >> commands
> > >> > >> should
> > >> > >> > > > > work:
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >> wget
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdownloads.apache.org%2Fzookeeper%2Fzookeeper-3.5.7%2Fapache-zookeeper-3.5.7.tar.gz&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944584465&sdata=QddyI0EG%2FV6Yk5DZQLO0HZOqAaY9CQJRpVPQXydBenQ%3D&reserved=0
> > >> > >> > > > > >>> > >>> >> >> > >> tar xzvf
> > >> > >> > > ./apache-zookeeper-3.5.7.tar.gz
> > >> > >> > > > > >>> > >>> >> >> > >> cd
> apache-zookeeper-3.5.7
> > >> > >> > > > > >>> > >>> >> >> > >> mvn clean install
> > >> -DskipTests
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >> I tested it with OpenJDK
> > >> 8u424
> > >> > >> and
> > >> > >> > > maven
> > >> > >> > > > > 3.6.0.
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >> Kind regards,
> > >> > >> > > > > >>> > >>> >> >> > >> Mate
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >> On Fri, Apr 17, 2020 at
> > >> 12:51
> > >> > PM
> > >> > >> > > kuldeep
> > >> > >> > > > > singh <
> > >> > >> > > > > >>> > >>> >> >> > kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > >>> >> >> > >> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >>> Hi All,
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>> I have download the
> > >> zookeeper
> > >> > >> source
> > >> > >> > > > > code and
> > >> > >> > > > > >>> run
> > >> > >> > > > > >>> > >>> the mvn
> > >> > >> > > > > >>> > >>> >> >> command for
> > >> > >> > > > > >>> > >>> >> >> > >>> packaging but get
> problem
> > >> on
> > >> > >> > > > > "zookeeper-server"
> > >> > >> > > > > >>> > >>> >> directory.
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>> *command :- mvn clean
> > >> package*
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] Failed to
> execute
> > >> goal
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > >
> > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > >> > >> > > > > >>> > >>> >> >> > >>> (default-compile) on
> > >> project
> > >> > >> > > zookeeper:
> > >> > >> > > > > Fatal
> > >> > >> > > > > >>> error
> > >> > >> > > > > >>> > >>> >> >> compiling:
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> java.lang.NullPointerException
> > >> > >> ->
> > >> > >> > > [Help
> > >> > >> > > > > 1]
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>>
> > >> > >> org.apache.maven.lifecycle.LifecycleExecutionException:
> > >> > >> > > > > >>> > >>> >> >> Failed to
> > >> > >> > > > > >>> > >>> >> >> > execute
> > >> > >> > > > > >>> > >>> >> >> > >>> goal
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > >
> > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > >> > >> > > > > >>> > >>> >> >> > >>> (default-compile) on
> > >> project
> > >> > >> > > zookeeper:
> > >> > >> > > > > Fatal
> > >> > >> > > > > >>> error
> > >> > >> > > > > >>> > >>> >> >> compiling
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > >
> > >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > >
> > org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > >> > >> > > > > Method)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >>
> > >> > java.lang.reflect.Method.invoke(Method.java:498)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> > >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > >> > >> > > > > >>> > >>> >>
> > >> org.apache.maven.plugin.MojoExecutionException:
> > >> > >> > > > > >>> > >>> >> >> Fatal error
> > >> > >> > > > > >>> > >>> >> >> > >>> compiling
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> > >> > >> > > > > >>> > >>> >> >> > >>> ... 19 more
> > >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > >> > >> > > > > >>> > >>> >>
> > >> org.codehaus.plexus.compiler.CompilerException:
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> java.lang.NullPointerException
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> > >> > >> > > > > >>> > >>> >> >> > >>> ... 22 more
> > >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > >> > >> > > java.lang.RuntimeException:
> > >> > >> > > > > >>> > >>> >> >> java.lang.NullPointerException
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > com.sun.tools.javac.main.Main.compile(Main.java:559)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> > >> > >> > > > > >>> > >>> >> >> > >>> ... 24 more
> > >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > >> > >> > > > java.lang.NullPointerException
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >>
> > >> > >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > com.sun.tools.doclint.Checker.scan(Checker.java:144)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > >
> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>>
> > >> > >> > >
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>>
> > >> > >> > >
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>>
> > >> > >> > >
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>>
> > >> > >> > >
> > com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>>
> > >> > >> > >
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> > com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>>
> > >> > >> > >
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >>
> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > com.sun.tools.javac.main.Main.compile(Main.java:523)
> > >> > >> > > > > >>> > >>> >> >> > >>> ... 27 more
> > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR]
> > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] Re-run Maven
> > using
> > >> the
> > >> > >> -X
> > >> > >> > > > switch
> > >> > >> > > > > to
> > >> > >> > > > > >>> enable
> > >> > >> > > > > >>> > >>> full
> > >> > >> > > > > >>> > >>> >> >> debug logging.
> > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR]
> > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] For more
> > >> information
> > >> > >> about
> > >> > >> > > the
> > >> > >> > > > > errors
> > >> > >> > > > > >>> and
> > >> > >> > > > > >>> > >>> >> possible
> > >> > >> > > > > >>> > >>> >> >> solutions,
> > >> > >> > > > > >>> > >>> >> >> > >>> please read the
> following
> > >> > >> articles:
> > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] [Help 1]
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > >
> > >> > >>
> > >>
> https://apc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMAVEN%2FMojoExecutionException&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944584465&sdata=gtUwAs%2BuGjN%2Fal5vqEYg%2FFCJGClvI1YsiaewmltZDpo%3D&reserved=0
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>> Can someone help me on
> > this
> > >> > >> issue?
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>> Thanks,
> > >> > >> > > > > >>> > >>> >> >> > >>> ---------------------
> > >> > >> > > > > >>> > >>> >> >> > >>> Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at
> > >> 5:57 PM
> > >> > >> > > > > Szalay-Bekő
> > >> > >> > > > > >>> Máté <
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > szalay.beko.mate@gmail.com
> > >> >
> > >> > >> > > > > >>> > >>> >> >> > >>> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> these exceptions can
> > mean
> > >> > many
> > >> > >> > > > > things... I
> > >> > >> > > > > >>> think
> > >> > >> > > > > >>> > >>> this
> > >> > >> > > > > >>> > >>> >> can
> > >> > >> > > > > >>> > >>> >> >> be even
> > >> > >> > > > > >>> > >>> >> >> > >> normal
> > >> > >> > > > > >>> > >>> >> >> > >>>> duding rolling restart
> > (as
> > >> > some
> > >> > >> > > > > connections
> > >> > >> > > > > >>> get
> > >> > >> > > > > >>> > >>> broken
> > >> > >> > > > > >>> > >>> >> in
> > >> > >> > > > > >>> > >>> >> >> this case)
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> However, I saw cases
> > >> already
> > >> > >> when
> > >> > >> > > > > exceptions
> > >> > >> > > > > >>> like
> > >> > >> > > > > >>> > >>> these
> > >> > >> > > > > >>> > >>> >> >> killed
> > >> > >> > > > > >>> > >>> >> >> > receiver
> > >> > >> > > > > >>> > >>> >> >> > >>> or
> > >> > >> > > > > >>> > >>> >> >> > >>>> sender threads in
> > >> > >> QuorumCnxManager /
> > >> > >> > > > > Leader
> > >> > >> > > > > >>> > >>> Election in
> > >> > >> > > > > >>> > >>> >> >> such a way
> > >> > >> > > > > >>> > >>> >> >> > that
> > >> > >> > > > > >>> > >>> >> >> > >>>> they were not able to
> > >> > recover,
> > >> > >> so
> > >> > >> > > the
> > >> > >> > > > > node was
> > >> > >> > > > > >>> > >>> unable to
> > >> > >> > > > > >>> > >>> >> >> connect to
> > >> > >> > > > > >>> > >>> >> >> > any
> > >> > >> > > > > >>> > >>> >> >> > >>>> quorum until restart.
> I
> > >> > >> remember
> > >> > >> > > > seeing
> > >> > >> > > > > this
> > >> > >> > > > > >>> in
> > >> > >> > > > > >>> > 3.4
> > >> > >> > > > > >>> > >>> too.
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> Do you see these
> > >> exceptions
> > >> > in
> > >> > >> the
> > >> > >> > > > > second
> > >> > >> > > > > >>> server
> > >> > >> > > > > >>> > >>> (the
> > >> > >> > > > > >>> > >>> >> one
> > >> > >> > > > > >>> > >>> >> >> which you
> > >> > >> > > > > >>> > >>> >> >> > >> just
> > >> > >> > > > > >>> > >>> >> >> > >>>> upgraded in step 3)?
> > >> > >> > > > > >>> > >>> >> >> > >>>> Is this issue
> > >> reproducible?
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> What is the tickTime
> and
> > >> > >> initLimit
> > >> > >> > > you
> > >> > >> > > > > use?
> > >> > >> > > > > >>> Maybe
> > >> > >> > > > > >>> > >>> the
> > >> > >> > > > > >>> > >>> >> >> server just
> > >> > >> > > > > >>> > >>> >> >> > >> require
> > >> > >> > > > > >>> > >>> >> >> > >>>> more time to sync?
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> I would need more logs
> > to
> > >> > >> really see
> > >> > >> > > > > what
> > >> > >> > > > > >>> > happened.
> > >> > >> > > > > >>> > >>> Can
> > >> > >> > > > > >>> > >>> >> >> you create a
> > >> > >> > > > > >>> > >>> >> >> > >> Jira
> > >> > >> > > > > >>> > >>> >> >> > >>>> issue and upload the
> > logs
> > >> and
> > >> > >> also
> > >> > >> > > the
> > >> > >> > > > > >>> ZooKeeper
> > >> > >> > > > > >>> > >>> >> configs?
> > >> > >> > > > > >>> > >>> >> >> I am happy
> > >> > >> > > > > >>> > >>> >> >> > to
> > >> > >> > > > > >>> > >>> >> >> > >>>> take a closer look.
> > >> > >> > > > > >>> > >>> >> >> > >>>> (if you need to re-run
> > the
> > >> > >> test to
> > >> > >> > > > > collect the
> > >> > >> > > > > >>> > logs,
> > >> > >> > > > > >>> > >>> >> then
> > >> > >> > > > > >>> > >>> >> >> enabling
> > >> > >> > > > > >>> > >>> >> >> > >> DEBUG
> > >> > >> > > > > >>> > >>> >> >> > >>>> logs would be great.
> The
> > >> INFO
> > >> > >> level
> > >> > >> > > > > logs are
> > >> > >> > > > > >>> > usually
> > >> > >> > > > > >>> > >>> >> >> enough for these
> > >> > >> > > > > >>> > >>> >> >> > >>>> problems, but one can
> > >> never
> > >> > >> know...)
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> Kind regards,
> > >> > >> > > > > >>> > >>> >> >> > >>>> Mate
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at
> > >> 10:05
> > >> > AM
> > >> > >> > > > kuldeep
> > >> > >> > > > > singh
> > >> > >> > > > > >>> <
> > >> > >> > > > > >>> > >>> >> >> > >>
> kuldeep.singh08@gmail.com
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> Hi Team,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> I have done some POC
> on
> > >> > >> rolling
> > >> > >> > > > > upgrade and
> > >> > >> > > > > >>> found
> > >> > >> > > > > >>> > >>> below
> > >> > >> > > > > >>> > >>> >> >> result.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 1. On 1st node
> > upgrade
> > >> > >> zookeeper
> > >> > >> > > .
> > >> > >> > > > > Traffic
> > >> > >> > > > > >>> was
> > >> > >> > > > > >>> > >>> >> running
> > >> > >> > > > > >>> > >>> >> >> fine
> > >> > >> > > > > >>> > >>> >> >> > >> because
> > >> > >> > > > > >>> > >>> >> >> > >>> 2
> > >> > >> > > > > >>> > >>> >> >> > >>>>> nodes are already
> on
> > >> old
> > >> > >> > > zookeeper.
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 2. On 1st node
> > upgrade
> > >> our
> > >> > >> > > > > application and
> > >> > >> > > > > >>> > didn’t
> > >> > >> > > > > >>> > >>> >> find
> > >> > >> > > > > >>> > >>> >> >> any issue
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 3. On 2nd node
> > upgrade
> > >> > >> zookeeper
> > >> > >> > > > but
> > >> > >> > > > > got
> > >> > >> > > > > >>> below
> > >> > >> > > > > >>> > >>> error
> > >> > >> > > > > >>> > >>> >> >> and zookeeper
> > >> > >> > > > > >>> > >>> >> >> > >>> is
> > >> > >> > > > > >>> > >>> >> >> > >>>>> not taking any
> > requests
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 4.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30
> > 14:19:55,587 -
> > >> > WARN
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
> > >> > >> > > > > >>> -
> > >> > >> > > > > >>> > >>> >> >> Interrupting
> > >> > >> > > > > >>> > >>> >> >> > >>> SendWorker
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30
> > 14:19:55,588 -
> > >> > >> ERROR
> > >> > >> > > > > >>> [LearnerHandler-/
> > >> > >> > > > > >>> > >>> >> >> 192.168.44.73:33754
> > >> > >> > > > > >>> > >>> >> >> > >>>>> :LearnerHandler@562]
> -
> > >> > >> Unexpected
> > >> > >> > > > > exception
> > >> > >> > > > > >>> > >>> causing
> > >> > >> > > > > >>> > >>> >> >> shutdown while
> > >> > >> > > > > >>> > >>> >> >> > >>> sock
> > >> > >> > > > > >>> > >>> >> >> > >>>>> still open
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30
> > 14:19:55,588 -
> > >> > WARN
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > [SendWorker:1:QuorumCnxManager$SendWorker@679]
> > >> > >> > > > > >>> -
> > >> > >> > > > > >>> > >>> >> >> Interrupted while
> > >> > >> > > > > >>> > >>> >> >> > >>>> waiting
> > >> > >> > > > > >>> > >>> >> >> > >>>>> for message on queue
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> Please let me know is
> > >> this
> > >> > the
> > >> > >> > > known
> > >> > >> > > > > issue or
> > >> > >> > > > > >>> > this
> > >> > >> > > > > >>> > >>> is
> > >> > >> > > > > >>> > >>> >> >> different issue
> > >> > >> > > > > >>> > >>> >> >> > >>>> which
> > >> > >> > > > > >>> > >>> >> >> > >>>>> is mention in Apache
> > >> > zookeeper
> > >> > >> > > > > documentation
> > >> > >> > > > > >>> when
> > >> > >> > > > > >>> > >>> >> >> upgrading from
> > >> > >> > > > > >>> > >>> >> >> > >> 3.4.5
> > >> > >> > > > > >>> > >>> >> >> > >>> to
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 3.5.6
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> Thanks,
> > >> > >> > > > > >>> > >>> >> >> > >>>>> ---------------------
> > >> > >> > > > > >>> > >>> >> >> > >>>>> Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>> >> >> > >>>>> Software Architect
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020
> at
> > >> 9:06
> > >> > >> AM
> > >> > >> > > > > Alexander
> > >> > >> > > > > >>> Shraer
> > >> > >> > > > > >>> > <
> > >> > >> > > > > >>> > >>> >> >> shralex@gmail.com>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> +1 to what Mate said
> > (I
> > >> > >> wrote the
> > >> > >> > > > > quoted
> > >> > >> > > > > >>> > >>> >> instructions).
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020
> > at
> > >> > 7:03
> > >> > >> AM
> > >> > >> > > > > Szalay-Bekő
> > >> > >> > > > > >>> > Máté <
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> szalay.beko.mate@gmail.com
> > >> > >
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> Hi Kuldeep,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> I just want to
> > provide
> > >> you
> > >> > >> some
> > >> > >> > > > > background
> > >> > >> > > > > >>> info
> > >> > >> > > > > >>> > >>> about
> > >> > >> > > > > >>> > >>> >> >> our
> > >> > >> > > > > >>> > >>> >> >> > >>>>> documentation.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> The reason to
> upgrade
> > >> to
> > >> > >> 3.4.6
> > >> > >> > > > first
> > >> > >> > > > > is to
> > >> > >> > > > > >>> > avoid
> > >> > >> > > > > >>> > >>> the
> > >> > >> > > > > >>> > >>> >> >> following
> > >> > >> > > > > >>> > >>> >> >> > >>> error:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> 2013-01-30
> > >> 11:32:10,663
> > >> > >> > > [myid:2] -
> > >> > >> > > > > WARN
> > >> > >> > > > > >>> > >>> [localhost/
> > >> > >> > > > > >>> > >>> >> >> > >>> 127.0.0.1:2784
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> :QuorumCnxManager@349
> > ]
> > >> -
> > >> > >> Invalid
> > >> > >> > > > > server
> > >> > >> > > > > >>> id:
> > >> > >> > > > > >>> > >>> -65536
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> This error comes
> > >> because
> > >> > of
> > >> > >> the
> > >> > >> > > > > protocol
> > >> > >> > > > > >>> > changes
> > >> > >> > > > > >>> > >>> >> between
> > >> > >> > > > > >>> > >>> >> >> > >> ZooKeeper
> > >> > >> > > > > >>> > >>> >> >> > >>>>> server
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> nodes during
> > connection
> > >> > >> > > initiation
> > >> > >> > > > > for
> > >> > >> > > > > >>> leader
> > >> > >> > > > > >>> > >>> >> election.
> > >> > >> > > > > >>> > >>> >> >> In
> > >> > >> > > > > >>> > >>> >> >> > >>> ZooKeeper
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 3.5
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> a
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> protocol version
> was
> > >> > >> introduced
> > >> > >> > > > (see
> > >> > >> > > > > >>> > >>> ZOOKEEPER-107)
> > >> > >> > > > > >>> > >>> >> and
> > >> > >> > > > > >>> > >>> >> >> since
> > >> > >> > > > > >>> > >>> >> >> > >> that
> > >> > >> > > > > >>> > >>> >> >> > >>>> time
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> the
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> fist long value
> sent
> > in
> > >> > the
> > >> > >> > > initial
> > >> > >> > > > > >>> message is
> > >> > >> > > > > >>> > >>> not
> > >> > >> > > > > >>> > >>> >> the
> > >> > >> > > > > >>> > >>> >> >> server ID
> > >> > >> > > > > >>> > >>> >> >> > >>> but
> > >> > >> > > > > >>> > >>> >> >> > >>>>> the
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> protocol version
> > >> (-65536).
> > >> > >> In
> > >> > >> > > > > ZooKeeper
> > >> > >> > > > > >>> 3.4.6
> > >> > >> > > > > >>> > we
> > >> > >> > > > > >>> > >>> made
> > >> > >> > > > > >>> > >>> >> >> the old 3.4
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> ZooKeepers backward
> > >> > >> compatible,
> > >> > >> > > so
> > >> > >> > > > > they are
> > >> > >> > > > > >>> > able
> > >> > >> > > > > >>> > >>> to
> > >> > >> > > > > >>> > >>> >> >> parse both
> > >> > >> > > > > >>> > >>> >> >> > >> the
> > >> > >> > > > > >>> > >>> >> >> > >>>> old
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> and
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> the new protocol
> > format
> > >> > (see
> > >> > >> > > > > >>> ZOOKEEPER-1633).
> > >> > >> > > > > >>> > >>> This
> > >> > >> > > > > >>> > >>> >> >> issue happens
> > >> > >> > > > > >>> > >>> >> >> > >>> only
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> when
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> you need to use old
> > >> > (3.4.0 -
> > >> > >> > > 3.4.5)
> > >> > >> > > > > and new
> > >> > >> > > > > >>> > >>> (3.5.0+)
> > >> > >> > > > > >>> > >>> >> >> ZooKeeper
> > >> > >> > > > > >>> > >>> >> >> > >>>> servers
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> together in the
> same
> > >> > >> cluster.
> > >> > >> > > > During
> > >> > >> > > > > a
> > >> > >> > > > > >>> rolling
> > >> > >> > > > > >>> > >>> >> upgrade,
> > >> > >> > > > > >>> > >>> >> >> this is
> > >> > >> > > > > >>> > >>> >> >> > >>>> usually
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> the
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> case to have old
> and
> > >> new
> > >> > >> > > ZooKeepers
> > >> > >> > > > > present
> > >> > >> > > > > >>> > >>> together.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> The fact that you
> > >> haven't
> > >> > >> seen
> > >> > >> > > any
> > >> > >> > > > > issues
> > >> > >> > > > > >>> might
> > >> > >> > > > > >>> > >>> be
> > >> > >> > > > > >>> > >>> >> >> caused by the
> > >> > >> > > > > >>> > >>> >> >> > >>>> order
> > >> > >> > > > > >>> > >>> >> >> > >>>>> of
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> the servers. In
> > >> ZooKeeper
> > >> > >> the
> > >> > >> > > > > connection
> > >> > >> > > > > >>> > >>> initiation
> > >> > >> > > > > >>> > >>> >> >> between the
> > >> > >> > > > > >>> > >>> >> >> > >>>> servers
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> during the leader
> > >> election
> > >> > >> > > follows
> > >> > >> > > > a
> > >> > >> > > > > >>> specific
> > >> > >> > > > > >>> > >>> rule.
> > >> > >> > > > > >>> > >>> >> As
> > >> > >> > > > > >>> > >>> >> >> far as I
> > >> > >> > > > > >>> > >>> >> >> > >>>>> remember
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> always the server
> > with
> > >> the
> > >> > >> larger
> > >> > >> > > > ID
> > >> > >> > > > > 'wins
> > >> > >> > > > > >>> the
> > >> > >> > > > > >>> > >>> >> >> challenge', so it
> > >> > >> > > > > >>> > >>> >> >> > >> is
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> possible, that the
> > old
> > >> > >> server
> > >> > >> > > > didn't
> > >> > >> > > > > need
> > >> > >> > > > > >>> to
> > >> > >> > > > > >>> > >>> parse
> > >> > >> > > > > >>> > >>> >> any
> > >> > >> > > > > >>> > >>> >> >> initial
> > >> > >> > > > > >>> > >>> >> >> > >>>> message
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> (if
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> it had the largest
> > ID)
> > >> and
> > >> > >> this
> > >> > >> > > is
> > >> > >> > > > > why you
> > >> > >> > > > > >>> > >>> haven't
> > >> > >> > > > > >>> > >>> >> seen
> > >> > >> > > > > >>> > >>> >> >> the
> > >> > >> > > > > >>> > >>> >> >> > >> issue.
> > >> > >> > > > > >>> > >>> >> >> > >>>> Also
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> having 2 nodes up
> > from
> > >> > the 3
> > >> > >> > > nodes
> > >> > >> > > > > cluster
> > >> > >> > > > > >>> > still
> > >> > >> > > > > >>> > >>> >> makes
> > >> > >> > > > > >>> > >>> >> >> the
> > >> > >> > > > > >>> > >>> >> >> > >> cluster
> > >> > >> > > > > >>> > >>> >> >> > >>>> work
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> (so
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> you should also
> check
> > >> if
> > >> > >> all the
> > >> > >> > > > > servers
> > >> > >> > > > > >>> are
> > >> > >> > > > > >>> > >>> part of
> > >> > >> > > > > >>> > >>> >> >> the quorum).
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> I agree with Enrico
> > and
> > >> > >> Norbert,
> > >> > >> > > > the
> > >> > >> > > > > >>> safest and
> > >> > >> > > > > >>> > >>> most
> > >> > >> > > > > >>> > >>> >> >> stable way
> > >> > >> > > > > >>> > >>> >> >> > >> is
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> upgrade
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> first to
> 3.4.latest,
> > >> then
> > >> > >> go to
> > >> > >> > > > > 3.5.latest.
> > >> > >> > > > > >>> > >>> Still, if
> > >> > >> > > > > >>> > >>> >> >> you don't
> > >> > >> > > > > >>> > >>> >> >> > >> see
> > >> > >> > > > > >>> > >>> >> >> > >>>>> that
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> you would hit this
> > >> > specific
> > >> > >> issue
> > >> > >> > > > > (e.g. no
> > >> > >> > > > > >>> > >>> "Invalid
> > >> > >> > > > > >>> > >>> >> >> server id" in
> > >> > >> > > > > >>> > >>> >> >> > >>> the
> > >> > >> > > > > >>> > >>> >> >> > >>>>> log
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> files), and all the
> > >> three
> > >> > >> servers
> > >> > >> > > > can
> > >> > >> > > > > >>> handle
> > >> > >> > > > > >>> > >>> traffic,
> > >> > >> > > > > >>> > >>> >> >> then maybe
> > >> > >> > > > > >>> > >>> >> >> > >>> you
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> don't
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> need to upgrade
> first
> > >> to
> > >> > >> > > > 3.4.latest,
> > >> > >> > > > > it is
> > >> > >> > > > > >>> your
> > >> > >> > > > > >>> > >>> >> >> decision.
> > >> > >> > > > > >>> > >>> >> >> > >>> Definitely
> > >> > >> > > > > >>> > >>> >> >> > >>>>> you
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> should test it
> first,
> > >> as
> > >> > >> > > suggested
> > >> > >> > > > > by the
> > >> > >> > > > > >>> > others.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> Kind regards,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> Mate
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> On Tue, Mar 24,
> 2020
> > at
> > >> > >> 12:29 PM
> > >> > >> > > > > Norbert
> > >> > >> > > > > >>> Kalmar
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> <nk...@cloudera.com.invalid>
> > >> > >> > > > > wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> Hi,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> That guide is to
> > >> upgrade
> > >> > to
> > >> > >> > > 3.5.0,
> > >> > >> > > > > which
> > >> > >> > > > > >>> was
> > >> > >> > > > > >>> > an
> > >> > >> > > > > >>> > >>> >> alpha
> > >> > >> > > > > >>> > >>> >> >> version.
> > >> > >> > > > > >>> > >>> >> >> > >> A
> > >> > >> > > > > >>> > >>> >> >> > >>>> lot
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> has
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> changed for the
> > first
> > >> > >> stable
> > >> > >> > > > > release of
> > >> > >> > > > > >>> 3.5.5
> > >> > >> > > > > >>> > >>> and
> > >> > >> > > > > >>> > >>> >> then
> > >> > >> > > > > >>> > >>> >> >> a few
> > >> > >> > > > > >>> > >>> >> >> > >>> more,
> > >> > >> > > > > >>> > >>> >> >> > >>>>> even
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> rolling upgrade
> > issues
> > >> > >> have been
> > >> > >> > > > > fixed for
> > >> > >> > > > > >>> > >>> 3.5.6.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> This is a more
> > >> up-to-date
> > >> > >> guide:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FZOOKEEPER%2FUpgrade%2BFAQ&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cbe3300d6fc06439d4fac08d8704e136d%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637382827944584465&sdata=w4GCQg9UtiBX8dXk4b9%2BBWDY0OzRL37G0RDjnlPNxBk%3D&reserved=0
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> If you have done
> > your
> > >> > >> testing
> > >> > >> > > > (with
> > >> > >> > > > > prod
> > >> > >> > > > > >>> > >>> snapshot!),
> > >> > >> > > > > >>> > >>> >> >> then you
> > >> > >> > > > > >>> > >>> >> >> > >> can
> > >> > >> > > > > >>> > >>> >> >> > >>>>> skip
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> 3.4
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> latest upgrade,
> but
> > >> keep
> > >> > >> in mind
> > >> > >> > > > we
> > >> > >> > > > > do our
> > >> > >> > > > > >>> > >>> >> >> recommendations for
> > >> > >> > > > > >>> > >>> >> >> > >> a
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> reason.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> There were issues
> > >> > reported
> > >> > >> > > and/or
> > >> > >> > > > > found
> > >> > >> > > > > >>> during
> > >> > >> > > > > >>> > >>> >> >> testing. Some
> > >> > >> > > > > >>> > >>> >> >> > >> are
> > >> > >> > > > > >>> > >>> >> >> > >>>>> fixed
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> with
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> 3.5.6, some only
> > >> happens
> > >> > if
> > >> > >> > > > certain
> > >> > >> > > > > >>> conditions
> > >> > >> > > > > >>> > >>> stand
> > >> > >> > > > > >>> > >>> >> >> > >>> (IOException:
> > >> > >> > > > > >>> > >>> >> >> > >>>> No
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> snapshot found -
> > >> > mentioned
> > >> > >> in
> > >> > >> > > the
> > >> > >> > > > > guide,
> > >> > >> > > > > >>> fixed
> > >> > >> > > > > >>> > >>> in
> > >> > >> > > > > >>> > >>> >> >> 3.5.6).
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> So it is up to
> you,
> > I
> > >> > would
> > >> > >> > > still
> > >> > >> > > > > >>> recommend to
> > >> > >> > > > > >>> > >>> do an
> > >> > >> > > > > >>> > >>> >> >> 3.4
> > >> > >> > > > > >>> > >>> >> >> > >> upgrade
> > >> > >> > > > > >>> > >>> >> >> > >>>>> first,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> if
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> it's feasible.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> Regards,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> Norbert
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> On Tue, Mar 24,
> 2020
> > >> at
> > >> > >> 11:45 AM
> > >> > >> > > > > kuldeep
> > >> > >> > > > > >>> > singh <
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> kuldeep.singh08@gmail.com
> > >> > >
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Hi,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Current Zookeeper
> > >> > version
> > >> > >> :-
> > >> > >> > > > 3.4.5
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Upgraded version
> > >> > >> > > > :-
> > >> > >> > > > > 3.5.6
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> We are not going
> > with
> > >> > >> 3.5.7.
> > >> > >> > > Our
> > >> > >> > > > > final
> > >> > >> > > > > >>> > >>> decision is
> > >> > >> > > > > >>> > >>> >> >> zookeeper
> > >> > >> > > > > >>> > >>> >> >> > >>>>> version
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> is
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.5.6
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> as per your reply
> > >> first
> > >> > >> we need
> > >> > >> > > > to
> > >> > >> > > > > move
> > >> > >> > > > > >>> > latest
> > >> > >> > > > > >>> > >>> >> >> version of
> > >> > >> > > > > >>> > >>> >> >> > >>> 3.4.x,
> > >> > >> > > > > >>> > >>> >> >> > >>>>> like
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> below
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14
> ->
> > >> 3.5.6
> > >> > >> > > (Correct
> > >> > >> > > > > me if
> > >> > >> > > > > >>> I am
> > >> > >> > > > > >>> > >>> wrong
> > >> > >> > > > > >>> > >>> >> >> here)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> But if We are not
> > >> facing
> > >> > >> any
> > >> > >> > > > > problem
> > >> > >> > > > > >>> that i
> > >> > >> > > > > >>> > >>> have
> > >> > >> > > > > >>> > >>> >> >> shared you
> > >> > >> > > > > >>> > >>> >> >> > >>> that
> > >> > >> > > > > >>> > >>> >> >> > >>>> we
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> have
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> set up of 3 node
> > >> cluster
> > >> > >> where
> > >> > >> > > 2
> > >> > >> > > > > node
> > >> > >> > > > > >>> are on
> > >> > >> > > > > >>> > >>> 3.5.6
> > >> > >> > > > > >>> > >>> >> >> version
> > >> > >> > > > > >>> > >>> >> >> > >> and
> > >> > >> > > > > >>> > >>> >> >> > >>> 1
> > >> > >> > > > > >>> > >>> >> >> > >>>>> node
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> on
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything
> > is
> > >> > >> running
> > >> > >> > > fine
> > >> > >> > > > > and
> > >> > >> > > > > >>> didn't
> > >> > >> > > > > >>> > >>> get
> > >> > >> > > > > >>> > >>> >> any
> > >> > >> > > > > >>> > >>> >> >> issue,
> > >> > >> > > > > >>> > >>> >> >> > >> So
> > >> > >> > > > > >>> > >>> >> >> > >>>> what
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> other
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> problem we can
> face
> > >> if
> > >> > we
> > >> > >> > > > directly
> > >> > >> > > > > move
> > >> > >> > > > > >>> to
> > >> > >> > > > > >>> > >>> 3.5.6
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Thanks,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > ---------------------
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Kuldeep Singh
> > Budania
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Software
> Architect
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24,
> > 2020
> > >> at
> > >> > >> 3:58 PM
> > >> > >> > > > > Enrico
> > >> > >> > > > > >>> > >>> Olivelli <
> > >> > >> > > > > >>> > >>> >> >> > >>>>> eolivelli@gmail.com
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Hi
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> You have to
> > upgrade
> > >> to
> > >> > >> latest
> > >> > >> > > > > 3.4.x
> > >> > >> > > > > >>> > Zookeeper
> > >> > >> > > > > >>> > >>> then
> > >> > >> > > > > >>> > >>> >> >> you will
> > >> > >> > > > > >>> > >>> >> >> > >>>>> upgrade
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> to
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> 3.5.7.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> All should run
> > well
> > >> > >> without
> > >> > >> > > > issues
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Enrico
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar
> > 2020,
> > >> > 10:18
> > >> > >> > > > kuldeep
> > >> > >> > > > > singh
> > >> > >> > > > > >>> <
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> kuldeep.singh08@gmail.com
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> ha
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> scritto:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Hi Team,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> We are
> upgrading
> > >> > >> zookeeper
> > >> > >> > > from
> > >> > >> > > > > 3.4.5
> > >> > >> > > > > >>> to
> > >> > >> > > > > >>> > >>> 3.5.6. I
> > >> > >> > > > > >>> > >>> >> >> have
> > >> > >> > > > > >>> > >>> >> >> > >> set
> > >> > >> > > > > >>> > >>> >> >> > >>>> up 3
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> node
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> cluster where 2
> > >> node
> > >> > >> are on
> > >> > >> > > > 3.5.6
> > >> > >> > > > > >>> version
> > >> > >> > > > > >>> > >>> and 1
> > >> > >> > > > > >>> > >>> >> >> node on
> > >> > >> > > > > >>> > >>> >> >> > >>>> 3.4.5.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Everything is
> > >> running
> > >> > >> fine
> > >> > >> > > and
> > >> > >> > > > > didn't
> > >> > >> > > > > >>> get
> > >> > >> > > > > >>> > any
> > >> > >> > > > > >>> > >>> >> issue
> > >> > >> > > > > >>> > >>> >> >> on my
> > >> > >> > > > > >>> > >>> >> >> > >>>>> system.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> but I found
> > >> something
> > >> > on
> > >> > >> > > apache
> > >> > >> > > > > site
> > >> > >> > > > > >>> that
> > >> > >> > > > > >>> > >>> first
> > >> > >> > > > > >>> > >>> >> we
> > >> > >> > > > > >>> > >>> >> >> need
> > >> > >> > > > > >>> > >>> >> >> > >> to
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> upgrade
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> on
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we
> can
> > >> > >> upgrade to
> > >> > >> > > > > 3.5.6. So
> > >> > >> > > > > >>> is
> > >> > >> > > > > >>> > it
> > >> > >> > > > > >>> > >>> >> >> mandatory
> > >> > >> > > > > >>> > >>> >> >> > >> to
> > >> > >> > > > > >>> > >>> >> >> > >>> go
> > >> > >> > > > > >>> > >>> >> >> > >>>>> on
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> 3.4.6
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> first.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> *Upgrading to
> > >> 3.5.0*
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Upgrading a
> > running
> > >> > >> ZooKeeper
> > >> > >> > > > > ensemble
> > >> > >> > > > > >>> to
> > >> > >> > > > > >>> > >>> 3.5.0
> > >> > >> > > > > >>> > >>> >> >> should be
> > >> > >> > > > > >>> > >>> >> >> > >>>> done
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> only
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> after
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> upgrading your
> > >> > ensemble
> > >> > >> to
> > >> > >> > > the
> > >> > >> > > > > 3.4.6
> > >> > >> > > > > >>> > release.
> > >> > >> > > > > >>> > >>> >> Note
> > >> > >> > > > > >>> > >>> >> >> that
> > >> > >> > > > > >>> > >>> >> >> > >>> this
> > >> > >> > > > > >>> > >>> >> >> > >>>> is
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> only
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> necessary for
> > >> rolling
> > >> > >> > > upgrades
> > >> > >> > > > > (if
> > >> > >> > > > > >>> you're
> > >> > >> > > > > >>> > >>> fine
> > >> > >> > > > > >>> > >>> >> with
> > >> > >> > > > > >>> > >>> >> >> > >>> shutting
> > >> > >> > > > > >>> > >>> >> >> > >>>>> down
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> the
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> system
> > completely,
> > >> you
> > >> > >> don't
> > >> > >> > > > > have to go
> > >> > >> > > > > >>> > >>> through
> > >> > >> > > > > >>> > >>> >> >> 3.4.6).
> > >> > >> > > > > >>> > >>> >> >> > >> If
> > >> > >> > > > > >>> > >>> >> >> > >>>> you
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> attempt
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> a
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> rolling upgrade
> > >> > without
> > >> > >> going
> > >> > >> > > > > through
> > >> > >> > > > > >>> 3.4.6
> > >> > >> > > > > >>> > >>> (for
> > >> > >> > > > > >>> > >>> >> >> example
> > >> > >> > > > > >>> > >>> >> >> > >>> from
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> 3.4.5),
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> you
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> may get the
> > >> following
> > >> > >> error:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30
> > >> > 11:32:10,663
> > >> > >> > > > [myid:2]
> > >> > >> > > > > - INFO
> > >> > >> > > > > >>> > >>> >> [localhost/
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > :QuorumCnxManager$Listener@498
> > >> > >> > > > ]
> > >> > >> > > > > -
> > >> > >> > > > > >>> Received
> > >> > >> > > > > >>> > >>> >> >> connection
> > >> > >> > > > > >>> > >>> >> >> > >>>> request
> > >> > >> > > > > >>> > >>> >> >> > >>>>> /
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> 127.0.0.1:60876
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30
> > >> > 11:32:10,663
> > >> > >> > > > [myid:2]
> > >> > >> > > > > - WARN
> > >> > >> > > > > >>> > >>> >> [localhost/
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> :QuorumCnxManager@349
> > >> > ]
> > >> > >> -
> > >> > >> > > > Invalid
> > >> > >> > > > > >>> server
> > >> > >> > > > > >>> > id:
> > >> > >> > > > > >>> > >>> >> -65536
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> During a
> rolling
> > >> > >> upgrade,
> > >> > >> > > each
> > >> > >> > > > > server
> > >> > >> > > > > >>> is
> > >> > >> > > > > >>> > >>> taken
> > >> > >> > > > > >>> > >>> >> down
> > >> > >> > > > > >>> > >>> >> >> in
> > >> > >> > > > > >>> > >>> >> >> > >> turn
> > >> > >> > > > > >>> > >>> >> >> > >>>> and
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> rebooted
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> with the new
> > 3.5.0
> > >> > >> binaries.
> > >> > >> > > > > Before
> > >> > >> > > > > >>> > starting
> > >> > >> > > > > >>> > >>> the
> > >> > >> > > > > >>> > >>> >> >> server
> > >> > >> > > > > >>> > >>> >> >> > >>> with
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> 3.5.0
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> binaries, we
> > highly
> > >> > >> recommend
> > >> > >> > > > > updating
> > >> > >> > > > > >>> the
> > >> > >> > > > > >>> > >>> >> >> configuration
> > >> > >> > > > > >>> > >>> >> >> > >>> file
> > >> > >> > > > > >>> > >>> >> >> > >>>>> so
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> that
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> all
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> server
> statements
> > >> > >> > > > "server.x=..."
> > >> > >> > > > > >>> contain
> > >> > >> > > > > >>> > >>> client
> > >> > >> > > > > >>> > >>> >> >> ports
> > >> > >> > > > > >>> > >>> >> >> > >> (see
> > >> > >> > > > > >>> > >>> >> >> > >>>> the
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> section
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Specifying
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> the client
> port).
> > >> As
> > >> > >> > > explained
> > >> > >> > > > > earlier
> > >> > >> > > > > >>> you
> > >> > >> > > > > >>> > >>> may
> > >> > >> > > > > >>> > >>> >> >> leave the
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> configuration
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> in a
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> single file, as
> > >> well
> > >> > as
> > >> > >> leave
> > >> > >> > > > the
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> clientPort/clientPortAddress
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> (although if
> you
> > >> > specify
> > >> > >> > > client
> > >> > >> > > > > ports
> > >> > >> > > > > >>> in
> > >> > >> > > > > >>> > the
> > >> > >> > > > > >>> > >>> new
> > >> > >> > > > > >>> > >>> >> >> format,
> > >> > >> > > > > >>> > >>> >> >> > >>>> these
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> are now
> > redundant).
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Could you
> please
> > >> let
> > >> > me
> > >> > >> know
> > >> > >> > > > > about this
> > >> > >> > > > > >>> > case.
> > >> > >> > > > > >>> > >>> >> >> Appreciate
> > >> > >> > > > > >>> > >>> >> >> > >> if
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> respond
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> soon.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Thanks,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> ---------------------
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh
> > >> Budania
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> ________________________________
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > >> > >> > > > > >>> > >>> >> >> This e-mail (including any
> > >> attachments)
> > >> > is
> > >> > >> > > > strictly
> > >> > >> > > > > >>> > >>> confidential
> > >> > >> > > > > >>> > >>> >> and
> > >> > >> > > > > >>> > >>> >> >> may also contain privileged
> > information.
> > >> If
> > >> > >> you are
> > >> > >> > > > > not the
> > >> > >> > > > > >>> > >>> intended
> > >> > >> > > > > >>> > >>> >> >> recipient you are not authorised to
> > read,
> > >> > >> print,
> > >> > >> > > > save,
> > >> > >> > > > > >>> process or
> > >> > >> > > > > >>> > >>> >> disclose
> > >> > >> > > > > >>> > >>> >> >> this message. If you have received
> this
> > >> > >> message by
> > >> > >> > > > > mistake,
> > >> > >> > > > > >>> > please
> > >> > >> > > > > >>> > >>> >> inform
> > >> > >> > > > > >>> > >>> >> >> the sender immediately and destroy
> this
> > >> > >> e-mail, its
> > >> > >> > > > > >>> attachments
> > >> > >> > > > > >>> > >>> and any
> > >> > >> > > > > >>> > >>> >> >> copies. Any use, distribution,
> > >> reproduction
> > >> > or
> > >> > >> > > > > disclosure by
> > >> > >> > > > > >>> any
> > >> > >> > > > > >>> > >>> person
> > >> > >> > > > > >>> > >>> >> >> other than the intended recipient is
> > >> > strictly
> > >> > >> > > > > prohibited and
> > >> > >> > > > > >>> the
> > >> > >> > > > > >>> > >>> person
> > >> > >> > > > > >>> > >>> >> >> responsible may incur in penalties.
> > >> > >> > > > > >>> > >>> >> >> The use of this e-mail is only
> for
> > >> > >> professional
> > >> > >> > > > > purposes;
> > >> > >> > > > > >>> > >>> there is
> > >> > >> > > > > >>> > >>> >> no
> > >> > >> > > > > >>> > >>> >> >> guarantee that the correspondence
> > towards
> > >> > this
> > >> > >> > > e-mail
> > >> > >> > > > > will be
> > >> > >> > > > > >>> > read
> > >> > >> > > > > >>> > >>> >> only by
> > >> > >> > > > > >>> > >>> >> >> the recipient, because, under certain
> > >> > >> > > circumstances,
> > >> > >> > > > > there
> > >> > >> > > > > >>> may
> > >> > >> > > > > >>> > be a
> > >> > >> > > > > >>> > >>> >> need to
> > >> > >> > > > > >>> > >>> >> >> access this email by third subjects
> > >> > belonging
> > >> > >> to
> > >> > >> > > the
> > >> > >> > > > > Company.
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> ________________________________
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > >> > >> > > > > >>> > >>> >> >> This e-mail (including any
> attachments)
> > >> is
> > >> > >> strictly
> > >> > >> > > > > >>> confidential
> > >> > >> > > > > >>> > >>> and
> > >> > >> > > > > >>> > >>> >> may
> > >> > >> > > > > >>> > >>> >> >> also contain privileged information.
> If
> > >> you
> > >> > >> are not
> > >> > >> > > > the
> > >> > >> > > > > >>> intended
> > >> > >> > > > > >>> > >>> >> recipient
> > >> > >> > > > > >>> > >>> >> >> you are not authorised to read,
> print,
> > >> save,
> > >> > >> > > process
> > >> > >> > > > or
> > >> > >> > > > > >>> disclose
> > >> > >> > > > > >>> > >>> this
> > >> > >> > > > > >>> > >>> >> >> message. If you have received this
> > >> message
> > >> > by
> > >> > >> > > > mistake,
> > >> > >> > > > > please
> > >> > >> > > > > >>> > >>> inform
> > >> > >> > > > > >>> > >>> >> the
> > >> > >> > > > > >>> > >>> >> >> sender immediately and destroy this
> > >> e-mail,
> > >> > >> its
> > >> > >> > > > > attachments
> > >> > >> > > > > >>> and
> > >> > >> > > > > >>> > any
> > >> > >> > > > > >>> > >>> >> copies.
> > >> > >> > > > > >>> > >>> >> >> Any use, distribution, reproduction
> or
> > >> > >> disclosure
> > >> > >> > > by
> > >> > >> > > > > any
> > >> > >> > > > > >>> person
> > >> > >> > > > > >>> > >>> other
> > >> > >> > > > > >>> > >>> >> than
> > >> > >> > > > > >>> > >>> >> >> the intended recipient is strictly
> > >> > prohibited
> > >> > >> and
> > >> > >> > > the
> > >> > >> > > > > person
> > >> > >> > > > > >>> > >>> >> responsible
> > >> > >> > > > > >>> > >>> >> >> may incur in penalties.
> > >> > >> > > > > >>> > >>> >> >> The use of this e-mail is only for
> > >> > >> professional
> > >> > >> > > > > purposes;
> > >> > >> > > > > >>> there
> > >> > >> > > > > >>> > is
> > >> > >> > > > > >>> > >>> no
> > >> > >> > > > > >>> > >>> >> >> guarantee that the correspondence
> > towards
> > >> > this
> > >> > >> > > e-mail
> > >> > >> > > > > will be
> > >> > >> > > > > >>> > read
> > >> > >> > > > > >>> > >>> >> only by
> > >> > >> > > > > >>> > >>> >> >> the recipient, because, under certain
> > >> > >> > > circumstances,
> > >> > >> > > > > there
> > >> > >> > > > > >>> may
> > >> > >> > > > > >>> > be a
> > >> > >> > > > > >>> > >>> >> need to
> > >> > >> > > > > >>> > >>> >> >> access this email by third subjects
> > >> > belonging
> > >> > >> to
> > >> > >> > > the
> > >> > >> > > > > Company.
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > > >>
> > >> > >> > > > >
> > >> > >> > > > >
> > >> > >> > > > > ________________________________
> > >> > >> > > > >
> > >> > >> > > > > CONFIDENTIALITY & PRIVACY NOTICE
> > >> > >> > > > > This e-mail (including any attachments) is strictly
> > >> confidential
> > >> > >> and
> > >> > >> > > may
> > >> > >> > > > > also contain privileged information. If you are not the
> > >> intended
> > >> > >> > > > recipient
> > >> > >> > > > > you are not authorised to read, print, save, process or
> > >> disclose
> > >> > >> this
> > >> > >> > > > > message. If you have received this message by mistake,
> > please
> > >> > >> inform
> > >> > >> > > the
> > >> > >> > > > > sender immediately and destroy this e-mail, its
> attachments
> > >> and
> > >> > >> any
> > >> > >> > > > copies.
> > >> > >> > > > > Any use, distribution, reproduction or disclosure by any
> > >> person
> > >> > >> other
> > >> > >> > > > than
> > >> > >> > > > > the intended recipient is strictly prohibited and the
> > person
> > >> > >> > > responsible
> > >> > >> > > > > may incur in penalties.
> > >> > >> > > > > The use of this e-mail is only for professional purposes;
> > >> there
> > >> > >> is no
> > >> > >> > > > > guarantee that the correspondence towards this e-mail
> will
> > be
> > >> > >> read only
> > >> > >> > > > by
> > >> > >> > > > > the recipient, because, under certain circumstances,
> there
> > >> may
> > >> > be
> > >> > >> a
> > >> > >> > > need
> > >> > >> > > > to
> > >> > >> > > > > access this email by third subjects belonging to the
> > Company.
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> > >>
> > >> >
> > >>
> > >
> >
>
This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient(s), please reply to the sender and destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email, and/or any action taken in reliance on the contents of this e-mail is strictly prohibited and may be unlawful. Where permitted by applicable law, this e-mail and other e-mail communications sent to and from Cognizant e-mail addresses may be monitored.
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Hi,
Yes, all the configurations are the same on all 5 nodes. I have checked
more than 10 times.
Before scaling , 3 node cluster was working fine, but scaling from 3 to 5
node, then we are facing this problem.
only question is on 3 node cluster it is working fine, but after scaling it
is not working and zkcli is not able to connect.
but one case I have seen.
1. if i remove all the SSL configuration from all the nodes and then
applying again all SSL property then it is working fine.
2 cases
1st case :- 3 node cluster witout SSL is working fine
scaled the cluster till 5 node without SSL is also
working fine
after that when applying SSL on all 5 nodes then it is
also working
2nd case :- 3 node cluster with SSL is working fine
scaled the cluster till 5 node with SSL is not working
in both cases the configuration area same and certificate is also same.
Thanks,
---------------------
Kuldeep Singh Budania
On Wed, Oct 14, 2020 at 5:41 PM Szalay-Bekő Máté <sz...@gmail.com>
wrote:
> the config looks OK in general...
>
> - are you sure the same configs are used on all ZK servers?
> - does the truststores accept all keys on the keystores? (if the
> truststores of the old servers had to be modified, then did you restart the
> old servers with the updated truststores?)
> - did the 3 node ZK cluster work with SSL? (were you able to connect to it
> with the client using SSL?)
>
> also: do you really need client authentication with SSL? (I see you are
> using SASL too)
> If you only need SSL for wire encryption, then you can try
> with ssl.clientAuth=none (see the admin guide). Although that feature was
> broken on 3.5.6, got fixed on 3.5.7 according to the doc.
>
> best regards,
> Mate
>
> On Wed, Oct 14, 2020 at 1:10 PM kuldeep singh <ku...@gmail.com>
> wrote:
>
> > Sorry,
> > secureClientPort=2182
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> >
> >
> >
> > On Wed, Oct 14, 2020 at 4:18 PM kuldeep singh <kuldeep.singh08@gmail.com
> >
> > wrote:
> >
> > > Thanks for reply
> > >
> > > zoo.cfg
> > > -----------
> > > secureClientPort=2181
> > > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > initLimit=10
> > > syncLimit=5
> > > dataDir= data directory (not mentioning exact path here)
> > > tickTime=2000
> > > autopurge.snapRetainCount=3
> > > autopurge.purgeInterval=1
> > > admin.enableServer=false
> > > standaloneEnabled=false
> > > jute.maxbuffer=2147483648
> > > server.1=host1_priv:10288:10388
> > > server.2=host2_priv:10288:10388
> > > server.3=host3_priv:10288:10388
> > > server.4=host4_priv:10288:10388
> > > server.5=host5_priv:10288:10388
> > > quorum.auth.enableSasl=true
> > > quorum.auth.learnerRequireSasl=true
> > > quorum.auth.serverRequireSasl=true
> > > quorum.auth.learner.loginContext=QuorumLearner
> > > quorum.auth.server.loginContext=QuorumServer
> > > quorum.cnxn.threads.size=10
> > > -------------------------------------------------------------
> > > java.env
> > >
> > > export
> > >
> >
> SERVER_JVMFLAGS="-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > -Dzookeeper.ssl.keyStore.location=keystore.jks
> > > -Dzookeeper.ssl.keyStore.password=<passwword>
> > > -Dzookeeper.ssl.trustStore.location= keystore.jks
> > > -Dzookeeper.ssl.trustStore.password= <passwword>
> > > -Djava.security.auth.login.config=zookeeper-jaas.conf"
> > >
> > > export
> > >
> >
> CLIENT_JVMFLAGS="-Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > -Dzookeeper.client.secure=true -Dzookeeper.ssl.keyStore.location=
> > > keystore.jks -Dzookeeper.ssl.keyStore.password= <passwword>
> > > -Dzookeeper.ssl.trustStore.location=keystore.jks
> > > -Dzookeeper.ssl.trustStore.password= <passwword>
> > > -Dzookeeper.ssl.hostnameVerification=false"
> > >
> > > Thanks,
> > > ---------------------
> > > Kuldeep Singh Budania
> > >
> > >
> > >
> > > On Wed, Oct 14, 2020 at 4:12 PM Szalay-Bekő Máté <
> > > szalay.beko.mate@gmail.com> wrote:
> > >
> > >> These log messages indicate that a client (or an other ZooKeeper
> server)
> > >> is
> > >> trying to connect without SSL to a ZooKeeper process that expects SSL.
> > >> I assume this will be a configuration issue then.
> > >>
> > >> Best regards,
> > >> Mate
> > >>
> > >> On Wed, Oct 14, 2020 at 12:30 PM kuldeep singh <
> > kuldeep.singh08@gmail.com
> > >> >
> > >> wrote:
> > >>
> > >> > Hi,
> > >> >
> > >> > more logs
> > >> >
> > >> > 2020-10-14 12:25:05,106 - ERROR
> > >> >
> > >> >
> > >>
> >
> [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler$CertificateVerifier@257
> > >> > ]
> > >> > - Unsuccessful handshake with session 0x0
> > >> >
> > >> > 2020-10-14 12:25:05,107 - WARN
> > >> > [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler@138
> ]
> > -
> > >> > Exception caught
> > >> >
> > >> > io.netty.handler.codec.DecoderException:
> > >> > io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record:
> > >> > 737276720a
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:475)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:283)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
> > >> >
> > >> > at
> > >> >
> > >>
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
> > >> >
> > >> > at
> > io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
> > >> >
> > >> > at
> > >> >
> > >>
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> > >> >
> > >> > at java.lang.Thread.run(Thread.java:748)
> > >> >
> > >> > Caused by: io.netty.handler.ssl.NotSslRecordException: not an
> SSL/TLS
> > >> > record: 737276720a
> > >> >
> > >> > at
> > >> >
> > >>
> > io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1203)
> > >> >
> > >> > at
> > io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1271)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:505)
> > >> >
> > >> > at
> > >> >
> > >> >
> > >>
> >
> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:444)
> > >> >
> > >> > ... 17 more
> > >> >
> > >> > Thanks,
> > >> > ---------------------
> > >> > Kuldeep Singh Budania
> > >> > Software Architect
> > >> >
> > >> >
> > >> >
> > >> > On Wed, Oct 14, 2020 at 3:51 PM kuldeep singh <
> > >> kuldeep.singh08@gmail.com>
> > >> > wrote:
> > >> >
> > >> > > Hi,
> > >> > >
> > >> > >
> > >> > > below error is coming on zookeeper logs on SSL.
> > >> > >
> > >> > > 2020-10-14 12:18:27,410 - WARN
> > >> > [nioEventLoopGroup-4-16:NettyServerCnxn@540]
> > >> > > - Closing connection to /127.0.0.1:49470
> > >> > > java.io.IOException: Len error 369296128
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:533)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> org.apache.zookeeper.server.NettyServerCnxn.processMessage(NettyServerCnxn.java:360)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.channelRead(NettyServerCnxnFactory.java:184)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
> > >> > > at
> > >> io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
> > >> > > at
> > >> > >
> > >>
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > >> > > at
> > >> > >
> > >> >
> > >>
> >
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> > >> > > at java.lang.Thread.run(Thread.java:748)
> > >> > >
> > >> > > Thanks,
> > >> > > ---------------------
> > >> > > Kuldeep Singh Budania
> > >> > >
> > >> > >
> > >> > >
> > >> > > On Thu, Oct 8, 2020 at 6:33 PM Szalay-Bekő Máté <
> > >> > > szalay.beko.mate@gmail.com> wrote:
> > >> > >
> > >> > >> Sounds like a bug or a configuration issue...
> > >> > >> can you share the configs (before and after the scale-up) and the
> > >> logs?
> > >> > >> also: does the truststores recognise all the keys used on all
> the 5
> > >> > >> nodes? (e.g. the truststores on the old nodes accept the new
> keys?)
> > >> > >>
> > >> > >> Best Regards,
> > >> > >> Mate
> > >> > >>
> > >> > >> On Thu, Oct 8, 2020 at 2:31 PM kuldeep singh <
> > >> kuldeep.singh08@gmail.com
> > >> > >
> > >> > >> wrote:
> > >> > >> >
> > >> > >> > Hi,
> > >> > >> >
> > >> > >> > Yes, My client and server both are using certificate and have
> > >> added in
> > >> > >> ZK
> > >> > >> > and client as well.
> > >> > >> >
> > >> > >> > Thanks,
> > >> > >> > ---------------------
> > >> > >> > Kuldeep Singh Budania
> > >> > >> >
> > >> > >> >
> > >> > >> >
> > >> > >> > On Thu, Oct 8, 2020 at 5:56 PM Enrico Olivelli <
> > >> eolivelli@gmail.com>
> > >> > >> wrote:
> > >> > >> >
> > >> > >> > > Il giorno gio 8 ott 2020 alle ore 14:17 kuldeep singh <
> > >> > >> > > kuldeep.singh08@gmail.com> ha scritto:
> > >> > >> > >
> > >> > >> > > > Hi Team,
> > >> > >> > > >
> > >> > >> > > > I am facing one issue in SSL communication between client
> and
> > >> > >> zookeeper
> > >> > >> > > > server.
> > >> > >> > > >
> > >> > >> > > > ZK 3.5.6 version
> > >> > >> > > >
> > >> > >> > > > 1. Mi on 3 node
> > >> > >> > > > 2. Applying SSL and 3 nodes cluster is working fine
> > >> > >> > > > 3. Scaled my cluster with 2 nodes and now my cluster have 5
> > >> nodes
> > >> > >> over
> > >> > >> > > SSL
> > >> > >> > > >
> > >> > >> > > > but after scaling my SSL is not working between client and
> ZK
> > >> > >> server and
> > >> > >> > > > even not able to login using zkCli as well.
> > >> > >> > > >
> > >> > >> > > > Can someone provide the details please why it is happening?
> > >> > >> > > >
> > >> > >> > >
> > >> > >> > > Is your client configured to use SSL ?
> > >> > >> > >
> > >> > >> > > Enrico
> > >> > >> > >
> > >> > >> > >
> > >> > >> > >
> > >> > >> > > >
> > >> > >> > > > Thanks,
> > >> > >> > > > ---------------------
> > >> > >> > > > Kuldeep Singh Budania
> > >> > >> > > > Software Architect
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > > > On Mon, Jul 13, 2020 at 2:19 PM Enrico Olivelli - Diennea
> > >> > >> > > > <en...@diennea.com.invalid> wrote:
> > >> > >> > > >
> > >> > >> > > > > It looks like we ported it to 3.5.
> > >> > >> > > > >
> > >> > >> > > > > See the subtask
> > >> > >> > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2792
> > >> > >> > > > >
> > >> > >> > > > > Enrico
> > >> > >> > > > >
> > >> > >> > > > > Il giorno 13/07/20, 10:37 "kuldeep singh" <
> > >> > >> kuldeep.singh08@gmail.com>
> > >> > >> > > > ha
> > >> > >> > > > > scritto:
> > >> > >> > > > >
> > >> > >> > > > > Hi Team,
> > >> > >> > > > >
> > >> > >> > > > > I appreciate it if I will get a response as soon as
> > >> > possible,
> > >> > >> as I
> > >> > >> > > am
> > >> > >> > > > > stuck
> > >> > >> > > > > at this point.
> > >> > >> > > > >
> > >> > >> > > > > Thanks,
> > >> > >> > > > > ---------------------
> > >> > >> > > > > Kuldeep Singh Budania
> > >> > >> > > > >
> > >> > >> > > > >
> > >> > >> > > > >
> > >> > >> > > > > On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <
> > >> > >> > > > > kuldeep.singh08@gmail.com>
> > >> > >> > > > > wrote:
> > >> > >> > > > >
> > >> > >> > > > > > Hi Team,
> > >> > >> > > > > >
> > >> > >> > > > > > Server to Server communication is not supported in
> > >> 3.5.6
> > >> > >> version
> > >> > >> > > > as
> > >> > >> > > > > per
> > >> > >> > > > > > below JIRA issue?
> > >> > >> > > > > >
> > >> > >> > > > > >
> https://issues.apache.org/jira/browse/ZOOKEEPER-2639
> > >> > >> > > > > >
> > >> > >> > > > > > Thanks,
> > >> > >> > > > > > ---------------------
> > >> > >> > > > > > Kuldeep Singh Budania
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > > On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <
> > >> > >> > > > > kuldeep.singh08@gmail.com>
> > >> > >> > > > > > wrote:
> > >> > >> > > > > >
> > >> > >> > > > > >> Thanks for the reply.
> > >> > >> > > > > >>
> > >> > >> > > > > >> Now my ZKCli cmd is working fine as we use some
> our
> > >> > >> customized
> > >> > >> > > > > >> authentication and we resolve the issue.
> > >> > >> > > > > >>
> > >> > >> > > > > >> Now I am going to implement Server to Server
> > >> > communication.
> > >> > >> > > > > >>
> > >> > >> > > > > >> Thanks,
> > >> > >> > > > > >> ---------------------
> > >> > >> > > > > >> Kuldeep Singh Budania
> > >> > >> > > > > >>
> > >> > >> > > > > >>
> > >> > >> > > > > >>
> > >> > >> > > > > >> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
> > >> > >> > > > > >> szalay.beko.mate@gmail.com> wrote:
> > >> > >> > > > > >>
> > >> > >> > > > > >>> I think SSL is working for you already... If you
> > >> managed
> > >> > >> to
> > >> > >> > > start
> > >> > >> > > > > the
> > >> > >> > > > > >>> zkCli.sh and be able to connect to ZooKeeper on
> the
> > >> > >> secure port
> > >> > >> > > > > and issue
> > >> > >> > > > > >>> any kind of command (like: " ls / "), then the
> wire
> > >> > >> encryption
> > >> > >> > > is
> > >> > >> > > > > working
> > >> > >> > > > > >>> and your server/client communication is secured
> by
> > >> > >> ZooKeeper.
> > >> > >> > > > > >>>
> > >> > >> > > > > >>> Why you want to run the following command?
> > >> > >> > > > > >>> addauth ztpasswd zooadmin:<password>
> > >> > >> > > > > >>>
> > >> > >> > > > > >>> Do you also want to configure a superDigest user
> in
> > >> > >> ZooKeeper?
> > >> > >> > > > > Please
> > >> > >> > > > > >>> note
> > >> > >> > > > > >>> that this command is independent from SSL. If you
> > >> need
> > >> > to
> > >> > >> > > create
> > >> > >> > > > a
> > >> > >> > > > > >>> username-password pair for digest authentication
> > then
> > >> > >> please
> > >> > >> > > use
> > >> > >> > > > > the
> > >> > >> > > > > >>> command in the following way:
> > >> > >> > > > > >>> addauth digest zooadmin:yourSuperSecretPassword
> > >> > >> > > > > >>>
> > >> > >> > > > > >>> Kind regards,
> > >> > >> > > > > >>> Mate
> > >> > >> > > > > >>>
> > >> > >> > > > > >>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <
> > >> > >> > > > > kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> wrote:
> > >> > >> > > > > >>>
> > >> > >> > > > > >>> > 1. sh zkCli.sh --config /etc/zookeeper -server
> > >> > >> localhost:2281
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> > 2. addauth ztpasswd zooadmin:<password>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> > Thanks,
> > >> > >> > > > > >>> > ---------------------
> > >> > >> > > > > >>> > Kuldeep Singh Budania
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
> > >> > >> > > > > >>> kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > wrote:
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>> > > Hi Team,
> > >> > >> > > > > >>> > >
> > >> > >> > > > > >>> > > Any update on this?
> > >> > >> > > > > >>> > >
> > >> > >> > > > > >>> > > Thanks,
> > >> > >> > > > > >>> > > ---------------------
> > >> > >> > > > > >>> > > Kuldeep Singh Budania
> > >> > >> > > > > >>> > >
> > >> > >> > > > > >>> > >
> > >> > >> > > > > >>> > >
> > >> > >> > > > > >>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh
> <
> > >> > >> > > > > >>> kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > > wrote:
> > >> > >> > > > > >>> > >
> > >> > >> > > > > >>> > >> Sorry this is my bad, there were server
> > setting
> > >> > like
> > >> > >> below
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> export SERVER_JVMFLAGS="
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> > >> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> > >> > > > > >>> > >>
> -Dzookeeper.ssl.trustStore.password=testpass"
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> export CLIENT_JVMFLAGS="
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >> > >> > > > > >>> > >> -Dzookeeper.client.secure=true
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> > >> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> > >> > > > > >>> > >>
> -Dzookeeper.ssl.trustStore.password=testpass"
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> I want to have SSL between client to server
> > >> > >> communication
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> I am already following the same link which
> you
> > >> have
> > >> > >> shared
> > >> > >> > > > > with me
> > >> > >> > > > > >>> but
> > >> > >> > > > > >>> > >> that is not working.
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> Zoo.cfg
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> secureClientPort=2281
> > >> > >> > > > > >>> > >> initLimit=10
> > >> > >> > > > > >>> > >> syncLimit=5
> > >> > >> > > > > >>> > >> dataDir=/var/lib/zookeeper/data
> > >> > >> > > > > >>> > >> tickTime=2000
> > >> > >> > > > > >>> > >> autopurge.snapRetainCount=3
> > >> > >> > > > > >>> > >> autopurge.purgeInterval=1
> > >> > >> > > > > >>> > >> admin.enableServer=false
> > >> > >> > > > > >>> > >> standaloneEnabled=false
> > >> > >> > > > > >>> > >> jute.maxbuffer=2147483648
> > >> > >> > > > > >>> > >>
> > >> > >> > > > >
> > >> > >>
> > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > >> > > > > >>> > >> server.1=host1_priv:10288:10388
> > >> > >> > > > > >>> > >> server.2=host2_priv:10288:10388
> > >> > >> > > > > >>> > >> server.3=host3_priv:10288:10388
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> command to connect using zkcli
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> 1. zkcli zoo.cfg localhost:2281
> > >> > >> > > > > >>> > >> 2. addauth ztpasswd usernaem:password
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> after second step we are getting below error
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> WatchedEvent state:AuthFailed type:None
> > >> path:null
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 -
> > >> WARN
> > >> > >> > > > > >>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119
> ]
> > -
> > >> No
> > >> > >> > > > > authentication
> > >> > >> > > > > >>> > provider
> > >> > >> > > > > >>> > >> for scheme: ztpasswd has x509 ip digest*
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> Thanks,
> > >> > >> > > > > >>> > >> ---------------------
> > >> > >> > > > > >>> > >> Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő
> > Máté
> > >> <
> > >> > >> > > > > >>> > >> szalay.beko.mate@gmail.com> wrote:
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> > >>> > No authentication provider for scheme:
> > >> ztpasswd
> > >> > >> has
> > >> > >> > > x509
> > >> > >> > > > > ip
> > >> > >> > > > > >>> digest*
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> > >>> This suggest you have some configuration
> > >> error...
> > >> > >> Where
> > >> > >> > > did
> > >> > >> > > > > you
> > >> > >> > > > > >>> use the
> > >> > >> > > > > >>> > >>> "ztpasswd" string in your configs /
> commands?
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő
> > >> Máté <
> > >> > >> > > > > >>> > >>> szalay.beko.mate@gmail.com>
> > >> > >> > > > > >>> > >>> wrote:
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> > >>> > > My ZK server is up and running in
> secure
> > >> mode
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > What is your goal? You want to setup
> > >> > >> client-server SSL
> > >> > >> > > > > >>> connection?
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > see:
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > (or you want to have both SSL and SASL
> > >> enabled?)
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > Anyway, please remove the following line
> > from
> > >> > the
> > >> > >> > > > > >>> SERVER_JVMFLAGS:
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> > >>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >> > >> > > > > >>> > >>> > This is a configuration that makes sense
> > only
> > >> > for
> > >> > >> the
> > >> > >> > > > > ZooKeeper
> > >> > >> > > > > >>> > client,
> > >> > >> > > > > >>> > >>> > not for the server. For the server, use
> the
> > >> > >> following:
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > If it doesn't solve the issue, then can
> you
> > >> > >> please send
> > >> > >> > > > > your
> > >> > >> > > > > >>> zoo.cfg
> > >> > >> > > > > >>> > >>> file?
> > >> > >> > > > > >>> > >>> > Also can you please send the zkCli
> command
> > >> you
> > >> > >> execute?
> > >> > >> > > > > (you
> > >> > >> > > > > >>> need to
> > >> > >> > > > > >>> > >>> > connect to the secure ZooKeeper port,
> > unless
> > >> > >> > > > > portUnification is
> > >> > >> > > > > >>> > >>> enabled)
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > Kind regards,
> > >> > >> > > > > >>> > >>> > Mate
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep
> > singh
> > >> <
> > >> > >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > >>> > wrote:
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>> >> Hi,
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> we have done below changes in java.env
> > file
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> export SERVER_JVMFLAGS="
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> > >> > > > > >>> > >>> >>
> -Dzookeeper.ssl.keyStore.password=testpass
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> > >> > > > > >>> > >>> >>
> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> export CLIENT_JVMFLAGS="
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >> > >> > > > > >>> > >>> >> -Dzookeeper.client.secure=true
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> > >> > > > > >>> > >>> >>
> -Dzookeeper.ssl.keyStore.password=testpass
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> > >> > > > > >>> > >>> >>
> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> I have started the ZK server and it is
> up
> > >> > >> without any
> > >> > >> > > > > issue.
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> But now when I login to ZkCli then it
> > gives
> > >> the
> > >> > >> below
> > >> > >> > > > > error.
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> WatchedEvent state:AuthFailed type:None
> > >> > path:null
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> Zookeeper logs :- *2020-07-01
> > 07:38:09,342 -
> > >> > WARN
> > >> > >> > > > > >>> > >>> >>
> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
> > >> -
> > >> > >> No
> > >> > >> > > > > >>> authentication
> > >> > >> > > > > >>> > >>> provider
> > >> > >> > > > > >>> > >>> >> for scheme: ztpasswd has x509 ip digest*
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> Please help me on this issue
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> Thanks,
> > >> > >> > > > > >>> > >>> >> ---------------------
> > >> > >> > > > > >>> > >>> >> Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>> >> Software Architect
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep
> > >> singh <
> > >> > >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > >>> >> wrote:
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >> > Hi,
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > My ZK server is up and running in
> > secure
> > >> > >> mode, But
> > >> > >> > > > > When I am
> > >> > >> > > > > >>> > >>> trying to
> > >> > >> > > > > >>> > >>> >> > connect to the ZK server using ZKCli,
> it
> > >> > gives
> > >> > >> the
> > >> > >> > > > below
> > >> > >> > > > > >>> error.
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > WatchedEvent state:AuthFailed
> type:None
> > >> > >> path:null
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > Zookeeper logs :- *2020-07-01
> > >> 07:38:09,342 -
> > >> > >> WARN
> > >> > >> > > > > >>> > >>> >> >
> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
> > >> > >> - No
> > >> > >> > > > > >>> authentication
> > >> > >> > > > > >>> > >>> >> provider
> > >> > >> > > > > >>> > >>> >> > for scheme: ztpasswd has x509 ip
> digest*
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > Can someone please help me on this
> > issue.
> > >> we
> > >> > >> are
> > >> > >> > > using
> > >> > >> > > > > the
> > >> > >> > > > > >>> 3.5.6
> > >> > >> > > > > >>> > >>> >> version.
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > I appreciate if I will get a response
> as
> > >> soon
> > >> > >> as
> > >> > >> > > > > possible, as
> > >> > >> > > > > >>> I am
> > >> > >> > > > > >>> > >>> stuck
> > >> > >> > > > > >>> > >>> >> > at this point.
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > Thanks,
> > >> > >> > > > > >>> > >>> >> > ---------------------
> > >> > >> > > > > >>> > >>> >> > Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>> >> > Software Architect
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM
> Enrico
> > >> > >> Olivelli -
> > >> > >> > > > > Diennea
> > >> > >> > > > > >>> > >>> >> > <en...@diennea.com.invalid>
> > >> wrote:
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >> >> I mean in zoo.cfg
> > >> > >> > > > > >>> > >>> >> >> Not as a system property
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Enrico
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico
> > >> Olivelli -
> > >> > >> > > > Diennea" <
> > >> > >> > > > > >>> > >>> >> >> enrico.olivelli@diennea.com.INVALID>
> > ha
> > >> > >> scritto:
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Hi
> > >> > >> > > > > >>> > >>> >> >> You have to enable Netty on the
> > >> server
> > >> > >> side
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Something like:
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Hope that helps
> > >> > >> > > > > >>> > >>> >> >> Enrico
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Il giorno 24/06/20, 19:17
> "kuldeep
> > >> > singh"
> > >> > >> <
> > >> > >> > > > > >>> > >>> >> kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > >>> >> >> ha scritto:
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Hi,
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> I got below error while
> setting
> > >> SSL
> > >> > >> > > > properties
> > >> > >> > > > > in
> > >> > >> > > > > >>> > zkEnv.sh
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> ==========================================================================================
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,864 -
> INFO
> > >> > >> > > > > >>> > [main:QuorumPeerConfig@133]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> Reading
> > >> > >> > > > > >>> > >>> >> >> configuration from:
> > >> > >> /etc/zookeeper/zoo.cfg
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 -
> INFO
> > >> > >> > > > > >>> > [main:QuorumPeerConfig@385]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> clientPortAddress is
> > >> > >> 0.0.0.0/0.0.0.0:10181
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 -
> INFO
> > >> > >> > > > > >>> > [main:QuorumPeerConfig@399]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> secureClientPortAddress is
> > >> > >> > > > > 0.0.0.0/0.0.0.0:2281
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,878 -
> INFO
> > >> > >> > > > > [main:X509Util@79] -
> > >> > >> > > > > >>> > >>> Setting
> > >> > >> > > > > >>> > >>> >> -D
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > jdk.tls.rejectClientInitiatedRenegotiation=true to
> > >> > >> > > > > >>> > disable
> > >> > >> > > > > >>> > >>> >> >> client-initiated
> > >> > >> > > > > >>> > >>> >> >> TLS renegotiation
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 -
> INFO
> > >> > >> > > > > >>> > >>> [main:DatadirCleanupManager@78]
> > >> > >> > > > > >>> > >>> >> -
> > >> > >> > > > > >>> > >>> >> >> autopurge.snapRetainCount set
> > to
> > >> 3
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 -
> INFO
> > >> > >> > > > > >>> > >>> [main:DatadirCleanupManager@79]
> > >> > >> > > > > >>> > >>> >> -
> > >> > >> > > > > >>> > >>> >> >> autopurge.purgeInterval set
> to
> > 1
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,898 -
> > INFO [
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > PurgeTask:DatadirCleanupManager$PurgeTask@138
> > >> > >> > > > ]
> > >> > >> > > > > -
> > >> > >> > > > > >>> Purge
> > >> > >> > > > > >>> > >>> task
> > >> > >> > > > > >>> > >>> >> >> started.
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,899 -
> INFO
> > >> > >> > > > > [main:ManagedUtil@46]
> > >> > >> > > > > >>> -
> > >> > >> > > > > >>> > >>> Log4j
> > >> > >> > > > > >>> > >>> >> >> found with
> > >> > >> > > > > >>> > >>> >> >> jmx enabled.
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,903 -
> INFO
> > >> > >> > > > > >>> > >>> [PurgeTask:FileTxnSnapLog@103]
> > >> > >> > > > > >>> > >>> >> -
> > >> > >> > > > > >>> > >>> >> >>
> zookeeper.snapshot.trust.empty
> > :
> > >> > false
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,910 -
> > INFO [
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > PurgeTask:DatadirCleanupManager$PurgeTask@144
> > >> > >> > > > ]
> > >> > >> > > > > -
> > >> > >> > > > > >>> Purge
> > >> > >> > > > > >>> > >>> task
> > >> > >> > > > > >>> > >>> >> >> completed.
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,975 -
> INFO
> > >> > >> > > > > >>> [main:QuorumPeerMain@141
> > >> > >> > > > > >>> > ]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> Starting quorum
> > >> > >> > > > > >>> > >>> >> >> peer
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,983 -
> INFO
> > >> > >> > > > > >>> > [main:ServerCnxnFactory@135]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> Using
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > >> > >> > > > > >>> > server
> > >> > >> > > > > >>> > >>> >> >> connection
> > >> > >> > > > > >>> > >>> >> >> factory
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,986 -
> INFO
> > >> > >> > > > > >>> > >>> [main:NIOServerCnxnFactory@673]
> > >> > >> > > > > >>> > >>> >> -
> > >> > >> > > > > >>> > >>> >> >> Configuring NIO connection
> > >> handler
> > >> > >> with 10s
> > >> > >> > > > > >>> sessionless
> > >> > >> > > > > >>> > >>> >> >> connection timeout,
> > >> > >> > > > > >>> > >>> >> >> 2 selector thread(s), 16
> worker
> > >> > >> threads,
> > >> > >> > > and
> > >> > >> > > > > 64 kB
> > >> > >> > > > > >>> direct
> > >> > >> > > > > >>> > >>> >> buffers.
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,992 -
> INFO
> > >> > >> > > > > >>> > >>> [main:NIOServerCnxnFactory@686
> > >> > >> > > > > >>> > >>> >> ]
> > >> > >> > > > > >>> > >>> >> >> - binding
> > >> > >> > > > > >>> > >>> >> >> to port
> 0.0.0.0/0.0.0.0:10181
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,994 -
> INFO
> > >> > >> > > > > >>> > [main:ServerCnxnFactory@135]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> Using
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > >> > >> > > > > >>> > server
> > >> > >> > > > > >>> > >>> >> >> connection
> > >> > >> > > > > >>> > >>> >> >> factory
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,995 -
> ERROR
> > >> > >> > > > > >>> [main:QuorumPeerMain@101
> > >> > >> > > > > >>> > ]
> > >> > >> > > > > >>> > >>> -
> > >> > >> > > > > >>> > >>> >> >> Unexpected
> > >> > >> > > > > >>> > >>> >> >> exception, exiting abnormally
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> java.lang.UnsupportedOperationException:
> > >> > >> > > SSL
> > >> > >> > > > > isn't
> > >> > >> > > > > >>> > >>> supported in
> > >> > >> > > > > >>> > >>> >> >> NIOServerCnxn
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> I have set the following
> > >> properties
> > >> > in
> > >> > >> > > > > >>> SERVER_JVMFLAGS in
> > >> > >> > > > > >>> > >>> >> >> zkEnv.sh file :
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> Thanks,
> > >> > >> > > > > >>> > >>> >> >> ---------------------
> > >> > >> > > > > >>> > >>> >> >> Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08
> PM
> > >> > Jordan
> > >> > >> > > > > Zimmerman <
> > >> > >> > > > > >>> > >>> >> >> jordan@jordanzimmerman.com>
> > >> > >> > > > > >>> > >>> >> >> wrote:
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> > It's the same as the normal
> > >> > >> ZooKeeper
> > >> > >> > > > client:
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > >> > >> > > > > >>> > >>> >> >> > <
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > >> > >> > > > > >>> > >>> >> >> > >
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >> > -Jordan
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >> > > On Jun 22, 2020, at 5:50
> > AM,
> > >> > >> kuldeep
> > >> > >> > > > singh
> > >> > >> > > > > <
> > >> > >> > > > > >>> > >>> >> >> kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > >>> >> >> > wrote:
> > >> > >> > > > > >>> > >>> >> >> > >
> > >> > >> > > > > >>> > >>> >> >> > > Hi Team,
> > >> > >> > > > > >>> > >>> >> >> > > How we will do secure
> > >> > >> communication
> > >> > >> > > > > between the
> > >> > >> > > > > >>> > Curator
> > >> > >> > > > > >>> > >>> >> >> framework and
> > >> > >> > > > > >>> > >>> >> >> > > zookeeper 3.5.6 ?
> > >> > >> > > > > >>> > >>> >> >> > > I didn't get any solution
> > >> right
> > >> > >> now.
> > >> > >> > > > > >>> > >>> >> >> > > I appreciate it if
> someone
> > >> could
> > >> > >> help
> > >> > >> > > me
> > >> > >> > > > > with the
> > >> > >> > > > > >>> > same.
> > >> > >> > > > > >>> > >>> >> >> > >
> > >> > >> > > > > >>> > >>> >> >> > > Thanks,
> > >> > >> > > > > >>> > >>> >> >> > > ---------------------
> > >> > >> > > > > >>> > >>> >> >> > > Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>> >> >> > > Software Architect
> > >> > >> > > > > >>> > >>> >> >> > >
> > >> > >> > > > > >>> > >>> >> >> > >
> > >> > >> > > > > >>> > >>> >> >> > > On Fri, Apr 17, 2020 at
> > 4:53
> > >> PM
> > >> > >> > > > > Szalay-Bekő Máté
> > >> > >> > > > > >>> <
> > >> > >> > > > > >>> > >>> >> >> > szalay.beko.mate@gmail.com
> >
> > >> > >> > > > > >>> > >>> >> >> > > wrote:
> > >> > >> > > > > >>> > >>> >> >> > >
> > >> > >> > > > > >>> > >>> >> >> > >> Hello Kuldeep,
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >> did you download the
> > source
> > >> > from
> > >> > >> the
> > >> > >> > > > > ZooKeeper
> > >> > >> > > > > >>> > >>> webpage, or
> > >> > >> > > > > >>> > >>> >> >> checked out
> > >> > >> > > > > >>> > >>> >> >> > from
> > >> > >> > > > > >>> > >>> >> >> > >> git?
> > >> > >> > > > > >>> > >>> >> >> > >> Anyway, the following
> > >> commands
> > >> > >> should
> > >> > >> > > > > work:
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >> wget
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> > >> > >> > > > > >>> > >>> >> >> > >> tar xzvf
> > >> > >> > > ./apache-zookeeper-3.5.7.tar.gz
> > >> > >> > > > > >>> > >>> >> >> > >> cd
> apache-zookeeper-3.5.7
> > >> > >> > > > > >>> > >>> >> >> > >> mvn clean install
> > >> -DskipTests
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >> I tested it with OpenJDK
> > >> 8u424
> > >> > >> and
> > >> > >> > > maven
> > >> > >> > > > > 3.6.0.
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >> Kind regards,
> > >> > >> > > > > >>> > >>> >> >> > >> Mate
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >> On Fri, Apr 17, 2020 at
> > >> 12:51
> > >> > PM
> > >> > >> > > kuldeep
> > >> > >> > > > > singh <
> > >> > >> > > > > >>> > >>> >> >> > kuldeep.singh08@gmail.com>
> > >> > >> > > > > >>> > >>> >> >> > >> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> > >>> Hi All,
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>> I have download the
> > >> zookeeper
> > >> > >> source
> > >> > >> > > > > code and
> > >> > >> > > > > >>> run
> > >> > >> > > > > >>> > >>> the mvn
> > >> > >> > > > > >>> > >>> >> >> command for
> > >> > >> > > > > >>> > >>> >> >> > >>> packaging but get
> problem
> > >> on
> > >> > >> > > > > "zookeeper-server"
> > >> > >> > > > > >>> > >>> >> directory.
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>> *command :- mvn clean
> > >> package*
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] Failed to
> execute
> > >> goal
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > >
> > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > >> > >> > > > > >>> > >>> >> >> > >>> (default-compile) on
> > >> project
> > >> > >> > > zookeeper:
> > >> > >> > > > > Fatal
> > >> > >> > > > > >>> error
> > >> > >> > > > > >>> > >>> >> >> compiling:
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> java.lang.NullPointerException
> > >> > >> ->
> > >> > >> > > [Help
> > >> > >> > > > > 1]
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>>
> > >> > >> org.apache.maven.lifecycle.LifecycleExecutionException:
> > >> > >> > > > > >>> > >>> >> >> Failed to
> > >> > >> > > > > >>> > >>> >> >> > execute
> > >> > >> > > > > >>> > >>> >> >> > >>> goal
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > >
> > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > >> > >> > > > > >>> > >>> >> >> > >>> (default-compile) on
> > >> project
> > >> > >> > > zookeeper:
> > >> > >> > > > > Fatal
> > >> > >> > > > > >>> error
> > >> > >> > > > > >>> > >>> >> >> compiling
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > >
> > >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > >
> > org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > >> > >> > > > > Method)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >>
> > >> > java.lang.reflect.Method.invoke(Method.java:498)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> > >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > >> > >> > > > > >>> > >>> >>
> > >> org.apache.maven.plugin.MojoExecutionException:
> > >> > >> > > > > >>> > >>> >> >> Fatal error
> > >> > >> > > > > >>> > >>> >> >> > >>> compiling
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> > >> > >> > > > > >>> > >>> >> >> > >>> ... 19 more
> > >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > >> > >> > > > > >>> > >>> >>
> > >> org.codehaus.plexus.compiler.CompilerException:
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> java.lang.NullPointerException
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> > >> > >> > > > > >>> > >>> >> >> > >>> ... 22 more
> > >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > >> > >> > > java.lang.RuntimeException:
> > >> > >> > > > > >>> > >>> >> >> java.lang.NullPointerException
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > com.sun.tools.javac.main.Main.compile(Main.java:559)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> > >> > >> > > > > >>> > >>> >> >> > >>> ... 24 more
> > >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > >> > >> > > > java.lang.NullPointerException
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >>
> > >> > >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > com.sun.tools.doclint.Checker.scan(Checker.java:144)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > >
> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>>
> > >> > >> > >
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>>
> > >> > >> > >
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>>
> > >> > >> > >
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>>
> > >> > >> > >
> > com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > >>
> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>>
> > >> > >> > >
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> > com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>>
> > >> > >> > >
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >>
> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> > >> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > com.sun.tools.javac.main.Main.compile(Main.java:523)
> > >> > >> > > > > >>> > >>> >> >> > >>> ... 27 more
> > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR]
> > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] Re-run Maven
> > using
> > >> the
> > >> > >> -X
> > >> > >> > > > switch
> > >> > >> > > > > to
> > >> > >> > > > > >>> enable
> > >> > >> > > > > >>> > >>> full
> > >> > >> > > > > >>> > >>> >> >> debug logging.
> > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR]
> > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] For more
> > >> information
> > >> > >> about
> > >> > >> > > the
> > >> > >> > > > > errors
> > >> > >> > > > > >>> and
> > >> > >> > > > > >>> > >>> >> possible
> > >> > >> > > > > >>> > >>> >> >> solutions,
> > >> > >> > > > > >>> > >>> >> >> > >>> please read the
> following
> > >> > >> articles:
> > >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] [Help 1]
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > >
> > >> > >>
> > >>
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>> Can someone help me on
> > this
> > >> > >> issue?
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>> Thanks,
> > >> > >> > > > > >>> > >>> >> >> > >>> ---------------------
> > >> > >> > > > > >>> > >>> >> >> > >>> Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at
> > >> 5:57 PM
> > >> > >> > > > > Szalay-Bekő
> > >> > >> > > > > >>> Máté <
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > szalay.beko.mate@gmail.com
> > >> >
> > >> > >> > > > > >>> > >>> >> >> > >>> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> these exceptions can
> > mean
> > >> > many
> > >> > >> > > > > things... I
> > >> > >> > > > > >>> think
> > >> > >> > > > > >>> > >>> this
> > >> > >> > > > > >>> > >>> >> can
> > >> > >> > > > > >>> > >>> >> >> be even
> > >> > >> > > > > >>> > >>> >> >> > >> normal
> > >> > >> > > > > >>> > >>> >> >> > >>>> duding rolling restart
> > (as
> > >> > some
> > >> > >> > > > > connections
> > >> > >> > > > > >>> get
> > >> > >> > > > > >>> > >>> broken
> > >> > >> > > > > >>> > >>> >> in
> > >> > >> > > > > >>> > >>> >> >> this case)
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> However, I saw cases
> > >> already
> > >> > >> when
> > >> > >> > > > > exceptions
> > >> > >> > > > > >>> like
> > >> > >> > > > > >>> > >>> these
> > >> > >> > > > > >>> > >>> >> >> killed
> > >> > >> > > > > >>> > >>> >> >> > receiver
> > >> > >> > > > > >>> > >>> >> >> > >>> or
> > >> > >> > > > > >>> > >>> >> >> > >>>> sender threads in
> > >> > >> QuorumCnxManager /
> > >> > >> > > > > Leader
> > >> > >> > > > > >>> > >>> Election in
> > >> > >> > > > > >>> > >>> >> >> such a way
> > >> > >> > > > > >>> > >>> >> >> > that
> > >> > >> > > > > >>> > >>> >> >> > >>>> they were not able to
> > >> > recover,
> > >> > >> so
> > >> > >> > > the
> > >> > >> > > > > node was
> > >> > >> > > > > >>> > >>> unable to
> > >> > >> > > > > >>> > >>> >> >> connect to
> > >> > >> > > > > >>> > >>> >> >> > any
> > >> > >> > > > > >>> > >>> >> >> > >>>> quorum until restart.
> I
> > >> > >> remember
> > >> > >> > > > seeing
> > >> > >> > > > > this
> > >> > >> > > > > >>> in
> > >> > >> > > > > >>> > 3.4
> > >> > >> > > > > >>> > >>> too.
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> Do you see these
> > >> exceptions
> > >> > in
> > >> > >> the
> > >> > >> > > > > second
> > >> > >> > > > > >>> server
> > >> > >> > > > > >>> > >>> (the
> > >> > >> > > > > >>> > >>> >> one
> > >> > >> > > > > >>> > >>> >> >> which you
> > >> > >> > > > > >>> > >>> >> >> > >> just
> > >> > >> > > > > >>> > >>> >> >> > >>>> upgraded in step 3)?
> > >> > >> > > > > >>> > >>> >> >> > >>>> Is this issue
> > >> reproducible?
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> What is the tickTime
> and
> > >> > >> initLimit
> > >> > >> > > you
> > >> > >> > > > > use?
> > >> > >> > > > > >>> Maybe
> > >> > >> > > > > >>> > >>> the
> > >> > >> > > > > >>> > >>> >> >> server just
> > >> > >> > > > > >>> > >>> >> >> > >> require
> > >> > >> > > > > >>> > >>> >> >> > >>>> more time to sync?
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> I would need more logs
> > to
> > >> > >> really see
> > >> > >> > > > > what
> > >> > >> > > > > >>> > happened.
> > >> > >> > > > > >>> > >>> Can
> > >> > >> > > > > >>> > >>> >> >> you create a
> > >> > >> > > > > >>> > >>> >> >> > >> Jira
> > >> > >> > > > > >>> > >>> >> >> > >>>> issue and upload the
> > logs
> > >> and
> > >> > >> also
> > >> > >> > > the
> > >> > >> > > > > >>> ZooKeeper
> > >> > >> > > > > >>> > >>> >> configs?
> > >> > >> > > > > >>> > >>> >> >> I am happy
> > >> > >> > > > > >>> > >>> >> >> > to
> > >> > >> > > > > >>> > >>> >> >> > >>>> take a closer look.
> > >> > >> > > > > >>> > >>> >> >> > >>>> (if you need to re-run
> > the
> > >> > >> test to
> > >> > >> > > > > collect the
> > >> > >> > > > > >>> > logs,
> > >> > >> > > > > >>> > >>> >> then
> > >> > >> > > > > >>> > >>> >> >> enabling
> > >> > >> > > > > >>> > >>> >> >> > >> DEBUG
> > >> > >> > > > > >>> > >>> >> >> > >>>> logs would be great.
> The
> > >> INFO
> > >> > >> level
> > >> > >> > > > > logs are
> > >> > >> > > > > >>> > usually
> > >> > >> > > > > >>> > >>> >> >> enough for these
> > >> > >> > > > > >>> > >>> >> >> > >>>> problems, but one can
> > >> never
> > >> > >> know...)
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> Kind regards,
> > >> > >> > > > > >>> > >>> >> >> > >>>> Mate
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at
> > >> 10:05
> > >> > AM
> > >> > >> > > > kuldeep
> > >> > >> > > > > singh
> > >> > >> > > > > >>> <
> > >> > >> > > > > >>> > >>> >> >> > >>
> kuldeep.singh08@gmail.com
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> Hi Team,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> I have done some POC
> on
> > >> > >> rolling
> > >> > >> > > > > upgrade and
> > >> > >> > > > > >>> found
> > >> > >> > > > > >>> > >>> below
> > >> > >> > > > > >>> > >>> >> >> result.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 1. On 1st node
> > upgrade
> > >> > >> zookeeper
> > >> > >> > > .
> > >> > >> > > > > Traffic
> > >> > >> > > > > >>> was
> > >> > >> > > > > >>> > >>> >> running
> > >> > >> > > > > >>> > >>> >> >> fine
> > >> > >> > > > > >>> > >>> >> >> > >> because
> > >> > >> > > > > >>> > >>> >> >> > >>> 2
> > >> > >> > > > > >>> > >>> >> >> > >>>>> nodes are already
> on
> > >> old
> > >> > >> > > zookeeper.
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 2. On 1st node
> > upgrade
> > >> our
> > >> > >> > > > > application and
> > >> > >> > > > > >>> > didn’t
> > >> > >> > > > > >>> > >>> >> find
> > >> > >> > > > > >>> > >>> >> >> any issue
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 3. On 2nd node
> > upgrade
> > >> > >> zookeeper
> > >> > >> > > > but
> > >> > >> > > > > got
> > >> > >> > > > > >>> below
> > >> > >> > > > > >>> > >>> error
> > >> > >> > > > > >>> > >>> >> >> and zookeeper
> > >> > >> > > > > >>> > >>> >> >> > >>> is
> > >> > >> > > > > >>> > >>> >> >> > >>>>> not taking any
> > requests
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 4.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30
> > 14:19:55,587 -
> > >> > WARN
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
> > >> > >> > > > > >>> -
> > >> > >> > > > > >>> > >>> >> >> Interrupting
> > >> > >> > > > > >>> > >>> >> >> > >>> SendWorker
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30
> > 14:19:55,588 -
> > >> > >> ERROR
> > >> > >> > > > > >>> [LearnerHandler-/
> > >> > >> > > > > >>> > >>> >> >> 192.168.44.73:33754
> > >> > >> > > > > >>> > >>> >> >> > >>>>> :LearnerHandler@562]
> -
> > >> > >> Unexpected
> > >> > >> > > > > exception
> > >> > >> > > > > >>> > >>> causing
> > >> > >> > > > > >>> > >>> >> >> shutdown while
> > >> > >> > > > > >>> > >>> >> >> > >>> sock
> > >> > >> > > > > >>> > >>> >> >> > >>>>> still open
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >>
> > >> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> >
> > >>
> >
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30
> > 14:19:55,588 -
> > >> > WARN
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > [SendWorker:1:QuorumCnxManager$SendWorker@679]
> > >> > >> > > > > >>> -
> > >> > >> > > > > >>> > >>> >> >> Interrupted while
> > >> > >> > > > > >>> > >>> >> >> > >>>> waiting
> > >> > >> > > > > >>> > >>> >> >> > >>>>> for message on queue
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> Please let me know is
> > >> this
> > >> > the
> > >> > >> > > known
> > >> > >> > > > > issue or
> > >> > >> > > > > >>> > this
> > >> > >> > > > > >>> > >>> is
> > >> > >> > > > > >>> > >>> >> >> different issue
> > >> > >> > > > > >>> > >>> >> >> > >>>> which
> > >> > >> > > > > >>> > >>> >> >> > >>>>> is mention in Apache
> > >> > zookeeper
> > >> > >> > > > > documentation
> > >> > >> > > > > >>> when
> > >> > >> > > > > >>> > >>> >> >> upgrading from
> > >> > >> > > > > >>> > >>> >> >> > >> 3.4.5
> > >> > >> > > > > >>> > >>> >> >> > >>> to
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 3.5.6
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> Thanks,
> > >> > >> > > > > >>> > >>> >> >> > >>>>> ---------------------
> > >> > >> > > > > >>> > >>> >> >> > >>>>> Kuldeep Singh Budania
> > >> > >> > > > > >>> > >>> >> >> > >>>>> Software Architect
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020
> at
> > >> 9:06
> > >> > >> AM
> > >> > >> > > > > Alexander
> > >> > >> > > > > >>> Shraer
> > >> > >> > > > > >>> > <
> > >> > >> > > > > >>> > >>> >> >> shralex@gmail.com>
> > >> > >> > > > > >>> > >>> >> >> > >>>>> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> +1 to what Mate said
> > (I
> > >> > >> wrote the
> > >> > >> > > > > quoted
> > >> > >> > > > > >>> > >>> >> instructions).
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020
> > at
> > >> > 7:03
> > >> > >> AM
> > >> > >> > > > > Szalay-Bekő
> > >> > >> > > > > >>> > Máté <
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> szalay.beko.mate@gmail.com
> > >> > >
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> Hi Kuldeep,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> I just want to
> > provide
> > >> you
> > >> > >> some
> > >> > >> > > > > background
> > >> > >> > > > > >>> info
> > >> > >> > > > > >>> > >>> about
> > >> > >> > > > > >>> > >>> >> >> our
> > >> > >> > > > > >>> > >>> >> >> > >>>>> documentation.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> The reason to
> upgrade
> > >> to
> > >> > >> 3.4.6
> > >> > >> > > > first
> > >> > >> > > > > is to
> > >> > >> > > > > >>> > avoid
> > >> > >> > > > > >>> > >>> the
> > >> > >> > > > > >>> > >>> >> >> following
> > >> > >> > > > > >>> > >>> >> >> > >>> error:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> 2013-01-30
> > >> 11:32:10,663
> > >> > >> > > [myid:2] -
> > >> > >> > > > > WARN
> > >> > >> > > > > >>> > >>> [localhost/
> > >> > >> > > > > >>> > >>> >> >> > >>> 127.0.0.1:2784
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> :QuorumCnxManager@349
> > ]
> > >> -
> > >> > >> Invalid
> > >> > >> > > > > server
> > >> > >> > > > > >>> id:
> > >> > >> > > > > >>> > >>> -65536
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> This error comes
> > >> because
> > >> > of
> > >> > >> the
> > >> > >> > > > > protocol
> > >> > >> > > > > >>> > changes
> > >> > >> > > > > >>> > >>> >> between
> > >> > >> > > > > >>> > >>> >> >> > >> ZooKeeper
> > >> > >> > > > > >>> > >>> >> >> > >>>>> server
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> nodes during
> > connection
> > >> > >> > > initiation
> > >> > >> > > > > for
> > >> > >> > > > > >>> leader
> > >> > >> > > > > >>> > >>> >> election.
> > >> > >> > > > > >>> > >>> >> >> In
> > >> > >> > > > > >>> > >>> >> >> > >>> ZooKeeper
> > >> > >> > > > > >>> > >>> >> >> > >>>>> 3.5
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> a
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> protocol version
> was
> > >> > >> introduced
> > >> > >> > > > (see
> > >> > >> > > > > >>> > >>> ZOOKEEPER-107)
> > >> > >> > > > > >>> > >>> >> and
> > >> > >> > > > > >>> > >>> >> >> since
> > >> > >> > > > > >>> > >>> >> >> > >> that
> > >> > >> > > > > >>> > >>> >> >> > >>>> time
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> the
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> fist long value
> sent
> > in
> > >> > the
> > >> > >> > > initial
> > >> > >> > > > > >>> message is
> > >> > >> > > > > >>> > >>> not
> > >> > >> > > > > >>> > >>> >> the
> > >> > >> > > > > >>> > >>> >> >> server ID
> > >> > >> > > > > >>> > >>> >> >> > >>> but
> > >> > >> > > > > >>> > >>> >> >> > >>>>> the
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> protocol version
> > >> (-65536).
> > >> > >> In
> > >> > >> > > > > ZooKeeper
> > >> > >> > > > > >>> 3.4.6
> > >> > >> > > > > >>> > we
> > >> > >> > > > > >>> > >>> made
> > >> > >> > > > > >>> > >>> >> >> the old 3.4
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> ZooKeepers backward
> > >> > >> compatible,
> > >> > >> > > so
> > >> > >> > > > > they are
> > >> > >> > > > > >>> > able
> > >> > >> > > > > >>> > >>> to
> > >> > >> > > > > >>> > >>> >> >> parse both
> > >> > >> > > > > >>> > >>> >> >> > >> the
> > >> > >> > > > > >>> > >>> >> >> > >>>> old
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> and
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> the new protocol
> > format
> > >> > (see
> > >> > >> > > > > >>> ZOOKEEPER-1633).
> > >> > >> > > > > >>> > >>> This
> > >> > >> > > > > >>> > >>> >> >> issue happens
> > >> > >> > > > > >>> > >>> >> >> > >>> only
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> when
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> you need to use old
> > >> > (3.4.0 -
> > >> > >> > > 3.4.5)
> > >> > >> > > > > and new
> > >> > >> > > > > >>> > >>> (3.5.0+)
> > >> > >> > > > > >>> > >>> >> >> ZooKeeper
> > >> > >> > > > > >>> > >>> >> >> > >>>> servers
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> together in the
> same
> > >> > >> cluster.
> > >> > >> > > > During
> > >> > >> > > > > a
> > >> > >> > > > > >>> rolling
> > >> > >> > > > > >>> > >>> >> upgrade,
> > >> > >> > > > > >>> > >>> >> >> this is
> > >> > >> > > > > >>> > >>> >> >> > >>>> usually
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> the
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> case to have old
> and
> > >> new
> > >> > >> > > ZooKeepers
> > >> > >> > > > > present
> > >> > >> > > > > >>> > >>> together.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> The fact that you
> > >> haven't
> > >> > >> seen
> > >> > >> > > any
> > >> > >> > > > > issues
> > >> > >> > > > > >>> might
> > >> > >> > > > > >>> > >>> be
> > >> > >> > > > > >>> > >>> >> >> caused by the
> > >> > >> > > > > >>> > >>> >> >> > >>>> order
> > >> > >> > > > > >>> > >>> >> >> > >>>>> of
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> the servers. In
> > >> ZooKeeper
> > >> > >> the
> > >> > >> > > > > connection
> > >> > >> > > > > >>> > >>> initiation
> > >> > >> > > > > >>> > >>> >> >> between the
> > >> > >> > > > > >>> > >>> >> >> > >>>> servers
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> during the leader
> > >> election
> > >> > >> > > follows
> > >> > >> > > > a
> > >> > >> > > > > >>> specific
> > >> > >> > > > > >>> > >>> rule.
> > >> > >> > > > > >>> > >>> >> As
> > >> > >> > > > > >>> > >>> >> >> far as I
> > >> > >> > > > > >>> > >>> >> >> > >>>>> remember
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> always the server
> > with
> > >> the
> > >> > >> larger
> > >> > >> > > > ID
> > >> > >> > > > > 'wins
> > >> > >> > > > > >>> the
> > >> > >> > > > > >>> > >>> >> >> challenge', so it
> > >> > >> > > > > >>> > >>> >> >> > >> is
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> possible, that the
> > old
> > >> > >> server
> > >> > >> > > > didn't
> > >> > >> > > > > need
> > >> > >> > > > > >>> to
> > >> > >> > > > > >>> > >>> parse
> > >> > >> > > > > >>> > >>> >> any
> > >> > >> > > > > >>> > >>> >> >> initial
> > >> > >> > > > > >>> > >>> >> >> > >>>> message
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> (if
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> it had the largest
> > ID)
> > >> and
> > >> > >> this
> > >> > >> > > is
> > >> > >> > > > > why you
> > >> > >> > > > > >>> > >>> haven't
> > >> > >> > > > > >>> > >>> >> seen
> > >> > >> > > > > >>> > >>> >> >> the
> > >> > >> > > > > >>> > >>> >> >> > >> issue.
> > >> > >> > > > > >>> > >>> >> >> > >>>> Also
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> having 2 nodes up
> > from
> > >> > the 3
> > >> > >> > > nodes
> > >> > >> > > > > cluster
> > >> > >> > > > > >>> > still
> > >> > >> > > > > >>> > >>> >> makes
> > >> > >> > > > > >>> > >>> >> >> the
> > >> > >> > > > > >>> > >>> >> >> > >> cluster
> > >> > >> > > > > >>> > >>> >> >> > >>>> work
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> (so
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> you should also
> check
> > >> if
> > >> > >> all the
> > >> > >> > > > > servers
> > >> > >> > > > > >>> are
> > >> > >> > > > > >>> > >>> part of
> > >> > >> > > > > >>> > >>> >> >> the quorum).
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> I agree with Enrico
> > and
> > >> > >> Norbert,
> > >> > >> > > > the
> > >> > >> > > > > >>> safest and
> > >> > >> > > > > >>> > >>> most
> > >> > >> > > > > >>> > >>> >> >> stable way
> > >> > >> > > > > >>> > >>> >> >> > >> is
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> upgrade
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> first to
> 3.4.latest,
> > >> then
> > >> > >> go to
> > >> > >> > > > > 3.5.latest.
> > >> > >> > > > > >>> > >>> Still, if
> > >> > >> > > > > >>> > >>> >> >> you don't
> > >> > >> > > > > >>> > >>> >> >> > >> see
> > >> > >> > > > > >>> > >>> >> >> > >>>>> that
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> you would hit this
> > >> > specific
> > >> > >> issue
> > >> > >> > > > > (e.g. no
> > >> > >> > > > > >>> > >>> "Invalid
> > >> > >> > > > > >>> > >>> >> >> server id" in
> > >> > >> > > > > >>> > >>> >> >> > >>> the
> > >> > >> > > > > >>> > >>> >> >> > >>>>> log
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> files), and all the
> > >> three
> > >> > >> servers
> > >> > >> > > > can
> > >> > >> > > > > >>> handle
> > >> > >> > > > > >>> > >>> traffic,
> > >> > >> > > > > >>> > >>> >> >> then maybe
> > >> > >> > > > > >>> > >>> >> >> > >>> you
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> don't
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> need to upgrade
> first
> > >> to
> > >> > >> > > > 3.4.latest,
> > >> > >> > > > > it is
> > >> > >> > > > > >>> your
> > >> > >> > > > > >>> > >>> >> >> decision.
> > >> > >> > > > > >>> > >>> >> >> > >>> Definitely
> > >> > >> > > > > >>> > >>> >> >> > >>>>> you
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> should test it
> first,
> > >> as
> > >> > >> > > suggested
> > >> > >> > > > > by the
> > >> > >> > > > > >>> > others.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> Kind regards,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> Mate
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> On Tue, Mar 24,
> 2020
> > at
> > >> > >> 12:29 PM
> > >> > >> > > > > Norbert
> > >> > >> > > > > >>> Kalmar
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> <nk...@cloudera.com.invalid>
> > >> > >> > > > > wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> Hi,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> That guide is to
> > >> upgrade
> > >> > to
> > >> > >> > > 3.5.0,
> > >> > >> > > > > which
> > >> > >> > > > > >>> was
> > >> > >> > > > > >>> > an
> > >> > >> > > > > >>> > >>> >> alpha
> > >> > >> > > > > >>> > >>> >> >> version.
> > >> > >> > > > > >>> > >>> >> >> > >> A
> > >> > >> > > > > >>> > >>> >> >> > >>>> lot
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> has
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> changed for the
> > first
> > >> > >> stable
> > >> > >> > > > > release of
> > >> > >> > > > > >>> 3.5.5
> > >> > >> > > > > >>> > >>> and
> > >> > >> > > > > >>> > >>> >> then
> > >> > >> > > > > >>> > >>> >> >> a few
> > >> > >> > > > > >>> > >>> >> >> > >>> more,
> > >> > >> > > > > >>> > >>> >> >> > >>>>> even
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> rolling upgrade
> > issues
> > >> > >> have been
> > >> > >> > > > > fixed for
> > >> > >> > > > > >>> > >>> 3.5.6.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> This is a more
> > >> up-to-date
> > >> > >> guide:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> >
> > >> > >> > > > >
> > >> > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> If you have done
> > your
> > >> > >> testing
> > >> > >> > > > (with
> > >> > >> > > > > prod
> > >> > >> > > > > >>> > >>> snapshot!),
> > >> > >> > > > > >>> > >>> >> >> then you
> > >> > >> > > > > >>> > >>> >> >> > >> can
> > >> > >> > > > > >>> > >>> >> >> > >>>>> skip
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> 3.4
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> latest upgrade,
> but
> > >> keep
> > >> > >> in mind
> > >> > >> > > > we
> > >> > >> > > > > do our
> > >> > >> > > > > >>> > >>> >> >> recommendations for
> > >> > >> > > > > >>> > >>> >> >> > >> a
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> reason.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> There were issues
> > >> > reported
> > >> > >> > > and/or
> > >> > >> > > > > found
> > >> > >> > > > > >>> during
> > >> > >> > > > > >>> > >>> >> >> testing. Some
> > >> > >> > > > > >>> > >>> >> >> > >> are
> > >> > >> > > > > >>> > >>> >> >> > >>>>> fixed
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> with
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> 3.5.6, some only
> > >> happens
> > >> > if
> > >> > >> > > > certain
> > >> > >> > > > > >>> conditions
> > >> > >> > > > > >>> > >>> stand
> > >> > >> > > > > >>> > >>> >> >> > >>> (IOException:
> > >> > >> > > > > >>> > >>> >> >> > >>>> No
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> snapshot found -
> > >> > mentioned
> > >> > >> in
> > >> > >> > > the
> > >> > >> > > > > guide,
> > >> > >> > > > > >>> fixed
> > >> > >> > > > > >>> > >>> in
> > >> > >> > > > > >>> > >>> >> >> 3.5.6).
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> So it is up to
> you,
> > I
> > >> > would
> > >> > >> > > still
> > >> > >> > > > > >>> recommend to
> > >> > >> > > > > >>> > >>> do an
> > >> > >> > > > > >>> > >>> >> >> 3.4
> > >> > >> > > > > >>> > >>> >> >> > >> upgrade
> > >> > >> > > > > >>> > >>> >> >> > >>>>> first,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> if
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> it's feasible.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> Regards,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> Norbert
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> On Tue, Mar 24,
> 2020
> > >> at
> > >> > >> 11:45 AM
> > >> > >> > > > > kuldeep
> > >> > >> > > > > >>> > singh <
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> kuldeep.singh08@gmail.com
> > >> > >
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Hi,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Current Zookeeper
> > >> > version
> > >> > >> :-
> > >> > >> > > > 3.4.5
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Upgraded version
> > >> > >> > > > :-
> > >> > >> > > > > 3.5.6
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> We are not going
> > with
> > >> > >> 3.5.7.
> > >> > >> > > Our
> > >> > >> > > > > final
> > >> > >> > > > > >>> > >>> decision is
> > >> > >> > > > > >>> > >>> >> >> zookeeper
> > >> > >> > > > > >>> > >>> >> >> > >>>>> version
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> is
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.5.6
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> as per your reply
> > >> first
> > >> > >> we need
> > >> > >> > > > to
> > >> > >> > > > > move
> > >> > >> > > > > >>> > latest
> > >> > >> > > > > >>> > >>> >> >> version of
> > >> > >> > > > > >>> > >>> >> >> > >>> 3.4.x,
> > >> > >> > > > > >>> > >>> >> >> > >>>>> like
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> below
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14
> ->
> > >> 3.5.6
> > >> > >> > > (Correct
> > >> > >> > > > > me if
> > >> > >> > > > > >>> I am
> > >> > >> > > > > >>> > >>> wrong
> > >> > >> > > > > >>> > >>> >> >> here)
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> But if We are not
> > >> facing
> > >> > >> any
> > >> > >> > > > > problem
> > >> > >> > > > > >>> that i
> > >> > >> > > > > >>> > >>> have
> > >> > >> > > > > >>> > >>> >> >> shared you
> > >> > >> > > > > >>> > >>> >> >> > >>> that
> > >> > >> > > > > >>> > >>> >> >> > >>>> we
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> have
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> set up of 3 node
> > >> cluster
> > >> > >> where
> > >> > >> > > 2
> > >> > >> > > > > node
> > >> > >> > > > > >>> are on
> > >> > >> > > > > >>> > >>> 3.5.6
> > >> > >> > > > > >>> > >>> >> >> version
> > >> > >> > > > > >>> > >>> >> >> > >> and
> > >> > >> > > > > >>> > >>> >> >> > >>> 1
> > >> > >> > > > > >>> > >>> >> >> > >>>>> node
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> on
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything
> > is
> > >> > >> running
> > >> > >> > > fine
> > >> > >> > > > > and
> > >> > >> > > > > >>> didn't
> > >> > >> > > > > >>> > >>> get
> > >> > >> > > > > >>> > >>> >> any
> > >> > >> > > > > >>> > >>> >> >> issue,
> > >> > >> > > > > >>> > >>> >> >> > >> So
> > >> > >> > > > > >>> > >>> >> >> > >>>> what
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> other
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> problem we can
> face
> > >> if
> > >> > we
> > >> > >> > > > directly
> > >> > >> > > > > move
> > >> > >> > > > > >>> to
> > >> > >> > > > > >>> > >>> 3.5.6
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Thanks,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > ---------------------
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Kuldeep Singh
> > Budania
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Software
> Architect
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24,
> > 2020
> > >> at
> > >> > >> 3:58 PM
> > >> > >> > > > > Enrico
> > >> > >> > > > > >>> > >>> Olivelli <
> > >> > >> > > > > >>> > >>> >> >> > >>>>> eolivelli@gmail.com
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> wrote:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Hi
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> You have to
> > upgrade
> > >> to
> > >> > >> latest
> > >> > >> > > > > 3.4.x
> > >> > >> > > > > >>> > Zookeeper
> > >> > >> > > > > >>> > >>> then
> > >> > >> > > > > >>> > >>> >> >> you will
> > >> > >> > > > > >>> > >>> >> >> > >>>>> upgrade
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> to
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> 3.5.7.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> All should run
> > well
> > >> > >> without
> > >> > >> > > > issues
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Enrico
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar
> > 2020,
> > >> > 10:18
> > >> > >> > > > kuldeep
> > >> > >> > > > > singh
> > >> > >> > > > > >>> <
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> kuldeep.singh08@gmail.com
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> ha
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> scritto:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Hi Team,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> We are
> upgrading
> > >> > >> zookeeper
> > >> > >> > > from
> > >> > >> > > > > 3.4.5
> > >> > >> > > > > >>> to
> > >> > >> > > > > >>> > >>> 3.5.6. I
> > >> > >> > > > > >>> > >>> >> >> have
> > >> > >> > > > > >>> > >>> >> >> > >> set
> > >> > >> > > > > >>> > >>> >> >> > >>>> up 3
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> node
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> cluster where 2
> > >> node
> > >> > >> are on
> > >> > >> > > > 3.5.6
> > >> > >> > > > > >>> version
> > >> > >> > > > > >>> > >>> and 1
> > >> > >> > > > > >>> > >>> >> >> node on
> > >> > >> > > > > >>> > >>> >> >> > >>>> 3.4.5.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Everything is
> > >> running
> > >> > >> fine
> > >> > >> > > and
> > >> > >> > > > > didn't
> > >> > >> > > > > >>> get
> > >> > >> > > > > >>> > any
> > >> > >> > > > > >>> > >>> >> issue
> > >> > >> > > > > >>> > >>> >> >> on my
> > >> > >> > > > > >>> > >>> >> >> > >>>>> system.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> but I found
> > >> something
> > >> > on
> > >> > >> > > apache
> > >> > >> > > > > site
> > >> > >> > > > > >>> that
> > >> > >> > > > > >>> > >>> first
> > >> > >> > > > > >>> > >>> >> we
> > >> > >> > > > > >>> > >>> >> >> need
> > >> > >> > > > > >>> > >>> >> >> > >> to
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> upgrade
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> on
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we
> can
> > >> > >> upgrade to
> > >> > >> > > > > 3.5.6. So
> > >> > >> > > > > >>> is
> > >> > >> > > > > >>> > it
> > >> > >> > > > > >>> > >>> >> >> mandatory
> > >> > >> > > > > >>> > >>> >> >> > >> to
> > >> > >> > > > > >>> > >>> >> >> > >>> go
> > >> > >> > > > > >>> > >>> >> >> > >>>>> on
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> 3.4.6
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> first.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> *Upgrading to
> > >> 3.5.0*
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Upgrading a
> > running
> > >> > >> ZooKeeper
> > >> > >> > > > > ensemble
> > >> > >> > > > > >>> to
> > >> > >> > > > > >>> > >>> 3.5.0
> > >> > >> > > > > >>> > >>> >> >> should be
> > >> > >> > > > > >>> > >>> >> >> > >>>> done
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> only
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> after
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> upgrading your
> > >> > ensemble
> > >> > >> to
> > >> > >> > > the
> > >> > >> > > > > 3.4.6
> > >> > >> > > > > >>> > release.
> > >> > >> > > > > >>> > >>> >> Note
> > >> > >> > > > > >>> > >>> >> >> that
> > >> > >> > > > > >>> > >>> >> >> > >>> this
> > >> > >> > > > > >>> > >>> >> >> > >>>> is
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> only
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> necessary for
> > >> rolling
> > >> > >> > > upgrades
> > >> > >> > > > > (if
> > >> > >> > > > > >>> you're
> > >> > >> > > > > >>> > >>> fine
> > >> > >> > > > > >>> > >>> >> with
> > >> > >> > > > > >>> > >>> >> >> > >>> shutting
> > >> > >> > > > > >>> > >>> >> >> > >>>>> down
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> the
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> system
> > completely,
> > >> you
> > >> > >> don't
> > >> > >> > > > > have to go
> > >> > >> > > > > >>> > >>> through
> > >> > >> > > > > >>> > >>> >> >> 3.4.6).
> > >> > >> > > > > >>> > >>> >> >> > >> If
> > >> > >> > > > > >>> > >>> >> >> > >>>> you
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> attempt
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> a
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> rolling upgrade
> > >> > without
> > >> > >> going
> > >> > >> > > > > through
> > >> > >> > > > > >>> 3.4.6
> > >> > >> > > > > >>> > >>> (for
> > >> > >> > > > > >>> > >>> >> >> example
> > >> > >> > > > > >>> > >>> >> >> > >>> from
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> 3.4.5),
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> you
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> may get the
> > >> following
> > >> > >> error:
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30
> > >> > 11:32:10,663
> > >> > >> > > > [myid:2]
> > >> > >> > > > > - INFO
> > >> > >> > > > > >>> > >>> >> [localhost/
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > :QuorumCnxManager$Listener@498
> > >> > >> > > > ]
> > >> > >> > > > > -
> > >> > >> > > > > >>> Received
> > >> > >> > > > > >>> > >>> >> >> connection
> > >> > >> > > > > >>> > >>> >> >> > >>>> request
> > >> > >> > > > > >>> > >>> >> >> > >>>>> /
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> 127.0.0.1:60876
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30
> > >> > 11:32:10,663
> > >> > >> > > > [myid:2]
> > >> > >> > > > > - WARN
> > >> > >> > > > > >>> > >>> >> [localhost/
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> :QuorumCnxManager@349
> > >> > ]
> > >> > >> -
> > >> > >> > > > Invalid
> > >> > >> > > > > >>> server
> > >> > >> > > > > >>> > id:
> > >> > >> > > > > >>> > >>> >> -65536
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> During a
> rolling
> > >> > >> upgrade,
> > >> > >> > > each
> > >> > >> > > > > server
> > >> > >> > > > > >>> is
> > >> > >> > > > > >>> > >>> taken
> > >> > >> > > > > >>> > >>> >> down
> > >> > >> > > > > >>> > >>> >> >> in
> > >> > >> > > > > >>> > >>> >> >> > >> turn
> > >> > >> > > > > >>> > >>> >> >> > >>>> and
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> rebooted
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> with the new
> > 3.5.0
> > >> > >> binaries.
> > >> > >> > > > > Before
> > >> > >> > > > > >>> > starting
> > >> > >> > > > > >>> > >>> the
> > >> > >> > > > > >>> > >>> >> >> server
> > >> > >> > > > > >>> > >>> >> >> > >>> with
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> 3.5.0
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> binaries, we
> > highly
> > >> > >> recommend
> > >> > >> > > > > updating
> > >> > >> > > > > >>> the
> > >> > >> > > > > >>> > >>> >> >> configuration
> > >> > >> > > > > >>> > >>> >> >> > >>> file
> > >> > >> > > > > >>> > >>> >> >> > >>>>> so
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>> that
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> all
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> server
> statements
> > >> > >> > > > "server.x=..."
> > >> > >> > > > > >>> contain
> > >> > >> > > > > >>> > >>> client
> > >> > >> > > > > >>> > >>> >> >> ports
> > >> > >> > > > > >>> > >>> >> >> > >> (see
> > >> > >> > > > > >>> > >>> >> >> > >>>> the
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> section
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Specifying
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> the client
> port).
> > >> As
> > >> > >> > > explained
> > >> > >> > > > > earlier
> > >> > >> > > > > >>> you
> > >> > >> > > > > >>> > >>> may
> > >> > >> > > > > >>> > >>> >> >> leave the
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>> configuration
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> in a
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> single file, as
> > >> well
> > >> > as
> > >> > >> leave
> > >> > >> > > > the
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> clientPort/clientPortAddress
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> (although if
> you
> > >> > specify
> > >> > >> > > client
> > >> > >> > > > > ports
> > >> > >> > > > > >>> in
> > >> > >> > > > > >>> > the
> > >> > >> > > > > >>> > >>> new
> > >> > >> > > > > >>> > >>> >> >> format,
> > >> > >> > > > > >>> > >>> >> >> > >>>> these
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> are now
> > redundant).
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Could you
> please
> > >> let
> > >> > me
> > >> > >> know
> > >> > >> > > > > about this
> > >> > >> > > > > >>> > case.
> > >> > >> > > > > >>> > >>> >> >> Appreciate
> > >> > >> > > > > >>> > >>> >> >> > >> if
> > >> > >> > > > > >>> > >>> >> >> > >>>>>> respond
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> soon.
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Thanks,
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> ---------------------
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh
> > >> Budania
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > >> > > > > >>> > >>> >> >> > >>>
> > >> > >> > > > > >>> > >>> >> >> > >>
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >> >
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> ________________________________
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > >> > >> > > > > >>> > >>> >> >> This e-mail (including any
> > >> attachments)
> > >> > is
> > >> > >> > > > strictly
> > >> > >> > > > > >>> > >>> confidential
> > >> > >> > > > > >>> > >>> >> and
> > >> > >> > > > > >>> > >>> >> >> may also contain privileged
> > information.
> > >> If
> > >> > >> you are
> > >> > >> > > > > not the
> > >> > >> > > > > >>> > >>> intended
> > >> > >> > > > > >>> > >>> >> >> recipient you are not authorised to
> > read,
> > >> > >> print,
> > >> > >> > > > save,
> > >> > >> > > > > >>> process or
> > >> > >> > > > > >>> > >>> >> disclose
> > >> > >> > > > > >>> > >>> >> >> this message. If you have received
> this
> > >> > >> message by
> > >> > >> > > > > mistake,
> > >> > >> > > > > >>> > please
> > >> > >> > > > > >>> > >>> >> inform
> > >> > >> > > > > >>> > >>> >> >> the sender immediately and destroy
> this
> > >> > >> e-mail, its
> > >> > >> > > > > >>> attachments
> > >> > >> > > > > >>> > >>> and any
> > >> > >> > > > > >>> > >>> >> >> copies. Any use, distribution,
> > >> reproduction
> > >> > or
> > >> > >> > > > > disclosure by
> > >> > >> > > > > >>> any
> > >> > >> > > > > >>> > >>> person
> > >> > >> > > > > >>> > >>> >> >> other than the intended recipient is
> > >> > strictly
> > >> > >> > > > > prohibited and
> > >> > >> > > > > >>> the
> > >> > >> > > > > >>> > >>> person
> > >> > >> > > > > >>> > >>> >> >> responsible may incur in penalties.
> > >> > >> > > > > >>> > >>> >> >> The use of this e-mail is only
> for
> > >> > >> professional
> > >> > >> > > > > purposes;
> > >> > >> > > > > >>> > >>> there is
> > >> > >> > > > > >>> > >>> >> no
> > >> > >> > > > > >>> > >>> >> >> guarantee that the correspondence
> > towards
> > >> > this
> > >> > >> > > e-mail
> > >> > >> > > > > will be
> > >> > >> > > > > >>> > read
> > >> > >> > > > > >>> > >>> >> only by
> > >> > >> > > > > >>> > >>> >> >> the recipient, because, under certain
> > >> > >> > > circumstances,
> > >> > >> > > > > there
> > >> > >> > > > > >>> may
> > >> > >> > > > > >>> > be a
> > >> > >> > > > > >>> > >>> >> need to
> > >> > >> > > > > >>> > >>> >> >> access this email by third subjects
> > >> > belonging
> > >> > >> to
> > >> > >> > > the
> > >> > >> > > > > Company.
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> ________________________________
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > >> > >> > > > > >>> > >>> >> >> This e-mail (including any
> attachments)
> > >> is
> > >> > >> strictly
> > >> > >> > > > > >>> confidential
> > >> > >> > > > > >>> > >>> and
> > >> > >> > > > > >>> > >>> >> may
> > >> > >> > > > > >>> > >>> >> >> also contain privileged information.
> If
> > >> you
> > >> > >> are not
> > >> > >> > > > the
> > >> > >> > > > > >>> intended
> > >> > >> > > > > >>> > >>> >> recipient
> > >> > >> > > > > >>> > >>> >> >> you are not authorised to read,
> print,
> > >> save,
> > >> > >> > > process
> > >> > >> > > > or
> > >> > >> > > > > >>> disclose
> > >> > >> > > > > >>> > >>> this
> > >> > >> > > > > >>> > >>> >> >> message. If you have received this
> > >> message
> > >> > by
> > >> > >> > > > mistake,
> > >> > >> > > > > please
> > >> > >> > > > > >>> > >>> inform
> > >> > >> > > > > >>> > >>> >> the
> > >> > >> > > > > >>> > >>> >> >> sender immediately and destroy this
> > >> e-mail,
> > >> > >> its
> > >> > >> > > > > attachments
> > >> > >> > > > > >>> and
> > >> > >> > > > > >>> > any
> > >> > >> > > > > >>> > >>> >> copies.
> > >> > >> > > > > >>> > >>> >> >> Any use, distribution, reproduction
> or
> > >> > >> disclosure
> > >> > >> > > by
> > >> > >> > > > > any
> > >> > >> > > > > >>> person
> > >> > >> > > > > >>> > >>> other
> > >> > >> > > > > >>> > >>> >> than
> > >> > >> > > > > >>> > >>> >> >> the intended recipient is strictly
> > >> > prohibited
> > >> > >> and
> > >> > >> > > the
> > >> > >> > > > > person
> > >> > >> > > > > >>> > >>> >> responsible
> > >> > >> > > > > >>> > >>> >> >> may incur in penalties.
> > >> > >> > > > > >>> > >>> >> >> The use of this e-mail is only for
> > >> > >> professional
> > >> > >> > > > > purposes;
> > >> > >> > > > > >>> there
> > >> > >> > > > > >>> > is
> > >> > >> > > > > >>> > >>> no
> > >> > >> > > > > >>> > >>> >> >> guarantee that the correspondence
> > towards
> > >> > this
> > >> > >> > > e-mail
> > >> > >> > > > > will be
> > >> > >> > > > > >>> > read
> > >> > >> > > > > >>> > >>> >> only by
> > >> > >> > > > > >>> > >>> >> >> the recipient, because, under certain
> > >> > >> > > circumstances,
> > >> > >> > > > > there
> > >> > >> > > > > >>> may
> > >> > >> > > > > >>> > be a
> > >> > >> > > > > >>> > >>> >> need to
> > >> > >> > > > > >>> > >>> >> >> access this email by third subjects
> > >> > belonging
> > >> > >> to
> > >> > >> > > the
> > >> > >> > > > > Company.
> > >> > >> > > > > >>> > >>> >> >>
> > >> > >> > > > > >>> > >>> >> >
> > >> > >> > > > > >>> > >>> >>
> > >> > >> > > > > >>> > >>> >
> > >> > >> > > > > >>> > >>>
> > >> > >> > > > > >>> > >>
> > >> > >> > > > > >>> >
> > >> > >> > > > > >>>
> > >> > >> > > > > >>
> > >> > >> > > > >
> > >> > >> > > > >
> > >> > >> > > > > ________________________________
> > >> > >> > > > >
> > >> > >> > > > > CONFIDENTIALITY & PRIVACY NOTICE
> > >> > >> > > > > This e-mail (including any attachments) is strictly
> > >> confidential
> > >> > >> and
> > >> > >> > > may
> > >> > >> > > > > also contain privileged information. If you are not the
> > >> intended
> > >> > >> > > > recipient
> > >> > >> > > > > you are not authorised to read, print, save, process or
> > >> disclose
> > >> > >> this
> > >> > >> > > > > message. If you have received this message by mistake,
> > please
> > >> > >> inform
> > >> > >> > > the
> > >> > >> > > > > sender immediately and destroy this e-mail, its
> attachments
> > >> and
> > >> > >> any
> > >> > >> > > > copies.
> > >> > >> > > > > Any use, distribution, reproduction or disclosure by any
> > >> person
> > >> > >> other
> > >> > >> > > > than
> > >> > >> > > > > the intended recipient is strictly prohibited and the
> > person
> > >> > >> > > responsible
> > >> > >> > > > > may incur in penalties.
> > >> > >> > > > > The use of this e-mail is only for professional purposes;
> > >> there
> > >> > >> is no
> > >> > >> > > > > guarantee that the correspondence towards this e-mail
> will
> > be
> > >> > >> read only
> > >> > >> > > > by
> > >> > >> > > > > the recipient, because, under certain circumstances,
> there
> > >> may
> > >> > be
> > >> > >> a
> > >> > >> > > need
> > >> > >> > > > to
> > >> > >> > > > > access this email by third subjects belonging to the
> > Company.
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >>
> > >> > >>
> > >> >
> > >>
> > >
> >
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by Szalay-Bekő Máté <sz...@gmail.com>.
the config looks OK in general...
- are you sure the same configs are used on all ZK servers?
- does the truststores accept all keys on the keystores? (if the
truststores of the old servers had to be modified, then did you restart the
old servers with the updated truststores?)
- did the 3 node ZK cluster work with SSL? (were you able to connect to it
with the client using SSL?)
also: do you really need client authentication with SSL? (I see you are
using SASL too)
If you only need SSL for wire encryption, then you can try
with ssl.clientAuth=none (see the admin guide). Although that feature was
broken on 3.5.6, got fixed on 3.5.7 according to the doc.
best regards,
Mate
On Wed, Oct 14, 2020 at 1:10 PM kuldeep singh <ku...@gmail.com>
wrote:
> Sorry,
> secureClientPort=2182
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Wed, Oct 14, 2020 at 4:18 PM kuldeep singh <ku...@gmail.com>
> wrote:
>
> > Thanks for reply
> >
> > zoo.cfg
> > -----------
> > secureClientPort=2181
> > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > initLimit=10
> > syncLimit=5
> > dataDir= data directory (not mentioning exact path here)
> > tickTime=2000
> > autopurge.snapRetainCount=3
> > autopurge.purgeInterval=1
> > admin.enableServer=false
> > standaloneEnabled=false
> > jute.maxbuffer=2147483648
> > server.1=host1_priv:10288:10388
> > server.2=host2_priv:10288:10388
> > server.3=host3_priv:10288:10388
> > server.4=host4_priv:10288:10388
> > server.5=host5_priv:10288:10388
> > quorum.auth.enableSasl=true
> > quorum.auth.learnerRequireSasl=true
> > quorum.auth.serverRequireSasl=true
> > quorum.auth.learner.loginContext=QuorumLearner
> > quorum.auth.server.loginContext=QuorumServer
> > quorum.cnxn.threads.size=10
> > -------------------------------------------------------------
> > java.env
> >
> > export
> >
> SERVER_JVMFLAGS="-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > -Dzookeeper.ssl.keyStore.location=keystore.jks
> > -Dzookeeper.ssl.keyStore.password=<passwword>
> > -Dzookeeper.ssl.trustStore.location= keystore.jks
> > -Dzookeeper.ssl.trustStore.password= <passwword>
> > -Djava.security.auth.login.config=zookeeper-jaas.conf"
> >
> > export
> >
> CLIENT_JVMFLAGS="-Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > -Dzookeeper.client.secure=true -Dzookeeper.ssl.keyStore.location=
> > keystore.jks -Dzookeeper.ssl.keyStore.password= <passwword>
> > -Dzookeeper.ssl.trustStore.location=keystore.jks
> > -Dzookeeper.ssl.trustStore.password= <passwword>
> > -Dzookeeper.ssl.hostnameVerification=false"
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> >
> >
> >
> > On Wed, Oct 14, 2020 at 4:12 PM Szalay-Bekő Máté <
> > szalay.beko.mate@gmail.com> wrote:
> >
> >> These log messages indicate that a client (or an other ZooKeeper server)
> >> is
> >> trying to connect without SSL to a ZooKeeper process that expects SSL.
> >> I assume this will be a configuration issue then.
> >>
> >> Best regards,
> >> Mate
> >>
> >> On Wed, Oct 14, 2020 at 12:30 PM kuldeep singh <
> kuldeep.singh08@gmail.com
> >> >
> >> wrote:
> >>
> >> > Hi,
> >> >
> >> > more logs
> >> >
> >> > 2020-10-14 12:25:05,106 - ERROR
> >> >
> >> >
> >>
> [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler$CertificateVerifier@257
> >> > ]
> >> > - Unsuccessful handshake with session 0x0
> >> >
> >> > 2020-10-14 12:25:05,107 - WARN
> >> > [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler@138]
> -
> >> > Exception caught
> >> >
> >> > io.netty.handler.codec.DecoderException:
> >> > io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record:
> >> > 737276720a
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:475)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:283)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
> >> >
> >> > at
> >> >
> >>
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
> >> >
> >> > at
> io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
> >> >
> >> > at
> >> >
> >>
> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> >> >
> >> > at java.lang.Thread.run(Thread.java:748)
> >> >
> >> > Caused by: io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS
> >> > record: 737276720a
> >> >
> >> > at
> >> >
> >>
> io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1203)
> >> >
> >> > at
> io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1271)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:505)
> >> >
> >> > at
> >> >
> >> >
> >>
> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:444)
> >> >
> >> > ... 17 more
> >> >
> >> > Thanks,
> >> > ---------------------
> >> > Kuldeep Singh Budania
> >> > Software Architect
> >> >
> >> >
> >> >
> >> > On Wed, Oct 14, 2020 at 3:51 PM kuldeep singh <
> >> kuldeep.singh08@gmail.com>
> >> > wrote:
> >> >
> >> > > Hi,
> >> > >
> >> > >
> >> > > below error is coming on zookeeper logs on SSL.
> >> > >
> >> > > 2020-10-14 12:18:27,410 - WARN
> >> > [nioEventLoopGroup-4-16:NettyServerCnxn@540]
> >> > > - Closing connection to /127.0.0.1:49470
> >> > > java.io.IOException: Len error 369296128
> >> > > at
> >> > >
> >> >
> >>
> org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:533)
> >> > > at
> >> > >
> >> >
> >>
> org.apache.zookeeper.server.NettyServerCnxn.processMessage(NettyServerCnxn.java:360)
> >> > > at
> >> > >
> >> >
> >>
> org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.channelRead(NettyServerCnxnFactory.java:184)
> >> > > at
> >> > >
> >> >
> >>
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> >> > > at
> >> > >
> >> >
> >>
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> >> > > at
> >> > >
> >> >
> >>
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
> >> > > at
> >> > >
> >> >
> >>
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
> >> > > at
> >> > >
> >> >
> >>
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> >> > > at
> >> > >
> >> >
> >>
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> >> > > at
> >> > >
> >> >
> >>
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
> >> > > at
> >> > >
> >> >
> >>
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
> >> > > at
> >> > >
> >> >
> >>
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
> >> > > at
> >> > >
> >> >
> >>
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
> >> > > at
> >> > >
> >> >
> >>
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
> >> > > at
> >> io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
> >> > > at
> >> > >
> >> >
> >>
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
> >> > > at
> >> > >
> >>
> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> >> > > at
> >> > >
> >> >
> >>
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> >> > > at java.lang.Thread.run(Thread.java:748)
> >> > >
> >> > > Thanks,
> >> > > ---------------------
> >> > > Kuldeep Singh Budania
> >> > >
> >> > >
> >> > >
> >> > > On Thu, Oct 8, 2020 at 6:33 PM Szalay-Bekő Máté <
> >> > > szalay.beko.mate@gmail.com> wrote:
> >> > >
> >> > >> Sounds like a bug or a configuration issue...
> >> > >> can you share the configs (before and after the scale-up) and the
> >> logs?
> >> > >> also: does the truststores recognise all the keys used on all the 5
> >> > >> nodes? (e.g. the truststores on the old nodes accept the new keys?)
> >> > >>
> >> > >> Best Regards,
> >> > >> Mate
> >> > >>
> >> > >> On Thu, Oct 8, 2020 at 2:31 PM kuldeep singh <
> >> kuldeep.singh08@gmail.com
> >> > >
> >> > >> wrote:
> >> > >> >
> >> > >> > Hi,
> >> > >> >
> >> > >> > Yes, My client and server both are using certificate and have
> >> added in
> >> > >> ZK
> >> > >> > and client as well.
> >> > >> >
> >> > >> > Thanks,
> >> > >> > ---------------------
> >> > >> > Kuldeep Singh Budania
> >> > >> >
> >> > >> >
> >> > >> >
> >> > >> > On Thu, Oct 8, 2020 at 5:56 PM Enrico Olivelli <
> >> eolivelli@gmail.com>
> >> > >> wrote:
> >> > >> >
> >> > >> > > Il giorno gio 8 ott 2020 alle ore 14:17 kuldeep singh <
> >> > >> > > kuldeep.singh08@gmail.com> ha scritto:
> >> > >> > >
> >> > >> > > > Hi Team,
> >> > >> > > >
> >> > >> > > > I am facing one issue in SSL communication between client and
> >> > >> zookeeper
> >> > >> > > > server.
> >> > >> > > >
> >> > >> > > > ZK 3.5.6 version
> >> > >> > > >
> >> > >> > > > 1. Mi on 3 node
> >> > >> > > > 2. Applying SSL and 3 nodes cluster is working fine
> >> > >> > > > 3. Scaled my cluster with 2 nodes and now my cluster have 5
> >> nodes
> >> > >> over
> >> > >> > > SSL
> >> > >> > > >
> >> > >> > > > but after scaling my SSL is not working between client and ZK
> >> > >> server and
> >> > >> > > > even not able to login using zkCli as well.
> >> > >> > > >
> >> > >> > > > Can someone provide the details please why it is happening?
> >> > >> > > >
> >> > >> > >
> >> > >> > > Is your client configured to use SSL ?
> >> > >> > >
> >> > >> > > Enrico
> >> > >> > >
> >> > >> > >
> >> > >> > >
> >> > >> > > >
> >> > >> > > > Thanks,
> >> > >> > > > ---------------------
> >> > >> > > > Kuldeep Singh Budania
> >> > >> > > > Software Architect
> >> > >> > > >
> >> > >> > > >
> >> > >> > > >
> >> > >> > > > On Mon, Jul 13, 2020 at 2:19 PM Enrico Olivelli - Diennea
> >> > >> > > > <en...@diennea.com.invalid> wrote:
> >> > >> > > >
> >> > >> > > > > It looks like we ported it to 3.5.
> >> > >> > > > >
> >> > >> > > > > See the subtask
> >> > >> > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2792
> >> > >> > > > >
> >> > >> > > > > Enrico
> >> > >> > > > >
> >> > >> > > > > Il giorno 13/07/20, 10:37 "kuldeep singh" <
> >> > >> kuldeep.singh08@gmail.com>
> >> > >> > > > ha
> >> > >> > > > > scritto:
> >> > >> > > > >
> >> > >> > > > > Hi Team,
> >> > >> > > > >
> >> > >> > > > > I appreciate it if I will get a response as soon as
> >> > possible,
> >> > >> as I
> >> > >> > > am
> >> > >> > > > > stuck
> >> > >> > > > > at this point.
> >> > >> > > > >
> >> > >> > > > > Thanks,
> >> > >> > > > > ---------------------
> >> > >> > > > > Kuldeep Singh Budania
> >> > >> > > > >
> >> > >> > > > >
> >> > >> > > > >
> >> > >> > > > > On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <
> >> > >> > > > > kuldeep.singh08@gmail.com>
> >> > >> > > > > wrote:
> >> > >> > > > >
> >> > >> > > > > > Hi Team,
> >> > >> > > > > >
> >> > >> > > > > > Server to Server communication is not supported in
> >> 3.5.6
> >> > >> version
> >> > >> > > > as
> >> > >> > > > > per
> >> > >> > > > > > below JIRA issue?
> >> > >> > > > > >
> >> > >> > > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2639
> >> > >> > > > > >
> >> > >> > > > > > Thanks,
> >> > >> > > > > > ---------------------
> >> > >> > > > > > Kuldeep Singh Budania
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > > > On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <
> >> > >> > > > > kuldeep.singh08@gmail.com>
> >> > >> > > > > > wrote:
> >> > >> > > > > >
> >> > >> > > > > >> Thanks for the reply.
> >> > >> > > > > >>
> >> > >> > > > > >> Now my ZKCli cmd is working fine as we use some our
> >> > >> customized
> >> > >> > > > > >> authentication and we resolve the issue.
> >> > >> > > > > >>
> >> > >> > > > > >> Now I am going to implement Server to Server
> >> > communication.
> >> > >> > > > > >>
> >> > >> > > > > >> Thanks,
> >> > >> > > > > >> ---------------------
> >> > >> > > > > >> Kuldeep Singh Budania
> >> > >> > > > > >>
> >> > >> > > > > >>
> >> > >> > > > > >>
> >> > >> > > > > >> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
> >> > >> > > > > >> szalay.beko.mate@gmail.com> wrote:
> >> > >> > > > > >>
> >> > >> > > > > >>> I think SSL is working for you already... If you
> >> managed
> >> > >> to
> >> > >> > > start
> >> > >> > > > > the
> >> > >> > > > > >>> zkCli.sh and be able to connect to ZooKeeper on the
> >> > >> secure port
> >> > >> > > > > and issue
> >> > >> > > > > >>> any kind of command (like: " ls / "), then the wire
> >> > >> encryption
> >> > >> > > is
> >> > >> > > > > working
> >> > >> > > > > >>> and your server/client communication is secured by
> >> > >> ZooKeeper.
> >> > >> > > > > >>>
> >> > >> > > > > >>> Why you want to run the following command?
> >> > >> > > > > >>> addauth ztpasswd zooadmin:<password>
> >> > >> > > > > >>>
> >> > >> > > > > >>> Do you also want to configure a superDigest user in
> >> > >> ZooKeeper?
> >> > >> > > > > Please
> >> > >> > > > > >>> note
> >> > >> > > > > >>> that this command is independent from SSL. If you
> >> need
> >> > to
> >> > >> > > create
> >> > >> > > > a
> >> > >> > > > > >>> username-password pair for digest authentication
> then
> >> > >> please
> >> > >> > > use
> >> > >> > > > > the
> >> > >> > > > > >>> command in the following way:
> >> > >> > > > > >>> addauth digest zooadmin:yourSuperSecretPassword
> >> > >> > > > > >>>
> >> > >> > > > > >>> Kind regards,
> >> > >> > > > > >>> Mate
> >> > >> > > > > >>>
> >> > >> > > > > >>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <
> >> > >> > > > > kuldeep.singh08@gmail.com>
> >> > >> > > > > >>> wrote:
> >> > >> > > > > >>>
> >> > >> > > > > >>> > 1. sh zkCli.sh --config /etc/zookeeper -server
> >> > >> localhost:2281
> >> > >> > > > > >>> >
> >> > >> > > > > >>> > 2. addauth ztpasswd zooadmin:<password>
> >> > >> > > > > >>> >
> >> > >> > > > > >>> >
> >> > >> > > > > >>> > Thanks,
> >> > >> > > > > >>> > ---------------------
> >> > >> > > > > >>> > Kuldeep Singh Budania
> >> > >> > > > > >>> >
> >> > >> > > > > >>> >
> >> > >> > > > > >>> >
> >> > >> > > > > >>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
> >> > >> > > > > >>> kuldeep.singh08@gmail.com>
> >> > >> > > > > >>> > wrote:
> >> > >> > > > > >>> >
> >> > >> > > > > >>> > > Hi Team,
> >> > >> > > > > >>> > >
> >> > >> > > > > >>> > > Any update on this?
> >> > >> > > > > >>> > >
> >> > >> > > > > >>> > > Thanks,
> >> > >> > > > > >>> > > ---------------------
> >> > >> > > > > >>> > > Kuldeep Singh Budania
> >> > >> > > > > >>> > >
> >> > >> > > > > >>> > >
> >> > >> > > > > >>> > >
> >> > >> > > > > >>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
> >> > >> > > > > >>> kuldeep.singh08@gmail.com>
> >> > >> > > > > >>> > > wrote:
> >> > >> > > > > >>> > >
> >> > >> > > > > >>> > >> Sorry this is my bad, there were server
> setting
> >> > like
> >> > >> below
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >> export SERVER_JVMFLAGS="
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >> > >> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >> > >> > > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >> export CLIENT_JVMFLAGS="
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> >> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >> > >> > > > > >>> > >> -Dzookeeper.client.secure=true
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >> > >> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >> > >> > > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >> I want to have SSL between client to server
> >> > >> communication
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >> I am already following the same link which you
> >> have
> >> > >> shared
> >> > >> > > > > with me
> >> > >> > > > > >>> but
> >> > >> > > > > >>> > >> that is not working.
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >> Zoo.cfg
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >> secureClientPort=2281
> >> > >> > > > > >>> > >> initLimit=10
> >> > >> > > > > >>> > >> syncLimit=5
> >> > >> > > > > >>> > >> dataDir=/var/lib/zookeeper/data
> >> > >> > > > > >>> > >> tickTime=2000
> >> > >> > > > > >>> > >> autopurge.snapRetainCount=3
> >> > >> > > > > >>> > >> autopurge.purgeInterval=1
> >> > >> > > > > >>> > >> admin.enableServer=false
> >> > >> > > > > >>> > >> standaloneEnabled=false
> >> > >> > > > > >>> > >> jute.maxbuffer=2147483648
> >> > >> > > > > >>> > >>
> >> > >> > > > >
> >> > >>
> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >> > >> > > > > >>> > >> server.1=host1_priv:10288:10388
> >> > >> > > > > >>> > >> server.2=host2_priv:10288:10388
> >> > >> > > > > >>> > >> server.3=host3_priv:10288:10388
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >> command to connect using zkcli
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >> 1. zkcli zoo.cfg localhost:2281
> >> > >> > > > > >>> > >> 2. addauth ztpasswd usernaem:password
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >> after second step we are getting below error
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >> WatchedEvent state:AuthFailed type:None
> >> path:null
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 -
> >> WARN
> >> > >> > > > > >>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
> -
> >> No
> >> > >> > > > > authentication
> >> > >> > > > > >>> > provider
> >> > >> > > > > >>> > >> for scheme: ztpasswd has x509 ip digest*
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >> Thanks,
> >> > >> > > > > >>> > >> ---------------------
> >> > >> > > > > >>> > >> Kuldeep Singh Budania
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő
> Máté
> >> <
> >> > >> > > > > >>> > >> szalay.beko.mate@gmail.com> wrote:
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> > >>> > No authentication provider for scheme:
> >> ztpasswd
> >> > >> has
> >> > >> > > x509
> >> > >> > > > > ip
> >> > >> > > > > >>> digest*
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> > >>> This suggest you have some configuration
> >> error...
> >> > >> Where
> >> > >> > > did
> >> > >> > > > > you
> >> > >> > > > > >>> use the
> >> > >> > > > > >>> > >>> "ztpasswd" string in your configs / commands?
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő
> >> Máté <
> >> > >> > > > > >>> > >>> szalay.beko.mate@gmail.com>
> >> > >> > > > > >>> > >>> wrote:
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> > >>> > > My ZK server is up and running in secure
> >> mode
> >> > >> > > > > >>> > >>> >
> >> > >> > > > > >>> > >>> > What is your goal? You want to setup
> >> > >> client-server SSL
> >> > >> > > > > >>> connection?
> >> > >> > > > > >>> > >>> >
> >> > >> > > > > >>> > >>> > see:
> >> > >> > > > > >>> > >>> >
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
> >> > >> > > > > >>> > >>> >
> >> > >> > > > > >>> > >>> > (or you want to have both SSL and SASL
> >> enabled?)
> >> > >> > > > > >>> > >>> >
> >> > >> > > > > >>> > >>> > Anyway, please remove the following line
> from
> >> > the
> >> > >> > > > > >>> SERVER_JVMFLAGS:
> >> > >> > > > > >>> > >>> >
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > >>
> >> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >> > >> > > > > >>> > >>> > This is a configuration that makes sense
> only
> >> > for
> >> > >> the
> >> > >> > > > > ZooKeeper
> >> > >> > > > > >>> > client,
> >> > >> > > > > >>> > >>> > not for the server. For the server, use the
> >> > >> following:
> >> > >> > > > > >>> > >>> >
> >> > >> > > > > >>> > >>> >
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >> > >> > > > > >>> > >>> >
> >> > >> > > > > >>> > >>> > If it doesn't solve the issue, then can you
> >> > >> please send
> >> > >> > > > > your
> >> > >> > > > > >>> zoo.cfg
> >> > >> > > > > >>> > >>> file?
> >> > >> > > > > >>> > >>> > Also can you please send the zkCli command
> >> you
> >> > >> execute?
> >> > >> > > > > (you
> >> > >> > > > > >>> need to
> >> > >> > > > > >>> > >>> > connect to the secure ZooKeeper port,
> unless
> >> > >> > > > > portUnification is
> >> > >> > > > > >>> > >>> enabled)
> >> > >> > > > > >>> > >>> >
> >> > >> > > > > >>> > >>> > Kind regards,
> >> > >> > > > > >>> > >>> > Mate
> >> > >> > > > > >>> > >>> >
> >> > >> > > > > >>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep
> singh
> >> <
> >> > >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> >> > >> > > > > >>> > >>> > wrote:
> >> > >> > > > > >>> > >>> >
> >> > >> > > > > >>> > >>> >> Hi,
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >> we have done below changes in java.env
> file
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >> export SERVER_JVMFLAGS="
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> >> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > >>
> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >> > >> > > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >> > >> > > > > >>> > >>> >>
> >> -Dzookeeper.ssl.trustStore.password=testpass"
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >> export CLIENT_JVMFLAGS="
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> >> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >> > >> > > > > >>> > >>> >> -Dzookeeper.client.secure=true
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > >>
> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >> > >> > > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >> > >> > > > > >>> > >>> >>
> >> -Dzookeeper.ssl.trustStore.password=testpass"
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >> I have started the ZK server and it is up
> >> > >> without any
> >> > >> > > > > issue.
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >> But now when I login to ZkCli then it
> gives
> >> the
> >> > >> below
> >> > >> > > > > error.
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >> WatchedEvent state:AuthFailed type:None
> >> > path:null
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >> Zookeeper logs :- *2020-07-01
> 07:38:09,342 -
> >> > WARN
> >> > >> > > > > >>> > >>> >>
> [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
> >> -
> >> > >> No
> >> > >> > > > > >>> authentication
> >> > >> > > > > >>> > >>> provider
> >> > >> > > > > >>> > >>> >> for scheme: ztpasswd has x509 ip digest*
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >> Please help me on this issue
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >> Thanks,
> >> > >> > > > > >>> > >>> >> ---------------------
> >> > >> > > > > >>> > >>> >> Kuldeep Singh Budania
> >> > >> > > > > >>> > >>> >> Software Architect
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep
> >> singh <
> >> > >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> >> > >> > > > > >>> > >>> >> wrote:
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >> > Hi,
> >> > >> > > > > >>> > >>> >> >
> >> > >> > > > > >>> > >>> >> > My ZK server is up and running in
> secure
> >> > >> mode, But
> >> > >> > > > > When I am
> >> > >> > > > > >>> > >>> trying to
> >> > >> > > > > >>> > >>> >> > connect to the ZK server using ZKCli, it
> >> > gives
> >> > >> the
> >> > >> > > > below
> >> > >> > > > > >>> error.
> >> > >> > > > > >>> > >>> >> >
> >> > >> > > > > >>> > >>> >> > WatchedEvent state:AuthFailed type:None
> >> > >> path:null
> >> > >> > > > > >>> > >>> >> >
> >> > >> > > > > >>> > >>> >> >
> >> > >> > > > > >>> > >>> >> > Zookeeper logs :- *2020-07-01
> >> 07:38:09,342 -
> >> > >> WARN
> >> > >> > > > > >>> > >>> >> >
> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
> >> > >> - No
> >> > >> > > > > >>> authentication
> >> > >> > > > > >>> > >>> >> provider
> >> > >> > > > > >>> > >>> >> > for scheme: ztpasswd has x509 ip digest*
> >> > >> > > > > >>> > >>> >> >
> >> > >> > > > > >>> > >>> >> > Can someone please help me on this
> issue.
> >> we
> >> > >> are
> >> > >> > > using
> >> > >> > > > > the
> >> > >> > > > > >>> 3.5.6
> >> > >> > > > > >>> > >>> >> version.
> >> > >> > > > > >>> > >>> >> >
> >> > >> > > > > >>> > >>> >> > I appreciate if I will get a response as
> >> soon
> >> > >> as
> >> > >> > > > > possible, as
> >> > >> > > > > >>> I am
> >> > >> > > > > >>> > >>> stuck
> >> > >> > > > > >>> > >>> >> > at this point.
> >> > >> > > > > >>> > >>> >> >
> >> > >> > > > > >>> > >>> >> > Thanks,
> >> > >> > > > > >>> > >>> >> > ---------------------
> >> > >> > > > > >>> > >>> >> > Kuldeep Singh Budania
> >> > >> > > > > >>> > >>> >> > Software Architect
> >> > >> > > > > >>> > >>> >> >
> >> > >> > > > > >>> > >>> >> >
> >> > >> > > > > >>> > >>> >> >
> >> > >> > > > > >>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico
> >> > >> Olivelli -
> >> > >> > > > > Diennea
> >> > >> > > > > >>> > >>> >> > <en...@diennea.com.invalid>
> >> wrote:
> >> > >> > > > > >>> > >>> >> >
> >> > >> > > > > >>> > >>> >> >> I mean in zoo.cfg
> >> > >> > > > > >>> > >>> >> >> Not as a system property
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> Enrico
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico
> >> Olivelli -
> >> > >> > > > Diennea" <
> >> > >> > > > > >>> > >>> >> >> enrico.olivelli@diennea.com.INVALID>
> ha
> >> > >> scritto:
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> Hi
> >> > >> > > > > >>> > >>> >> >> You have to enable Netty on the
> >> server
> >> > >> side
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> Something like:
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > >>
> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> Hope that helps
> >> > >> > > > > >>> > >>> >> >> Enrico
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep
> >> > singh"
> >> > >> <
> >> > >> > > > > >>> > >>> >> kuldeep.singh08@gmail.com>
> >> > >> > > > > >>> > >>> >> >> ha scritto:
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> Hi,
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> I got below error while setting
> >> SSL
> >> > >> > > > properties
> >> > >> > > > > in
> >> > >> > > > > >>> > zkEnv.sh
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> ==========================================================================================
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
> >> > >> > > > > >>> > [main:QuorumPeerConfig@133]
> >> > >> > > > > >>> > >>> -
> >> > >> > > > > >>> > >>> >> >> Reading
> >> > >> > > > > >>> > >>> >> >> configuration from:
> >> > >> /etc/zookeeper/zoo.cfg
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> >> > >> > > > > >>> > [main:QuorumPeerConfig@385]
> >> > >> > > > > >>> > >>> -
> >> > >> > > > > >>> > >>> >> >> clientPortAddress is
> >> > >> 0.0.0.0/0.0.0.0:10181
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> >> > >> > > > > >>> > [main:QuorumPeerConfig@399]
> >> > >> > > > > >>> > >>> -
> >> > >> > > > > >>> > >>> >> >> secureClientPortAddress is
> >> > >> > > > > 0.0.0.0/0.0.0.0:2281
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,878 - INFO
> >> > >> > > > > [main:X509Util@79] -
> >> > >> > > > > >>> > >>> Setting
> >> > >> > > > > >>> > >>> >> -D
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > jdk.tls.rejectClientInitiatedRenegotiation=true to
> >> > >> > > > > >>> > disable
> >> > >> > > > > >>> > >>> >> >> client-initiated
> >> > >> > > > > >>> > >>> >> >> TLS renegotiation
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> >> > >> > > > > >>> > >>> [main:DatadirCleanupManager@78]
> >> > >> > > > > >>> > >>> >> -
> >> > >> > > > > >>> > >>> >> >> autopurge.snapRetainCount set
> to
> >> 3
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> >> > >> > > > > >>> > >>> [main:DatadirCleanupManager@79]
> >> > >> > > > > >>> > >>> >> -
> >> > >> > > > > >>> > >>> >> >> autopurge.purgeInterval set to
> 1
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,898 -
> INFO [
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > PurgeTask:DatadirCleanupManager$PurgeTask@138
> >> > >> > > > ]
> >> > >> > > > > -
> >> > >> > > > > >>> Purge
> >> > >> > > > > >>> > >>> task
> >> > >> > > > > >>> > >>> >> >> started.
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,899 - INFO
> >> > >> > > > > [main:ManagedUtil@46]
> >> > >> > > > > >>> -
> >> > >> > > > > >>> > >>> Log4j
> >> > >> > > > > >>> > >>> >> >> found with
> >> > >> > > > > >>> > >>> >> >> jmx enabled.
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
> >> > >> > > > > >>> > >>> [PurgeTask:FileTxnSnapLog@103]
> >> > >> > > > > >>> > >>> >> -
> >> > >> > > > > >>> > >>> >> >> zookeeper.snapshot.trust.empty
> :
> >> > false
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,910 -
> INFO [
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > PurgeTask:DatadirCleanupManager$PurgeTask@144
> >> > >> > > > ]
> >> > >> > > > > -
> >> > >> > > > > >>> Purge
> >> > >> > > > > >>> > >>> task
> >> > >> > > > > >>> > >>> >> >> completed.
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
> >> > >> > > > > >>> [main:QuorumPeerMain@141
> >> > >> > > > > >>> > ]
> >> > >> > > > > >>> > >>> -
> >> > >> > > > > >>> > >>> >> >> Starting quorum
> >> > >> > > > > >>> > >>> >> >> peer
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
> >> > >> > > > > >>> > [main:ServerCnxnFactory@135]
> >> > >> > > > > >>> > >>> -
> >> > >> > > > > >>> > >>> >> >> Using
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> >> > >> > > > > >>> > server
> >> > >> > > > > >>> > >>> >> >> connection
> >> > >> > > > > >>> > >>> >> >> factory
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
> >> > >> > > > > >>> > >>> [main:NIOServerCnxnFactory@673]
> >> > >> > > > > >>> > >>> >> -
> >> > >> > > > > >>> > >>> >> >> Configuring NIO connection
> >> handler
> >> > >> with 10s
> >> > >> > > > > >>> sessionless
> >> > >> > > > > >>> > >>> >> >> connection timeout,
> >> > >> > > > > >>> > >>> >> >> 2 selector thread(s), 16 worker
> >> > >> threads,
> >> > >> > > and
> >> > >> > > > > 64 kB
> >> > >> > > > > >>> direct
> >> > >> > > > > >>> > >>> >> buffers.
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
> >> > >> > > > > >>> > >>> [main:NIOServerCnxnFactory@686
> >> > >> > > > > >>> > >>> >> ]
> >> > >> > > > > >>> > >>> >> >> - binding
> >> > >> > > > > >>> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
> >> > >> > > > > >>> > [main:ServerCnxnFactory@135]
> >> > >> > > > > >>> > >>> -
> >> > >> > > > > >>> > >>> >> >> Using
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> >> > >> > > > > >>> > server
> >> > >> > > > > >>> > >>> >> >> connection
> >> > >> > > > > >>> > >>> >> >> factory
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
> >> > >> > > > > >>> [main:QuorumPeerMain@101
> >> > >> > > > > >>> > ]
> >> > >> > > > > >>> > >>> -
> >> > >> > > > > >>> > >>> >> >> Unexpected
> >> > >> > > > > >>> > >>> >> >> exception, exiting abnormally
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> java.lang.UnsupportedOperationException:
> >> > >> > > SSL
> >> > >> > > > > isn't
> >> > >> > > > > >>> > >>> supported in
> >> > >> > > > > >>> > >>> >> >> NIOServerCnxn
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> I have set the following
> >> properties
> >> > in
> >> > >> > > > > >>> SERVER_JVMFLAGS in
> >> > >> > > > > >>> > >>> >> >> zkEnv.sh file :
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> Thanks,
> >> > >> > > > > >>> > >>> >> >> ---------------------
> >> > >> > > > > >>> > >>> >> >> Kuldeep Singh Budania
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM
> >> > Jordan
> >> > >> > > > > Zimmerman <
> >> > >> > > > > >>> > >>> >> >> jordan@jordanzimmerman.com>
> >> > >> > > > > >>> > >>> >> >> wrote:
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> > It's the same as the normal
> >> > >> ZooKeeper
> >> > >> > > > client:
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >> > >> > > > > >>> > >>> >> >> > <
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >> > >> > > > > >>> > >>> >> >> > >
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >> > -Jordan
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >> > > On Jun 22, 2020, at 5:50
> AM,
> >> > >> kuldeep
> >> > >> > > > singh
> >> > >> > > > > <
> >> > >> > > > > >>> > >>> >> >> kuldeep.singh08@gmail.com>
> >> > >> > > > > >>> > >>> >> >> > wrote:
> >> > >> > > > > >>> > >>> >> >> > >
> >> > >> > > > > >>> > >>> >> >> > > Hi Team,
> >> > >> > > > > >>> > >>> >> >> > > How we will do secure
> >> > >> communication
> >> > >> > > > > between the
> >> > >> > > > > >>> > Curator
> >> > >> > > > > >>> > >>> >> >> framework and
> >> > >> > > > > >>> > >>> >> >> > > zookeeper 3.5.6 ?
> >> > >> > > > > >>> > >>> >> >> > > I didn't get any solution
> >> right
> >> > >> now.
> >> > >> > > > > >>> > >>> >> >> > > I appreciate it if someone
> >> could
> >> > >> help
> >> > >> > > me
> >> > >> > > > > with the
> >> > >> > > > > >>> > same.
> >> > >> > > > > >>> > >>> >> >> > >
> >> > >> > > > > >>> > >>> >> >> > > Thanks,
> >> > >> > > > > >>> > >>> >> >> > > ---------------------
> >> > >> > > > > >>> > >>> >> >> > > Kuldeep Singh Budania
> >> > >> > > > > >>> > >>> >> >> > > Software Architect
> >> > >> > > > > >>> > >>> >> >> > >
> >> > >> > > > > >>> > >>> >> >> > >
> >> > >> > > > > >>> > >>> >> >> > > On Fri, Apr 17, 2020 at
> 4:53
> >> PM
> >> > >> > > > > Szalay-Bekő Máté
> >> > >> > > > > >>> <
> >> > >> > > > > >>> > >>> >> >> > szalay.beko.mate@gmail.com>
> >> > >> > > > > >>> > >>> >> >> > > wrote:
> >> > >> > > > > >>> > >>> >> >> > >
> >> > >> > > > > >>> > >>> >> >> > >> Hello Kuldeep,
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> > >> did you download the
> source
> >> > from
> >> > >> the
> >> > >> > > > > ZooKeeper
> >> > >> > > > > >>> > >>> webpage, or
> >> > >> > > > > >>> > >>> >> >> checked out
> >> > >> > > > > >>> > >>> >> >> > from
> >> > >> > > > > >>> > >>> >> >> > >> git?
> >> > >> > > > > >>> > >>> >> >> > >> Anyway, the following
> >> commands
> >> > >> should
> >> > >> > > > > work:
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> > >> wget
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> >> > >> > > > > >>> > >>> >> >> > >> tar xzvf
> >> > >> > > ./apache-zookeeper-3.5.7.tar.gz
> >> > >> > > > > >>> > >>> >> >> > >> cd apache-zookeeper-3.5.7
> >> > >> > > > > >>> > >>> >> >> > >> mvn clean install
> >> -DskipTests
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> > >> I tested it with OpenJDK
> >> 8u424
> >> > >> and
> >> > >> > > maven
> >> > >> > > > > 3.6.0.
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> > >> Kind regards,
> >> > >> > > > > >>> > >>> >> >> > >> Mate
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> > >> On Fri, Apr 17, 2020 at
> >> 12:51
> >> > PM
> >> > >> > > kuldeep
> >> > >> > > > > singh <
> >> > >> > > > > >>> > >>> >> >> > kuldeep.singh08@gmail.com>
> >> > >> > > > > >>> > >>> >> >> > >> wrote:
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> > >>> Hi All,
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>> I have download the
> >> zookeeper
> >> > >> source
> >> > >> > > > > code and
> >> > >> > > > > >>> run
> >> > >> > > > > >>> > >>> the mvn
> >> > >> > > > > >>> > >>> >> >> command for
> >> > >> > > > > >>> > >>> >> >> > >>> packaging but get problem
> >> on
> >> > >> > > > > "zookeeper-server"
> >> > >> > > > > >>> > >>> >> directory.
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>> *command :- mvn clean
> >> package*
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] Failed to execute
> >> goal
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > >
> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >> > >> > > > > >>> > >>> >> >> > >>> (default-compile) on
> >> project
> >> > >> > > zookeeper:
> >> > >> > > > > Fatal
> >> > >> > > > > >>> error
> >> > >> > > > > >>> > >>> >> >> compiling:
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> java.lang.NullPointerException
> >> > >> ->
> >> > >> > > [Help
> >> > >> > > > > 1]
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>>
> >> > >> org.apache.maven.lifecycle.LifecycleExecutionException:
> >> > >> > > > > >>> > >>> >> >> Failed to
> >> > >> > > > > >>> > >>> >> >> > execute
> >> > >> > > > > >>> > >>> >> >> > >>> goal
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > >
> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >> > >> > > > > >>> > >>> >> >> > >>> (default-compile) on
> >> project
> >> > >> > > zookeeper:
> >> > >> > > > > Fatal
> >> > >> > > > > >>> error
> >> > >> > > > > >>> > >>> >> >> compiling
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > >
> >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > >
> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> >> > >> > > > > Method)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >>
> >> > java.lang.reflect.Method.invoke(Method.java:498)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> >> > >> > > > > >>> > >>> >>
> >> org.apache.maven.plugin.MojoExecutionException:
> >> > >> > > > > >>> > >>> >> >> Fatal error
> >> > >> > > > > >>> > >>> >> >> > >>> compiling
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> >> > >> > > > > >>> > >>> >> >> > >>> ... 19 more
> >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> >> > >> > > > > >>> > >>> >>
> >> org.codehaus.plexus.compiler.CompilerException:
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> java.lang.NullPointerException
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> >> > >> > > > > >>> > >>> >> >> > >>> ... 22 more
> >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> >> > >> > > java.lang.RuntimeException:
> >> > >> > > > > >>> > >>> >> >> java.lang.NullPointerException
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > com.sun.tools.javac.main.Main.compile(Main.java:559)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> >> > >> > > > > >>> > >>> >> >> > >>> ... 24 more
> >> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> >> > >> > > > java.lang.NullPointerException
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >>
> >> > >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > com.sun.tools.doclint.Checker.scan(Checker.java:144)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>>
> >> > >> > >
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > >> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > >> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>>
> >> > >> > >
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > >> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> >> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>>
> >> > >> > >
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>>
> >> > >> > >
> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>>
> >> > >> > >
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>>
> >> > >> > >
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> >> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> >> > >> > > > > >>> > >>> >> >> > >>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > com.sun.tools.javac.main.Main.compile(Main.java:523)
> >> > >> > > > > >>> > >>> >> >> > >>> ... 27 more
> >> > >> > > > > >>> > >>> >> >> > >>> [ERROR]
> >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] Re-run Maven
> using
> >> the
> >> > >> -X
> >> > >> > > > switch
> >> > >> > > > > to
> >> > >> > > > > >>> enable
> >> > >> > > > > >>> > >>> full
> >> > >> > > > > >>> > >>> >> >> debug logging.
> >> > >> > > > > >>> > >>> >> >> > >>> [ERROR]
> >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] For more
> >> information
> >> > >> about
> >> > >> > > the
> >> > >> > > > > errors
> >> > >> > > > > >>> and
> >> > >> > > > > >>> > >>> >> possible
> >> > >> > > > > >>> > >>> >> >> solutions,
> >> > >> > > > > >>> > >>> >> >> > >>> please read the following
> >> > >> articles:
> >> > >> > > > > >>> > >>> >> >> > >>> [ERROR] [Help 1]
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > >
> >> > >>
> >> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>> Can someone help me on
> this
> >> > >> issue?
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>> Thanks,
> >> > >> > > > > >>> > >>> >> >> > >>> ---------------------
> >> > >> > > > > >>> > >>> >> >> > >>> Kuldeep Singh Budania
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at
> >> 5:57 PM
> >> > >> > > > > Szalay-Bekő
> >> > >> > > > > >>> Máté <
> >> > >> > > > > >>> > >>> >> >> > >>>
> szalay.beko.mate@gmail.com
> >> >
> >> > >> > > > > >>> > >>> >> >> > >>> wrote:
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>>> these exceptions can
> mean
> >> > many
> >> > >> > > > > things... I
> >> > >> > > > > >>> think
> >> > >> > > > > >>> > >>> this
> >> > >> > > > > >>> > >>> >> can
> >> > >> > > > > >>> > >>> >> >> be even
> >> > >> > > > > >>> > >>> >> >> > >> normal
> >> > >> > > > > >>> > >>> >> >> > >>>> duding rolling restart
> (as
> >> > some
> >> > >> > > > > connections
> >> > >> > > > > >>> get
> >> > >> > > > > >>> > >>> broken
> >> > >> > > > > >>> > >>> >> in
> >> > >> > > > > >>> > >>> >> >> this case)
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>> However, I saw cases
> >> already
> >> > >> when
> >> > >> > > > > exceptions
> >> > >> > > > > >>> like
> >> > >> > > > > >>> > >>> these
> >> > >> > > > > >>> > >>> >> >> killed
> >> > >> > > > > >>> > >>> >> >> > receiver
> >> > >> > > > > >>> > >>> >> >> > >>> or
> >> > >> > > > > >>> > >>> >> >> > >>>> sender threads in
> >> > >> QuorumCnxManager /
> >> > >> > > > > Leader
> >> > >> > > > > >>> > >>> Election in
> >> > >> > > > > >>> > >>> >> >> such a way
> >> > >> > > > > >>> > >>> >> >> > that
> >> > >> > > > > >>> > >>> >> >> > >>>> they were not able to
> >> > recover,
> >> > >> so
> >> > >> > > the
> >> > >> > > > > node was
> >> > >> > > > > >>> > >>> unable to
> >> > >> > > > > >>> > >>> >> >> connect to
> >> > >> > > > > >>> > >>> >> >> > any
> >> > >> > > > > >>> > >>> >> >> > >>>> quorum until restart. I
> >> > >> remember
> >> > >> > > > seeing
> >> > >> > > > > this
> >> > >> > > > > >>> in
> >> > >> > > > > >>> > 3.4
> >> > >> > > > > >>> > >>> too.
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>> Do you see these
> >> exceptions
> >> > in
> >> > >> the
> >> > >> > > > > second
> >> > >> > > > > >>> server
> >> > >> > > > > >>> > >>> (the
> >> > >> > > > > >>> > >>> >> one
> >> > >> > > > > >>> > >>> >> >> which you
> >> > >> > > > > >>> > >>> >> >> > >> just
> >> > >> > > > > >>> > >>> >> >> > >>>> upgraded in step 3)?
> >> > >> > > > > >>> > >>> >> >> > >>>> Is this issue
> >> reproducible?
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>> What is the tickTime and
> >> > >> initLimit
> >> > >> > > you
> >> > >> > > > > use?
> >> > >> > > > > >>> Maybe
> >> > >> > > > > >>> > >>> the
> >> > >> > > > > >>> > >>> >> >> server just
> >> > >> > > > > >>> > >>> >> >> > >> require
> >> > >> > > > > >>> > >>> >> >> > >>>> more time to sync?
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>> I would need more logs
> to
> >> > >> really see
> >> > >> > > > > what
> >> > >> > > > > >>> > happened.
> >> > >> > > > > >>> > >>> Can
> >> > >> > > > > >>> > >>> >> >> you create a
> >> > >> > > > > >>> > >>> >> >> > >> Jira
> >> > >> > > > > >>> > >>> >> >> > >>>> issue and upload the
> logs
> >> and
> >> > >> also
> >> > >> > > the
> >> > >> > > > > >>> ZooKeeper
> >> > >> > > > > >>> > >>> >> configs?
> >> > >> > > > > >>> > >>> >> >> I am happy
> >> > >> > > > > >>> > >>> >> >> > to
> >> > >> > > > > >>> > >>> >> >> > >>>> take a closer look.
> >> > >> > > > > >>> > >>> >> >> > >>>> (if you need to re-run
> the
> >> > >> test to
> >> > >> > > > > collect the
> >> > >> > > > > >>> > logs,
> >> > >> > > > > >>> > >>> >> then
> >> > >> > > > > >>> > >>> >> >> enabling
> >> > >> > > > > >>> > >>> >> >> > >> DEBUG
> >> > >> > > > > >>> > >>> >> >> > >>>> logs would be great. The
> >> INFO
> >> > >> level
> >> > >> > > > > logs are
> >> > >> > > > > >>> > usually
> >> > >> > > > > >>> > >>> >> >> enough for these
> >> > >> > > > > >>> > >>> >> >> > >>>> problems, but one can
> >> never
> >> > >> know...)
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>> Kind regards,
> >> > >> > > > > >>> > >>> >> >> > >>>> Mate
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at
> >> 10:05
> >> > AM
> >> > >> > > > kuldeep
> >> > >> > > > > singh
> >> > >> > > > > >>> <
> >> > >> > > > > >>> > >>> >> >> > >> kuldeep.singh08@gmail.com
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>> wrote:
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> Hi Team,
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> I have done some POC on
> >> > >> rolling
> >> > >> > > > > upgrade and
> >> > >> > > > > >>> found
> >> > >> > > > > >>> > >>> below
> >> > >> > > > > >>> > >>> >> >> result.
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> 1. On 1st node
> upgrade
> >> > >> zookeeper
> >> > >> > > .
> >> > >> > > > > Traffic
> >> > >> > > > > >>> was
> >> > >> > > > > >>> > >>> >> running
> >> > >> > > > > >>> > >>> >> >> fine
> >> > >> > > > > >>> > >>> >> >> > >> because
> >> > >> > > > > >>> > >>> >> >> > >>> 2
> >> > >> > > > > >>> > >>> >> >> > >>>>> nodes are already on
> >> old
> >> > >> > > zookeeper.
> >> > >> > > > > >>> > >>> >> >> > >>>>> 2. On 1st node
> upgrade
> >> our
> >> > >> > > > > application and
> >> > >> > > > > >>> > didn’t
> >> > >> > > > > >>> > >>> >> find
> >> > >> > > > > >>> > >>> >> >> any issue
> >> > >> > > > > >>> > >>> >> >> > >>>>> 3. On 2nd node
> upgrade
> >> > >> zookeeper
> >> > >> > > > but
> >> > >> > > > > got
> >> > >> > > > > >>> below
> >> > >> > > > > >>> > >>> error
> >> > >> > > > > >>> > >>> >> >> and zookeeper
> >> > >> > > > > >>> > >>> >> >> > >>> is
> >> > >> > > > > >>> > >>> >> >> > >>>>> not taking any
> requests
> >> > >> > > > > >>> > >>> >> >> > >>>>> 4.
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> at
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30
> 14:19:55,587 -
> >> > WARN
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
> >> > >> > > > > >>> -
> >> > >> > > > > >>> > >>> >> >> Interrupting
> >> > >> > > > > >>> > >>> >> >> > >>> SendWorker
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30
> 14:19:55,588 -
> >> > >> ERROR
> >> > >> > > > > >>> [LearnerHandler-/
> >> > >> > > > > >>> > >>> >> >> 192.168.44.73:33754
> >> > >> > > > > >>> > >>> >> >> > >>>>> :LearnerHandler@562] -
> >> > >> Unexpected
> >> > >> > > > > exception
> >> > >> > > > > >>> > >>> causing
> >> > >> > > > > >>> > >>> >> >> shutdown while
> >> > >> > > > > >>> > >>> >> >> > >>> sock
> >> > >> > > > > >>> > >>> >> >> > >>>>> still open
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> at
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> at
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >>
> >> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> at
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> at
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> at
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> >
> >>
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30
> 14:19:55,588 -
> >> > WARN
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > [SendWorker:1:QuorumCnxManager$SendWorker@679]
> >> > >> > > > > >>> -
> >> > >> > > > > >>> > >>> >> >> Interrupted while
> >> > >> > > > > >>> > >>> >> >> > >>>> waiting
> >> > >> > > > > >>> > >>> >> >> > >>>>> for message on queue
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> Please let me know is
> >> this
> >> > the
> >> > >> > > known
> >> > >> > > > > issue or
> >> > >> > > > > >>> > this
> >> > >> > > > > >>> > >>> is
> >> > >> > > > > >>> > >>> >> >> different issue
> >> > >> > > > > >>> > >>> >> >> > >>>> which
> >> > >> > > > > >>> > >>> >> >> > >>>>> is mention in Apache
> >> > zookeeper
> >> > >> > > > > documentation
> >> > >> > > > > >>> when
> >> > >> > > > > >>> > >>> >> >> upgrading from
> >> > >> > > > > >>> > >>> >> >> > >> 3.4.5
> >> > >> > > > > >>> > >>> >> >> > >>> to
> >> > >> > > > > >>> > >>> >> >> > >>>>> 3.5.6
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> Thanks,
> >> > >> > > > > >>> > >>> >> >> > >>>>> ---------------------
> >> > >> > > > > >>> > >>> >> >> > >>>>> Kuldeep Singh Budania
> >> > >> > > > > >>> > >>> >> >> > >>>>> Software Architect
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at
> >> 9:06
> >> > >> AM
> >> > >> > > > > Alexander
> >> > >> > > > > >>> Shraer
> >> > >> > > > > >>> > <
> >> > >> > > > > >>> > >>> >> >> shralex@gmail.com>
> >> > >> > > > > >>> > >>> >> >> > >>>>> wrote:
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>> +1 to what Mate said
> (I
> >> > >> wrote the
> >> > >> > > > > quoted
> >> > >> > > > > >>> > >>> >> instructions).
> >> > >> > > > > >>> > >>> >> >> > >>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020
> at
> >> > 7:03
> >> > >> AM
> >> > >> > > > > Szalay-Bekő
> >> > >> > > > > >>> > Máté <
> >> > >> > > > > >>> > >>> >> >> > >>>>>>
> >> szalay.beko.mate@gmail.com
> >> > >
> >> > >> > > > > >>> > >>> >> >> > >>>>>> wrote:
> >> > >> > > > > >>> > >>> >> >> > >>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> Hi Kuldeep,
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> I just want to
> provide
> >> you
> >> > >> some
> >> > >> > > > > background
> >> > >> > > > > >>> info
> >> > >> > > > > >>> > >>> about
> >> > >> > > > > >>> > >>> >> >> our
> >> > >> > > > > >>> > >>> >> >> > >>>>> documentation.
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> The reason to upgrade
> >> to
> >> > >> 3.4.6
> >> > >> > > > first
> >> > >> > > > > is to
> >> > >> > > > > >>> > avoid
> >> > >> > > > > >>> > >>> the
> >> > >> > > > > >>> > >>> >> >> following
> >> > >> > > > > >>> > >>> >> >> > >>> error:
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> 2013-01-30
> >> 11:32:10,663
> >> > >> > > [myid:2] -
> >> > >> > > > > WARN
> >> > >> > > > > >>> > >>> [localhost/
> >> > >> > > > > >>> > >>> >> >> > >>> 127.0.0.1:2784
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> :QuorumCnxManager@349
> ]
> >> -
> >> > >> Invalid
> >> > >> > > > > server
> >> > >> > > > > >>> id:
> >> > >> > > > > >>> > >>> -65536
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> This error comes
> >> because
> >> > of
> >> > >> the
> >> > >> > > > > protocol
> >> > >> > > > > >>> > changes
> >> > >> > > > > >>> > >>> >> between
> >> > >> > > > > >>> > >>> >> >> > >> ZooKeeper
> >> > >> > > > > >>> > >>> >> >> > >>>>> server
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> nodes during
> connection
> >> > >> > > initiation
> >> > >> > > > > for
> >> > >> > > > > >>> leader
> >> > >> > > > > >>> > >>> >> election.
> >> > >> > > > > >>> > >>> >> >> In
> >> > >> > > > > >>> > >>> >> >> > >>> ZooKeeper
> >> > >> > > > > >>> > >>> >> >> > >>>>> 3.5
> >> > >> > > > > >>> > >>> >> >> > >>>>>> a
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> protocol version was
> >> > >> introduced
> >> > >> > > > (see
> >> > >> > > > > >>> > >>> ZOOKEEPER-107)
> >> > >> > > > > >>> > >>> >> and
> >> > >> > > > > >>> > >>> >> >> since
> >> > >> > > > > >>> > >>> >> >> > >> that
> >> > >> > > > > >>> > >>> >> >> > >>>> time
> >> > >> > > > > >>> > >>> >> >> > >>>>>> the
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> fist long value sent
> in
> >> > the
> >> > >> > > initial
> >> > >> > > > > >>> message is
> >> > >> > > > > >>> > >>> not
> >> > >> > > > > >>> > >>> >> the
> >> > >> > > > > >>> > >>> >> >> server ID
> >> > >> > > > > >>> > >>> >> >> > >>> but
> >> > >> > > > > >>> > >>> >> >> > >>>>> the
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> protocol version
> >> (-65536).
> >> > >> In
> >> > >> > > > > ZooKeeper
> >> > >> > > > > >>> 3.4.6
> >> > >> > > > > >>> > we
> >> > >> > > > > >>> > >>> made
> >> > >> > > > > >>> > >>> >> >> the old 3.4
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> ZooKeepers backward
> >> > >> compatible,
> >> > >> > > so
> >> > >> > > > > they are
> >> > >> > > > > >>> > able
> >> > >> > > > > >>> > >>> to
> >> > >> > > > > >>> > >>> >> >> parse both
> >> > >> > > > > >>> > >>> >> >> > >> the
> >> > >> > > > > >>> > >>> >> >> > >>>> old
> >> > >> > > > > >>> > >>> >> >> > >>>>>> and
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> the new protocol
> format
> >> > (see
> >> > >> > > > > >>> ZOOKEEPER-1633).
> >> > >> > > > > >>> > >>> This
> >> > >> > > > > >>> > >>> >> >> issue happens
> >> > >> > > > > >>> > >>> >> >> > >>> only
> >> > >> > > > > >>> > >>> >> >> > >>>>>> when
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> you need to use old
> >> > (3.4.0 -
> >> > >> > > 3.4.5)
> >> > >> > > > > and new
> >> > >> > > > > >>> > >>> (3.5.0+)
> >> > >> > > > > >>> > >>> >> >> ZooKeeper
> >> > >> > > > > >>> > >>> >> >> > >>>> servers
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> together in the same
> >> > >> cluster.
> >> > >> > > > During
> >> > >> > > > > a
> >> > >> > > > > >>> rolling
> >> > >> > > > > >>> > >>> >> upgrade,
> >> > >> > > > > >>> > >>> >> >> this is
> >> > >> > > > > >>> > >>> >> >> > >>>> usually
> >> > >> > > > > >>> > >>> >> >> > >>>>>> the
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> case to have old and
> >> new
> >> > >> > > ZooKeepers
> >> > >> > > > > present
> >> > >> > > > > >>> > >>> together.
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> The fact that you
> >> haven't
> >> > >> seen
> >> > >> > > any
> >> > >> > > > > issues
> >> > >> > > > > >>> might
> >> > >> > > > > >>> > >>> be
> >> > >> > > > > >>> > >>> >> >> caused by the
> >> > >> > > > > >>> > >>> >> >> > >>>> order
> >> > >> > > > > >>> > >>> >> >> > >>>>> of
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> the servers. In
> >> ZooKeeper
> >> > >> the
> >> > >> > > > > connection
> >> > >> > > > > >>> > >>> initiation
> >> > >> > > > > >>> > >>> >> >> between the
> >> > >> > > > > >>> > >>> >> >> > >>>> servers
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> during the leader
> >> election
> >> > >> > > follows
> >> > >> > > > a
> >> > >> > > > > >>> specific
> >> > >> > > > > >>> > >>> rule.
> >> > >> > > > > >>> > >>> >> As
> >> > >> > > > > >>> > >>> >> >> far as I
> >> > >> > > > > >>> > >>> >> >> > >>>>> remember
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> always the server
> with
> >> the
> >> > >> larger
> >> > >> > > > ID
> >> > >> > > > > 'wins
> >> > >> > > > > >>> the
> >> > >> > > > > >>> > >>> >> >> challenge', so it
> >> > >> > > > > >>> > >>> >> >> > >> is
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> possible, that the
> old
> >> > >> server
> >> > >> > > > didn't
> >> > >> > > > > need
> >> > >> > > > > >>> to
> >> > >> > > > > >>> > >>> parse
> >> > >> > > > > >>> > >>> >> any
> >> > >> > > > > >>> > >>> >> >> initial
> >> > >> > > > > >>> > >>> >> >> > >>>> message
> >> > >> > > > > >>> > >>> >> >> > >>>>>> (if
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> it had the largest
> ID)
> >> and
> >> > >> this
> >> > >> > > is
> >> > >> > > > > why you
> >> > >> > > > > >>> > >>> haven't
> >> > >> > > > > >>> > >>> >> seen
> >> > >> > > > > >>> > >>> >> >> the
> >> > >> > > > > >>> > >>> >> >> > >> issue.
> >> > >> > > > > >>> > >>> >> >> > >>>> Also
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> having 2 nodes up
> from
> >> > the 3
> >> > >> > > nodes
> >> > >> > > > > cluster
> >> > >> > > > > >>> > still
> >> > >> > > > > >>> > >>> >> makes
> >> > >> > > > > >>> > >>> >> >> the
> >> > >> > > > > >>> > >>> >> >> > >> cluster
> >> > >> > > > > >>> > >>> >> >> > >>>> work
> >> > >> > > > > >>> > >>> >> >> > >>>>>> (so
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> you should also check
> >> if
> >> > >> all the
> >> > >> > > > > servers
> >> > >> > > > > >>> are
> >> > >> > > > > >>> > >>> part of
> >> > >> > > > > >>> > >>> >> >> the quorum).
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> I agree with Enrico
> and
> >> > >> Norbert,
> >> > >> > > > the
> >> > >> > > > > >>> safest and
> >> > >> > > > > >>> > >>> most
> >> > >> > > > > >>> > >>> >> >> stable way
> >> > >> > > > > >>> > >>> >> >> > >> is
> >> > >> > > > > >>> > >>> >> >> > >>>>>> upgrade
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> first to 3.4.latest,
> >> then
> >> > >> go to
> >> > >> > > > > 3.5.latest.
> >> > >> > > > > >>> > >>> Still, if
> >> > >> > > > > >>> > >>> >> >> you don't
> >> > >> > > > > >>> > >>> >> >> > >> see
> >> > >> > > > > >>> > >>> >> >> > >>>>> that
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> you would hit this
> >> > specific
> >> > >> issue
> >> > >> > > > > (e.g. no
> >> > >> > > > > >>> > >>> "Invalid
> >> > >> > > > > >>> > >>> >> >> server id" in
> >> > >> > > > > >>> > >>> >> >> > >>> the
> >> > >> > > > > >>> > >>> >> >> > >>>>> log
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> files), and all the
> >> three
> >> > >> servers
> >> > >> > > > can
> >> > >> > > > > >>> handle
> >> > >> > > > > >>> > >>> traffic,
> >> > >> > > > > >>> > >>> >> >> then maybe
> >> > >> > > > > >>> > >>> >> >> > >>> you
> >> > >> > > > > >>> > >>> >> >> > >>>>>> don't
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> need to upgrade first
> >> to
> >> > >> > > > 3.4.latest,
> >> > >> > > > > it is
> >> > >> > > > > >>> your
> >> > >> > > > > >>> > >>> >> >> decision.
> >> > >> > > > > >>> > >>> >> >> > >>> Definitely
> >> > >> > > > > >>> > >>> >> >> > >>>>> you
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> should test it first,
> >> as
> >> > >> > > suggested
> >> > >> > > > > by the
> >> > >> > > > > >>> > others.
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> Kind regards,
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> Mate
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020
> at
> >> > >> 12:29 PM
> >> > >> > > > > Norbert
> >> > >> > > > > >>> Kalmar
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > >> <nk...@cloudera.com.invalid>
> >> > >> > > > > wrote:
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> Hi,
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> That guide is to
> >> upgrade
> >> > to
> >> > >> > > 3.5.0,
> >> > >> > > > > which
> >> > >> > > > > >>> was
> >> > >> > > > > >>> > an
> >> > >> > > > > >>> > >>> >> alpha
> >> > >> > > > > >>> > >>> >> >> version.
> >> > >> > > > > >>> > >>> >> >> > >> A
> >> > >> > > > > >>> > >>> >> >> > >>>> lot
> >> > >> > > > > >>> > >>> >> >> > >>>>>> has
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> changed for the
> first
> >> > >> stable
> >> > >> > > > > release of
> >> > >> > > > > >>> 3.5.5
> >> > >> > > > > >>> > >>> and
> >> > >> > > > > >>> > >>> >> then
> >> > >> > > > > >>> > >>> >> >> a few
> >> > >> > > > > >>> > >>> >> >> > >>> more,
> >> > >> > > > > >>> > >>> >> >> > >>>>> even
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> rolling upgrade
> issues
> >> > >> have been
> >> > >> > > > > fixed for
> >> > >> > > > > >>> > >>> 3.5.6.
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> This is a more
> >> up-to-date
> >> > >> guide:
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> >
> >> > >> > > > >
> >> > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> If you have done
> your
> >> > >> testing
> >> > >> > > > (with
> >> > >> > > > > prod
> >> > >> > > > > >>> > >>> snapshot!),
> >> > >> > > > > >>> > >>> >> >> then you
> >> > >> > > > > >>> > >>> >> >> > >> can
> >> > >> > > > > >>> > >>> >> >> > >>>>> skip
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> 3.4
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> latest upgrade, but
> >> keep
> >> > >> in mind
> >> > >> > > > we
> >> > >> > > > > do our
> >> > >> > > > > >>> > >>> >> >> recommendations for
> >> > >> > > > > >>> > >>> >> >> > >> a
> >> > >> > > > > >>> > >>> >> >> > >>>>>> reason.
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> There were issues
> >> > reported
> >> > >> > > and/or
> >> > >> > > > > found
> >> > >> > > > > >>> during
> >> > >> > > > > >>> > >>> >> >> testing. Some
> >> > >> > > > > >>> > >>> >> >> > >> are
> >> > >> > > > > >>> > >>> >> >> > >>>>> fixed
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> with
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> 3.5.6, some only
> >> happens
> >> > if
> >> > >> > > > certain
> >> > >> > > > > >>> conditions
> >> > >> > > > > >>> > >>> stand
> >> > >> > > > > >>> > >>> >> >> > >>> (IOException:
> >> > >> > > > > >>> > >>> >> >> > >>>> No
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> snapshot found -
> >> > mentioned
> >> > >> in
> >> > >> > > the
> >> > >> > > > > guide,
> >> > >> > > > > >>> fixed
> >> > >> > > > > >>> > >>> in
> >> > >> > > > > >>> > >>> >> >> 3.5.6).
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> So it is up to you,
> I
> >> > would
> >> > >> > > still
> >> > >> > > > > >>> recommend to
> >> > >> > > > > >>> > >>> do an
> >> > >> > > > > >>> > >>> >> >> 3.4
> >> > >> > > > > >>> > >>> >> >> > >> upgrade
> >> > >> > > > > >>> > >>> >> >> > >>>>> first,
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> if
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> it's feasible.
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> Regards,
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> Norbert
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020
> >> at
> >> > >> 11:45 AM
> >> > >> > > > > kuldeep
> >> > >> > > > > >>> > singh <
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> >> kuldeep.singh08@gmail.com
> >> > >
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> wrote:
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Hi,
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Current Zookeeper
> >> > version
> >> > >> :-
> >> > >> > > > 3.4.5
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Upgraded version
> >> > >> > > > :-
> >> > >> > > > > 3.5.6
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> We are not going
> with
> >> > >> 3.5.7.
> >> > >> > > Our
> >> > >> > > > > final
> >> > >> > > > > >>> > >>> decision is
> >> > >> > > > > >>> > >>> >> >> zookeeper
> >> > >> > > > > >>> > >>> >> >> > >>>>> version
> >> > >> > > > > >>> > >>> >> >> > >>>>>> is
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.5.6
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> as per your reply
> >> first
> >> > >> we need
> >> > >> > > > to
> >> > >> > > > > move
> >> > >> > > > > >>> > latest
> >> > >> > > > > >>> > >>> >> >> version of
> >> > >> > > > > >>> > >>> >> >> > >>> 3.4.x,
> >> > >> > > > > >>> > >>> >> >> > >>>>> like
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> below
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 ->
> >> 3.5.6
> >> > >> > > (Correct
> >> > >> > > > > me if
> >> > >> > > > > >>> I am
> >> > >> > > > > >>> > >>> wrong
> >> > >> > > > > >>> > >>> >> >> here)
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> But if We are not
> >> facing
> >> > >> any
> >> > >> > > > > problem
> >> > >> > > > > >>> that i
> >> > >> > > > > >>> > >>> have
> >> > >> > > > > >>> > >>> >> >> shared you
> >> > >> > > > > >>> > >>> >> >> > >>> that
> >> > >> > > > > >>> > >>> >> >> > >>>> we
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> have
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> set up of 3 node
> >> cluster
> >> > >> where
> >> > >> > > 2
> >> > >> > > > > node
> >> > >> > > > > >>> are on
> >> > >> > > > > >>> > >>> 3.5.6
> >> > >> > > > > >>> > >>> >> >> version
> >> > >> > > > > >>> > >>> >> >> > >> and
> >> > >> > > > > >>> > >>> >> >> > >>> 1
> >> > >> > > > > >>> > >>> >> >> > >>>>> node
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> on
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything
> is
> >> > >> running
> >> > >> > > fine
> >> > >> > > > > and
> >> > >> > > > > >>> didn't
> >> > >> > > > > >>> > >>> get
> >> > >> > > > > >>> > >>> >> any
> >> > >> > > > > >>> > >>> >> >> issue,
> >> > >> > > > > >>> > >>> >> >> > >> So
> >> > >> > > > > >>> > >>> >> >> > >>>> what
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> other
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> problem we can face
> >> if
> >> > we
> >> > >> > > > directly
> >> > >> > > > > move
> >> > >> > > > > >>> to
> >> > >> > > > > >>> > >>> 3.5.6
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Thanks,
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> ---------------------
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Kuldeep Singh
> Budania
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Software Architect
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24,
> 2020
> >> at
> >> > >> 3:58 PM
> >> > >> > > > > Enrico
> >> > >> > > > > >>> > >>> Olivelli <
> >> > >> > > > > >>> > >>> >> >> > >>>>> eolivelli@gmail.com
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> wrote:
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Hi
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> You have to
> upgrade
> >> to
> >> > >> latest
> >> > >> > > > > 3.4.x
> >> > >> > > > > >>> > Zookeeper
> >> > >> > > > > >>> > >>> then
> >> > >> > > > > >>> > >>> >> >> you will
> >> > >> > > > > >>> > >>> >> >> > >>>>> upgrade
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> to
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> 3.5.7.
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> All should run
> well
> >> > >> without
> >> > >> > > > issues
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Enrico
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar
> 2020,
> >> > 10:18
> >> > >> > > > kuldeep
> >> > >> > > > > singh
> >> > >> > > > > >>> <
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> kuldeep.singh08@gmail.com
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> ha
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> scritto:
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Hi Team,
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> We are upgrading
> >> > >> zookeeper
> >> > >> > > from
> >> > >> > > > > 3.4.5
> >> > >> > > > > >>> to
> >> > >> > > > > >>> > >>> 3.5.6. I
> >> > >> > > > > >>> > >>> >> >> have
> >> > >> > > > > >>> > >>> >> >> > >> set
> >> > >> > > > > >>> > >>> >> >> > >>>> up 3
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> node
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> cluster where 2
> >> node
> >> > >> are on
> >> > >> > > > 3.5.6
> >> > >> > > > > >>> version
> >> > >> > > > > >>> > >>> and 1
> >> > >> > > > > >>> > >>> >> >> node on
> >> > >> > > > > >>> > >>> >> >> > >>>> 3.4.5.
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Everything is
> >> running
> >> > >> fine
> >> > >> > > and
> >> > >> > > > > didn't
> >> > >> > > > > >>> get
> >> > >> > > > > >>> > any
> >> > >> > > > > >>> > >>> >> issue
> >> > >> > > > > >>> > >>> >> >> on my
> >> > >> > > > > >>> > >>> >> >> > >>>>> system.
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> but I found
> >> something
> >> > on
> >> > >> > > apache
> >> > >> > > > > site
> >> > >> > > > > >>> that
> >> > >> > > > > >>> > >>> first
> >> > >> > > > > >>> > >>> >> we
> >> > >> > > > > >>> > >>> >> >> need
> >> > >> > > > > >>> > >>> >> >> > >> to
> >> > >> > > > > >>> > >>> >> >> > >>>>>> upgrade
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> on
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can
> >> > >> upgrade to
> >> > >> > > > > 3.5.6. So
> >> > >> > > > > >>> is
> >> > >> > > > > >>> > it
> >> > >> > > > > >>> > >>> >> >> mandatory
> >> > >> > > > > >>> > >>> >> >> > >> to
> >> > >> > > > > >>> > >>> >> >> > >>> go
> >> > >> > > > > >>> > >>> >> >> > >>>>> on
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> 3.4.6
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> first.
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> *Upgrading to
> >> 3.5.0*
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Upgrading a
> running
> >> > >> ZooKeeper
> >> > >> > > > > ensemble
> >> > >> > > > > >>> to
> >> > >> > > > > >>> > >>> 3.5.0
> >> > >> > > > > >>> > >>> >> >> should be
> >> > >> > > > > >>> > >>> >> >> > >>>> done
> >> > >> > > > > >>> > >>> >> >> > >>>>>> only
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> after
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> upgrading your
> >> > ensemble
> >> > >> to
> >> > >> > > the
> >> > >> > > > > 3.4.6
> >> > >> > > > > >>> > release.
> >> > >> > > > > >>> > >>> >> Note
> >> > >> > > > > >>> > >>> >> >> that
> >> > >> > > > > >>> > >>> >> >> > >>> this
> >> > >> > > > > >>> > >>> >> >> > >>>> is
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> only
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> necessary for
> >> rolling
> >> > >> > > upgrades
> >> > >> > > > > (if
> >> > >> > > > > >>> you're
> >> > >> > > > > >>> > >>> fine
> >> > >> > > > > >>> > >>> >> with
> >> > >> > > > > >>> > >>> >> >> > >>> shutting
> >> > >> > > > > >>> > >>> >> >> > >>>>> down
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> the
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> system
> completely,
> >> you
> >> > >> don't
> >> > >> > > > > have to go
> >> > >> > > > > >>> > >>> through
> >> > >> > > > > >>> > >>> >> >> 3.4.6).
> >> > >> > > > > >>> > >>> >> >> > >> If
> >> > >> > > > > >>> > >>> >> >> > >>>> you
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> attempt
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> a
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> rolling upgrade
> >> > without
> >> > >> going
> >> > >> > > > > through
> >> > >> > > > > >>> 3.4.6
> >> > >> > > > > >>> > >>> (for
> >> > >> > > > > >>> > >>> >> >> example
> >> > >> > > > > >>> > >>> >> >> > >>> from
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> 3.4.5),
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> you
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> may get the
> >> following
> >> > >> error:
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30
> >> > 11:32:10,663
> >> > >> > > > [myid:2]
> >> > >> > > > > - INFO
> >> > >> > > > > >>> > >>> >> [localhost/
> >> > >> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > >> > > :QuorumCnxManager$Listener@498
> >> > >> > > > ]
> >> > >> > > > > -
> >> > >> > > > > >>> Received
> >> > >> > > > > >>> > >>> >> >> connection
> >> > >> > > > > >>> > >>> >> >> > >>>> request
> >> > >> > > > > >>> > >>> >> >> > >>>>> /
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30
> >> > 11:32:10,663
> >> > >> > > > [myid:2]
> >> > >> > > > > - WARN
> >> > >> > > > > >>> > >>> >> [localhost/
> >> > >> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> :QuorumCnxManager@349
> >> > ]
> >> > >> -
> >> > >> > > > Invalid
> >> > >> > > > > >>> server
> >> > >> > > > > >>> > id:
> >> > >> > > > > >>> > >>> >> -65536
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> During a rolling
> >> > >> upgrade,
> >> > >> > > each
> >> > >> > > > > server
> >> > >> > > > > >>> is
> >> > >> > > > > >>> > >>> taken
> >> > >> > > > > >>> > >>> >> down
> >> > >> > > > > >>> > >>> >> >> in
> >> > >> > > > > >>> > >>> >> >> > >> turn
> >> > >> > > > > >>> > >>> >> >> > >>>> and
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> rebooted
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> with the new
> 3.5.0
> >> > >> binaries.
> >> > >> > > > > Before
> >> > >> > > > > >>> > starting
> >> > >> > > > > >>> > >>> the
> >> > >> > > > > >>> > >>> >> >> server
> >> > >> > > > > >>> > >>> >> >> > >>> with
> >> > >> > > > > >>> > >>> >> >> > >>>>>> 3.5.0
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> binaries, we
> highly
> >> > >> recommend
> >> > >> > > > > updating
> >> > >> > > > > >>> the
> >> > >> > > > > >>> > >>> >> >> configuration
> >> > >> > > > > >>> > >>> >> >> > >>> file
> >> > >> > > > > >>> > >>> >> >> > >>>>> so
> >> > >> > > > > >>> > >>> >> >> > >>>>>>> that
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> all
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> server statements
> >> > >> > > > "server.x=..."
> >> > >> > > > > >>> contain
> >> > >> > > > > >>> > >>> client
> >> > >> > > > > >>> > >>> >> >> ports
> >> > >> > > > > >>> > >>> >> >> > >> (see
> >> > >> > > > > >>> > >>> >> >> > >>>> the
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> section
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Specifying
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> the client port).
> >> As
> >> > >> > > explained
> >> > >> > > > > earlier
> >> > >> > > > > >>> you
> >> > >> > > > > >>> > >>> may
> >> > >> > > > > >>> > >>> >> >> leave the
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>> configuration
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> in a
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> single file, as
> >> well
> >> > as
> >> > >> leave
> >> > >> > > > the
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> clientPort/clientPortAddress
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> (although if you
> >> > specify
> >> > >> > > client
> >> > >> > > > > ports
> >> > >> > > > > >>> in
> >> > >> > > > > >>> > the
> >> > >> > > > > >>> > >>> new
> >> > >> > > > > >>> > >>> >> >> format,
> >> > >> > > > > >>> > >>> >> >> > >>>> these
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> are now
> redundant).
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Could you please
> >> let
> >> > me
> >> > >> know
> >> > >> > > > > about this
> >> > >> > > > > >>> > case.
> >> > >> > > > > >>> > >>> >> >> Appreciate
> >> > >> > > > > >>> > >>> >> >> > >> if
> >> > >> > > > > >>> > >>> >> >> > >>>>>> respond
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>> soon.
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Thanks,
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> ---------------------
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh
> >> Budania
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>>
> >> > >> > > > > >>> > >>> >> >> > >>>>
> >> > >> > > > > >>> > >>> >> >> > >>>
> >> > >> > > > > >>> > >>> >> >> > >>
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >> >
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> ________________________________
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> >> > >> > > > > >>> > >>> >> >> This e-mail (including any
> >> attachments)
> >> > is
> >> > >> > > > strictly
> >> > >> > > > > >>> > >>> confidential
> >> > >> > > > > >>> > >>> >> and
> >> > >> > > > > >>> > >>> >> >> may also contain privileged
> information.
> >> If
> >> > >> you are
> >> > >> > > > > not the
> >> > >> > > > > >>> > >>> intended
> >> > >> > > > > >>> > >>> >> >> recipient you are not authorised to
> read,
> >> > >> print,
> >> > >> > > > save,
> >> > >> > > > > >>> process or
> >> > >> > > > > >>> > >>> >> disclose
> >> > >> > > > > >>> > >>> >> >> this message. If you have received this
> >> > >> message by
> >> > >> > > > > mistake,
> >> > >> > > > > >>> > please
> >> > >> > > > > >>> > >>> >> inform
> >> > >> > > > > >>> > >>> >> >> the sender immediately and destroy this
> >> > >> e-mail, its
> >> > >> > > > > >>> attachments
> >> > >> > > > > >>> > >>> and any
> >> > >> > > > > >>> > >>> >> >> copies. Any use, distribution,
> >> reproduction
> >> > or
> >> > >> > > > > disclosure by
> >> > >> > > > > >>> any
> >> > >> > > > > >>> > >>> person
> >> > >> > > > > >>> > >>> >> >> other than the intended recipient is
> >> > strictly
> >> > >> > > > > prohibited and
> >> > >> > > > > >>> the
> >> > >> > > > > >>> > >>> person
> >> > >> > > > > >>> > >>> >> >> responsible may incur in penalties.
> >> > >> > > > > >>> > >>> >> >> The use of this e-mail is only for
> >> > >> professional
> >> > >> > > > > purposes;
> >> > >> > > > > >>> > >>> there is
> >> > >> > > > > >>> > >>> >> no
> >> > >> > > > > >>> > >>> >> >> guarantee that the correspondence
> towards
> >> > this
> >> > >> > > e-mail
> >> > >> > > > > will be
> >> > >> > > > > >>> > read
> >> > >> > > > > >>> > >>> >> only by
> >> > >> > > > > >>> > >>> >> >> the recipient, because, under certain
> >> > >> > > circumstances,
> >> > >> > > > > there
> >> > >> > > > > >>> may
> >> > >> > > > > >>> > be a
> >> > >> > > > > >>> > >>> >> need to
> >> > >> > > > > >>> > >>> >> >> access this email by third subjects
> >> > belonging
> >> > >> to
> >> > >> > > the
> >> > >> > > > > Company.
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> ________________________________
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> >> > >> > > > > >>> > >>> >> >> This e-mail (including any attachments)
> >> is
> >> > >> strictly
> >> > >> > > > > >>> confidential
> >> > >> > > > > >>> > >>> and
> >> > >> > > > > >>> > >>> >> may
> >> > >> > > > > >>> > >>> >> >> also contain privileged information. If
> >> you
> >> > >> are not
> >> > >> > > > the
> >> > >> > > > > >>> intended
> >> > >> > > > > >>> > >>> >> recipient
> >> > >> > > > > >>> > >>> >> >> you are not authorised to read, print,
> >> save,
> >> > >> > > process
> >> > >> > > > or
> >> > >> > > > > >>> disclose
> >> > >> > > > > >>> > >>> this
> >> > >> > > > > >>> > >>> >> >> message. If you have received this
> >> message
> >> > by
> >> > >> > > > mistake,
> >> > >> > > > > please
> >> > >> > > > > >>> > >>> inform
> >> > >> > > > > >>> > >>> >> the
> >> > >> > > > > >>> > >>> >> >> sender immediately and destroy this
> >> e-mail,
> >> > >> its
> >> > >> > > > > attachments
> >> > >> > > > > >>> and
> >> > >> > > > > >>> > any
> >> > >> > > > > >>> > >>> >> copies.
> >> > >> > > > > >>> > >>> >> >> Any use, distribution, reproduction or
> >> > >> disclosure
> >> > >> > > by
> >> > >> > > > > any
> >> > >> > > > > >>> person
> >> > >> > > > > >>> > >>> other
> >> > >> > > > > >>> > >>> >> than
> >> > >> > > > > >>> > >>> >> >> the intended recipient is strictly
> >> > prohibited
> >> > >> and
> >> > >> > > the
> >> > >> > > > > person
> >> > >> > > > > >>> > >>> >> responsible
> >> > >> > > > > >>> > >>> >> >> may incur in penalties.
> >> > >> > > > > >>> > >>> >> >> The use of this e-mail is only for
> >> > >> professional
> >> > >> > > > > purposes;
> >> > >> > > > > >>> there
> >> > >> > > > > >>> > is
> >> > >> > > > > >>> > >>> no
> >> > >> > > > > >>> > >>> >> >> guarantee that the correspondence
> towards
> >> > this
> >> > >> > > e-mail
> >> > >> > > > > will be
> >> > >> > > > > >>> > read
> >> > >> > > > > >>> > >>> >> only by
> >> > >> > > > > >>> > >>> >> >> the recipient, because, under certain
> >> > >> > > circumstances,
> >> > >> > > > > there
> >> > >> > > > > >>> may
> >> > >> > > > > >>> > be a
> >> > >> > > > > >>> > >>> >> need to
> >> > >> > > > > >>> > >>> >> >> access this email by third subjects
> >> > belonging
> >> > >> to
> >> > >> > > the
> >> > >> > > > > Company.
> >> > >> > > > > >>> > >>> >> >>
> >> > >> > > > > >>> > >>> >> >
> >> > >> > > > > >>> > >>> >>
> >> > >> > > > > >>> > >>> >
> >> > >> > > > > >>> > >>>
> >> > >> > > > > >>> > >>
> >> > >> > > > > >>> >
> >> > >> > > > > >>>
> >> > >> > > > > >>
> >> > >> > > > >
> >> > >> > > > >
> >> > >> > > > > ________________________________
> >> > >> > > > >
> >> > >> > > > > CONFIDENTIALITY & PRIVACY NOTICE
> >> > >> > > > > This e-mail (including any attachments) is strictly
> >> confidential
> >> > >> and
> >> > >> > > may
> >> > >> > > > > also contain privileged information. If you are not the
> >> intended
> >> > >> > > > recipient
> >> > >> > > > > you are not authorised to read, print, save, process or
> >> disclose
> >> > >> this
> >> > >> > > > > message. If you have received this message by mistake,
> please
> >> > >> inform
> >> > >> > > the
> >> > >> > > > > sender immediately and destroy this e-mail, its attachments
> >> and
> >> > >> any
> >> > >> > > > copies.
> >> > >> > > > > Any use, distribution, reproduction or disclosure by any
> >> person
> >> > >> other
> >> > >> > > > than
> >> > >> > > > > the intended recipient is strictly prohibited and the
> person
> >> > >> > > responsible
> >> > >> > > > > may incur in penalties.
> >> > >> > > > > The use of this e-mail is only for professional purposes;
> >> there
> >> > >> is no
> >> > >> > > > > guarantee that the correspondence towards this e-mail will
> be
> >> > >> read only
> >> > >> > > > by
> >> > >> > > > > the recipient, because, under certain circumstances, there
> >> may
> >> > be
> >> > >> a
> >> > >> > > need
> >> > >> > > > to
> >> > >> > > > > access this email by third subjects belonging to the
> Company.
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >>
> >> > >>
> >> >
> >>
> >
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Sorry,
secureClientPort=2182
Thanks,
---------------------
Kuldeep Singh Budania
On Wed, Oct 14, 2020 at 4:18 PM kuldeep singh <ku...@gmail.com>
wrote:
> Thanks for reply
>
> zoo.cfg
> -----------
> secureClientPort=2181
> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> initLimit=10
> syncLimit=5
> dataDir= data directory (not mentioning exact path here)
> tickTime=2000
> autopurge.snapRetainCount=3
> autopurge.purgeInterval=1
> admin.enableServer=false
> standaloneEnabled=false
> jute.maxbuffer=2147483648
> server.1=host1_priv:10288:10388
> server.2=host2_priv:10288:10388
> server.3=host3_priv:10288:10388
> server.4=host4_priv:10288:10388
> server.5=host5_priv:10288:10388
> quorum.auth.enableSasl=true
> quorum.auth.learnerRequireSasl=true
> quorum.auth.serverRequireSasl=true
> quorum.auth.learner.loginContext=QuorumLearner
> quorum.auth.server.loginContext=QuorumServer
> quorum.cnxn.threads.size=10
> -------------------------------------------------------------
> java.env
>
> export
> SERVER_JVMFLAGS="-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> -Dzookeeper.ssl.keyStore.location=keystore.jks
> -Dzookeeper.ssl.keyStore.password=<passwword>
> -Dzookeeper.ssl.trustStore.location= keystore.jks
> -Dzookeeper.ssl.trustStore.password= <passwword>
> -Djava.security.auth.login.config=zookeeper-jaas.conf"
>
> export
> CLIENT_JVMFLAGS="-Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> -Dzookeeper.client.secure=true -Dzookeeper.ssl.keyStore.location=
> keystore.jks -Dzookeeper.ssl.keyStore.password= <passwword>
> -Dzookeeper.ssl.trustStore.location=keystore.jks
> -Dzookeeper.ssl.trustStore.password= <passwword>
> -Dzookeeper.ssl.hostnameVerification=false"
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Wed, Oct 14, 2020 at 4:12 PM Szalay-Bekő Máté <
> szalay.beko.mate@gmail.com> wrote:
>
>> These log messages indicate that a client (or an other ZooKeeper server)
>> is
>> trying to connect without SSL to a ZooKeeper process that expects SSL.
>> I assume this will be a configuration issue then.
>>
>> Best regards,
>> Mate
>>
>> On Wed, Oct 14, 2020 at 12:30 PM kuldeep singh <kuldeep.singh08@gmail.com
>> >
>> wrote:
>>
>> > Hi,
>> >
>> > more logs
>> >
>> > 2020-10-14 12:25:05,106 - ERROR
>> >
>> >
>> [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler$CertificateVerifier@257
>> > ]
>> > - Unsuccessful handshake with session 0x0
>> >
>> > 2020-10-14 12:25:05,107 - WARN
>> > [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler@138] -
>> > Exception caught
>> >
>> > io.netty.handler.codec.DecoderException:
>> > io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record:
>> > 737276720a
>> >
>> > at
>> >
>> >
>> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:475)
>> >
>> > at
>> >
>> >
>> io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:283)
>> >
>> > at
>> >
>> >
>> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
>> >
>> > at
>> >
>> >
>> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
>> >
>> > at
>> >
>> >
>> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
>> >
>> > at
>> >
>> >
>> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
>> >
>> > at
>> >
>> >
>> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
>> >
>> > at
>> >
>> >
>> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
>> >
>> > at
>> >
>> >
>> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
>> >
>> > at
>> >
>> >
>> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
>> >
>> > at
>> >
>> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
>> >
>> > at
>> >
>> >
>> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
>> >
>> > at
>> >
>> >
>> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
>> >
>> > at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
>> >
>> > at
>> >
>> >
>> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
>> >
>> > at
>> >
>> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
>> >
>> > at
>> >
>> >
>> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
>> >
>> > at java.lang.Thread.run(Thread.java:748)
>> >
>> > Caused by: io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS
>> > record: 737276720a
>> >
>> > at
>> >
>> io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1203)
>> >
>> > at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1271)
>> >
>> > at
>> >
>> >
>> io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:505)
>> >
>> > at
>> >
>> >
>> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:444)
>> >
>> > ... 17 more
>> >
>> > Thanks,
>> > ---------------------
>> > Kuldeep Singh Budania
>> > Software Architect
>> >
>> >
>> >
>> > On Wed, Oct 14, 2020 at 3:51 PM kuldeep singh <
>> kuldeep.singh08@gmail.com>
>> > wrote:
>> >
>> > > Hi,
>> > >
>> > >
>> > > below error is coming on zookeeper logs on SSL.
>> > >
>> > > 2020-10-14 12:18:27,410 - WARN
>> > [nioEventLoopGroup-4-16:NettyServerCnxn@540]
>> > > - Closing connection to /127.0.0.1:49470
>> > > java.io.IOException: Len error 369296128
>> > > at
>> > >
>> >
>> org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:533)
>> > > at
>> > >
>> >
>> org.apache.zookeeper.server.NettyServerCnxn.processMessage(NettyServerCnxn.java:360)
>> > > at
>> > >
>> >
>> org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.channelRead(NettyServerCnxnFactory.java:184)
>> > > at
>> > >
>> >
>> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
>> > > at
>> > >
>> >
>> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
>> > > at
>> > >
>> >
>> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
>> > > at
>> > >
>> >
>> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
>> > > at
>> > >
>> >
>> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
>> > > at
>> > >
>> >
>> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
>> > > at
>> > >
>> >
>> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
>> > > at
>> > >
>> >
>> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
>> > > at
>> > >
>> >
>> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
>> > > at
>> > >
>> >
>> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
>> > > at
>> > >
>> >
>> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
>> > > at
>> io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
>> > > at
>> > >
>> >
>> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
>> > > at
>> > >
>> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
>> > > at
>> > >
>> >
>> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
>> > > at java.lang.Thread.run(Thread.java:748)
>> > >
>> > > Thanks,
>> > > ---------------------
>> > > Kuldeep Singh Budania
>> > >
>> > >
>> > >
>> > > On Thu, Oct 8, 2020 at 6:33 PM Szalay-Bekő Máté <
>> > > szalay.beko.mate@gmail.com> wrote:
>> > >
>> > >> Sounds like a bug or a configuration issue...
>> > >> can you share the configs (before and after the scale-up) and the
>> logs?
>> > >> also: does the truststores recognise all the keys used on all the 5
>> > >> nodes? (e.g. the truststores on the old nodes accept the new keys?)
>> > >>
>> > >> Best Regards,
>> > >> Mate
>> > >>
>> > >> On Thu, Oct 8, 2020 at 2:31 PM kuldeep singh <
>> kuldeep.singh08@gmail.com
>> > >
>> > >> wrote:
>> > >> >
>> > >> > Hi,
>> > >> >
>> > >> > Yes, My client and server both are using certificate and have
>> added in
>> > >> ZK
>> > >> > and client as well.
>> > >> >
>> > >> > Thanks,
>> > >> > ---------------------
>> > >> > Kuldeep Singh Budania
>> > >> >
>> > >> >
>> > >> >
>> > >> > On Thu, Oct 8, 2020 at 5:56 PM Enrico Olivelli <
>> eolivelli@gmail.com>
>> > >> wrote:
>> > >> >
>> > >> > > Il giorno gio 8 ott 2020 alle ore 14:17 kuldeep singh <
>> > >> > > kuldeep.singh08@gmail.com> ha scritto:
>> > >> > >
>> > >> > > > Hi Team,
>> > >> > > >
>> > >> > > > I am facing one issue in SSL communication between client and
>> > >> zookeeper
>> > >> > > > server.
>> > >> > > >
>> > >> > > > ZK 3.5.6 version
>> > >> > > >
>> > >> > > > 1. Mi on 3 node
>> > >> > > > 2. Applying SSL and 3 nodes cluster is working fine
>> > >> > > > 3. Scaled my cluster with 2 nodes and now my cluster have 5
>> nodes
>> > >> over
>> > >> > > SSL
>> > >> > > >
>> > >> > > > but after scaling my SSL is not working between client and ZK
>> > >> server and
>> > >> > > > even not able to login using zkCli as well.
>> > >> > > >
>> > >> > > > Can someone provide the details please why it is happening?
>> > >> > > >
>> > >> > >
>> > >> > > Is your client configured to use SSL ?
>> > >> > >
>> > >> > > Enrico
>> > >> > >
>> > >> > >
>> > >> > >
>> > >> > > >
>> > >> > > > Thanks,
>> > >> > > > ---------------------
>> > >> > > > Kuldeep Singh Budania
>> > >> > > > Software Architect
>> > >> > > >
>> > >> > > >
>> > >> > > >
>> > >> > > > On Mon, Jul 13, 2020 at 2:19 PM Enrico Olivelli - Diennea
>> > >> > > > <en...@diennea.com.invalid> wrote:
>> > >> > > >
>> > >> > > > > It looks like we ported it to 3.5.
>> > >> > > > >
>> > >> > > > > See the subtask
>> > >> > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2792
>> > >> > > > >
>> > >> > > > > Enrico
>> > >> > > > >
>> > >> > > > > Il giorno 13/07/20, 10:37 "kuldeep singh" <
>> > >> kuldeep.singh08@gmail.com>
>> > >> > > > ha
>> > >> > > > > scritto:
>> > >> > > > >
>> > >> > > > > Hi Team,
>> > >> > > > >
>> > >> > > > > I appreciate it if I will get a response as soon as
>> > possible,
>> > >> as I
>> > >> > > am
>> > >> > > > > stuck
>> > >> > > > > at this point.
>> > >> > > > >
>> > >> > > > > Thanks,
>> > >> > > > > ---------------------
>> > >> > > > > Kuldeep Singh Budania
>> > >> > > > >
>> > >> > > > >
>> > >> > > > >
>> > >> > > > > On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <
>> > >> > > > > kuldeep.singh08@gmail.com>
>> > >> > > > > wrote:
>> > >> > > > >
>> > >> > > > > > Hi Team,
>> > >> > > > > >
>> > >> > > > > > Server to Server communication is not supported in
>> 3.5.6
>> > >> version
>> > >> > > > as
>> > >> > > > > per
>> > >> > > > > > below JIRA issue?
>> > >> > > > > >
>> > >> > > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2639
>> > >> > > > > >
>> > >> > > > > > Thanks,
>> > >> > > > > > ---------------------
>> > >> > > > > > Kuldeep Singh Budania
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > > On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <
>> > >> > > > > kuldeep.singh08@gmail.com>
>> > >> > > > > > wrote:
>> > >> > > > > >
>> > >> > > > > >> Thanks for the reply.
>> > >> > > > > >>
>> > >> > > > > >> Now my ZKCli cmd is working fine as we use some our
>> > >> customized
>> > >> > > > > >> authentication and we resolve the issue.
>> > >> > > > > >>
>> > >> > > > > >> Now I am going to implement Server to Server
>> > communication.
>> > >> > > > > >>
>> > >> > > > > >> Thanks,
>> > >> > > > > >> ---------------------
>> > >> > > > > >> Kuldeep Singh Budania
>> > >> > > > > >>
>> > >> > > > > >>
>> > >> > > > > >>
>> > >> > > > > >> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
>> > >> > > > > >> szalay.beko.mate@gmail.com> wrote:
>> > >> > > > > >>
>> > >> > > > > >>> I think SSL is working for you already... If you
>> managed
>> > >> to
>> > >> > > start
>> > >> > > > > the
>> > >> > > > > >>> zkCli.sh and be able to connect to ZooKeeper on the
>> > >> secure port
>> > >> > > > > and issue
>> > >> > > > > >>> any kind of command (like: " ls / "), then the wire
>> > >> encryption
>> > >> > > is
>> > >> > > > > working
>> > >> > > > > >>> and your server/client communication is secured by
>> > >> ZooKeeper.
>> > >> > > > > >>>
>> > >> > > > > >>> Why you want to run the following command?
>> > >> > > > > >>> addauth ztpasswd zooadmin:<password>
>> > >> > > > > >>>
>> > >> > > > > >>> Do you also want to configure a superDigest user in
>> > >> ZooKeeper?
>> > >> > > > > Please
>> > >> > > > > >>> note
>> > >> > > > > >>> that this command is independent from SSL. If you
>> need
>> > to
>> > >> > > create
>> > >> > > > a
>> > >> > > > > >>> username-password pair for digest authentication then
>> > >> please
>> > >> > > use
>> > >> > > > > the
>> > >> > > > > >>> command in the following way:
>> > >> > > > > >>> addauth digest zooadmin:yourSuperSecretPassword
>> > >> > > > > >>>
>> > >> > > > > >>> Kind regards,
>> > >> > > > > >>> Mate
>> > >> > > > > >>>
>> > >> > > > > >>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <
>> > >> > > > > kuldeep.singh08@gmail.com>
>> > >> > > > > >>> wrote:
>> > >> > > > > >>>
>> > >> > > > > >>> > 1. sh zkCli.sh --config /etc/zookeeper -server
>> > >> localhost:2281
>> > >> > > > > >>> >
>> > >> > > > > >>> > 2. addauth ztpasswd zooadmin:<password>
>> > >> > > > > >>> >
>> > >> > > > > >>> >
>> > >> > > > > >>> > Thanks,
>> > >> > > > > >>> > ---------------------
>> > >> > > > > >>> > Kuldeep Singh Budania
>> > >> > > > > >>> >
>> > >> > > > > >>> >
>> > >> > > > > >>> >
>> > >> > > > > >>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
>> > >> > > > > >>> kuldeep.singh08@gmail.com>
>> > >> > > > > >>> > wrote:
>> > >> > > > > >>> >
>> > >> > > > > >>> > > Hi Team,
>> > >> > > > > >>> > >
>> > >> > > > > >>> > > Any update on this?
>> > >> > > > > >>> > >
>> > >> > > > > >>> > > Thanks,
>> > >> > > > > >>> > > ---------------------
>> > >> > > > > >>> > > Kuldeep Singh Budania
>> > >> > > > > >>> > >
>> > >> > > > > >>> > >
>> > >> > > > > >>> > >
>> > >> > > > > >>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
>> > >> > > > > >>> kuldeep.singh08@gmail.com>
>> > >> > > > > >>> > > wrote:
>> > >> > > > > >>> > >
>> > >> > > > > >>> > >> Sorry this is my bad, there were server setting
>> > like
>> > >> below
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >> export SERVER_JVMFLAGS="
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >>
>> > >> > > > > >>>
>> > >> > > > >
>> > >>
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> > >> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
>> > >> > > > > >>> > >>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> > >> > > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >> export CLIENT_JVMFLAGS="
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >>
>> > >> > > > > >>>
>> > >> > > > >
>> > >>
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> > >> > > > > >>> > >> -Dzookeeper.client.secure=true
>> > >> > > > > >>> > >>
>> > >> > > > > >>>
>> > >> > > > >
>> > >>
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> > >> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
>> > >> > > > > >>> > >>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> > >> > > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >> I want to have SSL between client to server
>> > >> communication
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >> I am already following the same link which you
>> have
>> > >> shared
>> > >> > > > > with me
>> > >> > > > > >>> but
>> > >> > > > > >>> > >> that is not working.
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >> Zoo.cfg
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >> secureClientPort=2281
>> > >> > > > > >>> > >> initLimit=10
>> > >> > > > > >>> > >> syncLimit=5
>> > >> > > > > >>> > >> dataDir=/var/lib/zookeeper/data
>> > >> > > > > >>> > >> tickTime=2000
>> > >> > > > > >>> > >> autopurge.snapRetainCount=3
>> > >> > > > > >>> > >> autopurge.purgeInterval=1
>> > >> > > > > >>> > >> admin.enableServer=false
>> > >> > > > > >>> > >> standaloneEnabled=false
>> > >> > > > > >>> > >> jute.maxbuffer=2147483648
>> > >> > > > > >>> > >>
>> > >> > > > >
>> > >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > >> > > > > >>> > >> server.1=host1_priv:10288:10388
>> > >> > > > > >>> > >> server.2=host2_priv:10288:10388
>> > >> > > > > >>> > >> server.3=host3_priv:10288:10388
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >> command to connect using zkcli
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >> 1. zkcli zoo.cfg localhost:2281
>> > >> > > > > >>> > >> 2. addauth ztpasswd usernaem:password
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >> after second step we are getting below error
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >> WatchedEvent state:AuthFailed type:None
>> path:null
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 -
>> WARN
>> > >> > > > > >>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] -
>> No
>> > >> > > > > authentication
>> > >> > > > > >>> > provider
>> > >> > > > > >>> > >> for scheme: ztpasswd has x509 ip digest*
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >> Thanks,
>> > >> > > > > >>> > >> ---------------------
>> > >> > > > > >>> > >> Kuldeep Singh Budania
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté
>> <
>> > >> > > > > >>> > >> szalay.beko.mate@gmail.com> wrote:
>> > >> > > > > >>> > >>
>> > >> > > > > >>> > >>> > No authentication provider for scheme:
>> ztpasswd
>> > >> has
>> > >> > > x509
>> > >> > > > > ip
>> > >> > > > > >>> digest*
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> > >>> This suggest you have some configuration
>> error...
>> > >> Where
>> > >> > > did
>> > >> > > > > you
>> > >> > > > > >>> use the
>> > >> > > > > >>> > >>> "ztpasswd" string in your configs / commands?
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő
>> Máté <
>> > >> > > > > >>> > >>> szalay.beko.mate@gmail.com>
>> > >> > > > > >>> > >>> wrote:
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> > >>> > > My ZK server is up and running in secure
>> mode
>> > >> > > > > >>> > >>> >
>> > >> > > > > >>> > >>> > What is your goal? You want to setup
>> > >> client-server SSL
>> > >> > > > > >>> connection?
>> > >> > > > > >>> > >>> >
>> > >> > > > > >>> > >>> > see:
>> > >> > > > > >>> > >>> >
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
>> > >> > > > > >>> > >>> >
>> > >> > > > > >>> > >>> > (or you want to have both SSL and SASL
>> enabled?)
>> > >> > > > > >>> > >>> >
>> > >> > > > > >>> > >>> > Anyway, please remove the following line from
>> > the
>> > >> > > > > >>> SERVER_JVMFLAGS:
>> > >> > > > > >>> > >>> >
>> > >> > > > > >>> >
>> > >> > > > >
>> > >>
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> > >> > > > > >>> > >>> > This is a configuration that makes sense only
>> > for
>> > >> the
>> > >> > > > > ZooKeeper
>> > >> > > > > >>> > client,
>> > >> > > > > >>> > >>> > not for the server. For the server, use the
>> > >> following:
>> > >> > > > > >>> > >>> >
>> > >> > > > > >>> > >>> >
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > >> > > > > >>> > >>> >
>> > >> > > > > >>> > >>> > If it doesn't solve the issue, then can you
>> > >> please send
>> > >> > > > > your
>> > >> > > > > >>> zoo.cfg
>> > >> > > > > >>> > >>> file?
>> > >> > > > > >>> > >>> > Also can you please send the zkCli command
>> you
>> > >> execute?
>> > >> > > > > (you
>> > >> > > > > >>> need to
>> > >> > > > > >>> > >>> > connect to the secure ZooKeeper port, unless
>> > >> > > > > portUnification is
>> > >> > > > > >>> > >>> enabled)
>> > >> > > > > >>> > >>> >
>> > >> > > > > >>> > >>> > Kind regards,
>> > >> > > > > >>> > >>> > Mate
>> > >> > > > > >>> > >>> >
>> > >> > > > > >>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh
>> <
>> > >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
>> > >> > > > > >>> > >>> > wrote:
>> > >> > > > > >>> > >>> >
>> > >> > > > > >>> > >>> >> Hi,
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >> we have done below changes in java.env file
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >> export SERVER_JVMFLAGS="
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>>
>> > >> > > > >
>> > >>
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > >>
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> > >> > > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> > >> > > > > >>> > >>> >>
>> -Dzookeeper.ssl.trustStore.password=testpass"
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >> export CLIENT_JVMFLAGS="
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>>
>> > >> > > > >
>> > >>
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> > >> > > > > >>> > >>> >> -Dzookeeper.client.secure=true
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > >>
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> > >> > > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> > >> > > > > >>> > >>> >>
>> -Dzookeeper.ssl.trustStore.password=testpass"
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >> I have started the ZK server and it is up
>> > >> without any
>> > >> > > > > issue.
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >> But now when I login to ZkCli then it gives
>> the
>> > >> below
>> > >> > > > > error.
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >> WatchedEvent state:AuthFailed type:None
>> > path:null
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 -
>> > WARN
>> > >> > > > > >>> > >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
>> -
>> > >> No
>> > >> > > > > >>> authentication
>> > >> > > > > >>> > >>> provider
>> > >> > > > > >>> > >>> >> for scheme: ztpasswd has x509 ip digest*
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >> Please help me on this issue
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >> Thanks,
>> > >> > > > > >>> > >>> >> ---------------------
>> > >> > > > > >>> > >>> >> Kuldeep Singh Budania
>> > >> > > > > >>> > >>> >> Software Architect
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep
>> singh <
>> > >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
>> > >> > > > > >>> > >>> >> wrote:
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >> > Hi,
>> > >> > > > > >>> > >>> >> >
>> > >> > > > > >>> > >>> >> > My ZK server is up and running in secure
>> > >> mode, But
>> > >> > > > > When I am
>> > >> > > > > >>> > >>> trying to
>> > >> > > > > >>> > >>> >> > connect to the ZK server using ZKCli, it
>> > gives
>> > >> the
>> > >> > > > below
>> > >> > > > > >>> error.
>> > >> > > > > >>> > >>> >> >
>> > >> > > > > >>> > >>> >> > WatchedEvent state:AuthFailed type:None
>> > >> path:null
>> > >> > > > > >>> > >>> >> >
>> > >> > > > > >>> > >>> >> >
>> > >> > > > > >>> > >>> >> > Zookeeper logs :- *2020-07-01
>> 07:38:09,342 -
>> > >> WARN
>> > >> > > > > >>> > >>> >> >
>> [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
>> > >> - No
>> > >> > > > > >>> authentication
>> > >> > > > > >>> > >>> >> provider
>> > >> > > > > >>> > >>> >> > for scheme: ztpasswd has x509 ip digest*
>> > >> > > > > >>> > >>> >> >
>> > >> > > > > >>> > >>> >> > Can someone please help me on this issue.
>> we
>> > >> are
>> > >> > > using
>> > >> > > > > the
>> > >> > > > > >>> 3.5.6
>> > >> > > > > >>> > >>> >> version.
>> > >> > > > > >>> > >>> >> >
>> > >> > > > > >>> > >>> >> > I appreciate if I will get a response as
>> soon
>> > >> as
>> > >> > > > > possible, as
>> > >> > > > > >>> I am
>> > >> > > > > >>> > >>> stuck
>> > >> > > > > >>> > >>> >> > at this point.
>> > >> > > > > >>> > >>> >> >
>> > >> > > > > >>> > >>> >> > Thanks,
>> > >> > > > > >>> > >>> >> > ---------------------
>> > >> > > > > >>> > >>> >> > Kuldeep Singh Budania
>> > >> > > > > >>> > >>> >> > Software Architect
>> > >> > > > > >>> > >>> >> >
>> > >> > > > > >>> > >>> >> >
>> > >> > > > > >>> > >>> >> >
>> > >> > > > > >>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico
>> > >> Olivelli -
>> > >> > > > > Diennea
>> > >> > > > > >>> > >>> >> > <en...@diennea.com.invalid>
>> wrote:
>> > >> > > > > >>> > >>> >> >
>> > >> > > > > >>> > >>> >> >> I mean in zoo.cfg
>> > >> > > > > >>> > >>> >> >> Not as a system property
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> Enrico
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico
>> Olivelli -
>> > >> > > > Diennea" <
>> > >> > > > > >>> > >>> >> >> enrico.olivelli@diennea.com.INVALID> ha
>> > >> scritto:
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> Hi
>> > >> > > > > >>> > >>> >> >> You have to enable Netty on the
>> server
>> > >> side
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> Something like:
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> Hope that helps
>> > >> > > > > >>> > >>> >> >> Enrico
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep
>> > singh"
>> > >> <
>> > >> > > > > >>> > >>> >> kuldeep.singh08@gmail.com>
>> > >> > > > > >>> > >>> >> >> ha scritto:
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> Hi,
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> I got below error while setting
>> SSL
>> > >> > > > properties
>> > >> > > > > in
>> > >> > > > > >>> > zkEnv.sh
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> ==========================================================================================
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
>> > >> > > > > >>> > [main:QuorumPeerConfig@133]
>> > >> > > > > >>> > >>> -
>> > >> > > > > >>> > >>> >> >> Reading
>> > >> > > > > >>> > >>> >> >> configuration from:
>> > >> /etc/zookeeper/zoo.cfg
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
>> > >> > > > > >>> > [main:QuorumPeerConfig@385]
>> > >> > > > > >>> > >>> -
>> > >> > > > > >>> > >>> >> >> clientPortAddress is
>> > >> 0.0.0.0/0.0.0.0:10181
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
>> > >> > > > > >>> > [main:QuorumPeerConfig@399]
>> > >> > > > > >>> > >>> -
>> > >> > > > > >>> > >>> >> >> secureClientPortAddress is
>> > >> > > > > 0.0.0.0/0.0.0.0:2281
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,878 - INFO
>> > >> > > > > [main:X509Util@79] -
>> > >> > > > > >>> > >>> Setting
>> > >> > > > > >>> > >>> >> -D
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > jdk.tls.rejectClientInitiatedRenegotiation=true to
>> > >> > > > > >>> > disable
>> > >> > > > > >>> > >>> >> >> client-initiated
>> > >> > > > > >>> > >>> >> >> TLS renegotiation
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
>> > >> > > > > >>> > >>> [main:DatadirCleanupManager@78]
>> > >> > > > > >>> > >>> >> -
>> > >> > > > > >>> > >>> >> >> autopurge.snapRetainCount set to
>> 3
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
>> > >> > > > > >>> > >>> [main:DatadirCleanupManager@79]
>> > >> > > > > >>> > >>> >> -
>> > >> > > > > >>> > >>> >> >> autopurge.purgeInterval set to 1
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,898 - INFO [
>> > >> > > > > >>> > >>> >> >>
>> > >> > > PurgeTask:DatadirCleanupManager$PurgeTask@138
>> > >> > > > ]
>> > >> > > > > -
>> > >> > > > > >>> Purge
>> > >> > > > > >>> > >>> task
>> > >> > > > > >>> > >>> >> >> started.
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,899 - INFO
>> > >> > > > > [main:ManagedUtil@46]
>> > >> > > > > >>> -
>> > >> > > > > >>> > >>> Log4j
>> > >> > > > > >>> > >>> >> >> found with
>> > >> > > > > >>> > >>> >> >> jmx enabled.
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
>> > >> > > > > >>> > >>> [PurgeTask:FileTxnSnapLog@103]
>> > >> > > > > >>> > >>> >> -
>> > >> > > > > >>> > >>> >> >> zookeeper.snapshot.trust.empty :
>> > false
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,910 - INFO [
>> > >> > > > > >>> > >>> >> >>
>> > >> > > PurgeTask:DatadirCleanupManager$PurgeTask@144
>> > >> > > > ]
>> > >> > > > > -
>> > >> > > > > >>> Purge
>> > >> > > > > >>> > >>> task
>> > >> > > > > >>> > >>> >> >> completed.
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
>> > >> > > > > >>> [main:QuorumPeerMain@141
>> > >> > > > > >>> > ]
>> > >> > > > > >>> > >>> -
>> > >> > > > > >>> > >>> >> >> Starting quorum
>> > >> > > > > >>> > >>> >> >> peer
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
>> > >> > > > > >>> > [main:ServerCnxnFactory@135]
>> > >> > > > > >>> > >>> -
>> > >> > > > > >>> > >>> >> >> Using
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
>> > >> > > > > >>> > server
>> > >> > > > > >>> > >>> >> >> connection
>> > >> > > > > >>> > >>> >> >> factory
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
>> > >> > > > > >>> > >>> [main:NIOServerCnxnFactory@673]
>> > >> > > > > >>> > >>> >> -
>> > >> > > > > >>> > >>> >> >> Configuring NIO connection
>> handler
>> > >> with 10s
>> > >> > > > > >>> sessionless
>> > >> > > > > >>> > >>> >> >> connection timeout,
>> > >> > > > > >>> > >>> >> >> 2 selector thread(s), 16 worker
>> > >> threads,
>> > >> > > and
>> > >> > > > > 64 kB
>> > >> > > > > >>> direct
>> > >> > > > > >>> > >>> >> buffers.
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
>> > >> > > > > >>> > >>> [main:NIOServerCnxnFactory@686
>> > >> > > > > >>> > >>> >> ]
>> > >> > > > > >>> > >>> >> >> - binding
>> > >> > > > > >>> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
>> > >> > > > > >>> > [main:ServerCnxnFactory@135]
>> > >> > > > > >>> > >>> -
>> > >> > > > > >>> > >>> >> >> Using
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
>> > >> > > > > >>> > server
>> > >> > > > > >>> > >>> >> >> connection
>> > >> > > > > >>> > >>> >> >> factory
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
>> > >> > > > > >>> [main:QuorumPeerMain@101
>> > >> > > > > >>> > ]
>> > >> > > > > >>> > >>> -
>> > >> > > > > >>> > >>> >> >> Unexpected
>> > >> > > > > >>> > >>> >> >> exception, exiting abnormally
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> java.lang.UnsupportedOperationException:
>> > >> > > SSL
>> > >> > > > > isn't
>> > >> > > > > >>> > >>> supported in
>> > >> > > > > >>> > >>> >> >> NIOServerCnxn
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> I have set the following
>> properties
>> > in
>> > >> > > > > >>> SERVER_JVMFLAGS in
>> > >> > > > > >>> > >>> >> >> zkEnv.sh file :
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> Thanks,
>> > >> > > > > >>> > >>> >> >> ---------------------
>> > >> > > > > >>> > >>> >> >> Kuldeep Singh Budania
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM
>> > Jordan
>> > >> > > > > Zimmerman <
>> > >> > > > > >>> > >>> >> >> jordan@jordanzimmerman.com>
>> > >> > > > > >>> > >>> >> >> wrote:
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> > It's the same as the normal
>> > >> ZooKeeper
>> > >> > > > client:
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> > >> > > > > >>> > >>> >> >> > <
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> > >> > > > > >>> > >>> >> >> > >
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >> > -Jordan
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >> > > On Jun 22, 2020, at 5:50 AM,
>> > >> kuldeep
>> > >> > > > singh
>> > >> > > > > <
>> > >> > > > > >>> > >>> >> >> kuldeep.singh08@gmail.com>
>> > >> > > > > >>> > >>> >> >> > wrote:
>> > >> > > > > >>> > >>> >> >> > >
>> > >> > > > > >>> > >>> >> >> > > Hi Team,
>> > >> > > > > >>> > >>> >> >> > > How we will do secure
>> > >> communication
>> > >> > > > > between the
>> > >> > > > > >>> > Curator
>> > >> > > > > >>> > >>> >> >> framework and
>> > >> > > > > >>> > >>> >> >> > > zookeeper 3.5.6 ?
>> > >> > > > > >>> > >>> >> >> > > I didn't get any solution
>> right
>> > >> now.
>> > >> > > > > >>> > >>> >> >> > > I appreciate it if someone
>> could
>> > >> help
>> > >> > > me
>> > >> > > > > with the
>> > >> > > > > >>> > same.
>> > >> > > > > >>> > >>> >> >> > >
>> > >> > > > > >>> > >>> >> >> > > Thanks,
>> > >> > > > > >>> > >>> >> >> > > ---------------------
>> > >> > > > > >>> > >>> >> >> > > Kuldeep Singh Budania
>> > >> > > > > >>> > >>> >> >> > > Software Architect
>> > >> > > > > >>> > >>> >> >> > >
>> > >> > > > > >>> > >>> >> >> > >
>> > >> > > > > >>> > >>> >> >> > > On Fri, Apr 17, 2020 at 4:53
>> PM
>> > >> > > > > Szalay-Bekő Máté
>> > >> > > > > >>> <
>> > >> > > > > >>> > >>> >> >> > szalay.beko.mate@gmail.com>
>> > >> > > > > >>> > >>> >> >> > > wrote:
>> > >> > > > > >>> > >>> >> >> > >
>> > >> > > > > >>> > >>> >> >> > >> Hello Kuldeep,
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> > >> did you download the source
>> > from
>> > >> the
>> > >> > > > > ZooKeeper
>> > >> > > > > >>> > >>> webpage, or
>> > >> > > > > >>> > >>> >> >> checked out
>> > >> > > > > >>> > >>> >> >> > from
>> > >> > > > > >>> > >>> >> >> > >> git?
>> > >> > > > > >>> > >>> >> >> > >> Anyway, the following
>> commands
>> > >> should
>> > >> > > > > work:
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> > >> wget
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
>> > >> > > > > >>> > >>> >> >> > >> tar xzvf
>> > >> > > ./apache-zookeeper-3.5.7.tar.gz
>> > >> > > > > >>> > >>> >> >> > >> cd apache-zookeeper-3.5.7
>> > >> > > > > >>> > >>> >> >> > >> mvn clean install
>> -DskipTests
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> > >> I tested it with OpenJDK
>> 8u424
>> > >> and
>> > >> > > maven
>> > >> > > > > 3.6.0.
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> > >> Kind regards,
>> > >> > > > > >>> > >>> >> >> > >> Mate
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> > >> On Fri, Apr 17, 2020 at
>> 12:51
>> > PM
>> > >> > > kuldeep
>> > >> > > > > singh <
>> > >> > > > > >>> > >>> >> >> > kuldeep.singh08@gmail.com>
>> > >> > > > > >>> > >>> >> >> > >> wrote:
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> > >>> Hi All,
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>> I have download the
>> zookeeper
>> > >> source
>> > >> > > > > code and
>> > >> > > > > >>> run
>> > >> > > > > >>> > >>> the mvn
>> > >> > > > > >>> > >>> >> >> command for
>> > >> > > > > >>> > >>> >> >> > >>> packaging but get problem
>> on
>> > >> > > > > "zookeeper-server"
>> > >> > > > > >>> > >>> >> directory.
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>> *command :- mvn clean
>> package*
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>> [ERROR] Failed to execute
>> goal
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> > >> > > > > >>> > >>> >> >> > >>> (default-compile) on
>> project
>> > >> > > zookeeper:
>> > >> > > > > Fatal
>> > >> > > > > >>> error
>> > >> > > > > >>> > >>> >> >> compiling:
>> > >> > > > > >>> > >>> >> >> > >>>
>> java.lang.NullPointerException
>> > >> ->
>> > >> > > [Help
>> > >> > > > > 1]
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>>
>> > >> org.apache.maven.lifecycle.LifecycleExecutionException:
>> > >> > > > > >>> > >>> >> >> Failed to
>> > >> > > > > >>> > >>> >> >> > execute
>> > >> > > > > >>> > >>> >> >> > >>> goal
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> > >> > > > > >>> > >>> >> >> > >>> (default-compile) on
>> project
>> > >> > > zookeeper:
>> > >> > > > > Fatal
>> > >> > > > > >>> error
>> > >> > > > > >>> > >>> >> >> compiling
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >>
>> > >> > > > >
>> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>> > >> > > > > Method)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >>
>> > java.lang.reflect.Method.invoke(Method.java:498)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > >
>> > >>
>> >
>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>> > >> > > > > >>> > >>> >> >> > >>> Caused by:
>> > >> > > > > >>> > >>> >>
>> org.apache.maven.plugin.MojoExecutionException:
>> > >> > > > > >>> > >>> >> >> Fatal error
>> > >> > > > > >>> > >>> >> >> > >>> compiling
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>> > >> > > > > >>> > >>> >> >> > >>> ... 19 more
>> > >> > > > > >>> > >>> >> >> > >>> Caused by:
>> > >> > > > > >>> > >>> >>
>> org.codehaus.plexus.compiler.CompilerException:
>> > >> > > > > >>> > >>> >> >> > >>>
>> java.lang.NullPointerException
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
>> > >> > > > > >>> > >>> >> >> > >>> ... 22 more
>> > >> > > > > >>> > >>> >> >> > >>> Caused by:
>> > >> > > java.lang.RuntimeException:
>> > >> > > > > >>> > >>> >> >> java.lang.NullPointerException
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > com.sun.tools.javac.main.Main.compile(Main.java:559)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>>
>> > >> > > > >
>> > >> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
>> > >> > > > > >>> > >>> >> >> > >>> ... 24 more
>> > >> > > > > >>> > >>> >> >> > >>> Caused by:
>> > >> > > > java.lang.NullPointerException
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >>
>> > >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > com.sun.tools.doclint.Checker.scan(Checker.java:144)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>>
>> > >> > > > >
>> > >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>>
>> > >> > > > >
>> > >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>>
>> > >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > >> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > >> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>>
>> > >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > >> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > >
>> > >>
>> >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > >
>> > >>
>> >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>>
>> > >> > > > >
>> > >>
>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>>
>> > >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>>
>> > >> > > com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>>
>> > >> > > > >
>> > >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>>
>> > >> > > > >
>> > >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>>
>> > >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > >
>> > >>
>> >
>> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>>
>> > >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>>
>> > >> > > > >
>> > >>
>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>>
>> > >> > > > >
>> > >> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>>
>> > >> > > > >
>> > >> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
>> > >> > > > > >>> > >>> >> >> > >>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > com.sun.tools.javac.main.Main.compile(Main.java:523)
>> > >> > > > > >>> > >>> >> >> > >>> ... 27 more
>> > >> > > > > >>> > >>> >> >> > >>> [ERROR]
>> > >> > > > > >>> > >>> >> >> > >>> [ERROR] Re-run Maven using
>> the
>> > >> -X
>> > >> > > > switch
>> > >> > > > > to
>> > >> > > > > >>> enable
>> > >> > > > > >>> > >>> full
>> > >> > > > > >>> > >>> >> >> debug logging.
>> > >> > > > > >>> > >>> >> >> > >>> [ERROR]
>> > >> > > > > >>> > >>> >> >> > >>> [ERROR] For more
>> information
>> > >> about
>> > >> > > the
>> > >> > > > > errors
>> > >> > > > > >>> and
>> > >> > > > > >>> > >>> >> possible
>> > >> > > > > >>> > >>> >> >> solutions,
>> > >> > > > > >>> > >>> >> >> > >>> please read the following
>> > >> articles:
>> > >> > > > > >>> > >>> >> >> > >>> [ERROR] [Help 1]
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > >
>> > >>
>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>> Can someone help me on this
>> > >> issue?
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>> Thanks,
>> > >> > > > > >>> > >>> >> >> > >>> ---------------------
>> > >> > > > > >>> > >>> >> >> > >>> Kuldeep Singh Budania
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at
>> 5:57 PM
>> > >> > > > > Szalay-Bekő
>> > >> > > > > >>> Máté <
>> > >> > > > > >>> > >>> >> >> > >>> szalay.beko.mate@gmail.com
>> >
>> > >> > > > > >>> > >>> >> >> > >>> wrote:
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>>> these exceptions can mean
>> > many
>> > >> > > > > things... I
>> > >> > > > > >>> think
>> > >> > > > > >>> > >>> this
>> > >> > > > > >>> > >>> >> can
>> > >> > > > > >>> > >>> >> >> be even
>> > >> > > > > >>> > >>> >> >> > >> normal
>> > >> > > > > >>> > >>> >> >> > >>>> duding rolling restart (as
>> > some
>> > >> > > > > connections
>> > >> > > > > >>> get
>> > >> > > > > >>> > >>> broken
>> > >> > > > > >>> > >>> >> in
>> > >> > > > > >>> > >>> >> >> this case)
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>> However, I saw cases
>> already
>> > >> when
>> > >> > > > > exceptions
>> > >> > > > > >>> like
>> > >> > > > > >>> > >>> these
>> > >> > > > > >>> > >>> >> >> killed
>> > >> > > > > >>> > >>> >> >> > receiver
>> > >> > > > > >>> > >>> >> >> > >>> or
>> > >> > > > > >>> > >>> >> >> > >>>> sender threads in
>> > >> QuorumCnxManager /
>> > >> > > > > Leader
>> > >> > > > > >>> > >>> Election in
>> > >> > > > > >>> > >>> >> >> such a way
>> > >> > > > > >>> > >>> >> >> > that
>> > >> > > > > >>> > >>> >> >> > >>>> they were not able to
>> > recover,
>> > >> so
>> > >> > > the
>> > >> > > > > node was
>> > >> > > > > >>> > >>> unable to
>> > >> > > > > >>> > >>> >> >> connect to
>> > >> > > > > >>> > >>> >> >> > any
>> > >> > > > > >>> > >>> >> >> > >>>> quorum until restart. I
>> > >> remember
>> > >> > > > seeing
>> > >> > > > > this
>> > >> > > > > >>> in
>> > >> > > > > >>> > 3.4
>> > >> > > > > >>> > >>> too.
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>> Do you see these
>> exceptions
>> > in
>> > >> the
>> > >> > > > > second
>> > >> > > > > >>> server
>> > >> > > > > >>> > >>> (the
>> > >> > > > > >>> > >>> >> one
>> > >> > > > > >>> > >>> >> >> which you
>> > >> > > > > >>> > >>> >> >> > >> just
>> > >> > > > > >>> > >>> >> >> > >>>> upgraded in step 3)?
>> > >> > > > > >>> > >>> >> >> > >>>> Is this issue
>> reproducible?
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>> What is the tickTime and
>> > >> initLimit
>> > >> > > you
>> > >> > > > > use?
>> > >> > > > > >>> Maybe
>> > >> > > > > >>> > >>> the
>> > >> > > > > >>> > >>> >> >> server just
>> > >> > > > > >>> > >>> >> >> > >> require
>> > >> > > > > >>> > >>> >> >> > >>>> more time to sync?
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>> I would need more logs to
>> > >> really see
>> > >> > > > > what
>> > >> > > > > >>> > happened.
>> > >> > > > > >>> > >>> Can
>> > >> > > > > >>> > >>> >> >> you create a
>> > >> > > > > >>> > >>> >> >> > >> Jira
>> > >> > > > > >>> > >>> >> >> > >>>> issue and upload the logs
>> and
>> > >> also
>> > >> > > the
>> > >> > > > > >>> ZooKeeper
>> > >> > > > > >>> > >>> >> configs?
>> > >> > > > > >>> > >>> >> >> I am happy
>> > >> > > > > >>> > >>> >> >> > to
>> > >> > > > > >>> > >>> >> >> > >>>> take a closer look.
>> > >> > > > > >>> > >>> >> >> > >>>> (if you need to re-run the
>> > >> test to
>> > >> > > > > collect the
>> > >> > > > > >>> > logs,
>> > >> > > > > >>> > >>> >> then
>> > >> > > > > >>> > >>> >> >> enabling
>> > >> > > > > >>> > >>> >> >> > >> DEBUG
>> > >> > > > > >>> > >>> >> >> > >>>> logs would be great. The
>> INFO
>> > >> level
>> > >> > > > > logs are
>> > >> > > > > >>> > usually
>> > >> > > > > >>> > >>> >> >> enough for these
>> > >> > > > > >>> > >>> >> >> > >>>> problems, but one can
>> never
>> > >> know...)
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>> Kind regards,
>> > >> > > > > >>> > >>> >> >> > >>>> Mate
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at
>> 10:05
>> > AM
>> > >> > > > kuldeep
>> > >> > > > > singh
>> > >> > > > > >>> <
>> > >> > > > > >>> > >>> >> >> > >> kuldeep.singh08@gmail.com
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>> wrote:
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> Hi Team,
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> I have done some POC on
>> > >> rolling
>> > >> > > > > upgrade and
>> > >> > > > > >>> found
>> > >> > > > > >>> > >>> below
>> > >> > > > > >>> > >>> >> >> result.
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> 1. On 1st node upgrade
>> > >> zookeeper
>> > >> > > .
>> > >> > > > > Traffic
>> > >> > > > > >>> was
>> > >> > > > > >>> > >>> >> running
>> > >> > > > > >>> > >>> >> >> fine
>> > >> > > > > >>> > >>> >> >> > >> because
>> > >> > > > > >>> > >>> >> >> > >>> 2
>> > >> > > > > >>> > >>> >> >> > >>>>> nodes are already on
>> old
>> > >> > > zookeeper.
>> > >> > > > > >>> > >>> >> >> > >>>>> 2. On 1st node upgrade
>> our
>> > >> > > > > application and
>> > >> > > > > >>> > didn’t
>> > >> > > > > >>> > >>> >> find
>> > >> > > > > >>> > >>> >> >> any issue
>> > >> > > > > >>> > >>> >> >> > >>>>> 3. On 2nd node upgrade
>> > >> zookeeper
>> > >> > > > but
>> > >> > > > > got
>> > >> > > > > >>> below
>> > >> > > > > >>> > >>> error
>> > >> > > > > >>> > >>> >> >> and zookeeper
>> > >> > > > > >>> > >>> >> >> > >>> is
>> > >> > > > > >>> > >>> >> >> > >>>>> not taking any requests
>> > >> > > > > >>> > >>> >> >> > >>>>> 4.
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> at
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,587 -
>> > WARN
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
>> > >> > > > > >>> -
>> > >> > > > > >>> > >>> >> >> Interrupting
>> > >> > > > > >>> > >>> >> >> > >>> SendWorker
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 -
>> > >> ERROR
>> > >> > > > > >>> [LearnerHandler-/
>> > >> > > > > >>> > >>> >> >> 192.168.44.73:33754
>> > >> > > > > >>> > >>> >> >> > >>>>> :LearnerHandler@562] -
>> > >> Unexpected
>> > >> > > > > exception
>> > >> > > > > >>> > >>> causing
>> > >> > > > > >>> > >>> >> >> shutdown while
>> > >> > > > > >>> > >>> >> >> > >>> sock
>> > >> > > > > >>> > >>> >> >> > >>>>> still open
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> at
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> at
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>>
>> > >> > > > >
>> > >>
>> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> at
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> at
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> at
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> >
>> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 -
>> > WARN
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > [SendWorker:1:QuorumCnxManager$SendWorker@679]
>> > >> > > > > >>> -
>> > >> > > > > >>> > >>> >> >> Interrupted while
>> > >> > > > > >>> > >>> >> >> > >>>> waiting
>> > >> > > > > >>> > >>> >> >> > >>>>> for message on queue
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> Please let me know is
>> this
>> > the
>> > >> > > known
>> > >> > > > > issue or
>> > >> > > > > >>> > this
>> > >> > > > > >>> > >>> is
>> > >> > > > > >>> > >>> >> >> different issue
>> > >> > > > > >>> > >>> >> >> > >>>> which
>> > >> > > > > >>> > >>> >> >> > >>>>> is mention in Apache
>> > zookeeper
>> > >> > > > > documentation
>> > >> > > > > >>> when
>> > >> > > > > >>> > >>> >> >> upgrading from
>> > >> > > > > >>> > >>> >> >> > >> 3.4.5
>> > >> > > > > >>> > >>> >> >> > >>> to
>> > >> > > > > >>> > >>> >> >> > >>>>> 3.5.6
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> Thanks,
>> > >> > > > > >>> > >>> >> >> > >>>>> ---------------------
>> > >> > > > > >>> > >>> >> >> > >>>>> Kuldeep Singh Budania
>> > >> > > > > >>> > >>> >> >> > >>>>> Software Architect
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at
>> 9:06
>> > >> AM
>> > >> > > > > Alexander
>> > >> > > > > >>> Shraer
>> > >> > > > > >>> > <
>> > >> > > > > >>> > >>> >> >> shralex@gmail.com>
>> > >> > > > > >>> > >>> >> >> > >>>>> wrote:
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>> +1 to what Mate said (I
>> > >> wrote the
>> > >> > > > > quoted
>> > >> > > > > >>> > >>> >> instructions).
>> > >> > > > > >>> > >>> >> >> > >>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at
>> > 7:03
>> > >> AM
>> > >> > > > > Szalay-Bekő
>> > >> > > > > >>> > Máté <
>> > >> > > > > >>> > >>> >> >> > >>>>>>
>> szalay.beko.mate@gmail.com
>> > >
>> > >> > > > > >>> > >>> >> >> > >>>>>> wrote:
>> > >> > > > > >>> > >>> >> >> > >>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>> Hi Kuldeep,
>> > >> > > > > >>> > >>> >> >> > >>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>> I just want to provide
>> you
>> > >> some
>> > >> > > > > background
>> > >> > > > > >>> info
>> > >> > > > > >>> > >>> about
>> > >> > > > > >>> > >>> >> >> our
>> > >> > > > > >>> > >>> >> >> > >>>>> documentation.
>> > >> > > > > >>> > >>> >> >> > >>>>>>> The reason to upgrade
>> to
>> > >> 3.4.6
>> > >> > > > first
>> > >> > > > > is to
>> > >> > > > > >>> > avoid
>> > >> > > > > >>> > >>> the
>> > >> > > > > >>> > >>> >> >> following
>> > >> > > > > >>> > >>> >> >> > >>> error:
>> > >> > > > > >>> > >>> >> >> > >>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> 2013-01-30
>> 11:32:10,663
>> > >> > > [myid:2] -
>> > >> > > > > WARN
>> > >> > > > > >>> > >>> [localhost/
>> > >> > > > > >>> > >>> >> >> > >>> 127.0.0.1:2784
>> > >> > > > > >>> > >>> >> >> > >>>>>>> :QuorumCnxManager@349]
>> -
>> > >> Invalid
>> > >> > > > > server
>> > >> > > > > >>> id:
>> > >> > > > > >>> > >>> -65536
>> > >> > > > > >>> > >>> >> >> > >>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>> This error comes
>> because
>> > of
>> > >> the
>> > >> > > > > protocol
>> > >> > > > > >>> > changes
>> > >> > > > > >>> > >>> >> between
>> > >> > > > > >>> > >>> >> >> > >> ZooKeeper
>> > >> > > > > >>> > >>> >> >> > >>>>> server
>> > >> > > > > >>> > >>> >> >> > >>>>>>> nodes during connection
>> > >> > > initiation
>> > >> > > > > for
>> > >> > > > > >>> leader
>> > >> > > > > >>> > >>> >> election.
>> > >> > > > > >>> > >>> >> >> In
>> > >> > > > > >>> > >>> >> >> > >>> ZooKeeper
>> > >> > > > > >>> > >>> >> >> > >>>>> 3.5
>> > >> > > > > >>> > >>> >> >> > >>>>>> a
>> > >> > > > > >>> > >>> >> >> > >>>>>>> protocol version was
>> > >> introduced
>> > >> > > > (see
>> > >> > > > > >>> > >>> ZOOKEEPER-107)
>> > >> > > > > >>> > >>> >> and
>> > >> > > > > >>> > >>> >> >> since
>> > >> > > > > >>> > >>> >> >> > >> that
>> > >> > > > > >>> > >>> >> >> > >>>> time
>> > >> > > > > >>> > >>> >> >> > >>>>>> the
>> > >> > > > > >>> > >>> >> >> > >>>>>>> fist long value sent in
>> > the
>> > >> > > initial
>> > >> > > > > >>> message is
>> > >> > > > > >>> > >>> not
>> > >> > > > > >>> > >>> >> the
>> > >> > > > > >>> > >>> >> >> server ID
>> > >> > > > > >>> > >>> >> >> > >>> but
>> > >> > > > > >>> > >>> >> >> > >>>>> the
>> > >> > > > > >>> > >>> >> >> > >>>>>>> protocol version
>> (-65536).
>> > >> In
>> > >> > > > > ZooKeeper
>> > >> > > > > >>> 3.4.6
>> > >> > > > > >>> > we
>> > >> > > > > >>> > >>> made
>> > >> > > > > >>> > >>> >> >> the old 3.4
>> > >> > > > > >>> > >>> >> >> > >>>>>>> ZooKeepers backward
>> > >> compatible,
>> > >> > > so
>> > >> > > > > they are
>> > >> > > > > >>> > able
>> > >> > > > > >>> > >>> to
>> > >> > > > > >>> > >>> >> >> parse both
>> > >> > > > > >>> > >>> >> >> > >> the
>> > >> > > > > >>> > >>> >> >> > >>>> old
>> > >> > > > > >>> > >>> >> >> > >>>>>> and
>> > >> > > > > >>> > >>> >> >> > >>>>>>> the new protocol format
>> > (see
>> > >> > > > > >>> ZOOKEEPER-1633).
>> > >> > > > > >>> > >>> This
>> > >> > > > > >>> > >>> >> >> issue happens
>> > >> > > > > >>> > >>> >> >> > >>> only
>> > >> > > > > >>> > >>> >> >> > >>>>>> when
>> > >> > > > > >>> > >>> >> >> > >>>>>>> you need to use old
>> > (3.4.0 -
>> > >> > > 3.4.5)
>> > >> > > > > and new
>> > >> > > > > >>> > >>> (3.5.0+)
>> > >> > > > > >>> > >>> >> >> ZooKeeper
>> > >> > > > > >>> > >>> >> >> > >>>> servers
>> > >> > > > > >>> > >>> >> >> > >>>>>>> together in the same
>> > >> cluster.
>> > >> > > > During
>> > >> > > > > a
>> > >> > > > > >>> rolling
>> > >> > > > > >>> > >>> >> upgrade,
>> > >> > > > > >>> > >>> >> >> this is
>> > >> > > > > >>> > >>> >> >> > >>>> usually
>> > >> > > > > >>> > >>> >> >> > >>>>>> the
>> > >> > > > > >>> > >>> >> >> > >>>>>>> case to have old and
>> new
>> > >> > > ZooKeepers
>> > >> > > > > present
>> > >> > > > > >>> > >>> together.
>> > >> > > > > >>> > >>> >> >> > >>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>> The fact that you
>> haven't
>> > >> seen
>> > >> > > any
>> > >> > > > > issues
>> > >> > > > > >>> might
>> > >> > > > > >>> > >>> be
>> > >> > > > > >>> > >>> >> >> caused by the
>> > >> > > > > >>> > >>> >> >> > >>>> order
>> > >> > > > > >>> > >>> >> >> > >>>>> of
>> > >> > > > > >>> > >>> >> >> > >>>>>>> the servers. In
>> ZooKeeper
>> > >> the
>> > >> > > > > connection
>> > >> > > > > >>> > >>> initiation
>> > >> > > > > >>> > >>> >> >> between the
>> > >> > > > > >>> > >>> >> >> > >>>> servers
>> > >> > > > > >>> > >>> >> >> > >>>>>>> during the leader
>> election
>> > >> > > follows
>> > >> > > > a
>> > >> > > > > >>> specific
>> > >> > > > > >>> > >>> rule.
>> > >> > > > > >>> > >>> >> As
>> > >> > > > > >>> > >>> >> >> far as I
>> > >> > > > > >>> > >>> >> >> > >>>>> remember
>> > >> > > > > >>> > >>> >> >> > >>>>>>> always the server with
>> the
>> > >> larger
>> > >> > > > ID
>> > >> > > > > 'wins
>> > >> > > > > >>> the
>> > >> > > > > >>> > >>> >> >> challenge', so it
>> > >> > > > > >>> > >>> >> >> > >> is
>> > >> > > > > >>> > >>> >> >> > >>>>>>> possible, that the old
>> > >> server
>> > >> > > > didn't
>> > >> > > > > need
>> > >> > > > > >>> to
>> > >> > > > > >>> > >>> parse
>> > >> > > > > >>> > >>> >> any
>> > >> > > > > >>> > >>> >> >> initial
>> > >> > > > > >>> > >>> >> >> > >>>> message
>> > >> > > > > >>> > >>> >> >> > >>>>>> (if
>> > >> > > > > >>> > >>> >> >> > >>>>>>> it had the largest ID)
>> and
>> > >> this
>> > >> > > is
>> > >> > > > > why you
>> > >> > > > > >>> > >>> haven't
>> > >> > > > > >>> > >>> >> seen
>> > >> > > > > >>> > >>> >> >> the
>> > >> > > > > >>> > >>> >> >> > >> issue.
>> > >> > > > > >>> > >>> >> >> > >>>> Also
>> > >> > > > > >>> > >>> >> >> > >>>>>>> having 2 nodes up from
>> > the 3
>> > >> > > nodes
>> > >> > > > > cluster
>> > >> > > > > >>> > still
>> > >> > > > > >>> > >>> >> makes
>> > >> > > > > >>> > >>> >> >> the
>> > >> > > > > >>> > >>> >> >> > >> cluster
>> > >> > > > > >>> > >>> >> >> > >>>> work
>> > >> > > > > >>> > >>> >> >> > >>>>>> (so
>> > >> > > > > >>> > >>> >> >> > >>>>>>> you should also check
>> if
>> > >> all the
>> > >> > > > > servers
>> > >> > > > > >>> are
>> > >> > > > > >>> > >>> part of
>> > >> > > > > >>> > >>> >> >> the quorum).
>> > >> > > > > >>> > >>> >> >> > >>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>> I agree with Enrico and
>> > >> Norbert,
>> > >> > > > the
>> > >> > > > > >>> safest and
>> > >> > > > > >>> > >>> most
>> > >> > > > > >>> > >>> >> >> stable way
>> > >> > > > > >>> > >>> >> >> > >> is
>> > >> > > > > >>> > >>> >> >> > >>>>>> upgrade
>> > >> > > > > >>> > >>> >> >> > >>>>>>> first to 3.4.latest,
>> then
>> > >> go to
>> > >> > > > > 3.5.latest.
>> > >> > > > > >>> > >>> Still, if
>> > >> > > > > >>> > >>> >> >> you don't
>> > >> > > > > >>> > >>> >> >> > >> see
>> > >> > > > > >>> > >>> >> >> > >>>>> that
>> > >> > > > > >>> > >>> >> >> > >>>>>>> you would hit this
>> > specific
>> > >> issue
>> > >> > > > > (e.g. no
>> > >> > > > > >>> > >>> "Invalid
>> > >> > > > > >>> > >>> >> >> server id" in
>> > >> > > > > >>> > >>> >> >> > >>> the
>> > >> > > > > >>> > >>> >> >> > >>>>> log
>> > >> > > > > >>> > >>> >> >> > >>>>>>> files), and all the
>> three
>> > >> servers
>> > >> > > > can
>> > >> > > > > >>> handle
>> > >> > > > > >>> > >>> traffic,
>> > >> > > > > >>> > >>> >> >> then maybe
>> > >> > > > > >>> > >>> >> >> > >>> you
>> > >> > > > > >>> > >>> >> >> > >>>>>> don't
>> > >> > > > > >>> > >>> >> >> > >>>>>>> need to upgrade first
>> to
>> > >> > > > 3.4.latest,
>> > >> > > > > it is
>> > >> > > > > >>> your
>> > >> > > > > >>> > >>> >> >> decision.
>> > >> > > > > >>> > >>> >> >> > >>> Definitely
>> > >> > > > > >>> > >>> >> >> > >>>>> you
>> > >> > > > > >>> > >>> >> >> > >>>>>>> should test it first,
>> as
>> > >> > > suggested
>> > >> > > > > by the
>> > >> > > > > >>> > others.
>> > >> > > > > >>> > >>> >> >> > >>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>> Kind regards,
>> > >> > > > > >>> > >>> >> >> > >>>>>>> Mate
>> > >> > > > > >>> > >>> >> >> > >>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at
>> > >> 12:29 PM
>> > >> > > > > Norbert
>> > >> > > > > >>> Kalmar
>> > >> > > > > >>> > >>> >> >> > >>>>>>>
>> > >> <nk...@cloudera.com.invalid>
>> > >> > > > > wrote:
>> > >> > > > > >>> > >>> >> >> > >>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> Hi,
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> That guide is to
>> upgrade
>> > to
>> > >> > > 3.5.0,
>> > >> > > > > which
>> > >> > > > > >>> was
>> > >> > > > > >>> > an
>> > >> > > > > >>> > >>> >> alpha
>> > >> > > > > >>> > >>> >> >> version.
>> > >> > > > > >>> > >>> >> >> > >> A
>> > >> > > > > >>> > >>> >> >> > >>>> lot
>> > >> > > > > >>> > >>> >> >> > >>>>>> has
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> changed for the first
>> > >> stable
>> > >> > > > > release of
>> > >> > > > > >>> 3.5.5
>> > >> > > > > >>> > >>> and
>> > >> > > > > >>> > >>> >> then
>> > >> > > > > >>> > >>> >> >> a few
>> > >> > > > > >>> > >>> >> >> > >>> more,
>> > >> > > > > >>> > >>> >> >> > >>>>> even
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> rolling upgrade issues
>> > >> have been
>> > >> > > > > fixed for
>> > >> > > > > >>> > >>> 3.5.6.
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> This is a more
>> up-to-date
>> > >> guide:
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> >
>> > >> > > > >
>> > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> If you have done your
>> > >> testing
>> > >> > > > (with
>> > >> > > > > prod
>> > >> > > > > >>> > >>> snapshot!),
>> > >> > > > > >>> > >>> >> >> then you
>> > >> > > > > >>> > >>> >> >> > >> can
>> > >> > > > > >>> > >>> >> >> > >>>>> skip
>> > >> > > > > >>> > >>> >> >> > >>>>>>> 3.4
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> latest upgrade, but
>> keep
>> > >> in mind
>> > >> > > > we
>> > >> > > > > do our
>> > >> > > > > >>> > >>> >> >> recommendations for
>> > >> > > > > >>> > >>> >> >> > >> a
>> > >> > > > > >>> > >>> >> >> > >>>>>> reason.
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> There were issues
>> > reported
>> > >> > > and/or
>> > >> > > > > found
>> > >> > > > > >>> during
>> > >> > > > > >>> > >>> >> >> testing. Some
>> > >> > > > > >>> > >>> >> >> > >> are
>> > >> > > > > >>> > >>> >> >> > >>>>> fixed
>> > >> > > > > >>> > >>> >> >> > >>>>>>> with
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> 3.5.6, some only
>> happens
>> > if
>> > >> > > > certain
>> > >> > > > > >>> conditions
>> > >> > > > > >>> > >>> stand
>> > >> > > > > >>> > >>> >> >> > >>> (IOException:
>> > >> > > > > >>> > >>> >> >> > >>>> No
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> snapshot found -
>> > mentioned
>> > >> in
>> > >> > > the
>> > >> > > > > guide,
>> > >> > > > > >>> fixed
>> > >> > > > > >>> > >>> in
>> > >> > > > > >>> > >>> >> >> 3.5.6).
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> So it is up to you, I
>> > would
>> > >> > > still
>> > >> > > > > >>> recommend to
>> > >> > > > > >>> > >>> do an
>> > >> > > > > >>> > >>> >> >> 3.4
>> > >> > > > > >>> > >>> >> >> > >> upgrade
>> > >> > > > > >>> > >>> >> >> > >>>>> first,
>> > >> > > > > >>> > >>> >> >> > >>>>>>> if
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> it's feasible.
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> Regards,
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> Norbert
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020
>> at
>> > >> 11:45 AM
>> > >> > > > > kuldeep
>> > >> > > > > >>> > singh <
>> > >> > > > > >>> > >>> >> >> > >>>>>>>
>> kuldeep.singh08@gmail.com
>> > >
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> wrote:
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Hi,
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Current Zookeeper
>> > version
>> > >> :-
>> > >> > > > 3.4.5
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Upgraded version
>> > >> > > > :-
>> > >> > > > > 3.5.6
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> We are not going with
>> > >> 3.5.7.
>> > >> > > Our
>> > >> > > > > final
>> > >> > > > > >>> > >>> decision is
>> > >> > > > > >>> > >>> >> >> zookeeper
>> > >> > > > > >>> > >>> >> >> > >>>>> version
>> > >> > > > > >>> > >>> >> >> > >>>>>> is
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.5.6
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> as per your reply
>> first
>> > >> we need
>> > >> > > > to
>> > >> > > > > move
>> > >> > > > > >>> > latest
>> > >> > > > > >>> > >>> >> >> version of
>> > >> > > > > >>> > >>> >> >> > >>> 3.4.x,
>> > >> > > > > >>> > >>> >> >> > >>>>> like
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> below
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 ->
>> 3.5.6
>> > >> > > (Correct
>> > >> > > > > me if
>> > >> > > > > >>> I am
>> > >> > > > > >>> > >>> wrong
>> > >> > > > > >>> > >>> >> >> here)
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> But if We are not
>> facing
>> > >> any
>> > >> > > > > problem
>> > >> > > > > >>> that i
>> > >> > > > > >>> > >>> have
>> > >> > > > > >>> > >>> >> >> shared you
>> > >> > > > > >>> > >>> >> >> > >>> that
>> > >> > > > > >>> > >>> >> >> > >>>> we
>> > >> > > > > >>> > >>> >> >> > >>>>>>> have
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> set up of 3 node
>> cluster
>> > >> where
>> > >> > > 2
>> > >> > > > > node
>> > >> > > > > >>> are on
>> > >> > > > > >>> > >>> 3.5.6
>> > >> > > > > >>> > >>> >> >> version
>> > >> > > > > >>> > >>> >> >> > >> and
>> > >> > > > > >>> > >>> >> >> > >>> 1
>> > >> > > > > >>> > >>> >> >> > >>>>> node
>> > >> > > > > >>> > >>> >> >> > >>>>>>> on
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything is
>> > >> running
>> > >> > > fine
>> > >> > > > > and
>> > >> > > > > >>> didn't
>> > >> > > > > >>> > >>> get
>> > >> > > > > >>> > >>> >> any
>> > >> > > > > >>> > >>> >> >> issue,
>> > >> > > > > >>> > >>> >> >> > >> So
>> > >> > > > > >>> > >>> >> >> > >>>> what
>> > >> > > > > >>> > >>> >> >> > >>>>>>> other
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> problem we can face
>> if
>> > we
>> > >> > > > directly
>> > >> > > > > move
>> > >> > > > > >>> to
>> > >> > > > > >>> > >>> 3.5.6
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Thanks,
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> ---------------------
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Software Architect
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020
>> at
>> > >> 3:58 PM
>> > >> > > > > Enrico
>> > >> > > > > >>> > >>> Olivelli <
>> > >> > > > > >>> > >>> >> >> > >>>>> eolivelli@gmail.com
>> > >> > > > > >>> > >>> >> >> > >>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> wrote:
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Hi
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> You have to upgrade
>> to
>> > >> latest
>> > >> > > > > 3.4.x
>> > >> > > > > >>> > Zookeeper
>> > >> > > > > >>> > >>> then
>> > >> > > > > >>> > >>> >> >> you will
>> > >> > > > > >>> > >>> >> >> > >>>>> upgrade
>> > >> > > > > >>> > >>> >> >> > >>>>>>> to
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> 3.5.7.
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> All should run well
>> > >> without
>> > >> > > > issues
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Enrico
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020,
>> > 10:18
>> > >> > > > kuldeep
>> > >> > > > > singh
>> > >> > > > > >>> <
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> kuldeep.singh08@gmail.com
>> > >> > > > > >>> > >>> >> >> > >>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>> ha
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> scritto:
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Hi Team,
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> We are upgrading
>> > >> zookeeper
>> > >> > > from
>> > >> > > > > 3.4.5
>> > >> > > > > >>> to
>> > >> > > > > >>> > >>> 3.5.6. I
>> > >> > > > > >>> > >>> >> >> have
>> > >> > > > > >>> > >>> >> >> > >> set
>> > >> > > > > >>> > >>> >> >> > >>>> up 3
>> > >> > > > > >>> > >>> >> >> > >>>>>>> node
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> cluster where 2
>> node
>> > >> are on
>> > >> > > > 3.5.6
>> > >> > > > > >>> version
>> > >> > > > > >>> > >>> and 1
>> > >> > > > > >>> > >>> >> >> node on
>> > >> > > > > >>> > >>> >> >> > >>>> 3.4.5.
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Everything is
>> running
>> > >> fine
>> > >> > > and
>> > >> > > > > didn't
>> > >> > > > > >>> get
>> > >> > > > > >>> > any
>> > >> > > > > >>> > >>> >> issue
>> > >> > > > > >>> > >>> >> >> on my
>> > >> > > > > >>> > >>> >> >> > >>>>> system.
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> but I found
>> something
>> > on
>> > >> > > apache
>> > >> > > > > site
>> > >> > > > > >>> that
>> > >> > > > > >>> > >>> first
>> > >> > > > > >>> > >>> >> we
>> > >> > > > > >>> > >>> >> >> need
>> > >> > > > > >>> > >>> >> >> > >> to
>> > >> > > > > >>> > >>> >> >> > >>>>>> upgrade
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> on
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can
>> > >> upgrade to
>> > >> > > > > 3.5.6. So
>> > >> > > > > >>> is
>> > >> > > > > >>> > it
>> > >> > > > > >>> > >>> >> >> mandatory
>> > >> > > > > >>> > >>> >> >> > >> to
>> > >> > > > > >>> > >>> >> >> > >>> go
>> > >> > > > > >>> > >>> >> >> > >>>>> on
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> 3.4.6
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> first.
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> *Upgrading to
>> 3.5.0*
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Upgrading a running
>> > >> ZooKeeper
>> > >> > > > > ensemble
>> > >> > > > > >>> to
>> > >> > > > > >>> > >>> 3.5.0
>> > >> > > > > >>> > >>> >> >> should be
>> > >> > > > > >>> > >>> >> >> > >>>> done
>> > >> > > > > >>> > >>> >> >> > >>>>>> only
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> after
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> upgrading your
>> > ensemble
>> > >> to
>> > >> > > the
>> > >> > > > > 3.4.6
>> > >> > > > > >>> > release.
>> > >> > > > > >>> > >>> >> Note
>> > >> > > > > >>> > >>> >> >> that
>> > >> > > > > >>> > >>> >> >> > >>> this
>> > >> > > > > >>> > >>> >> >> > >>>> is
>> > >> > > > > >>> > >>> >> >> > >>>>>>> only
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> necessary for
>> rolling
>> > >> > > upgrades
>> > >> > > > > (if
>> > >> > > > > >>> you're
>> > >> > > > > >>> > >>> fine
>> > >> > > > > >>> > >>> >> with
>> > >> > > > > >>> > >>> >> >> > >>> shutting
>> > >> > > > > >>> > >>> >> >> > >>>>> down
>> > >> > > > > >>> > >>> >> >> > >>>>>>> the
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> system completely,
>> you
>> > >> don't
>> > >> > > > > have to go
>> > >> > > > > >>> > >>> through
>> > >> > > > > >>> > >>> >> >> 3.4.6).
>> > >> > > > > >>> > >>> >> >> > >> If
>> > >> > > > > >>> > >>> >> >> > >>>> you
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> attempt
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> a
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> rolling upgrade
>> > without
>> > >> going
>> > >> > > > > through
>> > >> > > > > >>> 3.4.6
>> > >> > > > > >>> > >>> (for
>> > >> > > > > >>> > >>> >> >> example
>> > >> > > > > >>> > >>> >> >> > >>> from
>> > >> > > > > >>> > >>> >> >> > >>>>>>> 3.4.5),
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> you
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> may get the
>> following
>> > >> error:
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30
>> > 11:32:10,663
>> > >> > > > [myid:2]
>> > >> > > > > - INFO
>> > >> > > > > >>> > >>> >> [localhost/
>> > >> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > >> > > :QuorumCnxManager$Listener@498
>> > >> > > > ]
>> > >> > > > > -
>> > >> > > > > >>> Received
>> > >> > > > > >>> > >>> >> >> connection
>> > >> > > > > >>> > >>> >> >> > >>>> request
>> > >> > > > > >>> > >>> >> >> > >>>>> /
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30
>> > 11:32:10,663
>> > >> > > > [myid:2]
>> > >> > > > > - WARN
>> > >> > > > > >>> > >>> >> [localhost/
>> > >> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> :QuorumCnxManager@349
>> > ]
>> > >> -
>> > >> > > > Invalid
>> > >> > > > > >>> server
>> > >> > > > > >>> > id:
>> > >> > > > > >>> > >>> >> -65536
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> During a rolling
>> > >> upgrade,
>> > >> > > each
>> > >> > > > > server
>> > >> > > > > >>> is
>> > >> > > > > >>> > >>> taken
>> > >> > > > > >>> > >>> >> down
>> > >> > > > > >>> > >>> >> >> in
>> > >> > > > > >>> > >>> >> >> > >> turn
>> > >> > > > > >>> > >>> >> >> > >>>> and
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> rebooted
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> with the new 3.5.0
>> > >> binaries.
>> > >> > > > > Before
>> > >> > > > > >>> > starting
>> > >> > > > > >>> > >>> the
>> > >> > > > > >>> > >>> >> >> server
>> > >> > > > > >>> > >>> >> >> > >>> with
>> > >> > > > > >>> > >>> >> >> > >>>>>> 3.5.0
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> binaries, we highly
>> > >> recommend
>> > >> > > > > updating
>> > >> > > > > >>> the
>> > >> > > > > >>> > >>> >> >> configuration
>> > >> > > > > >>> > >>> >> >> > >>> file
>> > >> > > > > >>> > >>> >> >> > >>>>> so
>> > >> > > > > >>> > >>> >> >> > >>>>>>> that
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> all
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> server statements
>> > >> > > > "server.x=..."
>> > >> > > > > >>> contain
>> > >> > > > > >>> > >>> client
>> > >> > > > > >>> > >>> >> >> ports
>> > >> > > > > >>> > >>> >> >> > >> (see
>> > >> > > > > >>> > >>> >> >> > >>>> the
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> section
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Specifying
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> the client port).
>> As
>> > >> > > explained
>> > >> > > > > earlier
>> > >> > > > > >>> you
>> > >> > > > > >>> > >>> may
>> > >> > > > > >>> > >>> >> >> leave the
>> > >> > > > > >>> > >>> >> >> > >>>>>>>> configuration
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> in a
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> single file, as
>> well
>> > as
>> > >> leave
>> > >> > > > the
>> > >> > > > > >>> > >>> >> >> > >>>>
>> clientPort/clientPortAddress
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> (although if you
>> > specify
>> > >> > > client
>> > >> > > > > ports
>> > >> > > > > >>> in
>> > >> > > > > >>> > the
>> > >> > > > > >>> > >>> new
>> > >> > > > > >>> > >>> >> >> format,
>> > >> > > > > >>> > >>> >> >> > >>>> these
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> are now redundant).
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Could you please
>> let
>> > me
>> > >> know
>> > >> > > > > about this
>> > >> > > > > >>> > case.
>> > >> > > > > >>> > >>> >> >> Appreciate
>> > >> > > > > >>> > >>> >> >> > >> if
>> > >> > > > > >>> > >>> >> >> > >>>>>> respond
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>> soon.
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Thanks,
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> ---------------------
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh
>> Budania
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>>
>> > >> > > > > >>> > >>> >> >> > >>>>
>> > >> > > > > >>> > >>> >> >> > >>>
>> > >> > > > > >>> > >>> >> >> > >>
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >> >
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> ________________________________
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>> > >> > > > > >>> > >>> >> >> This e-mail (including any
>> attachments)
>> > is
>> > >> > > > strictly
>> > >> > > > > >>> > >>> confidential
>> > >> > > > > >>> > >>> >> and
>> > >> > > > > >>> > >>> >> >> may also contain privileged information.
>> If
>> > >> you are
>> > >> > > > > not the
>> > >> > > > > >>> > >>> intended
>> > >> > > > > >>> > >>> >> >> recipient you are not authorised to read,
>> > >> print,
>> > >> > > > save,
>> > >> > > > > >>> process or
>> > >> > > > > >>> > >>> >> disclose
>> > >> > > > > >>> > >>> >> >> this message. If you have received this
>> > >> message by
>> > >> > > > > mistake,
>> > >> > > > > >>> > please
>> > >> > > > > >>> > >>> >> inform
>> > >> > > > > >>> > >>> >> >> the sender immediately and destroy this
>> > >> e-mail, its
>> > >> > > > > >>> attachments
>> > >> > > > > >>> > >>> and any
>> > >> > > > > >>> > >>> >> >> copies. Any use, distribution,
>> reproduction
>> > or
>> > >> > > > > disclosure by
>> > >> > > > > >>> any
>> > >> > > > > >>> > >>> person
>> > >> > > > > >>> > >>> >> >> other than the intended recipient is
>> > strictly
>> > >> > > > > prohibited and
>> > >> > > > > >>> the
>> > >> > > > > >>> > >>> person
>> > >> > > > > >>> > >>> >> >> responsible may incur in penalties.
>> > >> > > > > >>> > >>> >> >> The use of this e-mail is only for
>> > >> professional
>> > >> > > > > purposes;
>> > >> > > > > >>> > >>> there is
>> > >> > > > > >>> > >>> >> no
>> > >> > > > > >>> > >>> >> >> guarantee that the correspondence towards
>> > this
>> > >> > > e-mail
>> > >> > > > > will be
>> > >> > > > > >>> > read
>> > >> > > > > >>> > >>> >> only by
>> > >> > > > > >>> > >>> >> >> the recipient, because, under certain
>> > >> > > circumstances,
>> > >> > > > > there
>> > >> > > > > >>> may
>> > >> > > > > >>> > be a
>> > >> > > > > >>> > >>> >> need to
>> > >> > > > > >>> > >>> >> >> access this email by third subjects
>> > belonging
>> > >> to
>> > >> > > the
>> > >> > > > > Company.
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> ________________________________
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>> > >> > > > > >>> > >>> >> >> This e-mail (including any attachments)
>> is
>> > >> strictly
>> > >> > > > > >>> confidential
>> > >> > > > > >>> > >>> and
>> > >> > > > > >>> > >>> >> may
>> > >> > > > > >>> > >>> >> >> also contain privileged information. If
>> you
>> > >> are not
>> > >> > > > the
>> > >> > > > > >>> intended
>> > >> > > > > >>> > >>> >> recipient
>> > >> > > > > >>> > >>> >> >> you are not authorised to read, print,
>> save,
>> > >> > > process
>> > >> > > > or
>> > >> > > > > >>> disclose
>> > >> > > > > >>> > >>> this
>> > >> > > > > >>> > >>> >> >> message. If you have received this
>> message
>> > by
>> > >> > > > mistake,
>> > >> > > > > please
>> > >> > > > > >>> > >>> inform
>> > >> > > > > >>> > >>> >> the
>> > >> > > > > >>> > >>> >> >> sender immediately and destroy this
>> e-mail,
>> > >> its
>> > >> > > > > attachments
>> > >> > > > > >>> and
>> > >> > > > > >>> > any
>> > >> > > > > >>> > >>> >> copies.
>> > >> > > > > >>> > >>> >> >> Any use, distribution, reproduction or
>> > >> disclosure
>> > >> > > by
>> > >> > > > > any
>> > >> > > > > >>> person
>> > >> > > > > >>> > >>> other
>> > >> > > > > >>> > >>> >> than
>> > >> > > > > >>> > >>> >> >> the intended recipient is strictly
>> > prohibited
>> > >> and
>> > >> > > the
>> > >> > > > > person
>> > >> > > > > >>> > >>> >> responsible
>> > >> > > > > >>> > >>> >> >> may incur in penalties.
>> > >> > > > > >>> > >>> >> >> The use of this e-mail is only for
>> > >> professional
>> > >> > > > > purposes;
>> > >> > > > > >>> there
>> > >> > > > > >>> > is
>> > >> > > > > >>> > >>> no
>> > >> > > > > >>> > >>> >> >> guarantee that the correspondence towards
>> > this
>> > >> > > e-mail
>> > >> > > > > will be
>> > >> > > > > >>> > read
>> > >> > > > > >>> > >>> >> only by
>> > >> > > > > >>> > >>> >> >> the recipient, because, under certain
>> > >> > > circumstances,
>> > >> > > > > there
>> > >> > > > > >>> may
>> > >> > > > > >>> > be a
>> > >> > > > > >>> > >>> >> need to
>> > >> > > > > >>> > >>> >> >> access this email by third subjects
>> > belonging
>> > >> to
>> > >> > > the
>> > >> > > > > Company.
>> > >> > > > > >>> > >>> >> >>
>> > >> > > > > >>> > >>> >> >
>> > >> > > > > >>> > >>> >>
>> > >> > > > > >>> > >>> >
>> > >> > > > > >>> > >>>
>> > >> > > > > >>> > >>
>> > >> > > > > >>> >
>> > >> > > > > >>>
>> > >> > > > > >>
>> > >> > > > >
>> > >> > > > >
>> > >> > > > > ________________________________
>> > >> > > > >
>> > >> > > > > CONFIDENTIALITY & PRIVACY NOTICE
>> > >> > > > > This e-mail (including any attachments) is strictly
>> confidential
>> > >> and
>> > >> > > may
>> > >> > > > > also contain privileged information. If you are not the
>> intended
>> > >> > > > recipient
>> > >> > > > > you are not authorised to read, print, save, process or
>> disclose
>> > >> this
>> > >> > > > > message. If you have received this message by mistake, please
>> > >> inform
>> > >> > > the
>> > >> > > > > sender immediately and destroy this e-mail, its attachments
>> and
>> > >> any
>> > >> > > > copies.
>> > >> > > > > Any use, distribution, reproduction or disclosure by any
>> person
>> > >> other
>> > >> > > > than
>> > >> > > > > the intended recipient is strictly prohibited and the person
>> > >> > > responsible
>> > >> > > > > may incur in penalties.
>> > >> > > > > The use of this e-mail is only for professional purposes;
>> there
>> > >> is no
>> > >> > > > > guarantee that the correspondence towards this e-mail will be
>> > >> read only
>> > >> > > > by
>> > >> > > > > the recipient, because, under certain circumstances, there
>> may
>> > be
>> > >> a
>> > >> > > need
>> > >> > > > to
>> > >> > > > > access this email by third subjects belonging to the Company.
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >>
>> > >>
>> >
>>
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Thanks for reply
zoo.cfg
-----------
secureClientPort=2181
serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
initLimit=10
syncLimit=5
dataDir= data directory (not mentioning exact path here)
tickTime=2000
autopurge.snapRetainCount=3
autopurge.purgeInterval=1
admin.enableServer=false
standaloneEnabled=false
jute.maxbuffer=2147483648
server.1=host1_priv:10288:10388
server.2=host2_priv:10288:10388
server.3=host3_priv:10288:10388
server.4=host4_priv:10288:10388
server.5=host5_priv:10288:10388
quorum.auth.enableSasl=true
quorum.auth.learnerRequireSasl=true
quorum.auth.serverRequireSasl=true
quorum.auth.learner.loginContext=QuorumLearner
quorum.auth.server.loginContext=QuorumServer
quorum.cnxn.threads.size=10
-------------------------------------------------------------
java.env
export
SERVER_JVMFLAGS="-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
-Dzookeeper.ssl.keyStore.location=keystore.jks
-Dzookeeper.ssl.keyStore.password=<passwword>
-Dzookeeper.ssl.trustStore.location= keystore.jks
-Dzookeeper.ssl.trustStore.password= <passwword>
-Djava.security.auth.login.config=zookeeper-jaas.conf"
export
CLIENT_JVMFLAGS="-Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
-Dzookeeper.client.secure=true -Dzookeeper.ssl.keyStore.location=
keystore.jks -Dzookeeper.ssl.keyStore.password= <passwword>
-Dzookeeper.ssl.trustStore.location=keystore.jks
-Dzookeeper.ssl.trustStore.password= <passwword>
-Dzookeeper.ssl.hostnameVerification=false"
Thanks,
---------------------
Kuldeep Singh Budania
On Wed, Oct 14, 2020 at 4:12 PM Szalay-Bekő Máté <sz...@gmail.com>
wrote:
> These log messages indicate that a client (or an other ZooKeeper server) is
> trying to connect without SSL to a ZooKeeper process that expects SSL.
> I assume this will be a configuration issue then.
>
> Best regards,
> Mate
>
> On Wed, Oct 14, 2020 at 12:30 PM kuldeep singh <ku...@gmail.com>
> wrote:
>
> > Hi,
> >
> > more logs
> >
> > 2020-10-14 12:25:05,106 - ERROR
> >
> >
> [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler$CertificateVerifier@257
> > ]
> > - Unsuccessful handshake with session 0x0
> >
> > 2020-10-14 12:25:05,107 - WARN
> > [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler@138] -
> > Exception caught
> >
> > io.netty.handler.codec.DecoderException:
> > io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record:
> > 737276720a
> >
> > at
> >
> >
> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:475)
> >
> > at
> >
> >
> io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:283)
> >
> > at
> >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> >
> > at
> >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> >
> > at
> >
> >
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
> >
> > at
> >
> >
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
> >
> > at
> >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> >
> > at
> >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> >
> > at
> >
> >
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
> >
> > at
> >
> >
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
> >
> > at
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
> >
> > at
> >
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
> >
> > at
> >
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
> >
> > at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
> >
> > at
> >
> >
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
> >
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> >
> > at
> >
> >
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> >
> > at java.lang.Thread.run(Thread.java:748)
> >
> > Caused by: io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS
> > record: 737276720a
> >
> > at
> > io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1203)
> >
> > at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1271)
> >
> > at
> >
> >
> io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:505)
> >
> > at
> >
> >
> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:444)
> >
> > ... 17 more
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> > Software Architect
> >
> >
> >
> > On Wed, Oct 14, 2020 at 3:51 PM kuldeep singh <kuldeep.singh08@gmail.com
> >
> > wrote:
> >
> > > Hi,
> > >
> > >
> > > below error is coming on zookeeper logs on SSL.
> > >
> > > 2020-10-14 12:18:27,410 - WARN
> > [nioEventLoopGroup-4-16:NettyServerCnxn@540]
> > > - Closing connection to /127.0.0.1:49470
> > > java.io.IOException: Len error 369296128
> > > at
> > >
> >
> org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:533)
> > > at
> > >
> >
> org.apache.zookeeper.server.NettyServerCnxn.processMessage(NettyServerCnxn.java:360)
> > > at
> > >
> >
> org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.channelRead(NettyServerCnxnFactory.java:184)
> > > at
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > > at
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > > at
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
> > > at
> > >
> >
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
> > > at
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > > at
> > >
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > > at
> > >
> >
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
> > > at
> > >
> >
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
> > > at
> > >
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
> > > at
> > >
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
> > > at
> > >
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
> > > at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
> > > at
> > >
> >
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
> > > at
> > >
> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > > at
> > >
> >
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> > > at java.lang.Thread.run(Thread.java:748)
> > >
> > > Thanks,
> > > ---------------------
> > > Kuldeep Singh Budania
> > >
> > >
> > >
> > > On Thu, Oct 8, 2020 at 6:33 PM Szalay-Bekő Máté <
> > > szalay.beko.mate@gmail.com> wrote:
> > >
> > >> Sounds like a bug or a configuration issue...
> > >> can you share the configs (before and after the scale-up) and the
> logs?
> > >> also: does the truststores recognise all the keys used on all the 5
> > >> nodes? (e.g. the truststores on the old nodes accept the new keys?)
> > >>
> > >> Best Regards,
> > >> Mate
> > >>
> > >> On Thu, Oct 8, 2020 at 2:31 PM kuldeep singh <
> kuldeep.singh08@gmail.com
> > >
> > >> wrote:
> > >> >
> > >> > Hi,
> > >> >
> > >> > Yes, My client and server both are using certificate and have added
> in
> > >> ZK
> > >> > and client as well.
> > >> >
> > >> > Thanks,
> > >> > ---------------------
> > >> > Kuldeep Singh Budania
> > >> >
> > >> >
> > >> >
> > >> > On Thu, Oct 8, 2020 at 5:56 PM Enrico Olivelli <eolivelli@gmail.com
> >
> > >> wrote:
> > >> >
> > >> > > Il giorno gio 8 ott 2020 alle ore 14:17 kuldeep singh <
> > >> > > kuldeep.singh08@gmail.com> ha scritto:
> > >> > >
> > >> > > > Hi Team,
> > >> > > >
> > >> > > > I am facing one issue in SSL communication between client and
> > >> zookeeper
> > >> > > > server.
> > >> > > >
> > >> > > > ZK 3.5.6 version
> > >> > > >
> > >> > > > 1. Mi on 3 node
> > >> > > > 2. Applying SSL and 3 nodes cluster is working fine
> > >> > > > 3. Scaled my cluster with 2 nodes and now my cluster have 5
> nodes
> > >> over
> > >> > > SSL
> > >> > > >
> > >> > > > but after scaling my SSL is not working between client and ZK
> > >> server and
> > >> > > > even not able to login using zkCli as well.
> > >> > > >
> > >> > > > Can someone provide the details please why it is happening?
> > >> > > >
> > >> > >
> > >> > > Is your client configured to use SSL ?
> > >> > >
> > >> > > Enrico
> > >> > >
> > >> > >
> > >> > >
> > >> > > >
> > >> > > > Thanks,
> > >> > > > ---------------------
> > >> > > > Kuldeep Singh Budania
> > >> > > > Software Architect
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > On Mon, Jul 13, 2020 at 2:19 PM Enrico Olivelli - Diennea
> > >> > > > <en...@diennea.com.invalid> wrote:
> > >> > > >
> > >> > > > > It looks like we ported it to 3.5.
> > >> > > > >
> > >> > > > > See the subtask
> > >> > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2792
> > >> > > > >
> > >> > > > > Enrico
> > >> > > > >
> > >> > > > > Il giorno 13/07/20, 10:37 "kuldeep singh" <
> > >> kuldeep.singh08@gmail.com>
> > >> > > > ha
> > >> > > > > scritto:
> > >> > > > >
> > >> > > > > Hi Team,
> > >> > > > >
> > >> > > > > I appreciate it if I will get a response as soon as
> > possible,
> > >> as I
> > >> > > am
> > >> > > > > stuck
> > >> > > > > at this point.
> > >> > > > >
> > >> > > > > Thanks,
> > >> > > > > ---------------------
> > >> > > > > Kuldeep Singh Budania
> > >> > > > >
> > >> > > > >
> > >> > > > >
> > >> > > > > On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <
> > >> > > > > kuldeep.singh08@gmail.com>
> > >> > > > > wrote:
> > >> > > > >
> > >> > > > > > Hi Team,
> > >> > > > > >
> > >> > > > > > Server to Server communication is not supported in 3.5.6
> > >> version
> > >> > > > as
> > >> > > > > per
> > >> > > > > > below JIRA issue?
> > >> > > > > >
> > >> > > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2639
> > >> > > > > >
> > >> > > > > > Thanks,
> > >> > > > > > ---------------------
> > >> > > > > > Kuldeep Singh Budania
> > >> > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <
> > >> > > > > kuldeep.singh08@gmail.com>
> > >> > > > > > wrote:
> > >> > > > > >
> > >> > > > > >> Thanks for the reply.
> > >> > > > > >>
> > >> > > > > >> Now my ZKCli cmd is working fine as we use some our
> > >> customized
> > >> > > > > >> authentication and we resolve the issue.
> > >> > > > > >>
> > >> > > > > >> Now I am going to implement Server to Server
> > communication.
> > >> > > > > >>
> > >> > > > > >> Thanks,
> > >> > > > > >> ---------------------
> > >> > > > > >> Kuldeep Singh Budania
> > >> > > > > >>
> > >> > > > > >>
> > >> > > > > >>
> > >> > > > > >> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
> > >> > > > > >> szalay.beko.mate@gmail.com> wrote:
> > >> > > > > >>
> > >> > > > > >>> I think SSL is working for you already... If you
> managed
> > >> to
> > >> > > start
> > >> > > > > the
> > >> > > > > >>> zkCli.sh and be able to connect to ZooKeeper on the
> > >> secure port
> > >> > > > > and issue
> > >> > > > > >>> any kind of command (like: " ls / "), then the wire
> > >> encryption
> > >> > > is
> > >> > > > > working
> > >> > > > > >>> and your server/client communication is secured by
> > >> ZooKeeper.
> > >> > > > > >>>
> > >> > > > > >>> Why you want to run the following command?
> > >> > > > > >>> addauth ztpasswd zooadmin:<password>
> > >> > > > > >>>
> > >> > > > > >>> Do you also want to configure a superDigest user in
> > >> ZooKeeper?
> > >> > > > > Please
> > >> > > > > >>> note
> > >> > > > > >>> that this command is independent from SSL. If you need
> > to
> > >> > > create
> > >> > > > a
> > >> > > > > >>> username-password pair for digest authentication then
> > >> please
> > >> > > use
> > >> > > > > the
> > >> > > > > >>> command in the following way:
> > >> > > > > >>> addauth digest zooadmin:yourSuperSecretPassword
> > >> > > > > >>>
> > >> > > > > >>> Kind regards,
> > >> > > > > >>> Mate
> > >> > > > > >>>
> > >> > > > > >>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <
> > >> > > > > kuldeep.singh08@gmail.com>
> > >> > > > > >>> wrote:
> > >> > > > > >>>
> > >> > > > > >>> > 1. sh zkCli.sh --config /etc/zookeeper -server
> > >> localhost:2281
> > >> > > > > >>> >
> > >> > > > > >>> > 2. addauth ztpasswd zooadmin:<password>
> > >> > > > > >>> >
> > >> > > > > >>> >
> > >> > > > > >>> > Thanks,
> > >> > > > > >>> > ---------------------
> > >> > > > > >>> > Kuldeep Singh Budania
> > >> > > > > >>> >
> > >> > > > > >>> >
> > >> > > > > >>> >
> > >> > > > > >>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
> > >> > > > > >>> kuldeep.singh08@gmail.com>
> > >> > > > > >>> > wrote:
> > >> > > > > >>> >
> > >> > > > > >>> > > Hi Team,
> > >> > > > > >>> > >
> > >> > > > > >>> > > Any update on this?
> > >> > > > > >>> > >
> > >> > > > > >>> > > Thanks,
> > >> > > > > >>> > > ---------------------
> > >> > > > > >>> > > Kuldeep Singh Budania
> > >> > > > > >>> > >
> > >> > > > > >>> > >
> > >> > > > > >>> > >
> > >> > > > > >>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
> > >> > > > > >>> kuldeep.singh08@gmail.com>
> > >> > > > > >>> > > wrote:
> > >> > > > > >>> > >
> > >> > > > > >>> > >> Sorry this is my bad, there were server setting
> > like
> > >> below
> > >> > > > > >>> > >>
> > >> > > > > >>> > >> export SERVER_JVMFLAGS="
> > >> > > > > >>> > >>
> > >> > > > > >>> > >>
> > >> > > > > >>> > >>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > > > > >>> > >>
> > >> > > > > >>> > >>
> > >> > > > > >>>
> > >> > > > >
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > >> > > > > >>> > >>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> > > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >> > > > > >>> > >>
> > >> > > > > >>> > >>
> > >> > > > > >>> > >>
> > >> > > > > >>> > >> export CLIENT_JVMFLAGS="
> > >> > > > > >>> > >>
> > >> > > > > >>> > >>
> > >> > > > > >>>
> > >> > > > >
> > >>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >> > > > > >>> > >> -Dzookeeper.client.secure=true
> > >> > > > > >>> > >>
> > >> > > > > >>>
> > >> > > > >
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > >> > > > > >>> > >>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> > > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >> > > > > >>> > >>
> > >> > > > > >>> > >> I want to have SSL between client to server
> > >> communication
> > >> > > > > >>> > >>
> > >> > > > > >>> > >> I am already following the same link which you
> have
> > >> shared
> > >> > > > > with me
> > >> > > > > >>> but
> > >> > > > > >>> > >> that is not working.
> > >> > > > > >>> > >>
> > >> > > > > >>> > >> Zoo.cfg
> > >> > > > > >>> > >>
> > >> > > > > >>> > >> secureClientPort=2281
> > >> > > > > >>> > >> initLimit=10
> > >> > > > > >>> > >> syncLimit=5
> > >> > > > > >>> > >> dataDir=/var/lib/zookeeper/data
> > >> > > > > >>> > >> tickTime=2000
> > >> > > > > >>> > >> autopurge.snapRetainCount=3
> > >> > > > > >>> > >> autopurge.purgeInterval=1
> > >> > > > > >>> > >> admin.enableServer=false
> > >> > > > > >>> > >> standaloneEnabled=false
> > >> > > > > >>> > >> jute.maxbuffer=2147483648
> > >> > > > > >>> > >>
> > >> > > > >
> > >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > > > > >>> > >> server.1=host1_priv:10288:10388
> > >> > > > > >>> > >> server.2=host2_priv:10288:10388
> > >> > > > > >>> > >> server.3=host3_priv:10288:10388
> > >> > > > > >>> > >>
> > >> > > > > >>> > >>
> > >> > > > > >>> > >> command to connect using zkcli
> > >> > > > > >>> > >>
> > >> > > > > >>> > >> 1. zkcli zoo.cfg localhost:2281
> > >> > > > > >>> > >> 2. addauth ztpasswd usernaem:password
> > >> > > > > >>> > >>
> > >> > > > > >>> > >> after second step we are getting below error
> > >> > > > > >>> > >>
> > >> > > > > >>> > >> WatchedEvent state:AuthFailed type:None path:null
> > >> > > > > >>> > >>
> > >> > > > > >>> > >>
> > >> > > > > >>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > >> > > > > >>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] -
> No
> > >> > > > > authentication
> > >> > > > > >>> > provider
> > >> > > > > >>> > >> for scheme: ztpasswd has x509 ip digest*
> > >> > > > > >>> > >>
> > >> > > > > >>> > >> Thanks,
> > >> > > > > >>> > >> ---------------------
> > >> > > > > >>> > >> Kuldeep Singh Budania
> > >> > > > > >>> > >>
> > >> > > > > >>> > >>
> > >> > > > > >>> > >>
> > >> > > > > >>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
> > >> > > > > >>> > >> szalay.beko.mate@gmail.com> wrote:
> > >> > > > > >>> > >>
> > >> > > > > >>> > >>> > No authentication provider for scheme:
> ztpasswd
> > >> has
> > >> > > x509
> > >> > > > > ip
> > >> > > > > >>> digest*
> > >> > > > > >>> > >>>
> > >> > > > > >>> > >>> This suggest you have some configuration
> error...
> > >> Where
> > >> > > did
> > >> > > > > you
> > >> > > > > >>> use the
> > >> > > > > >>> > >>> "ztpasswd" string in your configs / commands?
> > >> > > > > >>> > >>>
> > >> > > > > >>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté
> <
> > >> > > > > >>> > >>> szalay.beko.mate@gmail.com>
> > >> > > > > >>> > >>> wrote:
> > >> > > > > >>> > >>>
> > >> > > > > >>> > >>> > > My ZK server is up and running in secure
> mode
> > >> > > > > >>> > >>> >
> > >> > > > > >>> > >>> > What is your goal? You want to setup
> > >> client-server SSL
> > >> > > > > >>> connection?
> > >> > > > > >>> > >>> >
> > >> > > > > >>> > >>> > see:
> > >> > > > > >>> > >>> >
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
> > >> > > > > >>> > >>> >
> > >> > > > > >>> > >>> > (or you want to have both SSL and SASL
> enabled?)
> > >> > > > > >>> > >>> >
> > >> > > > > >>> > >>> > Anyway, please remove the following line from
> > the
> > >> > > > > >>> SERVER_JVMFLAGS:
> > >> > > > > >>> > >>> >
> > >> > > > > >>> >
> > >> > > > >
> > >>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >> > > > > >>> > >>> > This is a configuration that makes sense only
> > for
> > >> the
> > >> > > > > ZooKeeper
> > >> > > > > >>> > client,
> > >> > > > > >>> > >>> > not for the server. For the server, use the
> > >> following:
> > >> > > > > >>> > >>> >
> > >> > > > > >>> > >>> >
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > > > > >>> > >>> >
> > >> > > > > >>> > >>> > If it doesn't solve the issue, then can you
> > >> please send
> > >> > > > > your
> > >> > > > > >>> zoo.cfg
> > >> > > > > >>> > >>> file?
> > >> > > > > >>> > >>> > Also can you please send the zkCli command you
> > >> execute?
> > >> > > > > (you
> > >> > > > > >>> need to
> > >> > > > > >>> > >>> > connect to the secure ZooKeeper port, unless
> > >> > > > > portUnification is
> > >> > > > > >>> > >>> enabled)
> > >> > > > > >>> > >>> >
> > >> > > > > >>> > >>> > Kind regards,
> > >> > > > > >>> > >>> > Mate
> > >> > > > > >>> > >>> >
> > >> > > > > >>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
> > >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> > >> > > > > >>> > >>> > wrote:
> > >> > > > > >>> > >>> >
> > >> > > > > >>> > >>> >> Hi,
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >> we have done below changes in java.env file
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >> export SERVER_JVMFLAGS="
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>>
> > >> > > > >
> > >>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> >
> > >> > > > >
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> > > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> > > > > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >> export CLIENT_JVMFLAGS="
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>>
> > >> > > > >
> > >>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >> > > > > >>> > >>> >> -Dzookeeper.client.secure=true
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> >
> > >> > > > >
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> > > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> > > > > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >> I have started the ZK server and it is up
> > >> without any
> > >> > > > > issue.
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >> But now when I login to ZkCli then it gives
> the
> > >> below
> > >> > > > > error.
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >> WatchedEvent state:AuthFailed type:None
> > path:null
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 -
> > WARN
> > >> > > > > >>> > >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
> -
> > >> No
> > >> > > > > >>> authentication
> > >> > > > > >>> > >>> provider
> > >> > > > > >>> > >>> >> for scheme: ztpasswd has x509 ip digest*
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >> Please help me on this issue
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >> Thanks,
> > >> > > > > >>> > >>> >> ---------------------
> > >> > > > > >>> > >>> >> Kuldeep Singh Budania
> > >> > > > > >>> > >>> >> Software Architect
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep
> singh <
> > >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> > >> > > > > >>> > >>> >> wrote:
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >> > Hi,
> > >> > > > > >>> > >>> >> >
> > >> > > > > >>> > >>> >> > My ZK server is up and running in secure
> > >> mode, But
> > >> > > > > When I am
> > >> > > > > >>> > >>> trying to
> > >> > > > > >>> > >>> >> > connect to the ZK server using ZKCli, it
> > gives
> > >> the
> > >> > > > below
> > >> > > > > >>> error.
> > >> > > > > >>> > >>> >> >
> > >> > > > > >>> > >>> >> > WatchedEvent state:AuthFailed type:None
> > >> path:null
> > >> > > > > >>> > >>> >> >
> > >> > > > > >>> > >>> >> >
> > >> > > > > >>> > >>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342
> -
> > >> WARN
> > >> > > > > >>> > >>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119
> ]
> > >> - No
> > >> > > > > >>> authentication
> > >> > > > > >>> > >>> >> provider
> > >> > > > > >>> > >>> >> > for scheme: ztpasswd has x509 ip digest*
> > >> > > > > >>> > >>> >> >
> > >> > > > > >>> > >>> >> > Can someone please help me on this issue.
> we
> > >> are
> > >> > > using
> > >> > > > > the
> > >> > > > > >>> 3.5.6
> > >> > > > > >>> > >>> >> version.
> > >> > > > > >>> > >>> >> >
> > >> > > > > >>> > >>> >> > I appreciate if I will get a response as
> soon
> > >> as
> > >> > > > > possible, as
> > >> > > > > >>> I am
> > >> > > > > >>> > >>> stuck
> > >> > > > > >>> > >>> >> > at this point.
> > >> > > > > >>> > >>> >> >
> > >> > > > > >>> > >>> >> > Thanks,
> > >> > > > > >>> > >>> >> > ---------------------
> > >> > > > > >>> > >>> >> > Kuldeep Singh Budania
> > >> > > > > >>> > >>> >> > Software Architect
> > >> > > > > >>> > >>> >> >
> > >> > > > > >>> > >>> >> >
> > >> > > > > >>> > >>> >> >
> > >> > > > > >>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico
> > >> Olivelli -
> > >> > > > > Diennea
> > >> > > > > >>> > >>> >> > <en...@diennea.com.invalid>
> wrote:
> > >> > > > > >>> > >>> >> >
> > >> > > > > >>> > >>> >> >> I mean in zoo.cfg
> > >> > > > > >>> > >>> >> >> Not as a system property
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> Enrico
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico
> Olivelli -
> > >> > > > Diennea" <
> > >> > > > > >>> > >>> >> >> enrico.olivelli@diennea.com.INVALID> ha
> > >> scritto:
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> Hi
> > >> > > > > >>> > >>> >> >> You have to enable Netty on the server
> > >> side
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> Something like:
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> >
> > >> > > > >
> > >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> Hope that helps
> > >> > > > > >>> > >>> >> >> Enrico
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep
> > singh"
> > >> <
> > >> > > > > >>> > >>> >> kuldeep.singh08@gmail.com>
> > >> > > > > >>> > >>> >> >> ha scritto:
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> Hi,
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> I got below error while setting
> SSL
> > >> > > > properties
> > >> > > > > in
> > >> > > > > >>> > zkEnv.sh
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> ==========================================================================================
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
> > >> > > > > >>> > [main:QuorumPeerConfig@133]
> > >> > > > > >>> > >>> -
> > >> > > > > >>> > >>> >> >> Reading
> > >> > > > > >>> > >>> >> >> configuration from:
> > >> /etc/zookeeper/zoo.cfg
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> > >> > > > > >>> > [main:QuorumPeerConfig@385]
> > >> > > > > >>> > >>> -
> > >> > > > > >>> > >>> >> >> clientPortAddress is
> > >> 0.0.0.0/0.0.0.0:10181
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> > >> > > > > >>> > [main:QuorumPeerConfig@399]
> > >> > > > > >>> > >>> -
> > >> > > > > >>> > >>> >> >> secureClientPortAddress is
> > >> > > > > 0.0.0.0/0.0.0.0:2281
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,878 - INFO
> > >> > > > > [main:X509Util@79] -
> > >> > > > > >>> > >>> Setting
> > >> > > > > >>> > >>> >> -D
> > >> > > > > >>> > >>> >> >>
> > >> > > > > jdk.tls.rejectClientInitiatedRenegotiation=true to
> > >> > > > > >>> > disable
> > >> > > > > >>> > >>> >> >> client-initiated
> > >> > > > > >>> > >>> >> >> TLS renegotiation
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> > >> > > > > >>> > >>> [main:DatadirCleanupManager@78]
> > >> > > > > >>> > >>> >> -
> > >> > > > > >>> > >>> >> >> autopurge.snapRetainCount set to 3
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> > >> > > > > >>> > >>> [main:DatadirCleanupManager@79]
> > >> > > > > >>> > >>> >> -
> > >> > > > > >>> > >>> >> >> autopurge.purgeInterval set to 1
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,898 - INFO [
> > >> > > > > >>> > >>> >> >>
> > >> > > PurgeTask:DatadirCleanupManager$PurgeTask@138
> > >> > > > ]
> > >> > > > > -
> > >> > > > > >>> Purge
> > >> > > > > >>> > >>> task
> > >> > > > > >>> > >>> >> >> started.
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,899 - INFO
> > >> > > > > [main:ManagedUtil@46]
> > >> > > > > >>> -
> > >> > > > > >>> > >>> Log4j
> > >> > > > > >>> > >>> >> >> found with
> > >> > > > > >>> > >>> >> >> jmx enabled.
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
> > >> > > > > >>> > >>> [PurgeTask:FileTxnSnapLog@103]
> > >> > > > > >>> > >>> >> -
> > >> > > > > >>> > >>> >> >> zookeeper.snapshot.trust.empty :
> > false
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,910 - INFO [
> > >> > > > > >>> > >>> >> >>
> > >> > > PurgeTask:DatadirCleanupManager$PurgeTask@144
> > >> > > > ]
> > >> > > > > -
> > >> > > > > >>> Purge
> > >> > > > > >>> > >>> task
> > >> > > > > >>> > >>> >> >> completed.
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
> > >> > > > > >>> [main:QuorumPeerMain@141
> > >> > > > > >>> > ]
> > >> > > > > >>> > >>> -
> > >> > > > > >>> > >>> >> >> Starting quorum
> > >> > > > > >>> > >>> >> >> peer
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
> > >> > > > > >>> > [main:ServerCnxnFactory@135]
> > >> > > > > >>> > >>> -
> > >> > > > > >>> > >>> >> >> Using
> > >> > > > > >>> > >>> >> >>
> > >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > >> > > > > >>> > server
> > >> > > > > >>> > >>> >> >> connection
> > >> > > > > >>> > >>> >> >> factory
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
> > >> > > > > >>> > >>> [main:NIOServerCnxnFactory@673]
> > >> > > > > >>> > >>> >> -
> > >> > > > > >>> > >>> >> >> Configuring NIO connection handler
> > >> with 10s
> > >> > > > > >>> sessionless
> > >> > > > > >>> > >>> >> >> connection timeout,
> > >> > > > > >>> > >>> >> >> 2 selector thread(s), 16 worker
> > >> threads,
> > >> > > and
> > >> > > > > 64 kB
> > >> > > > > >>> direct
> > >> > > > > >>> > >>> >> buffers.
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
> > >> > > > > >>> > >>> [main:NIOServerCnxnFactory@686
> > >> > > > > >>> > >>> >> ]
> > >> > > > > >>> > >>> >> >> - binding
> > >> > > > > >>> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
> > >> > > > > >>> > [main:ServerCnxnFactory@135]
> > >> > > > > >>> > >>> -
> > >> > > > > >>> > >>> >> >> Using
> > >> > > > > >>> > >>> >> >>
> > >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > >> > > > > >>> > server
> > >> > > > > >>> > >>> >> >> connection
> > >> > > > > >>> > >>> >> >> factory
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
> > >> > > > > >>> [main:QuorumPeerMain@101
> > >> > > > > >>> > ]
> > >> > > > > >>> > >>> -
> > >> > > > > >>> > >>> >> >> Unexpected
> > >> > > > > >>> > >>> >> >> exception, exiting abnormally
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> java.lang.UnsupportedOperationException:
> > >> > > SSL
> > >> > > > > isn't
> > >> > > > > >>> > >>> supported in
> > >> > > > > >>> > >>> >> >> NIOServerCnxn
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> at
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> at
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> at
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> at
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> I have set the following
> properties
> > in
> > >> > > > > >>> SERVER_JVMFLAGS in
> > >> > > > > >>> > >>> >> >> zkEnv.sh file :
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> > >> > > > > >>> > >>> >> >>
> > >> > > > > -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> > >> > > > > >>> > >>> >> >>
> > >> > > > > -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> Thanks,
> > >> > > > > >>> > >>> >> >> ---------------------
> > >> > > > > >>> > >>> >> >> Kuldeep Singh Budania
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM
> > Jordan
> > >> > > > > Zimmerman <
> > >> > > > > >>> > >>> >> >> jordan@jordanzimmerman.com>
> > >> > > > > >>> > >>> >> >> wrote:
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> > It's the same as the normal
> > >> ZooKeeper
> > >> > > > client:
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > >> > > > > >>> > >>> >> >> > <
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > >> > > > > >>> > >>> >> >> > >
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >> > -Jordan
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >> > > On Jun 22, 2020, at 5:50 AM,
> > >> kuldeep
> > >> > > > singh
> > >> > > > > <
> > >> > > > > >>> > >>> >> >> kuldeep.singh08@gmail.com>
> > >> > > > > >>> > >>> >> >> > wrote:
> > >> > > > > >>> > >>> >> >> > >
> > >> > > > > >>> > >>> >> >> > > Hi Team,
> > >> > > > > >>> > >>> >> >> > > How we will do secure
> > >> communication
> > >> > > > > between the
> > >> > > > > >>> > Curator
> > >> > > > > >>> > >>> >> >> framework and
> > >> > > > > >>> > >>> >> >> > > zookeeper 3.5.6 ?
> > >> > > > > >>> > >>> >> >> > > I didn't get any solution
> right
> > >> now.
> > >> > > > > >>> > >>> >> >> > > I appreciate it if someone
> could
> > >> help
> > >> > > me
> > >> > > > > with the
> > >> > > > > >>> > same.
> > >> > > > > >>> > >>> >> >> > >
> > >> > > > > >>> > >>> >> >> > > Thanks,
> > >> > > > > >>> > >>> >> >> > > ---------------------
> > >> > > > > >>> > >>> >> >> > > Kuldeep Singh Budania
> > >> > > > > >>> > >>> >> >> > > Software Architect
> > >> > > > > >>> > >>> >> >> > >
> > >> > > > > >>> > >>> >> >> > >
> > >> > > > > >>> > >>> >> >> > > On Fri, Apr 17, 2020 at 4:53
> PM
> > >> > > > > Szalay-Bekő Máté
> > >> > > > > >>> <
> > >> > > > > >>> > >>> >> >> > szalay.beko.mate@gmail.com>
> > >> > > > > >>> > >>> >> >> > > wrote:
> > >> > > > > >>> > >>> >> >> > >
> > >> > > > > >>> > >>> >> >> > >> Hello Kuldeep,
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> > >> did you download the source
> > from
> > >> the
> > >> > > > > ZooKeeper
> > >> > > > > >>> > >>> webpage, or
> > >> > > > > >>> > >>> >> >> checked out
> > >> > > > > >>> > >>> >> >> > from
> > >> > > > > >>> > >>> >> >> > >> git?
> > >> > > > > >>> > >>> >> >> > >> Anyway, the following
> commands
> > >> should
> > >> > > > > work:
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> > >> wget
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> > >> > > > > >>> > >>> >> >> > >> tar xzvf
> > >> > > ./apache-zookeeper-3.5.7.tar.gz
> > >> > > > > >>> > >>> >> >> > >> cd apache-zookeeper-3.5.7
> > >> > > > > >>> > >>> >> >> > >> mvn clean install -DskipTests
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> > >> I tested it with OpenJDK
> 8u424
> > >> and
> > >> > > maven
> > >> > > > > 3.6.0.
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> > >> Kind regards,
> > >> > > > > >>> > >>> >> >> > >> Mate
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> > >> On Fri, Apr 17, 2020 at 12:51
> > PM
> > >> > > kuldeep
> > >> > > > > singh <
> > >> > > > > >>> > >>> >> >> > kuldeep.singh08@gmail.com>
> > >> > > > > >>> > >>> >> >> > >> wrote:
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> > >>> Hi All,
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>> I have download the
> zookeeper
> > >> source
> > >> > > > > code and
> > >> > > > > >>> run
> > >> > > > > >>> > >>> the mvn
> > >> > > > > >>> > >>> >> >> command for
> > >> > > > > >>> > >>> >> >> > >>> packaging but get problem on
> > >> > > > > "zookeeper-server"
> > >> > > > > >>> > >>> >> directory.
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>> *command :- mvn clean
> package*
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>> [ERROR] Failed to execute
> goal
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >>
> > >> > > > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > >> > > > > >>> > >>> >> >> > >>> (default-compile) on project
> > >> > > zookeeper:
> > >> > > > > Fatal
> > >> > > > > >>> error
> > >> > > > > >>> > >>> >> >> compiling:
> > >> > > > > >>> > >>> >> >> > >>>
> java.lang.NullPointerException
> > >> ->
> > >> > > [Help
> > >> > > > > 1]
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>>
> > >> org.apache.maven.lifecycle.LifecycleExecutionException:
> > >> > > > > >>> > >>> >> >> Failed to
> > >> > > > > >>> > >>> >> >> > execute
> > >> > > > > >>> > >>> >> >> > >>> goal
> > >> > > > > >>> > >>> >> >>
> > >> > > > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > >> > > > > >>> > >>> >> >> > >>> (default-compile) on project
> > >> > > zookeeper:
> > >> > > > > Fatal
> > >> > > > > >>> error
> > >> > > > > >>> > >>> >> >> compiling
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >>
> > >> > > > > org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >>
> > >> > > > > org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >>
> > >> > > > > org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >>
> > >> > > > org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >>
> > >> > > org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >>
> > >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > >> > > > > Method)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >>
> > java.lang.reflect.Method.invoke(Method.java:498)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > >
> > >>
> > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > >> > > > > >>> > >>> >>
> org.apache.maven.plugin.MojoExecutionException:
> > >> > > > > >>> > >>> >> >> Fatal error
> > >> > > > > >>> > >>> >> >> > >>> compiling
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> > >> > > > > >>> > >>> >> >> > >>> ... 19 more
> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > >> > > > > >>> > >>> >>
> org.codehaus.plexus.compiler.CompilerException:
> > >> > > > > >>> > >>> >> >> > >>>
> java.lang.NullPointerException
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> > >> > > > > >>> > >>> >> >> > >>> ... 22 more
> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > >> > > java.lang.RuntimeException:
> > >> > > > > >>> > >>> >> >> java.lang.NullPointerException
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >>
> > >> > > com.sun.tools.javac.main.Main.compile(Main.java:559)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>>
> > >> > > > >
> > >> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> >
> > >> > > > >
> > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> > >> > > > > >>> > >>> >> >> > >>> ... 24 more
> > >> > > > > >>> > >>> >> >> > >>> Caused by:
> > >> > > > java.lang.NullPointerException
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >>
> > >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >>
> > >> > > com.sun.tools.doclint.Checker.scan(Checker.java:144)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >>
> > >> > > > > com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>>
> > >> > > > >
> > >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>>
> > >> > > > >
> > >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> >
> > >> > > > >
> > >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>>
> > >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> >
> > >> > > > >
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> >
> > >> > > > >
> > >> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> >
> > >> > > > >
> > >> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>>
> > >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> >
> > >> > > > >
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> >
> > >> > > > >
> > >> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > >
> > >>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > >
> > >>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>>
> > >> > > > >
> > >> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>>
> > >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> >
> > >> > > > >
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >>
> > >> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> >
> > >> > > > >
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>>
> > >> > > com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>>
> > >> > > > >
> > >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>>
> > >> > > > >
> > >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> >
> > >> > > > >
> > >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>>
> > >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >>
> > >> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> >
> > >> > > > >
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > >
> > >>
> > com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>>
> > >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >>
> > >> > > > > com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>>
> > >> > > > >
> > >>
> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>>
> > >> > > > >
> > >> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>>
> > >> > > > >
> > >> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> > >> > > > > >>> > >>> >> >> > >>> at
> > >> > > > > >>> > >>> >> >>
> > >> > > com.sun.tools.javac.main.Main.compile(Main.java:523)
> > >> > > > > >>> > >>> >> >> > >>> ... 27 more
> > >> > > > > >>> > >>> >> >> > >>> [ERROR]
> > >> > > > > >>> > >>> >> >> > >>> [ERROR] Re-run Maven using
> the
> > >> -X
> > >> > > > switch
> > >> > > > > to
> > >> > > > > >>> enable
> > >> > > > > >>> > >>> full
> > >> > > > > >>> > >>> >> >> debug logging.
> > >> > > > > >>> > >>> >> >> > >>> [ERROR]
> > >> > > > > >>> > >>> >> >> > >>> [ERROR] For more information
> > >> about
> > >> > > the
> > >> > > > > errors
> > >> > > > > >>> and
> > >> > > > > >>> > >>> >> possible
> > >> > > > > >>> > >>> >> >> solutions,
> > >> > > > > >>> > >>> >> >> > >>> please read the following
> > >> articles:
> > >> > > > > >>> > >>> >> >> > >>> [ERROR] [Help 1]
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > >
> > >>
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>> Can someone help me on this
> > >> issue?
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>> Thanks,
> > >> > > > > >>> > >>> >> >> > >>> ---------------------
> > >> > > > > >>> > >>> >> >> > >>> Kuldeep Singh Budania
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57
> PM
> > >> > > > > Szalay-Bekő
> > >> > > > > >>> Máté <
> > >> > > > > >>> > >>> >> >> > >>> szalay.beko.mate@gmail.com>
> > >> > > > > >>> > >>> >> >> > >>> wrote:
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>>> these exceptions can mean
> > many
> > >> > > > > things... I
> > >> > > > > >>> think
> > >> > > > > >>> > >>> this
> > >> > > > > >>> > >>> >> can
> > >> > > > > >>> > >>> >> >> be even
> > >> > > > > >>> > >>> >> >> > >> normal
> > >> > > > > >>> > >>> >> >> > >>>> duding rolling restart (as
> > some
> > >> > > > > connections
> > >> > > > > >>> get
> > >> > > > > >>> > >>> broken
> > >> > > > > >>> > >>> >> in
> > >> > > > > >>> > >>> >> >> this case)
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>> However, I saw cases
> already
> > >> when
> > >> > > > > exceptions
> > >> > > > > >>> like
> > >> > > > > >>> > >>> these
> > >> > > > > >>> > >>> >> >> killed
> > >> > > > > >>> > >>> >> >> > receiver
> > >> > > > > >>> > >>> >> >> > >>> or
> > >> > > > > >>> > >>> >> >> > >>>> sender threads in
> > >> QuorumCnxManager /
> > >> > > > > Leader
> > >> > > > > >>> > >>> Election in
> > >> > > > > >>> > >>> >> >> such a way
> > >> > > > > >>> > >>> >> >> > that
> > >> > > > > >>> > >>> >> >> > >>>> they were not able to
> > recover,
> > >> so
> > >> > > the
> > >> > > > > node was
> > >> > > > > >>> > >>> unable to
> > >> > > > > >>> > >>> >> >> connect to
> > >> > > > > >>> > >>> >> >> > any
> > >> > > > > >>> > >>> >> >> > >>>> quorum until restart. I
> > >> remember
> > >> > > > seeing
> > >> > > > > this
> > >> > > > > >>> in
> > >> > > > > >>> > 3.4
> > >> > > > > >>> > >>> too.
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>> Do you see these exceptions
> > in
> > >> the
> > >> > > > > second
> > >> > > > > >>> server
> > >> > > > > >>> > >>> (the
> > >> > > > > >>> > >>> >> one
> > >> > > > > >>> > >>> >> >> which you
> > >> > > > > >>> > >>> >> >> > >> just
> > >> > > > > >>> > >>> >> >> > >>>> upgraded in step 3)?
> > >> > > > > >>> > >>> >> >> > >>>> Is this issue reproducible?
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>> What is the tickTime and
> > >> initLimit
> > >> > > you
> > >> > > > > use?
> > >> > > > > >>> Maybe
> > >> > > > > >>> > >>> the
> > >> > > > > >>> > >>> >> >> server just
> > >> > > > > >>> > >>> >> >> > >> require
> > >> > > > > >>> > >>> >> >> > >>>> more time to sync?
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>> I would need more logs to
> > >> really see
> > >> > > > > what
> > >> > > > > >>> > happened.
> > >> > > > > >>> > >>> Can
> > >> > > > > >>> > >>> >> >> you create a
> > >> > > > > >>> > >>> >> >> > >> Jira
> > >> > > > > >>> > >>> >> >> > >>>> issue and upload the logs
> and
> > >> also
> > >> > > the
> > >> > > > > >>> ZooKeeper
> > >> > > > > >>> > >>> >> configs?
> > >> > > > > >>> > >>> >> >> I am happy
> > >> > > > > >>> > >>> >> >> > to
> > >> > > > > >>> > >>> >> >> > >>>> take a closer look.
> > >> > > > > >>> > >>> >> >> > >>>> (if you need to re-run the
> > >> test to
> > >> > > > > collect the
> > >> > > > > >>> > logs,
> > >> > > > > >>> > >>> >> then
> > >> > > > > >>> > >>> >> >> enabling
> > >> > > > > >>> > >>> >> >> > >> DEBUG
> > >> > > > > >>> > >>> >> >> > >>>> logs would be great. The
> INFO
> > >> level
> > >> > > > > logs are
> > >> > > > > >>> > usually
> > >> > > > > >>> > >>> >> >> enough for these
> > >> > > > > >>> > >>> >> >> > >>>> problems, but one can never
> > >> know...)
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>> Kind regards,
> > >> > > > > >>> > >>> >> >> > >>>> Mate
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at
> 10:05
> > AM
> > >> > > > kuldeep
> > >> > > > > singh
> > >> > > > > >>> <
> > >> > > > > >>> > >>> >> >> > >> kuldeep.singh08@gmail.com
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>> wrote:
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>>> Hi Team,
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> I have done some POC on
> > >> rolling
> > >> > > > > upgrade and
> > >> > > > > >>> found
> > >> > > > > >>> > >>> below
> > >> > > > > >>> > >>> >> >> result.
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> 1. On 1st node upgrade
> > >> zookeeper
> > >> > > .
> > >> > > > > Traffic
> > >> > > > > >>> was
> > >> > > > > >>> > >>> >> running
> > >> > > > > >>> > >>> >> >> fine
> > >> > > > > >>> > >>> >> >> > >> because
> > >> > > > > >>> > >>> >> >> > >>> 2
> > >> > > > > >>> > >>> >> >> > >>>>> nodes are already on old
> > >> > > zookeeper.
> > >> > > > > >>> > >>> >> >> > >>>>> 2. On 1st node upgrade
> our
> > >> > > > > application and
> > >> > > > > >>> > didn’t
> > >> > > > > >>> > >>> >> find
> > >> > > > > >>> > >>> >> >> any issue
> > >> > > > > >>> > >>> >> >> > >>>>> 3. On 2nd node upgrade
> > >> zookeeper
> > >> > > > but
> > >> > > > > got
> > >> > > > > >>> below
> > >> > > > > >>> > >>> error
> > >> > > > > >>> > >>> >> >> and zookeeper
> > >> > > > > >>> > >>> >> >> > >>> is
> > >> > > > > >>> > >>> >> >> > >>>>> not taking any requests
> > >> > > > > >>> > >>> >> >> > >>>>> 4.
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > > > > >>> > >>> >> >>
> > >> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,587 -
> > WARN
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
> > >> > > > > >>> -
> > >> > > > > >>> > >>> >> >> Interrupting
> > >> > > > > >>> > >>> >> >> > >>> SendWorker
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 -
> > >> ERROR
> > >> > > > > >>> [LearnerHandler-/
> > >> > > > > >>> > >>> >> >> 192.168.44.73:33754
> > >> > > > > >>> > >>> >> >> > >>>>> :LearnerHandler@562] -
> > >> Unexpected
> > >> > > > > exception
> > >> > > > > >>> > >>> causing
> > >> > > > > >>> > >>> >> >> shutdown while
> > >> > > > > >>> > >>> >> >> > >>> sock
> > >> > > > > >>> > >>> >> >> > >>>>> still open
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > > > > >>> > >>> >> >>
> > >> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>>
> > >> > > > >
> > >> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> at
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> >
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 -
> > WARN
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > [SendWorker:1:QuorumCnxManager$SendWorker@679]
> > >> > > > > >>> -
> > >> > > > > >>> > >>> >> >> Interrupted while
> > >> > > > > >>> > >>> >> >> > >>>> waiting
> > >> > > > > >>> > >>> >> >> > >>>>> for message on queue
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> Please let me know is this
> > the
> > >> > > known
> > >> > > > > issue or
> > >> > > > > >>> > this
> > >> > > > > >>> > >>> is
> > >> > > > > >>> > >>> >> >> different issue
> > >> > > > > >>> > >>> >> >> > >>>> which
> > >> > > > > >>> > >>> >> >> > >>>>> is mention in Apache
> > zookeeper
> > >> > > > > documentation
> > >> > > > > >>> when
> > >> > > > > >>> > >>> >> >> upgrading from
> > >> > > > > >>> > >>> >> >> > >> 3.4.5
> > >> > > > > >>> > >>> >> >> > >>> to
> > >> > > > > >>> > >>> >> >> > >>>>> 3.5.6
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> Thanks,
> > >> > > > > >>> > >>> >> >> > >>>>> ---------------------
> > >> > > > > >>> > >>> >> >> > >>>>> Kuldeep Singh Budania
> > >> > > > > >>> > >>> >> >> > >>>>> Software Architect
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at
> 9:06
> > >> AM
> > >> > > > > Alexander
> > >> > > > > >>> Shraer
> > >> > > > > >>> > <
> > >> > > > > >>> > >>> >> >> shralex@gmail.com>
> > >> > > > > >>> > >>> >> >> > >>>>> wrote:
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>> +1 to what Mate said (I
> > >> wrote the
> > >> > > > > quoted
> > >> > > > > >>> > >>> >> instructions).
> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at
> > 7:03
> > >> AM
> > >> > > > > Szalay-Bekő
> > >> > > > > >>> > Máté <
> > >> > > > > >>> > >>> >> >> > >>>>>>
> szalay.beko.mate@gmail.com
> > >
> > >> > > > > >>> > >>> >> >> > >>>>>> wrote:
> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>> Hi Kuldeep,
> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>> I just want to provide
> you
> > >> some
> > >> > > > > background
> > >> > > > > >>> info
> > >> > > > > >>> > >>> about
> > >> > > > > >>> > >>> >> >> our
> > >> > > > > >>> > >>> >> >> > >>>>> documentation.
> > >> > > > > >>> > >>> >> >> > >>>>>>> The reason to upgrade to
> > >> 3.4.6
> > >> > > > first
> > >> > > > > is to
> > >> > > > > >>> > avoid
> > >> > > > > >>> > >>> the
> > >> > > > > >>> > >>> >> >> following
> > >> > > > > >>> > >>> >> >> > >>> error:
> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663
> > >> > > [myid:2] -
> > >> > > > > WARN
> > >> > > > > >>> > >>> [localhost/
> > >> > > > > >>> > >>> >> >> > >>> 127.0.0.1:2784
> > >> > > > > >>> > >>> >> >> > >>>>>>> :QuorumCnxManager@349]
> -
> > >> Invalid
> > >> > > > > server
> > >> > > > > >>> id:
> > >> > > > > >>> > >>> -65536
> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>> This error comes because
> > of
> > >> the
> > >> > > > > protocol
> > >> > > > > >>> > changes
> > >> > > > > >>> > >>> >> between
> > >> > > > > >>> > >>> >> >> > >> ZooKeeper
> > >> > > > > >>> > >>> >> >> > >>>>> server
> > >> > > > > >>> > >>> >> >> > >>>>>>> nodes during connection
> > >> > > initiation
> > >> > > > > for
> > >> > > > > >>> leader
> > >> > > > > >>> > >>> >> election.
> > >> > > > > >>> > >>> >> >> In
> > >> > > > > >>> > >>> >> >> > >>> ZooKeeper
> > >> > > > > >>> > >>> >> >> > >>>>> 3.5
> > >> > > > > >>> > >>> >> >> > >>>>>> a
> > >> > > > > >>> > >>> >> >> > >>>>>>> protocol version was
> > >> introduced
> > >> > > > (see
> > >> > > > > >>> > >>> ZOOKEEPER-107)
> > >> > > > > >>> > >>> >> and
> > >> > > > > >>> > >>> >> >> since
> > >> > > > > >>> > >>> >> >> > >> that
> > >> > > > > >>> > >>> >> >> > >>>> time
> > >> > > > > >>> > >>> >> >> > >>>>>> the
> > >> > > > > >>> > >>> >> >> > >>>>>>> fist long value sent in
> > the
> > >> > > initial
> > >> > > > > >>> message is
> > >> > > > > >>> > >>> not
> > >> > > > > >>> > >>> >> the
> > >> > > > > >>> > >>> >> >> server ID
> > >> > > > > >>> > >>> >> >> > >>> but
> > >> > > > > >>> > >>> >> >> > >>>>> the
> > >> > > > > >>> > >>> >> >> > >>>>>>> protocol version
> (-65536).
> > >> In
> > >> > > > > ZooKeeper
> > >> > > > > >>> 3.4.6
> > >> > > > > >>> > we
> > >> > > > > >>> > >>> made
> > >> > > > > >>> > >>> >> >> the old 3.4
> > >> > > > > >>> > >>> >> >> > >>>>>>> ZooKeepers backward
> > >> compatible,
> > >> > > so
> > >> > > > > they are
> > >> > > > > >>> > able
> > >> > > > > >>> > >>> to
> > >> > > > > >>> > >>> >> >> parse both
> > >> > > > > >>> > >>> >> >> > >> the
> > >> > > > > >>> > >>> >> >> > >>>> old
> > >> > > > > >>> > >>> >> >> > >>>>>> and
> > >> > > > > >>> > >>> >> >> > >>>>>>> the new protocol format
> > (see
> > >> > > > > >>> ZOOKEEPER-1633).
> > >> > > > > >>> > >>> This
> > >> > > > > >>> > >>> >> >> issue happens
> > >> > > > > >>> > >>> >> >> > >>> only
> > >> > > > > >>> > >>> >> >> > >>>>>> when
> > >> > > > > >>> > >>> >> >> > >>>>>>> you need to use old
> > (3.4.0 -
> > >> > > 3.4.5)
> > >> > > > > and new
> > >> > > > > >>> > >>> (3.5.0+)
> > >> > > > > >>> > >>> >> >> ZooKeeper
> > >> > > > > >>> > >>> >> >> > >>>> servers
> > >> > > > > >>> > >>> >> >> > >>>>>>> together in the same
> > >> cluster.
> > >> > > > During
> > >> > > > > a
> > >> > > > > >>> rolling
> > >> > > > > >>> > >>> >> upgrade,
> > >> > > > > >>> > >>> >> >> this is
> > >> > > > > >>> > >>> >> >> > >>>> usually
> > >> > > > > >>> > >>> >> >> > >>>>>> the
> > >> > > > > >>> > >>> >> >> > >>>>>>> case to have old and new
> > >> > > ZooKeepers
> > >> > > > > present
> > >> > > > > >>> > >>> together.
> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>> The fact that you
> haven't
> > >> seen
> > >> > > any
> > >> > > > > issues
> > >> > > > > >>> might
> > >> > > > > >>> > >>> be
> > >> > > > > >>> > >>> >> >> caused by the
> > >> > > > > >>> > >>> >> >> > >>>> order
> > >> > > > > >>> > >>> >> >> > >>>>> of
> > >> > > > > >>> > >>> >> >> > >>>>>>> the servers. In
> ZooKeeper
> > >> the
> > >> > > > > connection
> > >> > > > > >>> > >>> initiation
> > >> > > > > >>> > >>> >> >> between the
> > >> > > > > >>> > >>> >> >> > >>>> servers
> > >> > > > > >>> > >>> >> >> > >>>>>>> during the leader
> election
> > >> > > follows
> > >> > > > a
> > >> > > > > >>> specific
> > >> > > > > >>> > >>> rule.
> > >> > > > > >>> > >>> >> As
> > >> > > > > >>> > >>> >> >> far as I
> > >> > > > > >>> > >>> >> >> > >>>>> remember
> > >> > > > > >>> > >>> >> >> > >>>>>>> always the server with
> the
> > >> larger
> > >> > > > ID
> > >> > > > > 'wins
> > >> > > > > >>> the
> > >> > > > > >>> > >>> >> >> challenge', so it
> > >> > > > > >>> > >>> >> >> > >> is
> > >> > > > > >>> > >>> >> >> > >>>>>>> possible, that the old
> > >> server
> > >> > > > didn't
> > >> > > > > need
> > >> > > > > >>> to
> > >> > > > > >>> > >>> parse
> > >> > > > > >>> > >>> >> any
> > >> > > > > >>> > >>> >> >> initial
> > >> > > > > >>> > >>> >> >> > >>>> message
> > >> > > > > >>> > >>> >> >> > >>>>>> (if
> > >> > > > > >>> > >>> >> >> > >>>>>>> it had the largest ID)
> and
> > >> this
> > >> > > is
> > >> > > > > why you
> > >> > > > > >>> > >>> haven't
> > >> > > > > >>> > >>> >> seen
> > >> > > > > >>> > >>> >> >> the
> > >> > > > > >>> > >>> >> >> > >> issue.
> > >> > > > > >>> > >>> >> >> > >>>> Also
> > >> > > > > >>> > >>> >> >> > >>>>>>> having 2 nodes up from
> > the 3
> > >> > > nodes
> > >> > > > > cluster
> > >> > > > > >>> > still
> > >> > > > > >>> > >>> >> makes
> > >> > > > > >>> > >>> >> >> the
> > >> > > > > >>> > >>> >> >> > >> cluster
> > >> > > > > >>> > >>> >> >> > >>>> work
> > >> > > > > >>> > >>> >> >> > >>>>>> (so
> > >> > > > > >>> > >>> >> >> > >>>>>>> you should also check if
> > >> all the
> > >> > > > > servers
> > >> > > > > >>> are
> > >> > > > > >>> > >>> part of
> > >> > > > > >>> > >>> >> >> the quorum).
> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>> I agree with Enrico and
> > >> Norbert,
> > >> > > > the
> > >> > > > > >>> safest and
> > >> > > > > >>> > >>> most
> > >> > > > > >>> > >>> >> >> stable way
> > >> > > > > >>> > >>> >> >> > >> is
> > >> > > > > >>> > >>> >> >> > >>>>>> upgrade
> > >> > > > > >>> > >>> >> >> > >>>>>>> first to 3.4.latest,
> then
> > >> go to
> > >> > > > > 3.5.latest.
> > >> > > > > >>> > >>> Still, if
> > >> > > > > >>> > >>> >> >> you don't
> > >> > > > > >>> > >>> >> >> > >> see
> > >> > > > > >>> > >>> >> >> > >>>>> that
> > >> > > > > >>> > >>> >> >> > >>>>>>> you would hit this
> > specific
> > >> issue
> > >> > > > > (e.g. no
> > >> > > > > >>> > >>> "Invalid
> > >> > > > > >>> > >>> >> >> server id" in
> > >> > > > > >>> > >>> >> >> > >>> the
> > >> > > > > >>> > >>> >> >> > >>>>> log
> > >> > > > > >>> > >>> >> >> > >>>>>>> files), and all the
> three
> > >> servers
> > >> > > > can
> > >> > > > > >>> handle
> > >> > > > > >>> > >>> traffic,
> > >> > > > > >>> > >>> >> >> then maybe
> > >> > > > > >>> > >>> >> >> > >>> you
> > >> > > > > >>> > >>> >> >> > >>>>>> don't
> > >> > > > > >>> > >>> >> >> > >>>>>>> need to upgrade first to
> > >> > > > 3.4.latest,
> > >> > > > > it is
> > >> > > > > >>> your
> > >> > > > > >>> > >>> >> >> decision.
> > >> > > > > >>> > >>> >> >> > >>> Definitely
> > >> > > > > >>> > >>> >> >> > >>>>> you
> > >> > > > > >>> > >>> >> >> > >>>>>>> should test it first, as
> > >> > > suggested
> > >> > > > > by the
> > >> > > > > >>> > others.
> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>> Kind regards,
> > >> > > > > >>> > >>> >> >> > >>>>>>> Mate
> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at
> > >> 12:29 PM
> > >> > > > > Norbert
> > >> > > > > >>> Kalmar
> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> <nk...@cloudera.com.invalid>
> > >> > > > > wrote:
> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>> Hi,
> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>> That guide is to
> upgrade
> > to
> > >> > > 3.5.0,
> > >> > > > > which
> > >> > > > > >>> was
> > >> > > > > >>> > an
> > >> > > > > >>> > >>> >> alpha
> > >> > > > > >>> > >>> >> >> version.
> > >> > > > > >>> > >>> >> >> > >> A
> > >> > > > > >>> > >>> >> >> > >>>> lot
> > >> > > > > >>> > >>> >> >> > >>>>>> has
> > >> > > > > >>> > >>> >> >> > >>>>>>>> changed for the first
> > >> stable
> > >> > > > > release of
> > >> > > > > >>> 3.5.5
> > >> > > > > >>> > >>> and
> > >> > > > > >>> > >>> >> then
> > >> > > > > >>> > >>> >> >> a few
> > >> > > > > >>> > >>> >> >> > >>> more,
> > >> > > > > >>> > >>> >> >> > >>>>> even
> > >> > > > > >>> > >>> >> >> > >>>>>>>> rolling upgrade issues
> > >> have been
> > >> > > > > fixed for
> > >> > > > > >>> > >>> 3.5.6.
> > >> > > > > >>> > >>> >> >> > >>>>>>>> This is a more
> up-to-date
> > >> guide:
> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> >
> > >> > > > >
> > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>> If you have done your
> > >> testing
> > >> > > > (with
> > >> > > > > prod
> > >> > > > > >>> > >>> snapshot!),
> > >> > > > > >>> > >>> >> >> then you
> > >> > > > > >>> > >>> >> >> > >> can
> > >> > > > > >>> > >>> >> >> > >>>>> skip
> > >> > > > > >>> > >>> >> >> > >>>>>>> 3.4
> > >> > > > > >>> > >>> >> >> > >>>>>>>> latest upgrade, but
> keep
> > >> in mind
> > >> > > > we
> > >> > > > > do our
> > >> > > > > >>> > >>> >> >> recommendations for
> > >> > > > > >>> > >>> >> >> > >> a
> > >> > > > > >>> > >>> >> >> > >>>>>> reason.
> > >> > > > > >>> > >>> >> >> > >>>>>>>> There were issues
> > reported
> > >> > > and/or
> > >> > > > > found
> > >> > > > > >>> during
> > >> > > > > >>> > >>> >> >> testing. Some
> > >> > > > > >>> > >>> >> >> > >> are
> > >> > > > > >>> > >>> >> >> > >>>>> fixed
> > >> > > > > >>> > >>> >> >> > >>>>>>> with
> > >> > > > > >>> > >>> >> >> > >>>>>>>> 3.5.6, some only
> happens
> > if
> > >> > > > certain
> > >> > > > > >>> conditions
> > >> > > > > >>> > >>> stand
> > >> > > > > >>> > >>> >> >> > >>> (IOException:
> > >> > > > > >>> > >>> >> >> > >>>> No
> > >> > > > > >>> > >>> >> >> > >>>>>>>> snapshot found -
> > mentioned
> > >> in
> > >> > > the
> > >> > > > > guide,
> > >> > > > > >>> fixed
> > >> > > > > >>> > >>> in
> > >> > > > > >>> > >>> >> >> 3.5.6).
> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>> So it is up to you, I
> > would
> > >> > > still
> > >> > > > > >>> recommend to
> > >> > > > > >>> > >>> do an
> > >> > > > > >>> > >>> >> >> 3.4
> > >> > > > > >>> > >>> >> >> > >> upgrade
> > >> > > > > >>> > >>> >> >> > >>>>> first,
> > >> > > > > >>> > >>> >> >> > >>>>>>> if
> > >> > > > > >>> > >>> >> >> > >>>>>>>> it's feasible.
> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>> Regards,
> > >> > > > > >>> > >>> >> >> > >>>>>>>> Norbert
> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at
> > >> 11:45 AM
> > >> > > > > kuldeep
> > >> > > > > >>> > singh <
> > >> > > > > >>> > >>> >> >> > >>>>>>>
> kuldeep.singh08@gmail.com
> > >
> > >> > > > > >>> > >>> >> >> > >>>>>>>> wrote:
> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Hi,
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Current Zookeeper
> > version
> > >> :-
> > >> > > > 3.4.5
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Upgraded version
> > >> > > > :-
> > >> > > > > 3.5.6
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> We are not going with
> > >> 3.5.7.
> > >> > > Our
> > >> > > > > final
> > >> > > > > >>> > >>> decision is
> > >> > > > > >>> > >>> >> >> zookeeper
> > >> > > > > >>> > >>> >> >> > >>>>> version
> > >> > > > > >>> > >>> >> >> > >>>>>> is
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.5.6
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> as per your reply
> first
> > >> we need
> > >> > > > to
> > >> > > > > move
> > >> > > > > >>> > latest
> > >> > > > > >>> > >>> >> >> version of
> > >> > > > > >>> > >>> >> >> > >>> 3.4.x,
> > >> > > > > >>> > >>> >> >> > >>>>> like
> > >> > > > > >>> > >>> >> >> > >>>>>>>> below
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 ->
> 3.5.6
> > >> > > (Correct
> > >> > > > > me if
> > >> > > > > >>> I am
> > >> > > > > >>> > >>> wrong
> > >> > > > > >>> > >>> >> >> here)
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> But if We are not
> facing
> > >> any
> > >> > > > > problem
> > >> > > > > >>> that i
> > >> > > > > >>> > >>> have
> > >> > > > > >>> > >>> >> >> shared you
> > >> > > > > >>> > >>> >> >> > >>> that
> > >> > > > > >>> > >>> >> >> > >>>> we
> > >> > > > > >>> > >>> >> >> > >>>>>>> have
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> set up of 3 node
> cluster
> > >> where
> > >> > > 2
> > >> > > > > node
> > >> > > > > >>> are on
> > >> > > > > >>> > >>> 3.5.6
> > >> > > > > >>> > >>> >> >> version
> > >> > > > > >>> > >>> >> >> > >> and
> > >> > > > > >>> > >>> >> >> > >>> 1
> > >> > > > > >>> > >>> >> >> > >>>>> node
> > >> > > > > >>> > >>> >> >> > >>>>>>> on
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything is
> > >> running
> > >> > > fine
> > >> > > > > and
> > >> > > > > >>> didn't
> > >> > > > > >>> > >>> get
> > >> > > > > >>> > >>> >> any
> > >> > > > > >>> > >>> >> >> issue,
> > >> > > > > >>> > >>> >> >> > >> So
> > >> > > > > >>> > >>> >> >> > >>>> what
> > >> > > > > >>> > >>> >> >> > >>>>>>> other
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> problem we can face if
> > we
> > >> > > > directly
> > >> > > > > move
> > >> > > > > >>> to
> > >> > > > > >>> > >>> 3.5.6
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Thanks,
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> ---------------------
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> Software Architect
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020
> at
> > >> 3:58 PM
> > >> > > > > Enrico
> > >> > > > > >>> > >>> Olivelli <
> > >> > > > > >>> > >>> >> >> > >>>>> eolivelli@gmail.com
> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> wrote:
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Hi
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> You have to upgrade
> to
> > >> latest
> > >> > > > > 3.4.x
> > >> > > > > >>> > Zookeeper
> > >> > > > > >>> > >>> then
> > >> > > > > >>> > >>> >> >> you will
> > >> > > > > >>> > >>> >> >> > >>>>> upgrade
> > >> > > > > >>> > >>> >> >> > >>>>>>> to
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> 3.5.7.
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> All should run well
> > >> without
> > >> > > > issues
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Enrico
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020,
> > 10:18
> > >> > > > kuldeep
> > >> > > > > singh
> > >> > > > > >>> <
> > >> > > > > >>> > >>> >> >> > >>>>> kuldeep.singh08@gmail.com
> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>> ha
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> scritto:
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Hi Team,
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> We are upgrading
> > >> zookeeper
> > >> > > from
> > >> > > > > 3.4.5
> > >> > > > > >>> to
> > >> > > > > >>> > >>> 3.5.6. I
> > >> > > > > >>> > >>> >> >> have
> > >> > > > > >>> > >>> >> >> > >> set
> > >> > > > > >>> > >>> >> >> > >>>> up 3
> > >> > > > > >>> > >>> >> >> > >>>>>>> node
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> cluster where 2 node
> > >> are on
> > >> > > > 3.5.6
> > >> > > > > >>> version
> > >> > > > > >>> > >>> and 1
> > >> > > > > >>> > >>> >> >> node on
> > >> > > > > >>> > >>> >> >> > >>>> 3.4.5.
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Everything is
> running
> > >> fine
> > >> > > and
> > >> > > > > didn't
> > >> > > > > >>> get
> > >> > > > > >>> > any
> > >> > > > > >>> > >>> >> issue
> > >> > > > > >>> > >>> >> >> on my
> > >> > > > > >>> > >>> >> >> > >>>>> system.
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> but I found
> something
> > on
> > >> > > apache
> > >> > > > > site
> > >> > > > > >>> that
> > >> > > > > >>> > >>> first
> > >> > > > > >>> > >>> >> we
> > >> > > > > >>> > >>> >> >> need
> > >> > > > > >>> > >>> >> >> > >> to
> > >> > > > > >>> > >>> >> >> > >>>>>> upgrade
> > >> > > > > >>> > >>> >> >> > >>>>>>>> on
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can
> > >> upgrade to
> > >> > > > > 3.5.6. So
> > >> > > > > >>> is
> > >> > > > > >>> > it
> > >> > > > > >>> > >>> >> >> mandatory
> > >> > > > > >>> > >>> >> >> > >> to
> > >> > > > > >>> > >>> >> >> > >>> go
> > >> > > > > >>> > >>> >> >> > >>>>> on
> > >> > > > > >>> > >>> >> >> > >>>>>>>> 3.4.6
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> first.
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Upgrading a running
> > >> ZooKeeper
> > >> > > > > ensemble
> > >> > > > > >>> to
> > >> > > > > >>> > >>> 3.5.0
> > >> > > > > >>> > >>> >> >> should be
> > >> > > > > >>> > >>> >> >> > >>>> done
> > >> > > > > >>> > >>> >> >> > >>>>>> only
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> after
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> upgrading your
> > ensemble
> > >> to
> > >> > > the
> > >> > > > > 3.4.6
> > >> > > > > >>> > release.
> > >> > > > > >>> > >>> >> Note
> > >> > > > > >>> > >>> >> >> that
> > >> > > > > >>> > >>> >> >> > >>> this
> > >> > > > > >>> > >>> >> >> > >>>> is
> > >> > > > > >>> > >>> >> >> > >>>>>>> only
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> necessary for
> rolling
> > >> > > upgrades
> > >> > > > > (if
> > >> > > > > >>> you're
> > >> > > > > >>> > >>> fine
> > >> > > > > >>> > >>> >> with
> > >> > > > > >>> > >>> >> >> > >>> shutting
> > >> > > > > >>> > >>> >> >> > >>>>> down
> > >> > > > > >>> > >>> >> >> > >>>>>>> the
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> system completely,
> you
> > >> don't
> > >> > > > > have to go
> > >> > > > > >>> > >>> through
> > >> > > > > >>> > >>> >> >> 3.4.6).
> > >> > > > > >>> > >>> >> >> > >> If
> > >> > > > > >>> > >>> >> >> > >>>> you
> > >> > > > > >>> > >>> >> >> > >>>>>>>> attempt
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> a
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> rolling upgrade
> > without
> > >> going
> > >> > > > > through
> > >> > > > > >>> 3.4.6
> > >> > > > > >>> > >>> (for
> > >> > > > > >>> > >>> >> >> example
> > >> > > > > >>> > >>> >> >> > >>> from
> > >> > > > > >>> > >>> >> >> > >>>>>>> 3.4.5),
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> you
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> may get the
> following
> > >> error:
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30
> > 11:32:10,663
> > >> > > > [myid:2]
> > >> > > > > - INFO
> > >> > > > > >>> > >>> >> [localhost/
> > >> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > > :QuorumCnxManager$Listener@498
> > >> > > > ]
> > >> > > > > -
> > >> > > > > >>> Received
> > >> > > > > >>> > >>> >> >> connection
> > >> > > > > >>> > >>> >> >> > >>>> request
> > >> > > > > >>> > >>> >> >> > >>>>> /
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30
> > 11:32:10,663
> > >> > > > [myid:2]
> > >> > > > > - WARN
> > >> > > > > >>> > >>> >> [localhost/
> > >> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> :QuorumCnxManager@349
> > ]
> > >> -
> > >> > > > Invalid
> > >> > > > > >>> server
> > >> > > > > >>> > id:
> > >> > > > > >>> > >>> >> -65536
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> During a rolling
> > >> upgrade,
> > >> > > each
> > >> > > > > server
> > >> > > > > >>> is
> > >> > > > > >>> > >>> taken
> > >> > > > > >>> > >>> >> down
> > >> > > > > >>> > >>> >> >> in
> > >> > > > > >>> > >>> >> >> > >> turn
> > >> > > > > >>> > >>> >> >> > >>>> and
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> rebooted
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> with the new 3.5.0
> > >> binaries.
> > >> > > > > Before
> > >> > > > > >>> > starting
> > >> > > > > >>> > >>> the
> > >> > > > > >>> > >>> >> >> server
> > >> > > > > >>> > >>> >> >> > >>> with
> > >> > > > > >>> > >>> >> >> > >>>>>> 3.5.0
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> binaries, we highly
> > >> recommend
> > >> > > > > updating
> > >> > > > > >>> the
> > >> > > > > >>> > >>> >> >> configuration
> > >> > > > > >>> > >>> >> >> > >>> file
> > >> > > > > >>> > >>> >> >> > >>>>> so
> > >> > > > > >>> > >>> >> >> > >>>>>>> that
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> all
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> server statements
> > >> > > > "server.x=..."
> > >> > > > > >>> contain
> > >> > > > > >>> > >>> client
> > >> > > > > >>> > >>> >> >> ports
> > >> > > > > >>> > >>> >> >> > >> (see
> > >> > > > > >>> > >>> >> >> > >>>> the
> > >> > > > > >>> > >>> >> >> > >>>>>>>> section
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Specifying
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> the client port). As
> > >> > > explained
> > >> > > > > earlier
> > >> > > > > >>> you
> > >> > > > > >>> > >>> may
> > >> > > > > >>> > >>> >> >> leave the
> > >> > > > > >>> > >>> >> >> > >>>>>>>> configuration
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>> in a
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> single file, as well
> > as
> > >> leave
> > >> > > > the
> > >> > > > > >>> > >>> >> >> > >>>>
> clientPort/clientPortAddress
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> (although if you
> > specify
> > >> > > client
> > >> > > > > ports
> > >> > > > > >>> in
> > >> > > > > >>> > the
> > >> > > > > >>> > >>> new
> > >> > > > > >>> > >>> >> >> format,
> > >> > > > > >>> > >>> >> >> > >>>> these
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> are now redundant).
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Could you please let
> > me
> > >> know
> > >> > > > > about this
> > >> > > > > >>> > case.
> > >> > > > > >>> > >>> >> >> Appreciate
> > >> > > > > >>> > >>> >> >> > >> if
> > >> > > > > >>> > >>> >> >> > >>>>>> respond
> > >> > > > > >>> > >>> >> >> > >>>>>>>>> soon.
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Thanks,
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> ---------------------
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh
> Budania
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>>
> > >> > > > > >>> > >>> >> >> > >>>>>
> > >> > > > > >>> > >>> >> >> > >>>>
> > >> > > > > >>> > >>> >> >> > >>>
> > >> > > > > >>> > >>> >> >> > >>
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >> >
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> ________________________________
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > >> > > > > >>> > >>> >> >> This e-mail (including any
> attachments)
> > is
> > >> > > > strictly
> > >> > > > > >>> > >>> confidential
> > >> > > > > >>> > >>> >> and
> > >> > > > > >>> > >>> >> >> may also contain privileged information.
> If
> > >> you are
> > >> > > > > not the
> > >> > > > > >>> > >>> intended
> > >> > > > > >>> > >>> >> >> recipient you are not authorised to read,
> > >> print,
> > >> > > > save,
> > >> > > > > >>> process or
> > >> > > > > >>> > >>> >> disclose
> > >> > > > > >>> > >>> >> >> this message. If you have received this
> > >> message by
> > >> > > > > mistake,
> > >> > > > > >>> > please
> > >> > > > > >>> > >>> >> inform
> > >> > > > > >>> > >>> >> >> the sender immediately and destroy this
> > >> e-mail, its
> > >> > > > > >>> attachments
> > >> > > > > >>> > >>> and any
> > >> > > > > >>> > >>> >> >> copies. Any use, distribution,
> reproduction
> > or
> > >> > > > > disclosure by
> > >> > > > > >>> any
> > >> > > > > >>> > >>> person
> > >> > > > > >>> > >>> >> >> other than the intended recipient is
> > strictly
> > >> > > > > prohibited and
> > >> > > > > >>> the
> > >> > > > > >>> > >>> person
> > >> > > > > >>> > >>> >> >> responsible may incur in penalties.
> > >> > > > > >>> > >>> >> >> The use of this e-mail is only for
> > >> professional
> > >> > > > > purposes;
> > >> > > > > >>> > >>> there is
> > >> > > > > >>> > >>> >> no
> > >> > > > > >>> > >>> >> >> guarantee that the correspondence towards
> > this
> > >> > > e-mail
> > >> > > > > will be
> > >> > > > > >>> > read
> > >> > > > > >>> > >>> >> only by
> > >> > > > > >>> > >>> >> >> the recipient, because, under certain
> > >> > > circumstances,
> > >> > > > > there
> > >> > > > > >>> may
> > >> > > > > >>> > be a
> > >> > > > > >>> > >>> >> need to
> > >> > > > > >>> > >>> >> >> access this email by third subjects
> > belonging
> > >> to
> > >> > > the
> > >> > > > > Company.
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> ________________________________
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > >> > > > > >>> > >>> >> >> This e-mail (including any attachments) is
> > >> strictly
> > >> > > > > >>> confidential
> > >> > > > > >>> > >>> and
> > >> > > > > >>> > >>> >> may
> > >> > > > > >>> > >>> >> >> also contain privileged information. If
> you
> > >> are not
> > >> > > > the
> > >> > > > > >>> intended
> > >> > > > > >>> > >>> >> recipient
> > >> > > > > >>> > >>> >> >> you are not authorised to read, print,
> save,
> > >> > > process
> > >> > > > or
> > >> > > > > >>> disclose
> > >> > > > > >>> > >>> this
> > >> > > > > >>> > >>> >> >> message. If you have received this message
> > by
> > >> > > > mistake,
> > >> > > > > please
> > >> > > > > >>> > >>> inform
> > >> > > > > >>> > >>> >> the
> > >> > > > > >>> > >>> >> >> sender immediately and destroy this
> e-mail,
> > >> its
> > >> > > > > attachments
> > >> > > > > >>> and
> > >> > > > > >>> > any
> > >> > > > > >>> > >>> >> copies.
> > >> > > > > >>> > >>> >> >> Any use, distribution, reproduction or
> > >> disclosure
> > >> > > by
> > >> > > > > any
> > >> > > > > >>> person
> > >> > > > > >>> > >>> other
> > >> > > > > >>> > >>> >> than
> > >> > > > > >>> > >>> >> >> the intended recipient is strictly
> > prohibited
> > >> and
> > >> > > the
> > >> > > > > person
> > >> > > > > >>> > >>> >> responsible
> > >> > > > > >>> > >>> >> >> may incur in penalties.
> > >> > > > > >>> > >>> >> >> The use of this e-mail is only for
> > >> professional
> > >> > > > > purposes;
> > >> > > > > >>> there
> > >> > > > > >>> > is
> > >> > > > > >>> > >>> no
> > >> > > > > >>> > >>> >> >> guarantee that the correspondence towards
> > this
> > >> > > e-mail
> > >> > > > > will be
> > >> > > > > >>> > read
> > >> > > > > >>> > >>> >> only by
> > >> > > > > >>> > >>> >> >> the recipient, because, under certain
> > >> > > circumstances,
> > >> > > > > there
> > >> > > > > >>> may
> > >> > > > > >>> > be a
> > >> > > > > >>> > >>> >> need to
> > >> > > > > >>> > >>> >> >> access this email by third subjects
> > belonging
> > >> to
> > >> > > the
> > >> > > > > Company.
> > >> > > > > >>> > >>> >> >>
> > >> > > > > >>> > >>> >> >
> > >> > > > > >>> > >>> >>
> > >> > > > > >>> > >>> >
> > >> > > > > >>> > >>>
> > >> > > > > >>> > >>
> > >> > > > > >>> >
> > >> > > > > >>>
> > >> > > > > >>
> > >> > > > >
> > >> > > > >
> > >> > > > > ________________________________
> > >> > > > >
> > >> > > > > CONFIDENTIALITY & PRIVACY NOTICE
> > >> > > > > This e-mail (including any attachments) is strictly
> confidential
> > >> and
> > >> > > may
> > >> > > > > also contain privileged information. If you are not the
> intended
> > >> > > > recipient
> > >> > > > > you are not authorised to read, print, save, process or
> disclose
> > >> this
> > >> > > > > message. If you have received this message by mistake, please
> > >> inform
> > >> > > the
> > >> > > > > sender immediately and destroy this e-mail, its attachments
> and
> > >> any
> > >> > > > copies.
> > >> > > > > Any use, distribution, reproduction or disclosure by any
> person
> > >> other
> > >> > > > than
> > >> > > > > the intended recipient is strictly prohibited and the person
> > >> > > responsible
> > >> > > > > may incur in penalties.
> > >> > > > > The use of this e-mail is only for professional purposes;
> there
> > >> is no
> > >> > > > > guarantee that the correspondence towards this e-mail will be
> > >> read only
> > >> > > > by
> > >> > > > > the recipient, because, under certain circumstances, there may
> > be
> > >> a
> > >> > > need
> > >> > > > to
> > >> > > > > access this email by third subjects belonging to the Company.
> > >> > > > >
> > >> > > >
> > >> > >
> > >>
> > >>
> >
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by Szalay-Bekő Máté <sz...@gmail.com>.
These log messages indicate that a client (or an other ZooKeeper server) is
trying to connect without SSL to a ZooKeeper process that expects SSL.
I assume this will be a configuration issue then.
Best regards,
Mate
On Wed, Oct 14, 2020 at 12:30 PM kuldeep singh <ku...@gmail.com>
wrote:
> Hi,
>
> more logs
>
> 2020-10-14 12:25:05,106 - ERROR
>
> [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler$CertificateVerifier@257
> ]
> - Unsuccessful handshake with session 0x0
>
> 2020-10-14 12:25:05,107 - WARN
> [nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler@138] -
> Exception caught
>
> io.netty.handler.codec.DecoderException:
> io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record:
> 737276720a
>
> at
>
> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:475)
>
> at
>
> io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:283)
>
> at
>
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
>
> at
>
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
>
> at
>
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
>
> at
>
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
>
> at
>
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
>
> at
>
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
>
> at
>
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
>
> at
>
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
>
> at
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
>
> at
>
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
>
> at
>
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
>
> at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
>
> at
>
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
>
> at
> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
>
> at
>
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
>
> at java.lang.Thread.run(Thread.java:748)
>
> Caused by: io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS
> record: 737276720a
>
> at
> io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1203)
>
> at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1271)
>
> at
>
> io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:505)
>
> at
>
> io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:444)
>
> ... 17 more
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
> Software Architect
>
>
>
> On Wed, Oct 14, 2020 at 3:51 PM kuldeep singh <ku...@gmail.com>
> wrote:
>
> > Hi,
> >
> >
> > below error is coming on zookeeper logs on SSL.
> >
> > 2020-10-14 12:18:27,410 - WARN
> [nioEventLoopGroup-4-16:NettyServerCnxn@540]
> > - Closing connection to /127.0.0.1:49470
> > java.io.IOException: Len error 369296128
> > at
> >
> org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:533)
> > at
> >
> org.apache.zookeeper.server.NettyServerCnxn.processMessage(NettyServerCnxn.java:360)
> > at
> >
> org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.channelRead(NettyServerCnxnFactory.java:184)
> > at
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > at
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > at
> >
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
> > at
> >
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
> > at
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> > at
> >
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> > at
> >
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
> > at
> >
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
> > at
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
> > at
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
> > at
> >
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
> > at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
> > at
> >
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> > at java.lang.Thread.run(Thread.java:748)
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> >
> >
> >
> > On Thu, Oct 8, 2020 at 6:33 PM Szalay-Bekő Máté <
> > szalay.beko.mate@gmail.com> wrote:
> >
> >> Sounds like a bug or a configuration issue...
> >> can you share the configs (before and after the scale-up) and the logs?
> >> also: does the truststores recognise all the keys used on all the 5
> >> nodes? (e.g. the truststores on the old nodes accept the new keys?)
> >>
> >> Best Regards,
> >> Mate
> >>
> >> On Thu, Oct 8, 2020 at 2:31 PM kuldeep singh <kuldeep.singh08@gmail.com
> >
> >> wrote:
> >> >
> >> > Hi,
> >> >
> >> > Yes, My client and server both are using certificate and have added in
> >> ZK
> >> > and client as well.
> >> >
> >> > Thanks,
> >> > ---------------------
> >> > Kuldeep Singh Budania
> >> >
> >> >
> >> >
> >> > On Thu, Oct 8, 2020 at 5:56 PM Enrico Olivelli <eo...@gmail.com>
> >> wrote:
> >> >
> >> > > Il giorno gio 8 ott 2020 alle ore 14:17 kuldeep singh <
> >> > > kuldeep.singh08@gmail.com> ha scritto:
> >> > >
> >> > > > Hi Team,
> >> > > >
> >> > > > I am facing one issue in SSL communication between client and
> >> zookeeper
> >> > > > server.
> >> > > >
> >> > > > ZK 3.5.6 version
> >> > > >
> >> > > > 1. Mi on 3 node
> >> > > > 2. Applying SSL and 3 nodes cluster is working fine
> >> > > > 3. Scaled my cluster with 2 nodes and now my cluster have 5 nodes
> >> over
> >> > > SSL
> >> > > >
> >> > > > but after scaling my SSL is not working between client and ZK
> >> server and
> >> > > > even not able to login using zkCli as well.
> >> > > >
> >> > > > Can someone provide the details please why it is happening?
> >> > > >
> >> > >
> >> > > Is your client configured to use SSL ?
> >> > >
> >> > > Enrico
> >> > >
> >> > >
> >> > >
> >> > > >
> >> > > > Thanks,
> >> > > > ---------------------
> >> > > > Kuldeep Singh Budania
> >> > > > Software Architect
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Mon, Jul 13, 2020 at 2:19 PM Enrico Olivelli - Diennea
> >> > > > <en...@diennea.com.invalid> wrote:
> >> > > >
> >> > > > > It looks like we ported it to 3.5.
> >> > > > >
> >> > > > > See the subtask
> >> > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2792
> >> > > > >
> >> > > > > Enrico
> >> > > > >
> >> > > > > Il giorno 13/07/20, 10:37 "kuldeep singh" <
> >> kuldeep.singh08@gmail.com>
> >> > > > ha
> >> > > > > scritto:
> >> > > > >
> >> > > > > Hi Team,
> >> > > > >
> >> > > > > I appreciate it if I will get a response as soon as
> possible,
> >> as I
> >> > > am
> >> > > > > stuck
> >> > > > > at this point.
> >> > > > >
> >> > > > > Thanks,
> >> > > > > ---------------------
> >> > > > > Kuldeep Singh Budania
> >> > > > >
> >> > > > >
> >> > > > >
> >> > > > > On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <
> >> > > > > kuldeep.singh08@gmail.com>
> >> > > > > wrote:
> >> > > > >
> >> > > > > > Hi Team,
> >> > > > > >
> >> > > > > > Server to Server communication is not supported in 3.5.6
> >> version
> >> > > > as
> >> > > > > per
> >> > > > > > below JIRA issue?
> >> > > > > >
> >> > > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2639
> >> > > > > >
> >> > > > > > Thanks,
> >> > > > > > ---------------------
> >> > > > > > Kuldeep Singh Budania
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > > On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <
> >> > > > > kuldeep.singh08@gmail.com>
> >> > > > > > wrote:
> >> > > > > >
> >> > > > > >> Thanks for the reply.
> >> > > > > >>
> >> > > > > >> Now my ZKCli cmd is working fine as we use some our
> >> customized
> >> > > > > >> authentication and we resolve the issue.
> >> > > > > >>
> >> > > > > >> Now I am going to implement Server to Server
> communication.
> >> > > > > >>
> >> > > > > >> Thanks,
> >> > > > > >> ---------------------
> >> > > > > >> Kuldeep Singh Budania
> >> > > > > >>
> >> > > > > >>
> >> > > > > >>
> >> > > > > >> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
> >> > > > > >> szalay.beko.mate@gmail.com> wrote:
> >> > > > > >>
> >> > > > > >>> I think SSL is working for you already... If you managed
> >> to
> >> > > start
> >> > > > > the
> >> > > > > >>> zkCli.sh and be able to connect to ZooKeeper on the
> >> secure port
> >> > > > > and issue
> >> > > > > >>> any kind of command (like: " ls / "), then the wire
> >> encryption
> >> > > is
> >> > > > > working
> >> > > > > >>> and your server/client communication is secured by
> >> ZooKeeper.
> >> > > > > >>>
> >> > > > > >>> Why you want to run the following command?
> >> > > > > >>> addauth ztpasswd zooadmin:<password>
> >> > > > > >>>
> >> > > > > >>> Do you also want to configure a superDigest user in
> >> ZooKeeper?
> >> > > > > Please
> >> > > > > >>> note
> >> > > > > >>> that this command is independent from SSL. If you need
> to
> >> > > create
> >> > > > a
> >> > > > > >>> username-password pair for digest authentication then
> >> please
> >> > > use
> >> > > > > the
> >> > > > > >>> command in the following way:
> >> > > > > >>> addauth digest zooadmin:yourSuperSecretPassword
> >> > > > > >>>
> >> > > > > >>> Kind regards,
> >> > > > > >>> Mate
> >> > > > > >>>
> >> > > > > >>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <
> >> > > > > kuldeep.singh08@gmail.com>
> >> > > > > >>> wrote:
> >> > > > > >>>
> >> > > > > >>> > 1. sh zkCli.sh --config /etc/zookeeper -server
> >> localhost:2281
> >> > > > > >>> >
> >> > > > > >>> > 2. addauth ztpasswd zooadmin:<password>
> >> > > > > >>> >
> >> > > > > >>> >
> >> > > > > >>> > Thanks,
> >> > > > > >>> > ---------------------
> >> > > > > >>> > Kuldeep Singh Budania
> >> > > > > >>> >
> >> > > > > >>> >
> >> > > > > >>> >
> >> > > > > >>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
> >> > > > > >>> kuldeep.singh08@gmail.com>
> >> > > > > >>> > wrote:
> >> > > > > >>> >
> >> > > > > >>> > > Hi Team,
> >> > > > > >>> > >
> >> > > > > >>> > > Any update on this?
> >> > > > > >>> > >
> >> > > > > >>> > > Thanks,
> >> > > > > >>> > > ---------------------
> >> > > > > >>> > > Kuldeep Singh Budania
> >> > > > > >>> > >
> >> > > > > >>> > >
> >> > > > > >>> > >
> >> > > > > >>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
> >> > > > > >>> kuldeep.singh08@gmail.com>
> >> > > > > >>> > > wrote:
> >> > > > > >>> > >
> >> > > > > >>> > >> Sorry this is my bad, there were server setting
> like
> >> below
> >> > > > > >>> > >>
> >> > > > > >>> > >> export SERVER_JVMFLAGS="
> >> > > > > >>> > >>
> >> > > > > >>> > >>
> >> > > > > >>> > >>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >> > > > > >>> > >>
> >> > > > > >>> > >>
> >> > > > > >>>
> >> > > > >
> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> >> > > > > >>> > >>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >> > > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> >> > > > > >>> > >>
> >> > > > > >>> > >>
> >> > > > > >>> > >>
> >> > > > > >>> > >> export CLIENT_JVMFLAGS="
> >> > > > > >>> > >>
> >> > > > > >>> > >>
> >> > > > > >>>
> >> > > > >
> >> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >> > > > > >>> > >> -Dzookeeper.client.secure=true
> >> > > > > >>> > >>
> >> > > > > >>>
> >> > > > >
> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> >> > > > > >>> > >>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >> > > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> >> > > > > >>> > >>
> >> > > > > >>> > >> I want to have SSL between client to server
> >> communication
> >> > > > > >>> > >>
> >> > > > > >>> > >> I am already following the same link which you have
> >> shared
> >> > > > > with me
> >> > > > > >>> but
> >> > > > > >>> > >> that is not working.
> >> > > > > >>> > >>
> >> > > > > >>> > >> Zoo.cfg
> >> > > > > >>> > >>
> >> > > > > >>> > >> secureClientPort=2281
> >> > > > > >>> > >> initLimit=10
> >> > > > > >>> > >> syncLimit=5
> >> > > > > >>> > >> dataDir=/var/lib/zookeeper/data
> >> > > > > >>> > >> tickTime=2000
> >> > > > > >>> > >> autopurge.snapRetainCount=3
> >> > > > > >>> > >> autopurge.purgeInterval=1
> >> > > > > >>> > >> admin.enableServer=false
> >> > > > > >>> > >> standaloneEnabled=false
> >> > > > > >>> > >> jute.maxbuffer=2147483648
> >> > > > > >>> > >>
> >> > > > >
> >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >> > > > > >>> > >> server.1=host1_priv:10288:10388
> >> > > > > >>> > >> server.2=host2_priv:10288:10388
> >> > > > > >>> > >> server.3=host3_priv:10288:10388
> >> > > > > >>> > >>
> >> > > > > >>> > >>
> >> > > > > >>> > >> command to connect using zkcli
> >> > > > > >>> > >>
> >> > > > > >>> > >> 1. zkcli zoo.cfg localhost:2281
> >> > > > > >>> > >> 2. addauth ztpasswd usernaem:password
> >> > > > > >>> > >>
> >> > > > > >>> > >> after second step we are getting below error
> >> > > > > >>> > >>
> >> > > > > >>> > >> WatchedEvent state:AuthFailed type:None path:null
> >> > > > > >>> > >>
> >> > > > > >>> > >>
> >> > > > > >>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> >> > > > > >>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> >> > > > > authentication
> >> > > > > >>> > provider
> >> > > > > >>> > >> for scheme: ztpasswd has x509 ip digest*
> >> > > > > >>> > >>
> >> > > > > >>> > >> Thanks,
> >> > > > > >>> > >> ---------------------
> >> > > > > >>> > >> Kuldeep Singh Budania
> >> > > > > >>> > >>
> >> > > > > >>> > >>
> >> > > > > >>> > >>
> >> > > > > >>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
> >> > > > > >>> > >> szalay.beko.mate@gmail.com> wrote:
> >> > > > > >>> > >>
> >> > > > > >>> > >>> > No authentication provider for scheme: ztpasswd
> >> has
> >> > > x509
> >> > > > > ip
> >> > > > > >>> digest*
> >> > > > > >>> > >>>
> >> > > > > >>> > >>> This suggest you have some configuration error...
> >> Where
> >> > > did
> >> > > > > you
> >> > > > > >>> use the
> >> > > > > >>> > >>> "ztpasswd" string in your configs / commands?
> >> > > > > >>> > >>>
> >> > > > > >>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
> >> > > > > >>> > >>> szalay.beko.mate@gmail.com>
> >> > > > > >>> > >>> wrote:
> >> > > > > >>> > >>>
> >> > > > > >>> > >>> > > My ZK server is up and running in secure mode
> >> > > > > >>> > >>> >
> >> > > > > >>> > >>> > What is your goal? You want to setup
> >> client-server SSL
> >> > > > > >>> connection?
> >> > > > > >>> > >>> >
> >> > > > > >>> > >>> > see:
> >> > > > > >>> > >>> >
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
> >> > > > > >>> > >>> >
> >> > > > > >>> > >>> > (or you want to have both SSL and SASL enabled?)
> >> > > > > >>> > >>> >
> >> > > > > >>> > >>> > Anyway, please remove the following line from
> the
> >> > > > > >>> SERVER_JVMFLAGS:
> >> > > > > >>> > >>> >
> >> > > > > >>> >
> >> > > > >
> >> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >> > > > > >>> > >>> > This is a configuration that makes sense only
> for
> >> the
> >> > > > > ZooKeeper
> >> > > > > >>> > client,
> >> > > > > >>> > >>> > not for the server. For the server, use the
> >> following:
> >> > > > > >>> > >>> >
> >> > > > > >>> > >>> >
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >> > > > > >>> > >>> >
> >> > > > > >>> > >>> > If it doesn't solve the issue, then can you
> >> please send
> >> > > > > your
> >> > > > > >>> zoo.cfg
> >> > > > > >>> > >>> file?
> >> > > > > >>> > >>> > Also can you please send the zkCli command you
> >> execute?
> >> > > > > (you
> >> > > > > >>> need to
> >> > > > > >>> > >>> > connect to the secure ZooKeeper port, unless
> >> > > > > portUnification is
> >> > > > > >>> > >>> enabled)
> >> > > > > >>> > >>> >
> >> > > > > >>> > >>> > Kind regards,
> >> > > > > >>> > >>> > Mate
> >> > > > > >>> > >>> >
> >> > > > > >>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
> >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> >> > > > > >>> > >>> > wrote:
> >> > > > > >>> > >>> >
> >> > > > > >>> > >>> >> Hi,
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >> we have done below changes in java.env file
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >> export SERVER_JVMFLAGS="
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>>
> >> > > > >
> >> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >> > > > > >>> > >>> >>
> >> > > > > >>> >
> >> > > > >
> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >> > > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >> > > > > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >> export CLIENT_JVMFLAGS="
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>>
> >> > > > >
> >> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >> > > > > >>> > >>> >> -Dzookeeper.client.secure=true
> >> > > > > >>> > >>> >>
> >> > > > > >>> >
> >> > > > >
> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >> > > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >> > > > > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >> I have started the ZK server and it is up
> >> without any
> >> > > > > issue.
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >> But now when I login to ZkCli then it gives the
> >> below
> >> > > > > error.
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >> WatchedEvent state:AuthFailed type:None
> path:null
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 -
> WARN
> >> > > > > >>> > >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] -
> >> No
> >> > > > > >>> authentication
> >> > > > > >>> > >>> provider
> >> > > > > >>> > >>> >> for scheme: ztpasswd has x509 ip digest*
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >> Please help me on this issue
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >> Thanks,
> >> > > > > >>> > >>> >> ---------------------
> >> > > > > >>> > >>> >> Kuldeep Singh Budania
> >> > > > > >>> > >>> >> Software Architect
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
> >> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> >> > > > > >>> > >>> >> wrote:
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >> > Hi,
> >> > > > > >>> > >>> >> >
> >> > > > > >>> > >>> >> > My ZK server is up and running in secure
> >> mode, But
> >> > > > > When I am
> >> > > > > >>> > >>> trying to
> >> > > > > >>> > >>> >> > connect to the ZK server using ZKCli, it
> gives
> >> the
> >> > > > below
> >> > > > > >>> error.
> >> > > > > >>> > >>> >> >
> >> > > > > >>> > >>> >> > WatchedEvent state:AuthFailed type:None
> >> path:null
> >> > > > > >>> > >>> >> >
> >> > > > > >>> > >>> >> >
> >> > > > > >>> > >>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 -
> >> WARN
> >> > > > > >>> > >>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
> >> - No
> >> > > > > >>> authentication
> >> > > > > >>> > >>> >> provider
> >> > > > > >>> > >>> >> > for scheme: ztpasswd has x509 ip digest*
> >> > > > > >>> > >>> >> >
> >> > > > > >>> > >>> >> > Can someone please help me on this issue. we
> >> are
> >> > > using
> >> > > > > the
> >> > > > > >>> 3.5.6
> >> > > > > >>> > >>> >> version.
> >> > > > > >>> > >>> >> >
> >> > > > > >>> > >>> >> > I appreciate if I will get a response as soon
> >> as
> >> > > > > possible, as
> >> > > > > >>> I am
> >> > > > > >>> > >>> stuck
> >> > > > > >>> > >>> >> > at this point.
> >> > > > > >>> > >>> >> >
> >> > > > > >>> > >>> >> > Thanks,
> >> > > > > >>> > >>> >> > ---------------------
> >> > > > > >>> > >>> >> > Kuldeep Singh Budania
> >> > > > > >>> > >>> >> > Software Architect
> >> > > > > >>> > >>> >> >
> >> > > > > >>> > >>> >> >
> >> > > > > >>> > >>> >> >
> >> > > > > >>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico
> >> Olivelli -
> >> > > > > Diennea
> >> > > > > >>> > >>> >> > <en...@diennea.com.invalid> wrote:
> >> > > > > >>> > >>> >> >
> >> > > > > >>> > >>> >> >> I mean in zoo.cfg
> >> > > > > >>> > >>> >> >> Not as a system property
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> Enrico
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli -
> >> > > > Diennea" <
> >> > > > > >>> > >>> >> >> enrico.olivelli@diennea.com.INVALID> ha
> >> scritto:
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> Hi
> >> > > > > >>> > >>> >> >> You have to enable Netty on the server
> >> side
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> Something like:
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> >
> >> > > > >
> >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> Hope that helps
> >> > > > > >>> > >>> >> >> Enrico
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep
> singh"
> >> <
> >> > > > > >>> > >>> >> kuldeep.singh08@gmail.com>
> >> > > > > >>> > >>> >> >> ha scritto:
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> Hi,
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> I got below error while setting SSL
> >> > > > properties
> >> > > > > in
> >> > > > > >>> > zkEnv.sh
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> ==========================================================================================
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
> >> > > > > >>> > [main:QuorumPeerConfig@133]
> >> > > > > >>> > >>> -
> >> > > > > >>> > >>> >> >> Reading
> >> > > > > >>> > >>> >> >> configuration from:
> >> /etc/zookeeper/zoo.cfg
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> >> > > > > >>> > [main:QuorumPeerConfig@385]
> >> > > > > >>> > >>> -
> >> > > > > >>> > >>> >> >> clientPortAddress is
> >> 0.0.0.0/0.0.0.0:10181
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> >> > > > > >>> > [main:QuorumPeerConfig@399]
> >> > > > > >>> > >>> -
> >> > > > > >>> > >>> >> >> secureClientPortAddress is
> >> > > > > 0.0.0.0/0.0.0.0:2281
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,878 - INFO
> >> > > > > [main:X509Util@79] -
> >> > > > > >>> > >>> Setting
> >> > > > > >>> > >>> >> -D
> >> > > > > >>> > >>> >> >>
> >> > > > > jdk.tls.rejectClientInitiatedRenegotiation=true to
> >> > > > > >>> > disable
> >> > > > > >>> > >>> >> >> client-initiated
> >> > > > > >>> > >>> >> >> TLS renegotiation
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> >> > > > > >>> > >>> [main:DatadirCleanupManager@78]
> >> > > > > >>> > >>> >> -
> >> > > > > >>> > >>> >> >> autopurge.snapRetainCount set to 3
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> >> > > > > >>> > >>> [main:DatadirCleanupManager@79]
> >> > > > > >>> > >>> >> -
> >> > > > > >>> > >>> >> >> autopurge.purgeInterval set to 1
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,898 - INFO [
> >> > > > > >>> > >>> >> >>
> >> > > PurgeTask:DatadirCleanupManager$PurgeTask@138
> >> > > > ]
> >> > > > > -
> >> > > > > >>> Purge
> >> > > > > >>> > >>> task
> >> > > > > >>> > >>> >> >> started.
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,899 - INFO
> >> > > > > [main:ManagedUtil@46]
> >> > > > > >>> -
> >> > > > > >>> > >>> Log4j
> >> > > > > >>> > >>> >> >> found with
> >> > > > > >>> > >>> >> >> jmx enabled.
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
> >> > > > > >>> > >>> [PurgeTask:FileTxnSnapLog@103]
> >> > > > > >>> > >>> >> -
> >> > > > > >>> > >>> >> >> zookeeper.snapshot.trust.empty :
> false
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,910 - INFO [
> >> > > > > >>> > >>> >> >>
> >> > > PurgeTask:DatadirCleanupManager$PurgeTask@144
> >> > > > ]
> >> > > > > -
> >> > > > > >>> Purge
> >> > > > > >>> > >>> task
> >> > > > > >>> > >>> >> >> completed.
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
> >> > > > > >>> [main:QuorumPeerMain@141
> >> > > > > >>> > ]
> >> > > > > >>> > >>> -
> >> > > > > >>> > >>> >> >> Starting quorum
> >> > > > > >>> > >>> >> >> peer
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
> >> > > > > >>> > [main:ServerCnxnFactory@135]
> >> > > > > >>> > >>> -
> >> > > > > >>> > >>> >> >> Using
> >> > > > > >>> > >>> >> >>
> >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> >> > > > > >>> > server
> >> > > > > >>> > >>> >> >> connection
> >> > > > > >>> > >>> >> >> factory
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
> >> > > > > >>> > >>> [main:NIOServerCnxnFactory@673]
> >> > > > > >>> > >>> >> -
> >> > > > > >>> > >>> >> >> Configuring NIO connection handler
> >> with 10s
> >> > > > > >>> sessionless
> >> > > > > >>> > >>> >> >> connection timeout,
> >> > > > > >>> > >>> >> >> 2 selector thread(s), 16 worker
> >> threads,
> >> > > and
> >> > > > > 64 kB
> >> > > > > >>> direct
> >> > > > > >>> > >>> >> buffers.
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
> >> > > > > >>> > >>> [main:NIOServerCnxnFactory@686
> >> > > > > >>> > >>> >> ]
> >> > > > > >>> > >>> >> >> - binding
> >> > > > > >>> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
> >> > > > > >>> > [main:ServerCnxnFactory@135]
> >> > > > > >>> > >>> -
> >> > > > > >>> > >>> >> >> Using
> >> > > > > >>> > >>> >> >>
> >> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> >> > > > > >>> > server
> >> > > > > >>> > >>> >> >> connection
> >> > > > > >>> > >>> >> >> factory
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
> >> > > > > >>> [main:QuorumPeerMain@101
> >> > > > > >>> > ]
> >> > > > > >>> > >>> -
> >> > > > > >>> > >>> >> >> Unexpected
> >> > > > > >>> > >>> >> >> exception, exiting abnormally
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> java.lang.UnsupportedOperationException:
> >> > > SSL
> >> > > > > isn't
> >> > > > > >>> > >>> supported in
> >> > > > > >>> > >>> >> >> NIOServerCnxn
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> at
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> at
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> at
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> at
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> I have set the following properties
> in
> >> > > > > >>> SERVER_JVMFLAGS in
> >> > > > > >>> > >>> >> >> zkEnv.sh file :
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> >> > > > > >>> > >>> >> >>
> >> > > > > -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> >> > > > > >>> > >>> >> >>
> >> > > > > -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> Thanks,
> >> > > > > >>> > >>> >> >> ---------------------
> >> > > > > >>> > >>> >> >> Kuldeep Singh Budania
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM
> Jordan
> >> > > > > Zimmerman <
> >> > > > > >>> > >>> >> >> jordan@jordanzimmerman.com>
> >> > > > > >>> > >>> >> >> wrote:
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> > It's the same as the normal
> >> ZooKeeper
> >> > > > client:
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >> > > > > >>> > >>> >> >> > <
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >> > > > > >>> > >>> >> >> > >
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >> > -Jordan
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >> > > On Jun 22, 2020, at 5:50 AM,
> >> kuldeep
> >> > > > singh
> >> > > > > <
> >> > > > > >>> > >>> >> >> kuldeep.singh08@gmail.com>
> >> > > > > >>> > >>> >> >> > wrote:
> >> > > > > >>> > >>> >> >> > >
> >> > > > > >>> > >>> >> >> > > Hi Team,
> >> > > > > >>> > >>> >> >> > > How we will do secure
> >> communication
> >> > > > > between the
> >> > > > > >>> > Curator
> >> > > > > >>> > >>> >> >> framework and
> >> > > > > >>> > >>> >> >> > > zookeeper 3.5.6 ?
> >> > > > > >>> > >>> >> >> > > I didn't get any solution right
> >> now.
> >> > > > > >>> > >>> >> >> > > I appreciate it if someone could
> >> help
> >> > > me
> >> > > > > with the
> >> > > > > >>> > same.
> >> > > > > >>> > >>> >> >> > >
> >> > > > > >>> > >>> >> >> > > Thanks,
> >> > > > > >>> > >>> >> >> > > ---------------------
> >> > > > > >>> > >>> >> >> > > Kuldeep Singh Budania
> >> > > > > >>> > >>> >> >> > > Software Architect
> >> > > > > >>> > >>> >> >> > >
> >> > > > > >>> > >>> >> >> > >
> >> > > > > >>> > >>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM
> >> > > > > Szalay-Bekő Máté
> >> > > > > >>> <
> >> > > > > >>> > >>> >> >> > szalay.beko.mate@gmail.com>
> >> > > > > >>> > >>> >> >> > > wrote:
> >> > > > > >>> > >>> >> >> > >
> >> > > > > >>> > >>> >> >> > >> Hello Kuldeep,
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> > >> did you download the source
> from
> >> the
> >> > > > > ZooKeeper
> >> > > > > >>> > >>> webpage, or
> >> > > > > >>> > >>> >> >> checked out
> >> > > > > >>> > >>> >> >> > from
> >> > > > > >>> > >>> >> >> > >> git?
> >> > > > > >>> > >>> >> >> > >> Anyway, the following commands
> >> should
> >> > > > > work:
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> > >> wget
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> >> > > > > >>> > >>> >> >> > >> tar xzvf
> >> > > ./apache-zookeeper-3.5.7.tar.gz
> >> > > > > >>> > >>> >> >> > >> cd apache-zookeeper-3.5.7
> >> > > > > >>> > >>> >> >> > >> mvn clean install -DskipTests
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> > >> I tested it with OpenJDK 8u424
> >> and
> >> > > maven
> >> > > > > 3.6.0.
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> > >> Kind regards,
> >> > > > > >>> > >>> >> >> > >> Mate
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> > >> On Fri, Apr 17, 2020 at 12:51
> PM
> >> > > kuldeep
> >> > > > > singh <
> >> > > > > >>> > >>> >> >> > kuldeep.singh08@gmail.com>
> >> > > > > >>> > >>> >> >> > >> wrote:
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> > >>> Hi All,
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>> I have download the zookeeper
> >> source
> >> > > > > code and
> >> > > > > >>> run
> >> > > > > >>> > >>> the mvn
> >> > > > > >>> > >>> >> >> command for
> >> > > > > >>> > >>> >> >> > >>> packaging but get problem on
> >> > > > > "zookeeper-server"
> >> > > > > >>> > >>> >> directory.
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>> *command :- mvn clean package*
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>> [ERROR] Failed to execute goal
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >>
> >> > > > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >> > > > > >>> > >>> >> >> > >>> (default-compile) on project
> >> > > zookeeper:
> >> > > > > Fatal
> >> > > > > >>> error
> >> > > > > >>> > >>> >> >> compiling:
> >> > > > > >>> > >>> >> >> > >>> java.lang.NullPointerException
> >> ->
> >> > > [Help
> >> > > > > 1]
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>>
> >> org.apache.maven.lifecycle.LifecycleExecutionException:
> >> > > > > >>> > >>> >> >> Failed to
> >> > > > > >>> > >>> >> >> > execute
> >> > > > > >>> > >>> >> >> > >>> goal
> >> > > > > >>> > >>> >> >>
> >> > > > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >> > > > > >>> > >>> >> >> > >>> (default-compile) on project
> >> > > zookeeper:
> >> > > > > Fatal
> >> > > > > >>> error
> >> > > > > >>> > >>> >> >> compiling
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >>
> >> > > > > org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >>
> >> > > > > org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >>
> >> > > > > org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >>
> >> > > > org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >>
> >> > > org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >>
> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> >> > > > > Method)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >>
> java.lang.reflect.Method.invoke(Method.java:498)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > >
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> >> > > > > >>> > >>> >> >> > >>> Caused by:
> >> > > > > >>> > >>> >> org.apache.maven.plugin.MojoExecutionException:
> >> > > > > >>> > >>> >> >> Fatal error
> >> > > > > >>> > >>> >> >> > >>> compiling
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> >> > > > > >>> > >>> >> >> > >>> ... 19 more
> >> > > > > >>> > >>> >> >> > >>> Caused by:
> >> > > > > >>> > >>> >> org.codehaus.plexus.compiler.CompilerException:
> >> > > > > >>> > >>> >> >> > >>> java.lang.NullPointerException
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> >> > > > > >>> > >>> >> >> > >>> ... 22 more
> >> > > > > >>> > >>> >> >> > >>> Caused by:
> >> > > java.lang.RuntimeException:
> >> > > > > >>> > >>> >> >> java.lang.NullPointerException
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >>
> >> > > com.sun.tools.javac.main.Main.compile(Main.java:559)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>>
> >> > > > > >>>
> >> > > > >
> >> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> >
> >> > > > >
> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> >> > > > > >>> > >>> >> >> > >>> ... 24 more
> >> > > > > >>> > >>> >> >> > >>> Caused by:
> >> > > > java.lang.NullPointerException
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >>
> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >>
> >> > > com.sun.tools.doclint.Checker.scan(Checker.java:144)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >>
> >> > > > > com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>>
> >> > > > > >>>
> >> > > > >
> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>>
> >> > > > > >>>
> >> > > > >
> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> >
> >> > > > >
> >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>>
> >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> >
> >> > > > >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> >
> >> > > > >
> >> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> >
> >> > > > >
> >> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>>
> >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> >
> >> > > > >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> >
> >> > > > >
> >> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > >
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > >
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>>
> >> > > > > >>>
> >> > > > >
> >> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>>
> >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> >
> >> > > > >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >>
> >> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> >
> >> > > > >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>>
> >> > > com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>>
> >> > > > > >>>
> >> > > > >
> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>>
> >> > > > > >>>
> >> > > > >
> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> >
> >> > > > >
> >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>>
> >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >>
> >> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> >
> >> > > > >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > >
> >>
> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>>
> >> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >>
> >> > > > > com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>>
> >> > > > > >>>
> >> > > > >
> >> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>>
> >> > > > > >>>
> >> > > > >
> >> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>>
> >> > > > > >>>
> >> > > > >
> >> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> >> > > > > >>> > >>> >> >> > >>> at
> >> > > > > >>> > >>> >> >>
> >> > > com.sun.tools.javac.main.Main.compile(Main.java:523)
> >> > > > > >>> > >>> >> >> > >>> ... 27 more
> >> > > > > >>> > >>> >> >> > >>> [ERROR]
> >> > > > > >>> > >>> >> >> > >>> [ERROR] Re-run Maven using the
> >> -X
> >> > > > switch
> >> > > > > to
> >> > > > > >>> enable
> >> > > > > >>> > >>> full
> >> > > > > >>> > >>> >> >> debug logging.
> >> > > > > >>> > >>> >> >> > >>> [ERROR]
> >> > > > > >>> > >>> >> >> > >>> [ERROR] For more information
> >> about
> >> > > the
> >> > > > > errors
> >> > > > > >>> and
> >> > > > > >>> > >>> >> possible
> >> > > > > >>> > >>> >> >> solutions,
> >> > > > > >>> > >>> >> >> > >>> please read the following
> >> articles:
> >> > > > > >>> > >>> >> >> > >>> [ERROR] [Help 1]
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > >
> >> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>> Can someone help me on this
> >> issue?
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>> Thanks,
> >> > > > > >>> > >>> >> >> > >>> ---------------------
> >> > > > > >>> > >>> >> >> > >>> Kuldeep Singh Budania
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM
> >> > > > > Szalay-Bekő
> >> > > > > >>> Máté <
> >> > > > > >>> > >>> >> >> > >>> szalay.beko.mate@gmail.com>
> >> > > > > >>> > >>> >> >> > >>> wrote:
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>>> these exceptions can mean
> many
> >> > > > > things... I
> >> > > > > >>> think
> >> > > > > >>> > >>> this
> >> > > > > >>> > >>> >> can
> >> > > > > >>> > >>> >> >> be even
> >> > > > > >>> > >>> >> >> > >> normal
> >> > > > > >>> > >>> >> >> > >>>> duding rolling restart (as
> some
> >> > > > > connections
> >> > > > > >>> get
> >> > > > > >>> > >>> broken
> >> > > > > >>> > >>> >> in
> >> > > > > >>> > >>> >> >> this case)
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>> However, I saw cases already
> >> when
> >> > > > > exceptions
> >> > > > > >>> like
> >> > > > > >>> > >>> these
> >> > > > > >>> > >>> >> >> killed
> >> > > > > >>> > >>> >> >> > receiver
> >> > > > > >>> > >>> >> >> > >>> or
> >> > > > > >>> > >>> >> >> > >>>> sender threads in
> >> QuorumCnxManager /
> >> > > > > Leader
> >> > > > > >>> > >>> Election in
> >> > > > > >>> > >>> >> >> such a way
> >> > > > > >>> > >>> >> >> > that
> >> > > > > >>> > >>> >> >> > >>>> they were not able to
> recover,
> >> so
> >> > > the
> >> > > > > node was
> >> > > > > >>> > >>> unable to
> >> > > > > >>> > >>> >> >> connect to
> >> > > > > >>> > >>> >> >> > any
> >> > > > > >>> > >>> >> >> > >>>> quorum until restart. I
> >> remember
> >> > > > seeing
> >> > > > > this
> >> > > > > >>> in
> >> > > > > >>> > 3.4
> >> > > > > >>> > >>> too.
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>> Do you see these exceptions
> in
> >> the
> >> > > > > second
> >> > > > > >>> server
> >> > > > > >>> > >>> (the
> >> > > > > >>> > >>> >> one
> >> > > > > >>> > >>> >> >> which you
> >> > > > > >>> > >>> >> >> > >> just
> >> > > > > >>> > >>> >> >> > >>>> upgraded in step 3)?
> >> > > > > >>> > >>> >> >> > >>>> Is this issue reproducible?
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>> What is the tickTime and
> >> initLimit
> >> > > you
> >> > > > > use?
> >> > > > > >>> Maybe
> >> > > > > >>> > >>> the
> >> > > > > >>> > >>> >> >> server just
> >> > > > > >>> > >>> >> >> > >> require
> >> > > > > >>> > >>> >> >> > >>>> more time to sync?
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>> I would need more logs to
> >> really see
> >> > > > > what
> >> > > > > >>> > happened.
> >> > > > > >>> > >>> Can
> >> > > > > >>> > >>> >> >> you create a
> >> > > > > >>> > >>> >> >> > >> Jira
> >> > > > > >>> > >>> >> >> > >>>> issue and upload the logs and
> >> also
> >> > > the
> >> > > > > >>> ZooKeeper
> >> > > > > >>> > >>> >> configs?
> >> > > > > >>> > >>> >> >> I am happy
> >> > > > > >>> > >>> >> >> > to
> >> > > > > >>> > >>> >> >> > >>>> take a closer look.
> >> > > > > >>> > >>> >> >> > >>>> (if you need to re-run the
> >> test to
> >> > > > > collect the
> >> > > > > >>> > logs,
> >> > > > > >>> > >>> >> then
> >> > > > > >>> > >>> >> >> enabling
> >> > > > > >>> > >>> >> >> > >> DEBUG
> >> > > > > >>> > >>> >> >> > >>>> logs would be great. The INFO
> >> level
> >> > > > > logs are
> >> > > > > >>> > usually
> >> > > > > >>> > >>> >> >> enough for these
> >> > > > > >>> > >>> >> >> > >>>> problems, but one can never
> >> know...)
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>> Kind regards,
> >> > > > > >>> > >>> >> >> > >>>> Mate
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05
> AM
> >> > > > kuldeep
> >> > > > > singh
> >> > > > > >>> <
> >> > > > > >>> > >>> >> >> > >> kuldeep.singh08@gmail.com
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>> wrote:
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>>> Hi Team,
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> I have done some POC on
> >> rolling
> >> > > > > upgrade and
> >> > > > > >>> found
> >> > > > > >>> > >>> below
> >> > > > > >>> > >>> >> >> result.
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> 1. On 1st node upgrade
> >> zookeeper
> >> > > .
> >> > > > > Traffic
> >> > > > > >>> was
> >> > > > > >>> > >>> >> running
> >> > > > > >>> > >>> >> >> fine
> >> > > > > >>> > >>> >> >> > >> because
> >> > > > > >>> > >>> >> >> > >>> 2
> >> > > > > >>> > >>> >> >> > >>>>> nodes are already on old
> >> > > zookeeper.
> >> > > > > >>> > >>> >> >> > >>>>> 2. On 1st node upgrade our
> >> > > > > application and
> >> > > > > >>> > didn’t
> >> > > > > >>> > >>> >> find
> >> > > > > >>> > >>> >> >> any issue
> >> > > > > >>> > >>> >> >> > >>>>> 3. On 2nd node upgrade
> >> zookeeper
> >> > > > but
> >> > > > > got
> >> > > > > >>> below
> >> > > > > >>> > >>> error
> >> > > > > >>> > >>> >> >> and zookeeper
> >> > > > > >>> > >>> >> >> > >>> is
> >> > > > > >>> > >>> >> >> > >>>>> not taking any requests
> >> > > > > >>> > >>> >> >> > >>>>> 4.
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> at
> >> > > > > >>> > >>> >> >>
> >> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> at
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,587 -
> WARN
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
> >> > > > > >>> -
> >> > > > > >>> > >>> >> >> Interrupting
> >> > > > > >>> > >>> >> >> > >>> SendWorker
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 -
> >> ERROR
> >> > > > > >>> [LearnerHandler-/
> >> > > > > >>> > >>> >> >> 192.168.44.73:33754
> >> > > > > >>> > >>> >> >> > >>>>> :LearnerHandler@562] -
> >> Unexpected
> >> > > > > exception
> >> > > > > >>> > >>> causing
> >> > > > > >>> > >>> >> >> shutdown while
> >> > > > > >>> > >>> >> >> > >>> sock
> >> > > > > >>> > >>> >> >> > >>>>> still open
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> at
> >> > > > > >>> > >>> >> >>
> >> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> at
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>>
> >> > > > > >>>
> >> > > > >
> >> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> at
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> at
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> at
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > >
> >> > > >
> >> > >
> >>
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 -
> WARN
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > [SendWorker:1:QuorumCnxManager$SendWorker@679]
> >> > > > > >>> -
> >> > > > > >>> > >>> >> >> Interrupted while
> >> > > > > >>> > >>> >> >> > >>>> waiting
> >> > > > > >>> > >>> >> >> > >>>>> for message on queue
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> Please let me know is this
> the
> >> > > known
> >> > > > > issue or
> >> > > > > >>> > this
> >> > > > > >>> > >>> is
> >> > > > > >>> > >>> >> >> different issue
> >> > > > > >>> > >>> >> >> > >>>> which
> >> > > > > >>> > >>> >> >> > >>>>> is mention in Apache
> zookeeper
> >> > > > > documentation
> >> > > > > >>> when
> >> > > > > >>> > >>> >> >> upgrading from
> >> > > > > >>> > >>> >> >> > >> 3.4.5
> >> > > > > >>> > >>> >> >> > >>> to
> >> > > > > >>> > >>> >> >> > >>>>> 3.5.6
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> Thanks,
> >> > > > > >>> > >>> >> >> > >>>>> ---------------------
> >> > > > > >>> > >>> >> >> > >>>>> Kuldeep Singh Budania
> >> > > > > >>> > >>> >> >> > >>>>> Software Architect
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06
> >> AM
> >> > > > > Alexander
> >> > > > > >>> Shraer
> >> > > > > >>> > <
> >> > > > > >>> > >>> >> >> shralex@gmail.com>
> >> > > > > >>> > >>> >> >> > >>>>> wrote:
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>>> +1 to what Mate said (I
> >> wrote the
> >> > > > > quoted
> >> > > > > >>> > >>> >> instructions).
> >> > > > > >>> > >>> >> >> > >>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at
> 7:03
> >> AM
> >> > > > > Szalay-Bekő
> >> > > > > >>> > Máté <
> >> > > > > >>> > >>> >> >> > >>>>>> szalay.beko.mate@gmail.com
> >
> >> > > > > >>> > >>> >> >> > >>>>>> wrote:
> >> > > > > >>> > >>> >> >> > >>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>> Hi Kuldeep,
> >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>> I just want to provide you
> >> some
> >> > > > > background
> >> > > > > >>> info
> >> > > > > >>> > >>> about
> >> > > > > >>> > >>> >> >> our
> >> > > > > >>> > >>> >> >> > >>>>> documentation.
> >> > > > > >>> > >>> >> >> > >>>>>>> The reason to upgrade to
> >> 3.4.6
> >> > > > first
> >> > > > > is to
> >> > > > > >>> > avoid
> >> > > > > >>> > >>> the
> >> > > > > >>> > >>> >> >> following
> >> > > > > >>> > >>> >> >> > >>> error:
> >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663
> >> > > [myid:2] -
> >> > > > > WARN
> >> > > > > >>> > >>> [localhost/
> >> > > > > >>> > >>> >> >> > >>> 127.0.0.1:2784
> >> > > > > >>> > >>> >> >> > >>>>>>> :QuorumCnxManager@349] -
> >> Invalid
> >> > > > > server
> >> > > > > >>> id:
> >> > > > > >>> > >>> -65536
> >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>> This error comes because
> of
> >> the
> >> > > > > protocol
> >> > > > > >>> > changes
> >> > > > > >>> > >>> >> between
> >> > > > > >>> > >>> >> >> > >> ZooKeeper
> >> > > > > >>> > >>> >> >> > >>>>> server
> >> > > > > >>> > >>> >> >> > >>>>>>> nodes during connection
> >> > > initiation
> >> > > > > for
> >> > > > > >>> leader
> >> > > > > >>> > >>> >> election.
> >> > > > > >>> > >>> >> >> In
> >> > > > > >>> > >>> >> >> > >>> ZooKeeper
> >> > > > > >>> > >>> >> >> > >>>>> 3.5
> >> > > > > >>> > >>> >> >> > >>>>>> a
> >> > > > > >>> > >>> >> >> > >>>>>>> protocol version was
> >> introduced
> >> > > > (see
> >> > > > > >>> > >>> ZOOKEEPER-107)
> >> > > > > >>> > >>> >> and
> >> > > > > >>> > >>> >> >> since
> >> > > > > >>> > >>> >> >> > >> that
> >> > > > > >>> > >>> >> >> > >>>> time
> >> > > > > >>> > >>> >> >> > >>>>>> the
> >> > > > > >>> > >>> >> >> > >>>>>>> fist long value sent in
> the
> >> > > initial
> >> > > > > >>> message is
> >> > > > > >>> > >>> not
> >> > > > > >>> > >>> >> the
> >> > > > > >>> > >>> >> >> server ID
> >> > > > > >>> > >>> >> >> > >>> but
> >> > > > > >>> > >>> >> >> > >>>>> the
> >> > > > > >>> > >>> >> >> > >>>>>>> protocol version (-65536).
> >> In
> >> > > > > ZooKeeper
> >> > > > > >>> 3.4.6
> >> > > > > >>> > we
> >> > > > > >>> > >>> made
> >> > > > > >>> > >>> >> >> the old 3.4
> >> > > > > >>> > >>> >> >> > >>>>>>> ZooKeepers backward
> >> compatible,
> >> > > so
> >> > > > > they are
> >> > > > > >>> > able
> >> > > > > >>> > >>> to
> >> > > > > >>> > >>> >> >> parse both
> >> > > > > >>> > >>> >> >> > >> the
> >> > > > > >>> > >>> >> >> > >>>> old
> >> > > > > >>> > >>> >> >> > >>>>>> and
> >> > > > > >>> > >>> >> >> > >>>>>>> the new protocol format
> (see
> >> > > > > >>> ZOOKEEPER-1633).
> >> > > > > >>> > >>> This
> >> > > > > >>> > >>> >> >> issue happens
> >> > > > > >>> > >>> >> >> > >>> only
> >> > > > > >>> > >>> >> >> > >>>>>> when
> >> > > > > >>> > >>> >> >> > >>>>>>> you need to use old
> (3.4.0 -
> >> > > 3.4.5)
> >> > > > > and new
> >> > > > > >>> > >>> (3.5.0+)
> >> > > > > >>> > >>> >> >> ZooKeeper
> >> > > > > >>> > >>> >> >> > >>>> servers
> >> > > > > >>> > >>> >> >> > >>>>>>> together in the same
> >> cluster.
> >> > > > During
> >> > > > > a
> >> > > > > >>> rolling
> >> > > > > >>> > >>> >> upgrade,
> >> > > > > >>> > >>> >> >> this is
> >> > > > > >>> > >>> >> >> > >>>> usually
> >> > > > > >>> > >>> >> >> > >>>>>> the
> >> > > > > >>> > >>> >> >> > >>>>>>> case to have old and new
> >> > > ZooKeepers
> >> > > > > present
> >> > > > > >>> > >>> together.
> >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>> The fact that you haven't
> >> seen
> >> > > any
> >> > > > > issues
> >> > > > > >>> might
> >> > > > > >>> > >>> be
> >> > > > > >>> > >>> >> >> caused by the
> >> > > > > >>> > >>> >> >> > >>>> order
> >> > > > > >>> > >>> >> >> > >>>>> of
> >> > > > > >>> > >>> >> >> > >>>>>>> the servers. In ZooKeeper
> >> the
> >> > > > > connection
> >> > > > > >>> > >>> initiation
> >> > > > > >>> > >>> >> >> between the
> >> > > > > >>> > >>> >> >> > >>>> servers
> >> > > > > >>> > >>> >> >> > >>>>>>> during the leader election
> >> > > follows
> >> > > > a
> >> > > > > >>> specific
> >> > > > > >>> > >>> rule.
> >> > > > > >>> > >>> >> As
> >> > > > > >>> > >>> >> >> far as I
> >> > > > > >>> > >>> >> >> > >>>>> remember
> >> > > > > >>> > >>> >> >> > >>>>>>> always the server with the
> >> larger
> >> > > > ID
> >> > > > > 'wins
> >> > > > > >>> the
> >> > > > > >>> > >>> >> >> challenge', so it
> >> > > > > >>> > >>> >> >> > >> is
> >> > > > > >>> > >>> >> >> > >>>>>>> possible, that the old
> >> server
> >> > > > didn't
> >> > > > > need
> >> > > > > >>> to
> >> > > > > >>> > >>> parse
> >> > > > > >>> > >>> >> any
> >> > > > > >>> > >>> >> >> initial
> >> > > > > >>> > >>> >> >> > >>>> message
> >> > > > > >>> > >>> >> >> > >>>>>> (if
> >> > > > > >>> > >>> >> >> > >>>>>>> it had the largest ID) and
> >> this
> >> > > is
> >> > > > > why you
> >> > > > > >>> > >>> haven't
> >> > > > > >>> > >>> >> seen
> >> > > > > >>> > >>> >> >> the
> >> > > > > >>> > >>> >> >> > >> issue.
> >> > > > > >>> > >>> >> >> > >>>> Also
> >> > > > > >>> > >>> >> >> > >>>>>>> having 2 nodes up from
> the 3
> >> > > nodes
> >> > > > > cluster
> >> > > > > >>> > still
> >> > > > > >>> > >>> >> makes
> >> > > > > >>> > >>> >> >> the
> >> > > > > >>> > >>> >> >> > >> cluster
> >> > > > > >>> > >>> >> >> > >>>> work
> >> > > > > >>> > >>> >> >> > >>>>>> (so
> >> > > > > >>> > >>> >> >> > >>>>>>> you should also check if
> >> all the
> >> > > > > servers
> >> > > > > >>> are
> >> > > > > >>> > >>> part of
> >> > > > > >>> > >>> >> >> the quorum).
> >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>> I agree with Enrico and
> >> Norbert,
> >> > > > the
> >> > > > > >>> safest and
> >> > > > > >>> > >>> most
> >> > > > > >>> > >>> >> >> stable way
> >> > > > > >>> > >>> >> >> > >> is
> >> > > > > >>> > >>> >> >> > >>>>>> upgrade
> >> > > > > >>> > >>> >> >> > >>>>>>> first to 3.4.latest, then
> >> go to
> >> > > > > 3.5.latest.
> >> > > > > >>> > >>> Still, if
> >> > > > > >>> > >>> >> >> you don't
> >> > > > > >>> > >>> >> >> > >> see
> >> > > > > >>> > >>> >> >> > >>>>> that
> >> > > > > >>> > >>> >> >> > >>>>>>> you would hit this
> specific
> >> issue
> >> > > > > (e.g. no
> >> > > > > >>> > >>> "Invalid
> >> > > > > >>> > >>> >> >> server id" in
> >> > > > > >>> > >>> >> >> > >>> the
> >> > > > > >>> > >>> >> >> > >>>>> log
> >> > > > > >>> > >>> >> >> > >>>>>>> files), and all the three
> >> servers
> >> > > > can
> >> > > > > >>> handle
> >> > > > > >>> > >>> traffic,
> >> > > > > >>> > >>> >> >> then maybe
> >> > > > > >>> > >>> >> >> > >>> you
> >> > > > > >>> > >>> >> >> > >>>>>> don't
> >> > > > > >>> > >>> >> >> > >>>>>>> need to upgrade first to
> >> > > > 3.4.latest,
> >> > > > > it is
> >> > > > > >>> your
> >> > > > > >>> > >>> >> >> decision.
> >> > > > > >>> > >>> >> >> > >>> Definitely
> >> > > > > >>> > >>> >> >> > >>>>> you
> >> > > > > >>> > >>> >> >> > >>>>>>> should test it first, as
> >> > > suggested
> >> > > > > by the
> >> > > > > >>> > others.
> >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>> Kind regards,
> >> > > > > >>> > >>> >> >> > >>>>>>> Mate
> >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at
> >> 12:29 PM
> >> > > > > Norbert
> >> > > > > >>> Kalmar
> >> > > > > >>> > >>> >> >> > >>>>>>>
> >> <nk...@cloudera.com.invalid>
> >> > > > > wrote:
> >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>> Hi,
> >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>> That guide is to upgrade
> to
> >> > > 3.5.0,
> >> > > > > which
> >> > > > > >>> was
> >> > > > > >>> > an
> >> > > > > >>> > >>> >> alpha
> >> > > > > >>> > >>> >> >> version.
> >> > > > > >>> > >>> >> >> > >> A
> >> > > > > >>> > >>> >> >> > >>>> lot
> >> > > > > >>> > >>> >> >> > >>>>>> has
> >> > > > > >>> > >>> >> >> > >>>>>>>> changed for the first
> >> stable
> >> > > > > release of
> >> > > > > >>> 3.5.5
> >> > > > > >>> > >>> and
> >> > > > > >>> > >>> >> then
> >> > > > > >>> > >>> >> >> a few
> >> > > > > >>> > >>> >> >> > >>> more,
> >> > > > > >>> > >>> >> >> > >>>>> even
> >> > > > > >>> > >>> >> >> > >>>>>>>> rolling upgrade issues
> >> have been
> >> > > > > fixed for
> >> > > > > >>> > >>> 3.5.6.
> >> > > > > >>> > >>> >> >> > >>>>>>>> This is a more up-to-date
> >> guide:
> >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> >
> >> > > > >
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>> If you have done your
> >> testing
> >> > > > (with
> >> > > > > prod
> >> > > > > >>> > >>> snapshot!),
> >> > > > > >>> > >>> >> >> then you
> >> > > > > >>> > >>> >> >> > >> can
> >> > > > > >>> > >>> >> >> > >>>>> skip
> >> > > > > >>> > >>> >> >> > >>>>>>> 3.4
> >> > > > > >>> > >>> >> >> > >>>>>>>> latest upgrade, but keep
> >> in mind
> >> > > > we
> >> > > > > do our
> >> > > > > >>> > >>> >> >> recommendations for
> >> > > > > >>> > >>> >> >> > >> a
> >> > > > > >>> > >>> >> >> > >>>>>> reason.
> >> > > > > >>> > >>> >> >> > >>>>>>>> There were issues
> reported
> >> > > and/or
> >> > > > > found
> >> > > > > >>> during
> >> > > > > >>> > >>> >> >> testing. Some
> >> > > > > >>> > >>> >> >> > >> are
> >> > > > > >>> > >>> >> >> > >>>>> fixed
> >> > > > > >>> > >>> >> >> > >>>>>>> with
> >> > > > > >>> > >>> >> >> > >>>>>>>> 3.5.6, some only happens
> if
> >> > > > certain
> >> > > > > >>> conditions
> >> > > > > >>> > >>> stand
> >> > > > > >>> > >>> >> >> > >>> (IOException:
> >> > > > > >>> > >>> >> >> > >>>> No
> >> > > > > >>> > >>> >> >> > >>>>>>>> snapshot found -
> mentioned
> >> in
> >> > > the
> >> > > > > guide,
> >> > > > > >>> fixed
> >> > > > > >>> > >>> in
> >> > > > > >>> > >>> >> >> 3.5.6).
> >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>> So it is up to you, I
> would
> >> > > still
> >> > > > > >>> recommend to
> >> > > > > >>> > >>> do an
> >> > > > > >>> > >>> >> >> 3.4
> >> > > > > >>> > >>> >> >> > >> upgrade
> >> > > > > >>> > >>> >> >> > >>>>> first,
> >> > > > > >>> > >>> >> >> > >>>>>>> if
> >> > > > > >>> > >>> >> >> > >>>>>>>> it's feasible.
> >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>> Regards,
> >> > > > > >>> > >>> >> >> > >>>>>>>> Norbert
> >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at
> >> 11:45 AM
> >> > > > > kuldeep
> >> > > > > >>> > singh <
> >> > > > > >>> > >>> >> >> > >>>>>>> kuldeep.singh08@gmail.com
> >
> >> > > > > >>> > >>> >> >> > >>>>>>>> wrote:
> >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>> Hi,
> >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>> Current Zookeeper
> version
> >> :-
> >> > > > 3.4.5
> >> > > > > >>> > >>> >> >> > >>>>>>>>> Upgraded version
> >> > > > :-
> >> > > > > 3.5.6
> >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>> We are not going with
> >> 3.5.7.
> >> > > Our
> >> > > > > final
> >> > > > > >>> > >>> decision is
> >> > > > > >>> > >>> >> >> zookeeper
> >> > > > > >>> > >>> >> >> > >>>>> version
> >> > > > > >>> > >>> >> >> > >>>>>> is
> >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.5.6
> >> > > > > >>> > >>> >> >> > >>>>>>>>> as per your reply first
> >> we need
> >> > > > to
> >> > > > > move
> >> > > > > >>> > latest
> >> > > > > >>> > >>> >> >> version of
> >> > > > > >>> > >>> >> >> > >>> 3.4.x,
> >> > > > > >>> > >>> >> >> > >>>>> like
> >> > > > > >>> > >>> >> >> > >>>>>>>> below
> >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6
> >> > > (Correct
> >> > > > > me if
> >> > > > > >>> I am
> >> > > > > >>> > >>> wrong
> >> > > > > >>> > >>> >> >> here)
> >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>> But if We are not facing
> >> any
> >> > > > > problem
> >> > > > > >>> that i
> >> > > > > >>> > >>> have
> >> > > > > >>> > >>> >> >> shared you
> >> > > > > >>> > >>> >> >> > >>> that
> >> > > > > >>> > >>> >> >> > >>>> we
> >> > > > > >>> > >>> >> >> > >>>>>>> have
> >> > > > > >>> > >>> >> >> > >>>>>>>>> set up of 3 node cluster
> >> where
> >> > > 2
> >> > > > > node
> >> > > > > >>> are on
> >> > > > > >>> > >>> 3.5.6
> >> > > > > >>> > >>> >> >> version
> >> > > > > >>> > >>> >> >> > >> and
> >> > > > > >>> > >>> >> >> > >>> 1
> >> > > > > >>> > >>> >> >> > >>>>> node
> >> > > > > >>> > >>> >> >> > >>>>>>> on
> >> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything is
> >> running
> >> > > fine
> >> > > > > and
> >> > > > > >>> didn't
> >> > > > > >>> > >>> get
> >> > > > > >>> > >>> >> any
> >> > > > > >>> > >>> >> >> issue,
> >> > > > > >>> > >>> >> >> > >> So
> >> > > > > >>> > >>> >> >> > >>>> what
> >> > > > > >>> > >>> >> >> > >>>>>>> other
> >> > > > > >>> > >>> >> >> > >>>>>>>>> problem we can face if
> we
> >> > > > directly
> >> > > > > move
> >> > > > > >>> to
> >> > > > > >>> > >>> 3.5.6
> >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>> Thanks,
> >> > > > > >>> > >>> >> >> > >>>>>>>>> ---------------------
> >> > > > > >>> > >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
> >> > > > > >>> > >>> >> >> > >>>>>>>>> Software Architect
> >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at
> >> 3:58 PM
> >> > > > > Enrico
> >> > > > > >>> > >>> Olivelli <
> >> > > > > >>> > >>> >> >> > >>>>> eolivelli@gmail.com
> >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>> wrote:
> >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>> Hi
> >> > > > > >>> > >>> >> >> > >>>>>>>>>> You have to upgrade to
> >> latest
> >> > > > > 3.4.x
> >> > > > > >>> > Zookeeper
> >> > > > > >>> > >>> then
> >> > > > > >>> > >>> >> >> you will
> >> > > > > >>> > >>> >> >> > >>>>> upgrade
> >> > > > > >>> > >>> >> >> > >>>>>>> to
> >> > > > > >>> > >>> >> >> > >>>>>>>>>> 3.5.7.
> >> > > > > >>> > >>> >> >> > >>>>>>>>>> All should run well
> >> without
> >> > > > issues
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>> Enrico
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020,
> 10:18
> >> > > > kuldeep
> >> > > > > singh
> >> > > > > >>> <
> >> > > > > >>> > >>> >> >> > >>>>> kuldeep.singh08@gmail.com
> >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>> ha
> >> > > > > >>> > >>> >> >> > >>>>>>>>>> scritto:
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Hi Team,
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> We are upgrading
> >> zookeeper
> >> > > from
> >> > > > > 3.4.5
> >> > > > > >>> to
> >> > > > > >>> > >>> 3.5.6. I
> >> > > > > >>> > >>> >> >> have
> >> > > > > >>> > >>> >> >> > >> set
> >> > > > > >>> > >>> >> >> > >>>> up 3
> >> > > > > >>> > >>> >> >> > >>>>>>> node
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> cluster where 2 node
> >> are on
> >> > > > 3.5.6
> >> > > > > >>> version
> >> > > > > >>> > >>> and 1
> >> > > > > >>> > >>> >> >> node on
> >> > > > > >>> > >>> >> >> > >>>> 3.4.5.
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Everything is running
> >> fine
> >> > > and
> >> > > > > didn't
> >> > > > > >>> get
> >> > > > > >>> > any
> >> > > > > >>> > >>> >> issue
> >> > > > > >>> > >>> >> >> on my
> >> > > > > >>> > >>> >> >> > >>>>> system.
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> but I found something
> on
> >> > > apache
> >> > > > > site
> >> > > > > >>> that
> >> > > > > >>> > >>> first
> >> > > > > >>> > >>> >> we
> >> > > > > >>> > >>> >> >> need
> >> > > > > >>> > >>> >> >> > >> to
> >> > > > > >>> > >>> >> >> > >>>>>> upgrade
> >> > > > > >>> > >>> >> >> > >>>>>>>> on
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can
> >> upgrade to
> >> > > > > 3.5.6. So
> >> > > > > >>> is
> >> > > > > >>> > it
> >> > > > > >>> > >>> >> >> mandatory
> >> > > > > >>> > >>> >> >> > >> to
> >> > > > > >>> > >>> >> >> > >>> go
> >> > > > > >>> > >>> >> >> > >>>>> on
> >> > > > > >>> > >>> >> >> > >>>>>>>> 3.4.6
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> first.
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Upgrading a running
> >> ZooKeeper
> >> > > > > ensemble
> >> > > > > >>> to
> >> > > > > >>> > >>> 3.5.0
> >> > > > > >>> > >>> >> >> should be
> >> > > > > >>> > >>> >> >> > >>>> done
> >> > > > > >>> > >>> >> >> > >>>>>> only
> >> > > > > >>> > >>> >> >> > >>>>>>>>> after
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> upgrading your
> ensemble
> >> to
> >> > > the
> >> > > > > 3.4.6
> >> > > > > >>> > release.
> >> > > > > >>> > >>> >> Note
> >> > > > > >>> > >>> >> >> that
> >> > > > > >>> > >>> >> >> > >>> this
> >> > > > > >>> > >>> >> >> > >>>> is
> >> > > > > >>> > >>> >> >> > >>>>>>> only
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> necessary for rolling
> >> > > upgrades
> >> > > > > (if
> >> > > > > >>> you're
> >> > > > > >>> > >>> fine
> >> > > > > >>> > >>> >> with
> >> > > > > >>> > >>> >> >> > >>> shutting
> >> > > > > >>> > >>> >> >> > >>>>> down
> >> > > > > >>> > >>> >> >> > >>>>>>> the
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> system completely, you
> >> don't
> >> > > > > have to go
> >> > > > > >>> > >>> through
> >> > > > > >>> > >>> >> >> 3.4.6).
> >> > > > > >>> > >>> >> >> > >> If
> >> > > > > >>> > >>> >> >> > >>>> you
> >> > > > > >>> > >>> >> >> > >>>>>>>> attempt
> >> > > > > >>> > >>> >> >> > >>>>>>>>> a
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> rolling upgrade
> without
> >> going
> >> > > > > through
> >> > > > > >>> 3.4.6
> >> > > > > >>> > >>> (for
> >> > > > > >>> > >>> >> >> example
> >> > > > > >>> > >>> >> >> > >>> from
> >> > > > > >>> > >>> >> >> > >>>>>>> 3.4.5),
> >> > > > > >>> > >>> >> >> > >>>>>>>>> you
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> may get the following
> >> error:
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30
> 11:32:10,663
> >> > > > [myid:2]
> >> > > > > - INFO
> >> > > > > >>> > >>> >> [localhost/
> >> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > > :QuorumCnxManager$Listener@498
> >> > > > ]
> >> > > > > -
> >> > > > > >>> Received
> >> > > > > >>> > >>> >> >> connection
> >> > > > > >>> > >>> >> >> > >>>> request
> >> > > > > >>> > >>> >> >> > >>>>> /
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30
> 11:32:10,663
> >> > > > [myid:2]
> >> > > > > - WARN
> >> > > > > >>> > >>> >> [localhost/
> >> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349
> ]
> >> -
> >> > > > Invalid
> >> > > > > >>> server
> >> > > > > >>> > id:
> >> > > > > >>> > >>> >> -65536
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> During a rolling
> >> upgrade,
> >> > > each
> >> > > > > server
> >> > > > > >>> is
> >> > > > > >>> > >>> taken
> >> > > > > >>> > >>> >> down
> >> > > > > >>> > >>> >> >> in
> >> > > > > >>> > >>> >> >> > >> turn
> >> > > > > >>> > >>> >> >> > >>>> and
> >> > > > > >>> > >>> >> >> > >>>>>>>>> rebooted
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> with the new 3.5.0
> >> binaries.
> >> > > > > Before
> >> > > > > >>> > starting
> >> > > > > >>> > >>> the
> >> > > > > >>> > >>> >> >> server
> >> > > > > >>> > >>> >> >> > >>> with
> >> > > > > >>> > >>> >> >> > >>>>>> 3.5.0
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> binaries, we highly
> >> recommend
> >> > > > > updating
> >> > > > > >>> the
> >> > > > > >>> > >>> >> >> configuration
> >> > > > > >>> > >>> >> >> > >>> file
> >> > > > > >>> > >>> >> >> > >>>>> so
> >> > > > > >>> > >>> >> >> > >>>>>>> that
> >> > > > > >>> > >>> >> >> > >>>>>>>>> all
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> server statements
> >> > > > "server.x=..."
> >> > > > > >>> contain
> >> > > > > >>> > >>> client
> >> > > > > >>> > >>> >> >> ports
> >> > > > > >>> > >>> >> >> > >> (see
> >> > > > > >>> > >>> >> >> > >>>> the
> >> > > > > >>> > >>> >> >> > >>>>>>>> section
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Specifying
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> the client port). As
> >> > > explained
> >> > > > > earlier
> >> > > > > >>> you
> >> > > > > >>> > >>> may
> >> > > > > >>> > >>> >> >> leave the
> >> > > > > >>> > >>> >> >> > >>>>>>>> configuration
> >> > > > > >>> > >>> >> >> > >>>>>>>>>> in a
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> single file, as well
> as
> >> leave
> >> > > > the
> >> > > > > >>> > >>> >> >> > >>>> clientPort/clientPortAddress
> >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> (although if you
> specify
> >> > > client
> >> > > > > ports
> >> > > > > >>> in
> >> > > > > >>> > the
> >> > > > > >>> > >>> new
> >> > > > > >>> > >>> >> >> format,
> >> > > > > >>> > >>> >> >> > >>>> these
> >> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> are now redundant).
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Could you please let
> me
> >> know
> >> > > > > about this
> >> > > > > >>> > case.
> >> > > > > >>> > >>> >> >> Appreciate
> >> > > > > >>> > >>> >> >> > >> if
> >> > > > > >>> > >>> >> >> > >>>>>> respond
> >> > > > > >>> > >>> >> >> > >>>>>>>>> soon.
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Thanks,
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> ---------------------
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>>
> >> > > > > >>> > >>> >> >> > >>>>>
> >> > > > > >>> > >>> >> >> > >>>>
> >> > > > > >>> > >>> >> >> > >>>
> >> > > > > >>> > >>> >> >> > >>
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >> >
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> ________________________________
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> >> > > > > >>> > >>> >> >> This e-mail (including any attachments)
> is
> >> > > > strictly
> >> > > > > >>> > >>> confidential
> >> > > > > >>> > >>> >> and
> >> > > > > >>> > >>> >> >> may also contain privileged information. If
> >> you are
> >> > > > > not the
> >> > > > > >>> > >>> intended
> >> > > > > >>> > >>> >> >> recipient you are not authorised to read,
> >> print,
> >> > > > save,
> >> > > > > >>> process or
> >> > > > > >>> > >>> >> disclose
> >> > > > > >>> > >>> >> >> this message. If you have received this
> >> message by
> >> > > > > mistake,
> >> > > > > >>> > please
> >> > > > > >>> > >>> >> inform
> >> > > > > >>> > >>> >> >> the sender immediately and destroy this
> >> e-mail, its
> >> > > > > >>> attachments
> >> > > > > >>> > >>> and any
> >> > > > > >>> > >>> >> >> copies. Any use, distribution, reproduction
> or
> >> > > > > disclosure by
> >> > > > > >>> any
> >> > > > > >>> > >>> person
> >> > > > > >>> > >>> >> >> other than the intended recipient is
> strictly
> >> > > > > prohibited and
> >> > > > > >>> the
> >> > > > > >>> > >>> person
> >> > > > > >>> > >>> >> >> responsible may incur in penalties.
> >> > > > > >>> > >>> >> >> The use of this e-mail is only for
> >> professional
> >> > > > > purposes;
> >> > > > > >>> > >>> there is
> >> > > > > >>> > >>> >> no
> >> > > > > >>> > >>> >> >> guarantee that the correspondence towards
> this
> >> > > e-mail
> >> > > > > will be
> >> > > > > >>> > read
> >> > > > > >>> > >>> >> only by
> >> > > > > >>> > >>> >> >> the recipient, because, under certain
> >> > > circumstances,
> >> > > > > there
> >> > > > > >>> may
> >> > > > > >>> > be a
> >> > > > > >>> > >>> >> need to
> >> > > > > >>> > >>> >> >> access this email by third subjects
> belonging
> >> to
> >> > > the
> >> > > > > Company.
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> ________________________________
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> >> > > > > >>> > >>> >> >> This e-mail (including any attachments) is
> >> strictly
> >> > > > > >>> confidential
> >> > > > > >>> > >>> and
> >> > > > > >>> > >>> >> may
> >> > > > > >>> > >>> >> >> also contain privileged information. If you
> >> are not
> >> > > > the
> >> > > > > >>> intended
> >> > > > > >>> > >>> >> recipient
> >> > > > > >>> > >>> >> >> you are not authorised to read, print, save,
> >> > > process
> >> > > > or
> >> > > > > >>> disclose
> >> > > > > >>> > >>> this
> >> > > > > >>> > >>> >> >> message. If you have received this message
> by
> >> > > > mistake,
> >> > > > > please
> >> > > > > >>> > >>> inform
> >> > > > > >>> > >>> >> the
> >> > > > > >>> > >>> >> >> sender immediately and destroy this e-mail,
> >> its
> >> > > > > attachments
> >> > > > > >>> and
> >> > > > > >>> > any
> >> > > > > >>> > >>> >> copies.
> >> > > > > >>> > >>> >> >> Any use, distribution, reproduction or
> >> disclosure
> >> > > by
> >> > > > > any
> >> > > > > >>> person
> >> > > > > >>> > >>> other
> >> > > > > >>> > >>> >> than
> >> > > > > >>> > >>> >> >> the intended recipient is strictly
> prohibited
> >> and
> >> > > the
> >> > > > > person
> >> > > > > >>> > >>> >> responsible
> >> > > > > >>> > >>> >> >> may incur in penalties.
> >> > > > > >>> > >>> >> >> The use of this e-mail is only for
> >> professional
> >> > > > > purposes;
> >> > > > > >>> there
> >> > > > > >>> > is
> >> > > > > >>> > >>> no
> >> > > > > >>> > >>> >> >> guarantee that the correspondence towards
> this
> >> > > e-mail
> >> > > > > will be
> >> > > > > >>> > read
> >> > > > > >>> > >>> >> only by
> >> > > > > >>> > >>> >> >> the recipient, because, under certain
> >> > > circumstances,
> >> > > > > there
> >> > > > > >>> may
> >> > > > > >>> > be a
> >> > > > > >>> > >>> >> need to
> >> > > > > >>> > >>> >> >> access this email by third subjects
> belonging
> >> to
> >> > > the
> >> > > > > Company.
> >> > > > > >>> > >>> >> >>
> >> > > > > >>> > >>> >> >
> >> > > > > >>> > >>> >>
> >> > > > > >>> > >>> >
> >> > > > > >>> > >>>
> >> > > > > >>> > >>
> >> > > > > >>> >
> >> > > > > >>>
> >> > > > > >>
> >> > > > >
> >> > > > >
> >> > > > > ________________________________
> >> > > > >
> >> > > > > CONFIDENTIALITY & PRIVACY NOTICE
> >> > > > > This e-mail (including any attachments) is strictly confidential
> >> and
> >> > > may
> >> > > > > also contain privileged information. If you are not the intended
> >> > > > recipient
> >> > > > > you are not authorised to read, print, save, process or disclose
> >> this
> >> > > > > message. If you have received this message by mistake, please
> >> inform
> >> > > the
> >> > > > > sender immediately and destroy this e-mail, its attachments and
> >> any
> >> > > > copies.
> >> > > > > Any use, distribution, reproduction or disclosure by any person
> >> other
> >> > > > than
> >> > > > > the intended recipient is strictly prohibited and the person
> >> > > responsible
> >> > > > > may incur in penalties.
> >> > > > > The use of this e-mail is only for professional purposes; there
> >> is no
> >> > > > > guarantee that the correspondence towards this e-mail will be
> >> read only
> >> > > > by
> >> > > > > the recipient, because, under certain circumstances, there may
> be
> >> a
> >> > > need
> >> > > > to
> >> > > > > access this email by third subjects belonging to the Company.
> >> > > > >
> >> > > >
> >> > >
> >>
> >>
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Hi,
more logs
2020-10-14 12:25:05,106 - ERROR
[nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler$CertificateVerifier@257]
- Unsuccessful handshake with session 0x0
2020-10-14 12:25:05,107 - WARN
[nioEventLoopGroup-7-4:NettyServerCnxnFactory$CnxnChannelHandler@138] -
Exception caught
io.netty.handler.codec.DecoderException:
io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record:
737276720a
at
io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:475)
at
io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:283)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
at
io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at
io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
at
io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at
io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
at
io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
at
io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
at
io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
at
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS
record: 737276720a
at
io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1203)
at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1271)
at
io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:505)
at
io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:444)
... 17 more
Thanks,
---------------------
Kuldeep Singh Budania
Software Architect
On Wed, Oct 14, 2020 at 3:51 PM kuldeep singh <ku...@gmail.com>
wrote:
> Hi,
>
>
> below error is coming on zookeeper logs on SSL.
>
> 2020-10-14 12:18:27,410 - WARN [nioEventLoopGroup-4-16:NettyServerCnxn@540]
> - Closing connection to /127.0.0.1:49470
> java.io.IOException: Len error 369296128
> at
> org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:533)
> at
> org.apache.zookeeper.server.NettyServerCnxn.processMessage(NettyServerCnxn.java:360)
> at
> org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.channelRead(NettyServerCnxnFactory.java:184)
> at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> at
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
> at
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
> at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
> at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
> at
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
> at
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
> at
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
> at
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
> at
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
> at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
> at
> io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
> at
> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> at
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> at java.lang.Thread.run(Thread.java:748)
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Thu, Oct 8, 2020 at 6:33 PM Szalay-Bekő Máté <
> szalay.beko.mate@gmail.com> wrote:
>
>> Sounds like a bug or a configuration issue...
>> can you share the configs (before and after the scale-up) and the logs?
>> also: does the truststores recognise all the keys used on all the 5
>> nodes? (e.g. the truststores on the old nodes accept the new keys?)
>>
>> Best Regards,
>> Mate
>>
>> On Thu, Oct 8, 2020 at 2:31 PM kuldeep singh <ku...@gmail.com>
>> wrote:
>> >
>> > Hi,
>> >
>> > Yes, My client and server both are using certificate and have added in
>> ZK
>> > and client as well.
>> >
>> > Thanks,
>> > ---------------------
>> > Kuldeep Singh Budania
>> >
>> >
>> >
>> > On Thu, Oct 8, 2020 at 5:56 PM Enrico Olivelli <eo...@gmail.com>
>> wrote:
>> >
>> > > Il giorno gio 8 ott 2020 alle ore 14:17 kuldeep singh <
>> > > kuldeep.singh08@gmail.com> ha scritto:
>> > >
>> > > > Hi Team,
>> > > >
>> > > > I am facing one issue in SSL communication between client and
>> zookeeper
>> > > > server.
>> > > >
>> > > > ZK 3.5.6 version
>> > > >
>> > > > 1. Mi on 3 node
>> > > > 2. Applying SSL and 3 nodes cluster is working fine
>> > > > 3. Scaled my cluster with 2 nodes and now my cluster have 5 nodes
>> over
>> > > SSL
>> > > >
>> > > > but after scaling my SSL is not working between client and ZK
>> server and
>> > > > even not able to login using zkCli as well.
>> > > >
>> > > > Can someone provide the details please why it is happening?
>> > > >
>> > >
>> > > Is your client configured to use SSL ?
>> > >
>> > > Enrico
>> > >
>> > >
>> > >
>> > > >
>> > > > Thanks,
>> > > > ---------------------
>> > > > Kuldeep Singh Budania
>> > > > Software Architect
>> > > >
>> > > >
>> > > >
>> > > > On Mon, Jul 13, 2020 at 2:19 PM Enrico Olivelli - Diennea
>> > > > <en...@diennea.com.invalid> wrote:
>> > > >
>> > > > > It looks like we ported it to 3.5.
>> > > > >
>> > > > > See the subtask
>> > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2792
>> > > > >
>> > > > > Enrico
>> > > > >
>> > > > > Il giorno 13/07/20, 10:37 "kuldeep singh" <
>> kuldeep.singh08@gmail.com>
>> > > > ha
>> > > > > scritto:
>> > > > >
>> > > > > Hi Team,
>> > > > >
>> > > > > I appreciate it if I will get a response as soon as possible,
>> as I
>> > > am
>> > > > > stuck
>> > > > > at this point.
>> > > > >
>> > > > > Thanks,
>> > > > > ---------------------
>> > > > > Kuldeep Singh Budania
>> > > > >
>> > > > >
>> > > > >
>> > > > > On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <
>> > > > > kuldeep.singh08@gmail.com>
>> > > > > wrote:
>> > > > >
>> > > > > > Hi Team,
>> > > > > >
>> > > > > > Server to Server communication is not supported in 3.5.6
>> version
>> > > > as
>> > > > > per
>> > > > > > below JIRA issue?
>> > > > > >
>> > > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2639
>> > > > > >
>> > > > > > Thanks,
>> > > > > > ---------------------
>> > > > > > Kuldeep Singh Budania
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <
>> > > > > kuldeep.singh08@gmail.com>
>> > > > > > wrote:
>> > > > > >
>> > > > > >> Thanks for the reply.
>> > > > > >>
>> > > > > >> Now my ZKCli cmd is working fine as we use some our
>> customized
>> > > > > >> authentication and we resolve the issue.
>> > > > > >>
>> > > > > >> Now I am going to implement Server to Server communication.
>> > > > > >>
>> > > > > >> Thanks,
>> > > > > >> ---------------------
>> > > > > >> Kuldeep Singh Budania
>> > > > > >>
>> > > > > >>
>> > > > > >>
>> > > > > >> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
>> > > > > >> szalay.beko.mate@gmail.com> wrote:
>> > > > > >>
>> > > > > >>> I think SSL is working for you already... If you managed
>> to
>> > > start
>> > > > > the
>> > > > > >>> zkCli.sh and be able to connect to ZooKeeper on the
>> secure port
>> > > > > and issue
>> > > > > >>> any kind of command (like: " ls / "), then the wire
>> encryption
>> > > is
>> > > > > working
>> > > > > >>> and your server/client communication is secured by
>> ZooKeeper.
>> > > > > >>>
>> > > > > >>> Why you want to run the following command?
>> > > > > >>> addauth ztpasswd zooadmin:<password>
>> > > > > >>>
>> > > > > >>> Do you also want to configure a superDigest user in
>> ZooKeeper?
>> > > > > Please
>> > > > > >>> note
>> > > > > >>> that this command is independent from SSL. If you need to
>> > > create
>> > > > a
>> > > > > >>> username-password pair for digest authentication then
>> please
>> > > use
>> > > > > the
>> > > > > >>> command in the following way:
>> > > > > >>> addauth digest zooadmin:yourSuperSecretPassword
>> > > > > >>>
>> > > > > >>> Kind regards,
>> > > > > >>> Mate
>> > > > > >>>
>> > > > > >>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <
>> > > > > kuldeep.singh08@gmail.com>
>> > > > > >>> wrote:
>> > > > > >>>
>> > > > > >>> > 1. sh zkCli.sh --config /etc/zookeeper -server
>> localhost:2281
>> > > > > >>> >
>> > > > > >>> > 2. addauth ztpasswd zooadmin:<password>
>> > > > > >>> >
>> > > > > >>> >
>> > > > > >>> > Thanks,
>> > > > > >>> > ---------------------
>> > > > > >>> > Kuldeep Singh Budania
>> > > > > >>> >
>> > > > > >>> >
>> > > > > >>> >
>> > > > > >>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
>> > > > > >>> kuldeep.singh08@gmail.com>
>> > > > > >>> > wrote:
>> > > > > >>> >
>> > > > > >>> > > Hi Team,
>> > > > > >>> > >
>> > > > > >>> > > Any update on this?
>> > > > > >>> > >
>> > > > > >>> > > Thanks,
>> > > > > >>> > > ---------------------
>> > > > > >>> > > Kuldeep Singh Budania
>> > > > > >>> > >
>> > > > > >>> > >
>> > > > > >>> > >
>> > > > > >>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
>> > > > > >>> kuldeep.singh08@gmail.com>
>> > > > > >>> > > wrote:
>> > > > > >>> > >
>> > > > > >>> > >> Sorry this is my bad, there were server setting like
>> below
>> > > > > >>> > >>
>> > > > > >>> > >> export SERVER_JVMFLAGS="
>> > > > > >>> > >>
>> > > > > >>> > >>
>> > > > > >>> > >>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > > > > >>> > >>
>> > > > > >>> > >>
>> > > > > >>>
>> > > > >
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
>> > > > > >>> > >>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> > > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
>> > > > > >>> > >>
>> > > > > >>> > >>
>> > > > > >>> > >>
>> > > > > >>> > >> export CLIENT_JVMFLAGS="
>> > > > > >>> > >>
>> > > > > >>> > >>
>> > > > > >>>
>> > > > >
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> > > > > >>> > >> -Dzookeeper.client.secure=true
>> > > > > >>> > >>
>> > > > > >>>
>> > > > >
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
>> > > > > >>> > >>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> > > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
>> > > > > >>> > >>
>> > > > > >>> > >> I want to have SSL between client to server
>> communication
>> > > > > >>> > >>
>> > > > > >>> > >> I am already following the same link which you have
>> shared
>> > > > > with me
>> > > > > >>> but
>> > > > > >>> > >> that is not working.
>> > > > > >>> > >>
>> > > > > >>> > >> Zoo.cfg
>> > > > > >>> > >>
>> > > > > >>> > >> secureClientPort=2281
>> > > > > >>> > >> initLimit=10
>> > > > > >>> > >> syncLimit=5
>> > > > > >>> > >> dataDir=/var/lib/zookeeper/data
>> > > > > >>> > >> tickTime=2000
>> > > > > >>> > >> autopurge.snapRetainCount=3
>> > > > > >>> > >> autopurge.purgeInterval=1
>> > > > > >>> > >> admin.enableServer=false
>> > > > > >>> > >> standaloneEnabled=false
>> > > > > >>> > >> jute.maxbuffer=2147483648
>> > > > > >>> > >>
>> > > > >
>> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > > > > >>> > >> server.1=host1_priv:10288:10388
>> > > > > >>> > >> server.2=host2_priv:10288:10388
>> > > > > >>> > >> server.3=host3_priv:10288:10388
>> > > > > >>> > >>
>> > > > > >>> > >>
>> > > > > >>> > >> command to connect using zkcli
>> > > > > >>> > >>
>> > > > > >>> > >> 1. zkcli zoo.cfg localhost:2281
>> > > > > >>> > >> 2. addauth ztpasswd usernaem:password
>> > > > > >>> > >>
>> > > > > >>> > >> after second step we are getting below error
>> > > > > >>> > >>
>> > > > > >>> > >> WatchedEvent state:AuthFailed type:None path:null
>> > > > > >>> > >>
>> > > > > >>> > >>
>> > > > > >>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>> > > > > >>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
>> > > > > authentication
>> > > > > >>> > provider
>> > > > > >>> > >> for scheme: ztpasswd has x509 ip digest*
>> > > > > >>> > >>
>> > > > > >>> > >> Thanks,
>> > > > > >>> > >> ---------------------
>> > > > > >>> > >> Kuldeep Singh Budania
>> > > > > >>> > >>
>> > > > > >>> > >>
>> > > > > >>> > >>
>> > > > > >>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
>> > > > > >>> > >> szalay.beko.mate@gmail.com> wrote:
>> > > > > >>> > >>
>> > > > > >>> > >>> > No authentication provider for scheme: ztpasswd
>> has
>> > > x509
>> > > > > ip
>> > > > > >>> digest*
>> > > > > >>> > >>>
>> > > > > >>> > >>> This suggest you have some configuration error...
>> Where
>> > > did
>> > > > > you
>> > > > > >>> use the
>> > > > > >>> > >>> "ztpasswd" string in your configs / commands?
>> > > > > >>> > >>>
>> > > > > >>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
>> > > > > >>> > >>> szalay.beko.mate@gmail.com>
>> > > > > >>> > >>> wrote:
>> > > > > >>> > >>>
>> > > > > >>> > >>> > > My ZK server is up and running in secure mode
>> > > > > >>> > >>> >
>> > > > > >>> > >>> > What is your goal? You want to setup
>> client-server SSL
>> > > > > >>> connection?
>> > > > > >>> > >>> >
>> > > > > >>> > >>> > see:
>> > > > > >>> > >>> >
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
>> > > > > >>> > >>> >
>> > > > > >>> > >>> > (or you want to have both SSL and SASL enabled?)
>> > > > > >>> > >>> >
>> > > > > >>> > >>> > Anyway, please remove the following line from the
>> > > > > >>> SERVER_JVMFLAGS:
>> > > > > >>> > >>> >
>> > > > > >>> >
>> > > > >
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> > > > > >>> > >>> > This is a configuration that makes sense only for
>> the
>> > > > > ZooKeeper
>> > > > > >>> > client,
>> > > > > >>> > >>> > not for the server. For the server, use the
>> following:
>> > > > > >>> > >>> >
>> > > > > >>> > >>> >
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > > > > >>> > >>> >
>> > > > > >>> > >>> > If it doesn't solve the issue, then can you
>> please send
>> > > > > your
>> > > > > >>> zoo.cfg
>> > > > > >>> > >>> file?
>> > > > > >>> > >>> > Also can you please send the zkCli command you
>> execute?
>> > > > > (you
>> > > > > >>> need to
>> > > > > >>> > >>> > connect to the secure ZooKeeper port, unless
>> > > > > portUnification is
>> > > > > >>> > >>> enabled)
>> > > > > >>> > >>> >
>> > > > > >>> > >>> > Kind regards,
>> > > > > >>> > >>> > Mate
>> > > > > >>> > >>> >
>> > > > > >>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
>> > > > > >>> > >>> kuldeep.singh08@gmail.com>
>> > > > > >>> > >>> > wrote:
>> > > > > >>> > >>> >
>> > > > > >>> > >>> >> Hi,
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >> we have done below changes in java.env file
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >> export SERVER_JVMFLAGS="
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>>
>> > > > >
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> > > > > >>> > >>> >>
>> > > > > >>> >
>> > > > >
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> > > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> > > > > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >> export CLIENT_JVMFLAGS="
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>>
>> > > > >
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> > > > > >>> > >>> >> -Dzookeeper.client.secure=true
>> > > > > >>> > >>> >>
>> > > > > >>> >
>> > > > >
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> > > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> > > > > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >> I have started the ZK server and it is up
>> without any
>> > > > > issue.
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >> But now when I login to ZkCli then it gives the
>> below
>> > > > > error.
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >> WatchedEvent state:AuthFailed type:None path:null
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>> > > > > >>> > >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] -
>> No
>> > > > > >>> authentication
>> > > > > >>> > >>> provider
>> > > > > >>> > >>> >> for scheme: ztpasswd has x509 ip digest*
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >> Please help me on this issue
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >> Thanks,
>> > > > > >>> > >>> >> ---------------------
>> > > > > >>> > >>> >> Kuldeep Singh Budania
>> > > > > >>> > >>> >> Software Architect
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
>> > > > > >>> > >>> kuldeep.singh08@gmail.com>
>> > > > > >>> > >>> >> wrote:
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >> > Hi,
>> > > > > >>> > >>> >> >
>> > > > > >>> > >>> >> > My ZK server is up and running in secure
>> mode, But
>> > > > > When I am
>> > > > > >>> > >>> trying to
>> > > > > >>> > >>> >> > connect to the ZK server using ZKCli, it gives
>> the
>> > > > below
>> > > > > >>> error.
>> > > > > >>> > >>> >> >
>> > > > > >>> > >>> >> > WatchedEvent state:AuthFailed type:None
>> path:null
>> > > > > >>> > >>> >> >
>> > > > > >>> > >>> >> >
>> > > > > >>> > >>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 -
>> WARN
>> > > > > >>> > >>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119]
>> - No
>> > > > > >>> authentication
>> > > > > >>> > >>> >> provider
>> > > > > >>> > >>> >> > for scheme: ztpasswd has x509 ip digest*
>> > > > > >>> > >>> >> >
>> > > > > >>> > >>> >> > Can someone please help me on this issue. we
>> are
>> > > using
>> > > > > the
>> > > > > >>> 3.5.6
>> > > > > >>> > >>> >> version.
>> > > > > >>> > >>> >> >
>> > > > > >>> > >>> >> > I appreciate if I will get a response as soon
>> as
>> > > > > possible, as
>> > > > > >>> I am
>> > > > > >>> > >>> stuck
>> > > > > >>> > >>> >> > at this point.
>> > > > > >>> > >>> >> >
>> > > > > >>> > >>> >> > Thanks,
>> > > > > >>> > >>> >> > ---------------------
>> > > > > >>> > >>> >> > Kuldeep Singh Budania
>> > > > > >>> > >>> >> > Software Architect
>> > > > > >>> > >>> >> >
>> > > > > >>> > >>> >> >
>> > > > > >>> > >>> >> >
>> > > > > >>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico
>> Olivelli -
>> > > > > Diennea
>> > > > > >>> > >>> >> > <en...@diennea.com.invalid> wrote:
>> > > > > >>> > >>> >> >
>> > > > > >>> > >>> >> >> I mean in zoo.cfg
>> > > > > >>> > >>> >> >> Not as a system property
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> Enrico
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli -
>> > > > Diennea" <
>> > > > > >>> > >>> >> >> enrico.olivelli@diennea.com.INVALID> ha
>> scritto:
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> Hi
>> > > > > >>> > >>> >> >> You have to enable Netty on the server
>> side
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> Something like:
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> >
>> > > > >
>> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> Hope that helps
>> > > > > >>> > >>> >> >> Enrico
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh"
>> <
>> > > > > >>> > >>> >> kuldeep.singh08@gmail.com>
>> > > > > >>> > >>> >> >> ha scritto:
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> Hi,
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> I got below error while setting SSL
>> > > > properties
>> > > > > in
>> > > > > >>> > zkEnv.sh
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> ==========================================================================================
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
>> > > > > >>> > [main:QuorumPeerConfig@133]
>> > > > > >>> > >>> -
>> > > > > >>> > >>> >> >> Reading
>> > > > > >>> > >>> >> >> configuration from:
>> /etc/zookeeper/zoo.cfg
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
>> > > > > >>> > [main:QuorumPeerConfig@385]
>> > > > > >>> > >>> -
>> > > > > >>> > >>> >> >> clientPortAddress is
>> 0.0.0.0/0.0.0.0:10181
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
>> > > > > >>> > [main:QuorumPeerConfig@399]
>> > > > > >>> > >>> -
>> > > > > >>> > >>> >> >> secureClientPortAddress is
>> > > > > 0.0.0.0/0.0.0.0:2281
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,878 - INFO
>> > > > > [main:X509Util@79] -
>> > > > > >>> > >>> Setting
>> > > > > >>> > >>> >> -D
>> > > > > >>> > >>> >> >>
>> > > > > jdk.tls.rejectClientInitiatedRenegotiation=true to
>> > > > > >>> > disable
>> > > > > >>> > >>> >> >> client-initiated
>> > > > > >>> > >>> >> >> TLS renegotiation
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
>> > > > > >>> > >>> [main:DatadirCleanupManager@78]
>> > > > > >>> > >>> >> -
>> > > > > >>> > >>> >> >> autopurge.snapRetainCount set to 3
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
>> > > > > >>> > >>> [main:DatadirCleanupManager@79]
>> > > > > >>> > >>> >> -
>> > > > > >>> > >>> >> >> autopurge.purgeInterval set to 1
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,898 - INFO [
>> > > > > >>> > >>> >> >>
>> > > PurgeTask:DatadirCleanupManager$PurgeTask@138
>> > > > ]
>> > > > > -
>> > > > > >>> Purge
>> > > > > >>> > >>> task
>> > > > > >>> > >>> >> >> started.
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,899 - INFO
>> > > > > [main:ManagedUtil@46]
>> > > > > >>> -
>> > > > > >>> > >>> Log4j
>> > > > > >>> > >>> >> >> found with
>> > > > > >>> > >>> >> >> jmx enabled.
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
>> > > > > >>> > >>> [PurgeTask:FileTxnSnapLog@103]
>> > > > > >>> > >>> >> -
>> > > > > >>> > >>> >> >> zookeeper.snapshot.trust.empty : false
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,910 - INFO [
>> > > > > >>> > >>> >> >>
>> > > PurgeTask:DatadirCleanupManager$PurgeTask@144
>> > > > ]
>> > > > > -
>> > > > > >>> Purge
>> > > > > >>> > >>> task
>> > > > > >>> > >>> >> >> completed.
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
>> > > > > >>> [main:QuorumPeerMain@141
>> > > > > >>> > ]
>> > > > > >>> > >>> -
>> > > > > >>> > >>> >> >> Starting quorum
>> > > > > >>> > >>> >> >> peer
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
>> > > > > >>> > [main:ServerCnxnFactory@135]
>> > > > > >>> > >>> -
>> > > > > >>> > >>> >> >> Using
>> > > > > >>> > >>> >> >>
>> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
>> > > > > >>> > server
>> > > > > >>> > >>> >> >> connection
>> > > > > >>> > >>> >> >> factory
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
>> > > > > >>> > >>> [main:NIOServerCnxnFactory@673]
>> > > > > >>> > >>> >> -
>> > > > > >>> > >>> >> >> Configuring NIO connection handler
>> with 10s
>> > > > > >>> sessionless
>> > > > > >>> > >>> >> >> connection timeout,
>> > > > > >>> > >>> >> >> 2 selector thread(s), 16 worker
>> threads,
>> > > and
>> > > > > 64 kB
>> > > > > >>> direct
>> > > > > >>> > >>> >> buffers.
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
>> > > > > >>> > >>> [main:NIOServerCnxnFactory@686
>> > > > > >>> > >>> >> ]
>> > > > > >>> > >>> >> >> - binding
>> > > > > >>> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
>> > > > > >>> > [main:ServerCnxnFactory@135]
>> > > > > >>> > >>> -
>> > > > > >>> > >>> >> >> Using
>> > > > > >>> > >>> >> >>
>> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
>> > > > > >>> > server
>> > > > > >>> > >>> >> >> connection
>> > > > > >>> > >>> >> >> factory
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
>> > > > > >>> [main:QuorumPeerMain@101
>> > > > > >>> > ]
>> > > > > >>> > >>> -
>> > > > > >>> > >>> >> >> Unexpected
>> > > > > >>> > >>> >> >> exception, exiting abnormally
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> java.lang.UnsupportedOperationException:
>> > > SSL
>> > > > > isn't
>> > > > > >>> > >>> supported in
>> > > > > >>> > >>> >> >> NIOServerCnxn
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> at
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> at
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> at
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> at
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> I have set the following properties in
>> > > > > >>> SERVER_JVMFLAGS in
>> > > > > >>> > >>> >> >> zkEnv.sh file :
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
>> > > > > >>> > >>> >> >>
>> > > > > -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
>> > > > > >>> > >>> >> >>
>> > > > > -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> Thanks,
>> > > > > >>> > >>> >> >> ---------------------
>> > > > > >>> > >>> >> >> Kuldeep Singh Budania
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan
>> > > > > Zimmerman <
>> > > > > >>> > >>> >> >> jordan@jordanzimmerman.com>
>> > > > > >>> > >>> >> >> wrote:
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> > It's the same as the normal
>> ZooKeeper
>> > > > client:
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> > > > > >>> > >>> >> >> > <
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> > > > > >>> > >>> >> >> > >
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >> > -Jordan
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >> > > On Jun 22, 2020, at 5:50 AM,
>> kuldeep
>> > > > singh
>> > > > > <
>> > > > > >>> > >>> >> >> kuldeep.singh08@gmail.com>
>> > > > > >>> > >>> >> >> > wrote:
>> > > > > >>> > >>> >> >> > >
>> > > > > >>> > >>> >> >> > > Hi Team,
>> > > > > >>> > >>> >> >> > > How we will do secure
>> communication
>> > > > > between the
>> > > > > >>> > Curator
>> > > > > >>> > >>> >> >> framework and
>> > > > > >>> > >>> >> >> > > zookeeper 3.5.6 ?
>> > > > > >>> > >>> >> >> > > I didn't get any solution right
>> now.
>> > > > > >>> > >>> >> >> > > I appreciate it if someone could
>> help
>> > > me
>> > > > > with the
>> > > > > >>> > same.
>> > > > > >>> > >>> >> >> > >
>> > > > > >>> > >>> >> >> > > Thanks,
>> > > > > >>> > >>> >> >> > > ---------------------
>> > > > > >>> > >>> >> >> > > Kuldeep Singh Budania
>> > > > > >>> > >>> >> >> > > Software Architect
>> > > > > >>> > >>> >> >> > >
>> > > > > >>> > >>> >> >> > >
>> > > > > >>> > >>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM
>> > > > > Szalay-Bekő Máté
>> > > > > >>> <
>> > > > > >>> > >>> >> >> > szalay.beko.mate@gmail.com>
>> > > > > >>> > >>> >> >> > > wrote:
>> > > > > >>> > >>> >> >> > >
>> > > > > >>> > >>> >> >> > >> Hello Kuldeep,
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> > >> did you download the source from
>> the
>> > > > > ZooKeeper
>> > > > > >>> > >>> webpage, or
>> > > > > >>> > >>> >> >> checked out
>> > > > > >>> > >>> >> >> > from
>> > > > > >>> > >>> >> >> > >> git?
>> > > > > >>> > >>> >> >> > >> Anyway, the following commands
>> should
>> > > > > work:
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> > >> wget
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
>> > > > > >>> > >>> >> >> > >> tar xzvf
>> > > ./apache-zookeeper-3.5.7.tar.gz
>> > > > > >>> > >>> >> >> > >> cd apache-zookeeper-3.5.7
>> > > > > >>> > >>> >> >> > >> mvn clean install -DskipTests
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> > >> I tested it with OpenJDK 8u424
>> and
>> > > maven
>> > > > > 3.6.0.
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> > >> Kind regards,
>> > > > > >>> > >>> >> >> > >> Mate
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM
>> > > kuldeep
>> > > > > singh <
>> > > > > >>> > >>> >> >> > kuldeep.singh08@gmail.com>
>> > > > > >>> > >>> >> >> > >> wrote:
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> > >>> Hi All,
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>> I have download the zookeeper
>> source
>> > > > > code and
>> > > > > >>> run
>> > > > > >>> > >>> the mvn
>> > > > > >>> > >>> >> >> command for
>> > > > > >>> > >>> >> >> > >>> packaging but get problem on
>> > > > > "zookeeper-server"
>> > > > > >>> > >>> >> directory.
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>> *command :- mvn clean package*
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>> [ERROR] Failed to execute goal
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >>
>> > > > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> > > > > >>> > >>> >> >> > >>> (default-compile) on project
>> > > zookeeper:
>> > > > > Fatal
>> > > > > >>> error
>> > > > > >>> > >>> >> >> compiling:
>> > > > > >>> > >>> >> >> > >>> java.lang.NullPointerException
>> ->
>> > > [Help
>> > > > > 1]
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>>
>> org.apache.maven.lifecycle.LifecycleExecutionException:
>> > > > > >>> > >>> >> >> Failed to
>> > > > > >>> > >>> >> >> > execute
>> > > > > >>> > >>> >> >> > >>> goal
>> > > > > >>> > >>> >> >>
>> > > > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> > > > > >>> > >>> >> >> > >>> (default-compile) on project
>> > > zookeeper:
>> > > > > Fatal
>> > > > > >>> error
>> > > > > >>> > >>> >> >> compiling
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >>
>> > > > > org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >>
>> > > > > org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >>
>> > > > > org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >>
>> > > > org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >>
>> > > org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >>
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>> > > > > Method)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> java.lang.reflect.Method.invoke(Method.java:498)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > >
>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>> > > > > >>> > >>> >> >> > >>> Caused by:
>> > > > > >>> > >>> >> org.apache.maven.plugin.MojoExecutionException:
>> > > > > >>> > >>> >> >> Fatal error
>> > > > > >>> > >>> >> >> > >>> compiling
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>> > > > > >>> > >>> >> >> > >>> ... 19 more
>> > > > > >>> > >>> >> >> > >>> Caused by:
>> > > > > >>> > >>> >> org.codehaus.plexus.compiler.CompilerException:
>> > > > > >>> > >>> >> >> > >>> java.lang.NullPointerException
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
>> > > > > >>> > >>> >> >> > >>> ... 22 more
>> > > > > >>> > >>> >> >> > >>> Caused by:
>> > > java.lang.RuntimeException:
>> > > > > >>> > >>> >> >> java.lang.NullPointerException
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >>
>> > > com.sun.tools.javac.main.Main.compile(Main.java:559)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>>
>> > > > > >>>
>> > > > >
>> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> >
>> > > > > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
>> > > > > >>> > >>> >> >> > >>> ... 24 more
>> > > > > >>> > >>> >> >> > >>> Caused by:
>> > > > java.lang.NullPointerException
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >>
>> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >>
>> > > com.sun.tools.doclint.Checker.scan(Checker.java:144)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >>
>> > > > > com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>>
>> > > > > >>>
>> > > > >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>>
>> > > > > >>>
>> > > > >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> >
>> > > > >
>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>>
>> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> >
>> > > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> >
>> > > > >
>> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> >
>> > > > >
>> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>>
>> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> >
>> > > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> >
>> > > > >
>> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>>
>> > > > > >>>
>> > > > >
>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>>
>> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> >
>> > > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >>
>> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> >
>> > > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >>
>> > > > > >>>
>> > > com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>>
>> > > > > >>>
>> > > > >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>>
>> > > > > >>>
>> > > > >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> >
>> > > > >
>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>>
>> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >>
>> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> >
>> > > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > >
>> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>>
>> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >>
>> > > > > com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>>
>> > > > > >>>
>> > > > >
>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>>
>> > > > > >>>
>> > > > >
>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>>
>> > > > > >>>
>> > > > >
>> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
>> > > > > >>> > >>> >> >> > >>> at
>> > > > > >>> > >>> >> >>
>> > > com.sun.tools.javac.main.Main.compile(Main.java:523)
>> > > > > >>> > >>> >> >> > >>> ... 27 more
>> > > > > >>> > >>> >> >> > >>> [ERROR]
>> > > > > >>> > >>> >> >> > >>> [ERROR] Re-run Maven using the
>> -X
>> > > > switch
>> > > > > to
>> > > > > >>> enable
>> > > > > >>> > >>> full
>> > > > > >>> > >>> >> >> debug logging.
>> > > > > >>> > >>> >> >> > >>> [ERROR]
>> > > > > >>> > >>> >> >> > >>> [ERROR] For more information
>> about
>> > > the
>> > > > > errors
>> > > > > >>> and
>> > > > > >>> > >>> >> possible
>> > > > > >>> > >>> >> >> solutions,
>> > > > > >>> > >>> >> >> > >>> please read the following
>> articles:
>> > > > > >>> > >>> >> >> > >>> [ERROR] [Help 1]
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > >
>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>> Can someone help me on this
>> issue?
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>> Thanks,
>> > > > > >>> > >>> >> >> > >>> ---------------------
>> > > > > >>> > >>> >> >> > >>> Kuldeep Singh Budania
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM
>> > > > > Szalay-Bekő
>> > > > > >>> Máté <
>> > > > > >>> > >>> >> >> > >>> szalay.beko.mate@gmail.com>
>> > > > > >>> > >>> >> >> > >>> wrote:
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>>> these exceptions can mean many
>> > > > > things... I
>> > > > > >>> think
>> > > > > >>> > >>> this
>> > > > > >>> > >>> >> can
>> > > > > >>> > >>> >> >> be even
>> > > > > >>> > >>> >> >> > >> normal
>> > > > > >>> > >>> >> >> > >>>> duding rolling restart (as some
>> > > > > connections
>> > > > > >>> get
>> > > > > >>> > >>> broken
>> > > > > >>> > >>> >> in
>> > > > > >>> > >>> >> >> this case)
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>> However, I saw cases already
>> when
>> > > > > exceptions
>> > > > > >>> like
>> > > > > >>> > >>> these
>> > > > > >>> > >>> >> >> killed
>> > > > > >>> > >>> >> >> > receiver
>> > > > > >>> > >>> >> >> > >>> or
>> > > > > >>> > >>> >> >> > >>>> sender threads in
>> QuorumCnxManager /
>> > > > > Leader
>> > > > > >>> > >>> Election in
>> > > > > >>> > >>> >> >> such a way
>> > > > > >>> > >>> >> >> > that
>> > > > > >>> > >>> >> >> > >>>> they were not able to recover,
>> so
>> > > the
>> > > > > node was
>> > > > > >>> > >>> unable to
>> > > > > >>> > >>> >> >> connect to
>> > > > > >>> > >>> >> >> > any
>> > > > > >>> > >>> >> >> > >>>> quorum until restart. I
>> remember
>> > > > seeing
>> > > > > this
>> > > > > >>> in
>> > > > > >>> > 3.4
>> > > > > >>> > >>> too.
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>> Do you see these exceptions in
>> the
>> > > > > second
>> > > > > >>> server
>> > > > > >>> > >>> (the
>> > > > > >>> > >>> >> one
>> > > > > >>> > >>> >> >> which you
>> > > > > >>> > >>> >> >> > >> just
>> > > > > >>> > >>> >> >> > >>>> upgraded in step 3)?
>> > > > > >>> > >>> >> >> > >>>> Is this issue reproducible?
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>> What is the tickTime and
>> initLimit
>> > > you
>> > > > > use?
>> > > > > >>> Maybe
>> > > > > >>> > >>> the
>> > > > > >>> > >>> >> >> server just
>> > > > > >>> > >>> >> >> > >> require
>> > > > > >>> > >>> >> >> > >>>> more time to sync?
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>> I would need more logs to
>> really see
>> > > > > what
>> > > > > >>> > happened.
>> > > > > >>> > >>> Can
>> > > > > >>> > >>> >> >> you create a
>> > > > > >>> > >>> >> >> > >> Jira
>> > > > > >>> > >>> >> >> > >>>> issue and upload the logs and
>> also
>> > > the
>> > > > > >>> ZooKeeper
>> > > > > >>> > >>> >> configs?
>> > > > > >>> > >>> >> >> I am happy
>> > > > > >>> > >>> >> >> > to
>> > > > > >>> > >>> >> >> > >>>> take a closer look.
>> > > > > >>> > >>> >> >> > >>>> (if you need to re-run the
>> test to
>> > > > > collect the
>> > > > > >>> > logs,
>> > > > > >>> > >>> >> then
>> > > > > >>> > >>> >> >> enabling
>> > > > > >>> > >>> >> >> > >> DEBUG
>> > > > > >>> > >>> >> >> > >>>> logs would be great. The INFO
>> level
>> > > > > logs are
>> > > > > >>> > usually
>> > > > > >>> > >>> >> >> enough for these
>> > > > > >>> > >>> >> >> > >>>> problems, but one can never
>> know...)
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>> Kind regards,
>> > > > > >>> > >>> >> >> > >>>> Mate
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM
>> > > > kuldeep
>> > > > > singh
>> > > > > >>> <
>> > > > > >>> > >>> >> >> > >> kuldeep.singh08@gmail.com
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>> wrote:
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>>> Hi Team,
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> I have done some POC on
>> rolling
>> > > > > upgrade and
>> > > > > >>> found
>> > > > > >>> > >>> below
>> > > > > >>> > >>> >> >> result.
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> 1. On 1st node upgrade
>> zookeeper
>> > > .
>> > > > > Traffic
>> > > > > >>> was
>> > > > > >>> > >>> >> running
>> > > > > >>> > >>> >> >> fine
>> > > > > >>> > >>> >> >> > >> because
>> > > > > >>> > >>> >> >> > >>> 2
>> > > > > >>> > >>> >> >> > >>>>> nodes are already on old
>> > > zookeeper.
>> > > > > >>> > >>> >> >> > >>>>> 2. On 1st node upgrade our
>> > > > > application and
>> > > > > >>> > didn’t
>> > > > > >>> > >>> >> find
>> > > > > >>> > >>> >> >> any issue
>> > > > > >>> > >>> >> >> > >>>>> 3. On 2nd node upgrade
>> zookeeper
>> > > > but
>> > > > > got
>> > > > > >>> below
>> > > > > >>> > >>> error
>> > > > > >>> > >>> >> >> and zookeeper
>> > > > > >>> > >>> >> >> > >>> is
>> > > > > >>> > >>> >> >> > >>>>> not taking any requests
>> > > > > >>> > >>> >> >> > >>>>> 4.
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> at
>> > > > > >>> > >>> >> >>
>> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> at
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
>> > > > > >>> -
>> > > > > >>> > >>> >> >> Interrupting
>> > > > > >>> > >>> >> >> > >>> SendWorker
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 -
>> ERROR
>> > > > > >>> [LearnerHandler-/
>> > > > > >>> > >>> >> >> 192.168.44.73:33754
>> > > > > >>> > >>> >> >> > >>>>> :LearnerHandler@562] -
>> Unexpected
>> > > > > exception
>> > > > > >>> > >>> causing
>> > > > > >>> > >>> >> >> shutdown while
>> > > > > >>> > >>> >> >> > >>> sock
>> > > > > >>> > >>> >> >> > >>>>> still open
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> at
>> > > > > >>> > >>> >> >>
>> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> at
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>>
>> > > > > >>>
>> > > > >
>> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> at
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> at
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> at
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >>
>> > > > > >>> > >>>
>> > > > > >>> >
>> > > > > >>>
>> > > > >
>> > > >
>> > >
>> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > [SendWorker:1:QuorumCnxManager$SendWorker@679]
>> > > > > >>> -
>> > > > > >>> > >>> >> >> Interrupted while
>> > > > > >>> > >>> >> >> > >>>> waiting
>> > > > > >>> > >>> >> >> > >>>>> for message on queue
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> Please let me know is this the
>> > > known
>> > > > > issue or
>> > > > > >>> > this
>> > > > > >>> > >>> is
>> > > > > >>> > >>> >> >> different issue
>> > > > > >>> > >>> >> >> > >>>> which
>> > > > > >>> > >>> >> >> > >>>>> is mention in Apache zookeeper
>> > > > > documentation
>> > > > > >>> when
>> > > > > >>> > >>> >> >> upgrading from
>> > > > > >>> > >>> >> >> > >> 3.4.5
>> > > > > >>> > >>> >> >> > >>> to
>> > > > > >>> > >>> >> >> > >>>>> 3.5.6
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> Thanks,
>> > > > > >>> > >>> >> >> > >>>>> ---------------------
>> > > > > >>> > >>> >> >> > >>>>> Kuldeep Singh Budania
>> > > > > >>> > >>> >> >> > >>>>> Software Architect
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06
>> AM
>> > > > > Alexander
>> > > > > >>> Shraer
>> > > > > >>> > <
>> > > > > >>> > >>> >> >> shralex@gmail.com>
>> > > > > >>> > >>> >> >> > >>>>> wrote:
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>>> +1 to what Mate said (I
>> wrote the
>> > > > > quoted
>> > > > > >>> > >>> >> instructions).
>> > > > > >>> > >>> >> >> > >>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>
>> > > > > >>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03
>> AM
>> > > > > Szalay-Bekő
>> > > > > >>> > Máté <
>> > > > > >>> > >>> >> >> > >>>>>> szalay.beko.mate@gmail.com>
>> > > > > >>> > >>> >> >> > >>>>>> wrote:
>> > > > > >>> > >>> >> >> > >>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>> Hi Kuldeep,
>> > > > > >>> > >>> >> >> > >>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>> I just want to provide you
>> some
>> > > > > background
>> > > > > >>> info
>> > > > > >>> > >>> about
>> > > > > >>> > >>> >> >> our
>> > > > > >>> > >>> >> >> > >>>>> documentation.
>> > > > > >>> > >>> >> >> > >>>>>>> The reason to upgrade to
>> 3.4.6
>> > > > first
>> > > > > is to
>> > > > > >>> > avoid
>> > > > > >>> > >>> the
>> > > > > >>> > >>> >> >> following
>> > > > > >>> > >>> >> >> > >>> error:
>> > > > > >>> > >>> >> >> > >>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663
>> > > [myid:2] -
>> > > > > WARN
>> > > > > >>> > >>> [localhost/
>> > > > > >>> > >>> >> >> > >>> 127.0.0.1:2784
>> > > > > >>> > >>> >> >> > >>>>>>> :QuorumCnxManager@349] -
>> Invalid
>> > > > > server
>> > > > > >>> id:
>> > > > > >>> > >>> -65536
>> > > > > >>> > >>> >> >> > >>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>> This error comes because of
>> the
>> > > > > protocol
>> > > > > >>> > changes
>> > > > > >>> > >>> >> between
>> > > > > >>> > >>> >> >> > >> ZooKeeper
>> > > > > >>> > >>> >> >> > >>>>> server
>> > > > > >>> > >>> >> >> > >>>>>>> nodes during connection
>> > > initiation
>> > > > > for
>> > > > > >>> leader
>> > > > > >>> > >>> >> election.
>> > > > > >>> > >>> >> >> In
>> > > > > >>> > >>> >> >> > >>> ZooKeeper
>> > > > > >>> > >>> >> >> > >>>>> 3.5
>> > > > > >>> > >>> >> >> > >>>>>> a
>> > > > > >>> > >>> >> >> > >>>>>>> protocol version was
>> introduced
>> > > > (see
>> > > > > >>> > >>> ZOOKEEPER-107)
>> > > > > >>> > >>> >> and
>> > > > > >>> > >>> >> >> since
>> > > > > >>> > >>> >> >> > >> that
>> > > > > >>> > >>> >> >> > >>>> time
>> > > > > >>> > >>> >> >> > >>>>>> the
>> > > > > >>> > >>> >> >> > >>>>>>> fist long value sent in the
>> > > initial
>> > > > > >>> message is
>> > > > > >>> > >>> not
>> > > > > >>> > >>> >> the
>> > > > > >>> > >>> >> >> server ID
>> > > > > >>> > >>> >> >> > >>> but
>> > > > > >>> > >>> >> >> > >>>>> the
>> > > > > >>> > >>> >> >> > >>>>>>> protocol version (-65536).
>> In
>> > > > > ZooKeeper
>> > > > > >>> 3.4.6
>> > > > > >>> > we
>> > > > > >>> > >>> made
>> > > > > >>> > >>> >> >> the old 3.4
>> > > > > >>> > >>> >> >> > >>>>>>> ZooKeepers backward
>> compatible,
>> > > so
>> > > > > they are
>> > > > > >>> > able
>> > > > > >>> > >>> to
>> > > > > >>> > >>> >> >> parse both
>> > > > > >>> > >>> >> >> > >> the
>> > > > > >>> > >>> >> >> > >>>> old
>> > > > > >>> > >>> >> >> > >>>>>> and
>> > > > > >>> > >>> >> >> > >>>>>>> the new protocol format (see
>> > > > > >>> ZOOKEEPER-1633).
>> > > > > >>> > >>> This
>> > > > > >>> > >>> >> >> issue happens
>> > > > > >>> > >>> >> >> > >>> only
>> > > > > >>> > >>> >> >> > >>>>>> when
>> > > > > >>> > >>> >> >> > >>>>>>> you need to use old (3.4.0 -
>> > > 3.4.5)
>> > > > > and new
>> > > > > >>> > >>> (3.5.0+)
>> > > > > >>> > >>> >> >> ZooKeeper
>> > > > > >>> > >>> >> >> > >>>> servers
>> > > > > >>> > >>> >> >> > >>>>>>> together in the same
>> cluster.
>> > > > During
>> > > > > a
>> > > > > >>> rolling
>> > > > > >>> > >>> >> upgrade,
>> > > > > >>> > >>> >> >> this is
>> > > > > >>> > >>> >> >> > >>>> usually
>> > > > > >>> > >>> >> >> > >>>>>> the
>> > > > > >>> > >>> >> >> > >>>>>>> case to have old and new
>> > > ZooKeepers
>> > > > > present
>> > > > > >>> > >>> together.
>> > > > > >>> > >>> >> >> > >>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>> The fact that you haven't
>> seen
>> > > any
>> > > > > issues
>> > > > > >>> might
>> > > > > >>> > >>> be
>> > > > > >>> > >>> >> >> caused by the
>> > > > > >>> > >>> >> >> > >>>> order
>> > > > > >>> > >>> >> >> > >>>>> of
>> > > > > >>> > >>> >> >> > >>>>>>> the servers. In ZooKeeper
>> the
>> > > > > connection
>> > > > > >>> > >>> initiation
>> > > > > >>> > >>> >> >> between the
>> > > > > >>> > >>> >> >> > >>>> servers
>> > > > > >>> > >>> >> >> > >>>>>>> during the leader election
>> > > follows
>> > > > a
>> > > > > >>> specific
>> > > > > >>> > >>> rule.
>> > > > > >>> > >>> >> As
>> > > > > >>> > >>> >> >> far as I
>> > > > > >>> > >>> >> >> > >>>>> remember
>> > > > > >>> > >>> >> >> > >>>>>>> always the server with the
>> larger
>> > > > ID
>> > > > > 'wins
>> > > > > >>> the
>> > > > > >>> > >>> >> >> challenge', so it
>> > > > > >>> > >>> >> >> > >> is
>> > > > > >>> > >>> >> >> > >>>>>>> possible, that the old
>> server
>> > > > didn't
>> > > > > need
>> > > > > >>> to
>> > > > > >>> > >>> parse
>> > > > > >>> > >>> >> any
>> > > > > >>> > >>> >> >> initial
>> > > > > >>> > >>> >> >> > >>>> message
>> > > > > >>> > >>> >> >> > >>>>>> (if
>> > > > > >>> > >>> >> >> > >>>>>>> it had the largest ID) and
>> this
>> > > is
>> > > > > why you
>> > > > > >>> > >>> haven't
>> > > > > >>> > >>> >> seen
>> > > > > >>> > >>> >> >> the
>> > > > > >>> > >>> >> >> > >> issue.
>> > > > > >>> > >>> >> >> > >>>> Also
>> > > > > >>> > >>> >> >> > >>>>>>> having 2 nodes up from the 3
>> > > nodes
>> > > > > cluster
>> > > > > >>> > still
>> > > > > >>> > >>> >> makes
>> > > > > >>> > >>> >> >> the
>> > > > > >>> > >>> >> >> > >> cluster
>> > > > > >>> > >>> >> >> > >>>> work
>> > > > > >>> > >>> >> >> > >>>>>> (so
>> > > > > >>> > >>> >> >> > >>>>>>> you should also check if
>> all the
>> > > > > servers
>> > > > > >>> are
>> > > > > >>> > >>> part of
>> > > > > >>> > >>> >> >> the quorum).
>> > > > > >>> > >>> >> >> > >>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>> I agree with Enrico and
>> Norbert,
>> > > > the
>> > > > > >>> safest and
>> > > > > >>> > >>> most
>> > > > > >>> > >>> >> >> stable way
>> > > > > >>> > >>> >> >> > >> is
>> > > > > >>> > >>> >> >> > >>>>>> upgrade
>> > > > > >>> > >>> >> >> > >>>>>>> first to 3.4.latest, then
>> go to
>> > > > > 3.5.latest.
>> > > > > >>> > >>> Still, if
>> > > > > >>> > >>> >> >> you don't
>> > > > > >>> > >>> >> >> > >> see
>> > > > > >>> > >>> >> >> > >>>>> that
>> > > > > >>> > >>> >> >> > >>>>>>> you would hit this specific
>> issue
>> > > > > (e.g. no
>> > > > > >>> > >>> "Invalid
>> > > > > >>> > >>> >> >> server id" in
>> > > > > >>> > >>> >> >> > >>> the
>> > > > > >>> > >>> >> >> > >>>>> log
>> > > > > >>> > >>> >> >> > >>>>>>> files), and all the three
>> servers
>> > > > can
>> > > > > >>> handle
>> > > > > >>> > >>> traffic,
>> > > > > >>> > >>> >> >> then maybe
>> > > > > >>> > >>> >> >> > >>> you
>> > > > > >>> > >>> >> >> > >>>>>> don't
>> > > > > >>> > >>> >> >> > >>>>>>> need to upgrade first to
>> > > > 3.4.latest,
>> > > > > it is
>> > > > > >>> your
>> > > > > >>> > >>> >> >> decision.
>> > > > > >>> > >>> >> >> > >>> Definitely
>> > > > > >>> > >>> >> >> > >>>>> you
>> > > > > >>> > >>> >> >> > >>>>>>> should test it first, as
>> > > suggested
>> > > > > by the
>> > > > > >>> > others.
>> > > > > >>> > >>> >> >> > >>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>> Kind regards,
>> > > > > >>> > >>> >> >> > >>>>>>> Mate
>> > > > > >>> > >>> >> >> > >>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at
>> 12:29 PM
>> > > > > Norbert
>> > > > > >>> Kalmar
>> > > > > >>> > >>> >> >> > >>>>>>>
>> <nk...@cloudera.com.invalid>
>> > > > > wrote:
>> > > > > >>> > >>> >> >> > >>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>> Hi,
>> > > > > >>> > >>> >> >> > >>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>> That guide is to upgrade to
>> > > 3.5.0,
>> > > > > which
>> > > > > >>> was
>> > > > > >>> > an
>> > > > > >>> > >>> >> alpha
>> > > > > >>> > >>> >> >> version.
>> > > > > >>> > >>> >> >> > >> A
>> > > > > >>> > >>> >> >> > >>>> lot
>> > > > > >>> > >>> >> >> > >>>>>> has
>> > > > > >>> > >>> >> >> > >>>>>>>> changed for the first
>> stable
>> > > > > release of
>> > > > > >>> 3.5.5
>> > > > > >>> > >>> and
>> > > > > >>> > >>> >> then
>> > > > > >>> > >>> >> >> a few
>> > > > > >>> > >>> >> >> > >>> more,
>> > > > > >>> > >>> >> >> > >>>>> even
>> > > > > >>> > >>> >> >> > >>>>>>>> rolling upgrade issues
>> have been
>> > > > > fixed for
>> > > > > >>> > >>> 3.5.6.
>> > > > > >>> > >>> >> >> > >>>>>>>> This is a more up-to-date
>> guide:
>> > > > > >>> > >>> >> >> > >>>>>>>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >>
>> > > > > >>> >
>> > > > > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
>> > > > > >>> > >>> >> >> > >>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>> If you have done your
>> testing
>> > > > (with
>> > > > > prod
>> > > > > >>> > >>> snapshot!),
>> > > > > >>> > >>> >> >> then you
>> > > > > >>> > >>> >> >> > >> can
>> > > > > >>> > >>> >> >> > >>>>> skip
>> > > > > >>> > >>> >> >> > >>>>>>> 3.4
>> > > > > >>> > >>> >> >> > >>>>>>>> latest upgrade, but keep
>> in mind
>> > > > we
>> > > > > do our
>> > > > > >>> > >>> >> >> recommendations for
>> > > > > >>> > >>> >> >> > >> a
>> > > > > >>> > >>> >> >> > >>>>>> reason.
>> > > > > >>> > >>> >> >> > >>>>>>>> There were issues reported
>> > > and/or
>> > > > > found
>> > > > > >>> during
>> > > > > >>> > >>> >> >> testing. Some
>> > > > > >>> > >>> >> >> > >> are
>> > > > > >>> > >>> >> >> > >>>>> fixed
>> > > > > >>> > >>> >> >> > >>>>>>> with
>> > > > > >>> > >>> >> >> > >>>>>>>> 3.5.6, some only happens if
>> > > > certain
>> > > > > >>> conditions
>> > > > > >>> > >>> stand
>> > > > > >>> > >>> >> >> > >>> (IOException:
>> > > > > >>> > >>> >> >> > >>>> No
>> > > > > >>> > >>> >> >> > >>>>>>>> snapshot found - mentioned
>> in
>> > > the
>> > > > > guide,
>> > > > > >>> fixed
>> > > > > >>> > >>> in
>> > > > > >>> > >>> >> >> 3.5.6).
>> > > > > >>> > >>> >> >> > >>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>> So it is up to you, I would
>> > > still
>> > > > > >>> recommend to
>> > > > > >>> > >>> do an
>> > > > > >>> > >>> >> >> 3.4
>> > > > > >>> > >>> >> >> > >> upgrade
>> > > > > >>> > >>> >> >> > >>>>> first,
>> > > > > >>> > >>> >> >> > >>>>>>> if
>> > > > > >>> > >>> >> >> > >>>>>>>> it's feasible.
>> > > > > >>> > >>> >> >> > >>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>> Regards,
>> > > > > >>> > >>> >> >> > >>>>>>>> Norbert
>> > > > > >>> > >>> >> >> > >>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at
>> 11:45 AM
>> > > > > kuldeep
>> > > > > >>> > singh <
>> > > > > >>> > >>> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
>> > > > > >>> > >>> >> >> > >>>>>>>> wrote:
>> > > > > >>> > >>> >> >> > >>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>> Hi,
>> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>> Current Zookeeper version
>> :-
>> > > > 3.4.5
>> > > > > >>> > >>> >> >> > >>>>>>>>> Upgraded version
>> > > > :-
>> > > > > 3.5.6
>> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>> We are not going with
>> 3.5.7.
>> > > Our
>> > > > > final
>> > > > > >>> > >>> decision is
>> > > > > >>> > >>> >> >> zookeeper
>> > > > > >>> > >>> >> >> > >>>>> version
>> > > > > >>> > >>> >> >> > >>>>>> is
>> > > > > >>> > >>> >> >> > >>>>>>>>> 3.5.6
>> > > > > >>> > >>> >> >> > >>>>>>>>> as per your reply first
>> we need
>> > > > to
>> > > > > move
>> > > > > >>> > latest
>> > > > > >>> > >>> >> >> version of
>> > > > > >>> > >>> >> >> > >>> 3.4.x,
>> > > > > >>> > >>> >> >> > >>>>> like
>> > > > > >>> > >>> >> >> > >>>>>>>> below
>> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6
>> > > (Correct
>> > > > > me if
>> > > > > >>> I am
>> > > > > >>> > >>> wrong
>> > > > > >>> > >>> >> >> here)
>> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>> But if We are not facing
>> any
>> > > > > problem
>> > > > > >>> that i
>> > > > > >>> > >>> have
>> > > > > >>> > >>> >> >> shared you
>> > > > > >>> > >>> >> >> > >>> that
>> > > > > >>> > >>> >> >> > >>>> we
>> > > > > >>> > >>> >> >> > >>>>>>> have
>> > > > > >>> > >>> >> >> > >>>>>>>>> set up of 3 node cluster
>> where
>> > > 2
>> > > > > node
>> > > > > >>> are on
>> > > > > >>> > >>> 3.5.6
>> > > > > >>> > >>> >> >> version
>> > > > > >>> > >>> >> >> > >> and
>> > > > > >>> > >>> >> >> > >>> 1
>> > > > > >>> > >>> >> >> > >>>>> node
>> > > > > >>> > >>> >> >> > >>>>>>> on
>> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything is
>> running
>> > > fine
>> > > > > and
>> > > > > >>> didn't
>> > > > > >>> > >>> get
>> > > > > >>> > >>> >> any
>> > > > > >>> > >>> >> >> issue,
>> > > > > >>> > >>> >> >> > >> So
>> > > > > >>> > >>> >> >> > >>>> what
>> > > > > >>> > >>> >> >> > >>>>>>> other
>> > > > > >>> > >>> >> >> > >>>>>>>>> problem we can face if we
>> > > > directly
>> > > > > move
>> > > > > >>> to
>> > > > > >>> > >>> 3.5.6
>> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>> Thanks,
>> > > > > >>> > >>> >> >> > >>>>>>>>> ---------------------
>> > > > > >>> > >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
>> > > > > >>> > >>> >> >> > >>>>>>>>> Software Architect
>> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at
>> 3:58 PM
>> > > > > Enrico
>> > > > > >>> > >>> Olivelli <
>> > > > > >>> > >>> >> >> > >>>>> eolivelli@gmail.com
>> > > > > >>> > >>> >> >> > >>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>> wrote:
>> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>> Hi
>> > > > > >>> > >>> >> >> > >>>>>>>>>> You have to upgrade to
>> latest
>> > > > > 3.4.x
>> > > > > >>> > Zookeeper
>> > > > > >>> > >>> then
>> > > > > >>> > >>> >> >> you will
>> > > > > >>> > >>> >> >> > >>>>> upgrade
>> > > > > >>> > >>> >> >> > >>>>>>> to
>> > > > > >>> > >>> >> >> > >>>>>>>>>> 3.5.7.
>> > > > > >>> > >>> >> >> > >>>>>>>>>> All should run well
>> without
>> > > > issues
>> > > > > >>> > >>> >> >> > >>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>> Enrico
>> > > > > >>> > >>> >> >> > >>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18
>> > > > kuldeep
>> > > > > singh
>> > > > > >>> <
>> > > > > >>> > >>> >> >> > >>>>> kuldeep.singh08@gmail.com
>> > > > > >>> > >>> >> >> > >>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>> ha
>> > > > > >>> > >>> >> >> > >>>>>>>>>> scritto:
>> > > > > >>> > >>> >> >> > >>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> Hi Team,
>> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> We are upgrading
>> zookeeper
>> > > from
>> > > > > 3.4.5
>> > > > > >>> to
>> > > > > >>> > >>> 3.5.6. I
>> > > > > >>> > >>> >> >> have
>> > > > > >>> > >>> >> >> > >> set
>> > > > > >>> > >>> >> >> > >>>> up 3
>> > > > > >>> > >>> >> >> > >>>>>>> node
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> cluster where 2 node
>> are on
>> > > > 3.5.6
>> > > > > >>> version
>> > > > > >>> > >>> and 1
>> > > > > >>> > >>> >> >> node on
>> > > > > >>> > >>> >> >> > >>>> 3.4.5.
>> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> Everything is running
>> fine
>> > > and
>> > > > > didn't
>> > > > > >>> get
>> > > > > >>> > any
>> > > > > >>> > >>> >> issue
>> > > > > >>> > >>> >> >> on my
>> > > > > >>> > >>> >> >> > >>>>> system.
>> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> but I found something on
>> > > apache
>> > > > > site
>> > > > > >>> that
>> > > > > >>> > >>> first
>> > > > > >>> > >>> >> we
>> > > > > >>> > >>> >> >> need
>> > > > > >>> > >>> >> >> > >> to
>> > > > > >>> > >>> >> >> > >>>>>> upgrade
>> > > > > >>> > >>> >> >> > >>>>>>>> on
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can
>> upgrade to
>> > > > > 3.5.6. So
>> > > > > >>> is
>> > > > > >>> > it
>> > > > > >>> > >>> >> >> mandatory
>> > > > > >>> > >>> >> >> > >> to
>> > > > > >>> > >>> >> >> > >>> go
>> > > > > >>> > >>> >> >> > >>>>> on
>> > > > > >>> > >>> >> >> > >>>>>>>> 3.4.6
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> first.
>> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
>> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> Upgrading a running
>> ZooKeeper
>> > > > > ensemble
>> > > > > >>> to
>> > > > > >>> > >>> 3.5.0
>> > > > > >>> > >>> >> >> should be
>> > > > > >>> > >>> >> >> > >>>> done
>> > > > > >>> > >>> >> >> > >>>>>> only
>> > > > > >>> > >>> >> >> > >>>>>>>>> after
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> upgrading your ensemble
>> to
>> > > the
>> > > > > 3.4.6
>> > > > > >>> > release.
>> > > > > >>> > >>> >> Note
>> > > > > >>> > >>> >> >> that
>> > > > > >>> > >>> >> >> > >>> this
>> > > > > >>> > >>> >> >> > >>>> is
>> > > > > >>> > >>> >> >> > >>>>>>> only
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> necessary for rolling
>> > > upgrades
>> > > > > (if
>> > > > > >>> you're
>> > > > > >>> > >>> fine
>> > > > > >>> > >>> >> with
>> > > > > >>> > >>> >> >> > >>> shutting
>> > > > > >>> > >>> >> >> > >>>>> down
>> > > > > >>> > >>> >> >> > >>>>>>> the
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> system completely, you
>> don't
>> > > > > have to go
>> > > > > >>> > >>> through
>> > > > > >>> > >>> >> >> 3.4.6).
>> > > > > >>> > >>> >> >> > >> If
>> > > > > >>> > >>> >> >> > >>>> you
>> > > > > >>> > >>> >> >> > >>>>>>>> attempt
>> > > > > >>> > >>> >> >> > >>>>>>>>> a
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> rolling upgrade without
>> going
>> > > > > through
>> > > > > >>> 3.4.6
>> > > > > >>> > >>> (for
>> > > > > >>> > >>> >> >> example
>> > > > > >>> > >>> >> >> > >>> from
>> > > > > >>> > >>> >> >> > >>>>>>> 3.4.5),
>> > > > > >>> > >>> >> >> > >>>>>>>>> you
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> may get the following
>> error:
>> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663
>> > > > [myid:2]
>> > > > > - INFO
>> > > > > >>> > >>> >> [localhost/
>> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
>> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > > :QuorumCnxManager$Listener@498
>> > > > ]
>> > > > > -
>> > > > > >>> Received
>> > > > > >>> > >>> >> >> connection
>> > > > > >>> > >>> >> >> > >>>> request
>> > > > > >>> > >>> >> >> > >>>>> /
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
>> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663
>> > > > [myid:2]
>> > > > > - WARN
>> > > > > >>> > >>> >> [localhost/
>> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349]
>> -
>> > > > Invalid
>> > > > > >>> server
>> > > > > >>> > id:
>> > > > > >>> > >>> >> -65536
>> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> During a rolling
>> upgrade,
>> > > each
>> > > > > server
>> > > > > >>> is
>> > > > > >>> > >>> taken
>> > > > > >>> > >>> >> down
>> > > > > >>> > >>> >> >> in
>> > > > > >>> > >>> >> >> > >> turn
>> > > > > >>> > >>> >> >> > >>>> and
>> > > > > >>> > >>> >> >> > >>>>>>>>> rebooted
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> with the new 3.5.0
>> binaries.
>> > > > > Before
>> > > > > >>> > starting
>> > > > > >>> > >>> the
>> > > > > >>> > >>> >> >> server
>> > > > > >>> > >>> >> >> > >>> with
>> > > > > >>> > >>> >> >> > >>>>>> 3.5.0
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> binaries, we highly
>> recommend
>> > > > > updating
>> > > > > >>> the
>> > > > > >>> > >>> >> >> configuration
>> > > > > >>> > >>> >> >> > >>> file
>> > > > > >>> > >>> >> >> > >>>>> so
>> > > > > >>> > >>> >> >> > >>>>>>> that
>> > > > > >>> > >>> >> >> > >>>>>>>>> all
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> server statements
>> > > > "server.x=..."
>> > > > > >>> contain
>> > > > > >>> > >>> client
>> > > > > >>> > >>> >> >> ports
>> > > > > >>> > >>> >> >> > >> (see
>> > > > > >>> > >>> >> >> > >>>> the
>> > > > > >>> > >>> >> >> > >>>>>>>> section
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> Specifying
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> the client port). As
>> > > explained
>> > > > > earlier
>> > > > > >>> you
>> > > > > >>> > >>> may
>> > > > > >>> > >>> >> >> leave the
>> > > > > >>> > >>> >> >> > >>>>>>>> configuration
>> > > > > >>> > >>> >> >> > >>>>>>>>>> in a
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> single file, as well as
>> leave
>> > > > the
>> > > > > >>> > >>> >> >> > >>>> clientPort/clientPortAddress
>> > > > > >>> > >>> >> >> > >>>>>>>>> statements
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> (although if you specify
>> > > client
>> > > > > ports
>> > > > > >>> in
>> > > > > >>> > the
>> > > > > >>> > >>> new
>> > > > > >>> > >>> >> >> format,
>> > > > > >>> > >>> >> >> > >>>> these
>> > > > > >>> > >>> >> >> > >>>>>>>>> statements
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> are now redundant).
>> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> Could you please let me
>> know
>> > > > > about this
>> > > > > >>> > case.
>> > > > > >>> > >>> >> >> Appreciate
>> > > > > >>> > >>> >> >> > >> if
>> > > > > >>> > >>> >> >> > >>>>>> respond
>> > > > > >>> > >>> >> >> > >>>>>>>>> soon.
>> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> Thanks,
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> ---------------------
>> > > > > >>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
>> > > > > >>> > >>> >> >> > >>>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>>
>> > > > > >>> > >>> >> >> > >>>>>>
>> > > > > >>> > >>> >> >> > >>>>>
>> > > > > >>> > >>> >> >> > >>>>
>> > > > > >>> > >>> >> >> > >>>
>> > > > > >>> > >>> >> >> > >>
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >> >
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> ________________________________
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>> > > > > >>> > >>> >> >> This e-mail (including any attachments) is
>> > > > strictly
>> > > > > >>> > >>> confidential
>> > > > > >>> > >>> >> and
>> > > > > >>> > >>> >> >> may also contain privileged information. If
>> you are
>> > > > > not the
>> > > > > >>> > >>> intended
>> > > > > >>> > >>> >> >> recipient you are not authorised to read,
>> print,
>> > > > save,
>> > > > > >>> process or
>> > > > > >>> > >>> >> disclose
>> > > > > >>> > >>> >> >> this message. If you have received this
>> message by
>> > > > > mistake,
>> > > > > >>> > please
>> > > > > >>> > >>> >> inform
>> > > > > >>> > >>> >> >> the sender immediately and destroy this
>> e-mail, its
>> > > > > >>> attachments
>> > > > > >>> > >>> and any
>> > > > > >>> > >>> >> >> copies. Any use, distribution, reproduction or
>> > > > > disclosure by
>> > > > > >>> any
>> > > > > >>> > >>> person
>> > > > > >>> > >>> >> >> other than the intended recipient is strictly
>> > > > > prohibited and
>> > > > > >>> the
>> > > > > >>> > >>> person
>> > > > > >>> > >>> >> >> responsible may incur in penalties.
>> > > > > >>> > >>> >> >> The use of this e-mail is only for
>> professional
>> > > > > purposes;
>> > > > > >>> > >>> there is
>> > > > > >>> > >>> >> no
>> > > > > >>> > >>> >> >> guarantee that the correspondence towards this
>> > > e-mail
>> > > > > will be
>> > > > > >>> > read
>> > > > > >>> > >>> >> only by
>> > > > > >>> > >>> >> >> the recipient, because, under certain
>> > > circumstances,
>> > > > > there
>> > > > > >>> may
>> > > > > >>> > be a
>> > > > > >>> > >>> >> need to
>> > > > > >>> > >>> >> >> access this email by third subjects belonging
>> to
>> > > the
>> > > > > Company.
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> ________________________________
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>> > > > > >>> > >>> >> >> This e-mail (including any attachments) is
>> strictly
>> > > > > >>> confidential
>> > > > > >>> > >>> and
>> > > > > >>> > >>> >> may
>> > > > > >>> > >>> >> >> also contain privileged information. If you
>> are not
>> > > > the
>> > > > > >>> intended
>> > > > > >>> > >>> >> recipient
>> > > > > >>> > >>> >> >> you are not authorised to read, print, save,
>> > > process
>> > > > or
>> > > > > >>> disclose
>> > > > > >>> > >>> this
>> > > > > >>> > >>> >> >> message. If you have received this message by
>> > > > mistake,
>> > > > > please
>> > > > > >>> > >>> inform
>> > > > > >>> > >>> >> the
>> > > > > >>> > >>> >> >> sender immediately and destroy this e-mail,
>> its
>> > > > > attachments
>> > > > > >>> and
>> > > > > >>> > any
>> > > > > >>> > >>> >> copies.
>> > > > > >>> > >>> >> >> Any use, distribution, reproduction or
>> disclosure
>> > > by
>> > > > > any
>> > > > > >>> person
>> > > > > >>> > >>> other
>> > > > > >>> > >>> >> than
>> > > > > >>> > >>> >> >> the intended recipient is strictly prohibited
>> and
>> > > the
>> > > > > person
>> > > > > >>> > >>> >> responsible
>> > > > > >>> > >>> >> >> may incur in penalties.
>> > > > > >>> > >>> >> >> The use of this e-mail is only for
>> professional
>> > > > > purposes;
>> > > > > >>> there
>> > > > > >>> > is
>> > > > > >>> > >>> no
>> > > > > >>> > >>> >> >> guarantee that the correspondence towards this
>> > > e-mail
>> > > > > will be
>> > > > > >>> > read
>> > > > > >>> > >>> >> only by
>> > > > > >>> > >>> >> >> the recipient, because, under certain
>> > > circumstances,
>> > > > > there
>> > > > > >>> may
>> > > > > >>> > be a
>> > > > > >>> > >>> >> need to
>> > > > > >>> > >>> >> >> access this email by third subjects belonging
>> to
>> > > the
>> > > > > Company.
>> > > > > >>> > >>> >> >>
>> > > > > >>> > >>> >> >
>> > > > > >>> > >>> >>
>> > > > > >>> > >>> >
>> > > > > >>> > >>>
>> > > > > >>> > >>
>> > > > > >>> >
>> > > > > >>>
>> > > > > >>
>> > > > >
>> > > > >
>> > > > > ________________________________
>> > > > >
>> > > > > CONFIDENTIALITY & PRIVACY NOTICE
>> > > > > This e-mail (including any attachments) is strictly confidential
>> and
>> > > may
>> > > > > also contain privileged information. If you are not the intended
>> > > > recipient
>> > > > > you are not authorised to read, print, save, process or disclose
>> this
>> > > > > message. If you have received this message by mistake, please
>> inform
>> > > the
>> > > > > sender immediately and destroy this e-mail, its attachments and
>> any
>> > > > copies.
>> > > > > Any use, distribution, reproduction or disclosure by any person
>> other
>> > > > than
>> > > > > the intended recipient is strictly prohibited and the person
>> > > responsible
>> > > > > may incur in penalties.
>> > > > > The use of this e-mail is only for professional purposes; there
>> is no
>> > > > > guarantee that the correspondence towards this e-mail will be
>> read only
>> > > > by
>> > > > > the recipient, because, under certain circumstances, there may be
>> a
>> > > need
>> > > > to
>> > > > > access this email by third subjects belonging to the Company.
>> > > > >
>> > > >
>> > >
>>
>>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Hi,
below error is coming on zookeeper logs on SSL.
2020-10-14 12:18:27,410 - WARN [nioEventLoopGroup-4-16:NettyServerCnxn@540]
- Closing connection to /127.0.0.1:49470
java.io.IOException: Len error 369296128
at
org.apache.zookeeper.server.NettyServerCnxn.receiveMessage(NettyServerCnxn.java:533)
at
org.apache.zookeeper.server.NettyServerCnxn.processMessage(NettyServerCnxn.java:360)
at
org.apache.zookeeper.server.NettyServerCnxnFactory$CnxnChannelHandler.channelRead(NettyServerCnxnFactory.java:184)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
at
io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at
io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
at
io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at
io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
at
io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
at
io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
at
io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
at
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Thanks,
---------------------
Kuldeep Singh Budania
On Thu, Oct 8, 2020 at 6:33 PM Szalay-Bekő Máté <sz...@gmail.com>
wrote:
> Sounds like a bug or a configuration issue...
> can you share the configs (before and after the scale-up) and the logs?
> also: does the truststores recognise all the keys used on all the 5
> nodes? (e.g. the truststores on the old nodes accept the new keys?)
>
> Best Regards,
> Mate
>
> On Thu, Oct 8, 2020 at 2:31 PM kuldeep singh <ku...@gmail.com>
> wrote:
> >
> > Hi,
> >
> > Yes, My client and server both are using certificate and have added in ZK
> > and client as well.
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> >
> >
> >
> > On Thu, Oct 8, 2020 at 5:56 PM Enrico Olivelli <eo...@gmail.com>
> wrote:
> >
> > > Il giorno gio 8 ott 2020 alle ore 14:17 kuldeep singh <
> > > kuldeep.singh08@gmail.com> ha scritto:
> > >
> > > > Hi Team,
> > > >
> > > > I am facing one issue in SSL communication between client and
> zookeeper
> > > > server.
> > > >
> > > > ZK 3.5.6 version
> > > >
> > > > 1. Mi on 3 node
> > > > 2. Applying SSL and 3 nodes cluster is working fine
> > > > 3. Scaled my cluster with 2 nodes and now my cluster have 5 nodes
> over
> > > SSL
> > > >
> > > > but after scaling my SSL is not working between client and ZK server
> and
> > > > even not able to login using zkCli as well.
> > > >
> > > > Can someone provide the details please why it is happening?
> > > >
> > >
> > > Is your client configured to use SSL ?
> > >
> > > Enrico
> > >
> > >
> > >
> > > >
> > > > Thanks,
> > > > ---------------------
> > > > Kuldeep Singh Budania
> > > > Software Architect
> > > >
> > > >
> > > >
> > > > On Mon, Jul 13, 2020 at 2:19 PM Enrico Olivelli - Diennea
> > > > <en...@diennea.com.invalid> wrote:
> > > >
> > > > > It looks like we ported it to 3.5.
> > > > >
> > > > > See the subtask
> > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2792
> > > > >
> > > > > Enrico
> > > > >
> > > > > Il giorno 13/07/20, 10:37 "kuldeep singh" <
> kuldeep.singh08@gmail.com>
> > > > ha
> > > > > scritto:
> > > > >
> > > > > Hi Team,
> > > > >
> > > > > I appreciate it if I will get a response as soon as possible,
> as I
> > > am
> > > > > stuck
> > > > > at this point.
> > > > >
> > > > > Thanks,
> > > > > ---------------------
> > > > > Kuldeep Singh Budania
> > > > >
> > > > >
> > > > >
> > > > > On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <
> > > > > kuldeep.singh08@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Hi Team,
> > > > > >
> > > > > > Server to Server communication is not supported in 3.5.6
> version
> > > > as
> > > > > per
> > > > > > below JIRA issue?
> > > > > >
> > > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2639
> > > > > >
> > > > > > Thanks,
> > > > > > ---------------------
> > > > > > Kuldeep Singh Budania
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <
> > > > > kuldeep.singh08@gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > >> Thanks for the reply.
> > > > > >>
> > > > > >> Now my ZKCli cmd is working fine as we use some our
> customized
> > > > > >> authentication and we resolve the issue.
> > > > > >>
> > > > > >> Now I am going to implement Server to Server communication.
> > > > > >>
> > > > > >> Thanks,
> > > > > >> ---------------------
> > > > > >> Kuldeep Singh Budania
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
> > > > > >> szalay.beko.mate@gmail.com> wrote:
> > > > > >>
> > > > > >>> I think SSL is working for you already... If you managed to
> > > start
> > > > > the
> > > > > >>> zkCli.sh and be able to connect to ZooKeeper on the secure
> port
> > > > > and issue
> > > > > >>> any kind of command (like: " ls / "), then the wire
> encryption
> > > is
> > > > > working
> > > > > >>> and your server/client communication is secured by
> ZooKeeper.
> > > > > >>>
> > > > > >>> Why you want to run the following command?
> > > > > >>> addauth ztpasswd zooadmin:<password>
> > > > > >>>
> > > > > >>> Do you also want to configure a superDigest user in
> ZooKeeper?
> > > > > Please
> > > > > >>> note
> > > > > >>> that this command is independent from SSL. If you need to
> > > create
> > > > a
> > > > > >>> username-password pair for digest authentication then
> please
> > > use
> > > > > the
> > > > > >>> command in the following way:
> > > > > >>> addauth digest zooadmin:yourSuperSecretPassword
> > > > > >>>
> > > > > >>> Kind regards,
> > > > > >>> Mate
> > > > > >>>
> > > > > >>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <
> > > > > kuldeep.singh08@gmail.com>
> > > > > >>> wrote:
> > > > > >>>
> > > > > >>> > 1. sh zkCli.sh --config /etc/zookeeper -server
> localhost:2281
> > > > > >>> >
> > > > > >>> > 2. addauth ztpasswd zooadmin:<password>
> > > > > >>> >
> > > > > >>> >
> > > > > >>> > Thanks,
> > > > > >>> > ---------------------
> > > > > >>> > Kuldeep Singh Budania
> > > > > >>> >
> > > > > >>> >
> > > > > >>> >
> > > > > >>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
> > > > > >>> kuldeep.singh08@gmail.com>
> > > > > >>> > wrote:
> > > > > >>> >
> > > > > >>> > > Hi Team,
> > > > > >>> > >
> > > > > >>> > > Any update on this?
> > > > > >>> > >
> > > > > >>> > > Thanks,
> > > > > >>> > > ---------------------
> > > > > >>> > > Kuldeep Singh Budania
> > > > > >>> > >
> > > > > >>> > >
> > > > > >>> > >
> > > > > >>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
> > > > > >>> kuldeep.singh08@gmail.com>
> > > > > >>> > > wrote:
> > > > > >>> > >
> > > > > >>> > >> Sorry this is my bad, there were server setting like
> below
> > > > > >>> > >>
> > > > > >>> > >> export SERVER_JVMFLAGS="
> > > > > >>> > >>
> > > > > >>> > >>
> > > > > >>> > >>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > > > >>> > >>
> > > > > >>> > >>
> > > > > >>>
> > > > >
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > > > > >>> > >>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > > > >>> > >>
> > > > > >>> > >>
> > > > > >>> > >>
> > > > > >>> > >> export CLIENT_JVMFLAGS="
> > > > > >>> > >>
> > > > > >>> > >>
> > > > > >>>
> > > > >
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > > > >>> > >> -Dzookeeper.client.secure=true
> > > > > >>> > >>
> > > > > >>>
> > > > >
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > > > > >>> > >>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > > > >>> > >>
> > > > > >>> > >> I want to have SSL between client to server
> communication
> > > > > >>> > >>
> > > > > >>> > >> I am already following the same link which you have
> shared
> > > > > with me
> > > > > >>> but
> > > > > >>> > >> that is not working.
> > > > > >>> > >>
> > > > > >>> > >> Zoo.cfg
> > > > > >>> > >>
> > > > > >>> > >> secureClientPort=2281
> > > > > >>> > >> initLimit=10
> > > > > >>> > >> syncLimit=5
> > > > > >>> > >> dataDir=/var/lib/zookeeper/data
> > > > > >>> > >> tickTime=2000
> > > > > >>> > >> autopurge.snapRetainCount=3
> > > > > >>> > >> autopurge.purgeInterval=1
> > > > > >>> > >> admin.enableServer=false
> > > > > >>> > >> standaloneEnabled=false
> > > > > >>> > >> jute.maxbuffer=2147483648
> > > > > >>> > >>
> > > > >
> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > > > >>> > >> server.1=host1_priv:10288:10388
> > > > > >>> > >> server.2=host2_priv:10288:10388
> > > > > >>> > >> server.3=host3_priv:10288:10388
> > > > > >>> > >>
> > > > > >>> > >>
> > > > > >>> > >> command to connect using zkcli
> > > > > >>> > >>
> > > > > >>> > >> 1. zkcli zoo.cfg localhost:2281
> > > > > >>> > >> 2. addauth ztpasswd usernaem:password
> > > > > >>> > >>
> > > > > >>> > >> after second step we are getting below error
> > > > > >>> > >>
> > > > > >>> > >> WatchedEvent state:AuthFailed type:None path:null
> > > > > >>> > >>
> > > > > >>> > >>
> > > > > >>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > > > > >>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> > > > > authentication
> > > > > >>> > provider
> > > > > >>> > >> for scheme: ztpasswd has x509 ip digest*
> > > > > >>> > >>
> > > > > >>> > >> Thanks,
> > > > > >>> > >> ---------------------
> > > > > >>> > >> Kuldeep Singh Budania
> > > > > >>> > >>
> > > > > >>> > >>
> > > > > >>> > >>
> > > > > >>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
> > > > > >>> > >> szalay.beko.mate@gmail.com> wrote:
> > > > > >>> > >>
> > > > > >>> > >>> > No authentication provider for scheme: ztpasswd
> has
> > > x509
> > > > > ip
> > > > > >>> digest*
> > > > > >>> > >>>
> > > > > >>> > >>> This suggest you have some configuration error...
> Where
> > > did
> > > > > you
> > > > > >>> use the
> > > > > >>> > >>> "ztpasswd" string in your configs / commands?
> > > > > >>> > >>>
> > > > > >>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
> > > > > >>> > >>> szalay.beko.mate@gmail.com>
> > > > > >>> > >>> wrote:
> > > > > >>> > >>>
> > > > > >>> > >>> > > My ZK server is up and running in secure mode
> > > > > >>> > >>> >
> > > > > >>> > >>> > What is your goal? You want to setup client-server
> SSL
> > > > > >>> connection?
> > > > > >>> > >>> >
> > > > > >>> > >>> > see:
> > > > > >>> > >>> >
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
> > > > > >>> > >>> >
> > > > > >>> > >>> > (or you want to have both SSL and SASL enabled?)
> > > > > >>> > >>> >
> > > > > >>> > >>> > Anyway, please remove the following line from the
> > > > > >>> SERVER_JVMFLAGS:
> > > > > >>> > >>> >
> > > > > >>> >
> > > > >
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > > > >>> > >>> > This is a configuration that makes sense only for
> the
> > > > > ZooKeeper
> > > > > >>> > client,
> > > > > >>> > >>> > not for the server. For the server, use the
> following:
> > > > > >>> > >>> >
> > > > > >>> > >>> >
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > > > >>> > >>> >
> > > > > >>> > >>> > If it doesn't solve the issue, then can you please
> send
> > > > > your
> > > > > >>> zoo.cfg
> > > > > >>> > >>> file?
> > > > > >>> > >>> > Also can you please send the zkCli command you
> execute?
> > > > > (you
> > > > > >>> need to
> > > > > >>> > >>> > connect to the secure ZooKeeper port, unless
> > > > > portUnification is
> > > > > >>> > >>> enabled)
> > > > > >>> > >>> >
> > > > > >>> > >>> > Kind regards,
> > > > > >>> > >>> > Mate
> > > > > >>> > >>> >
> > > > > >>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> > > > > >>> > >>> > wrote:
> > > > > >>> > >>> >
> > > > > >>> > >>> >> Hi,
> > > > > >>> > >>> >>
> > > > > >>> > >>> >> we have done below changes in java.env file
> > > > > >>> > >>> >>
> > > > > >>> > >>> >> export SERVER_JVMFLAGS="
> > > > > >>> > >>> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>>
> > > > >
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > > > >>> > >>> >>
> > > > > >>> >
> > > > >
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > > > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > > > >>> > >>> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>> >> export CLIENT_JVMFLAGS="
> > > > > >>> > >>> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>>
> > > > >
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > > > >>> > >>> >> -Dzookeeper.client.secure=true
> > > > > >>> > >>> >>
> > > > > >>> >
> > > > >
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > > > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > > > >>> > >>> >>
> > > > > >>> > >>> >> I have started the ZK server and it is up without
> any
> > > > > issue.
> > > > > >>> > >>> >>
> > > > > >>> > >>> >> But now when I login to ZkCli then it gives the
> below
> > > > > error.
> > > > > >>> > >>> >>
> > > > > >>> > >>> >> WatchedEvent state:AuthFailed type:None path:null
> > > > > >>> > >>> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > > > > >>> > >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> > > > > >>> authentication
> > > > > >>> > >>> provider
> > > > > >>> > >>> >> for scheme: ztpasswd has x509 ip digest*
> > > > > >>> > >>> >>
> > > > > >>> > >>> >> Please help me on this issue
> > > > > >>> > >>> >>
> > > > > >>> > >>> >> Thanks,
> > > > > >>> > >>> >> ---------------------
> > > > > >>> > >>> >> Kuldeep Singh Budania
> > > > > >>> > >>> >> Software Architect
> > > > > >>> > >>> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
> > > > > >>> > >>> kuldeep.singh08@gmail.com>
> > > > > >>> > >>> >> wrote:
> > > > > >>> > >>> >>
> > > > > >>> > >>> >> > Hi,
> > > > > >>> > >>> >> >
> > > > > >>> > >>> >> > My ZK server is up and running in secure mode,
> But
> > > > > When I am
> > > > > >>> > >>> trying to
> > > > > >>> > >>> >> > connect to the ZK server using ZKCli, it gives
> the
> > > > below
> > > > > >>> error.
> > > > > >>> > >>> >> >
> > > > > >>> > >>> >> > WatchedEvent state:AuthFailed type:None
> path:null
> > > > > >>> > >>> >> >
> > > > > >>> > >>> >> >
> > > > > >>> > >>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 -
> WARN
> > > > > >>> > >>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] -
> No
> > > > > >>> authentication
> > > > > >>> > >>> >> provider
> > > > > >>> > >>> >> > for scheme: ztpasswd has x509 ip digest*
> > > > > >>> > >>> >> >
> > > > > >>> > >>> >> > Can someone please help me on this issue. we are
> > > using
> > > > > the
> > > > > >>> 3.5.6
> > > > > >>> > >>> >> version.
> > > > > >>> > >>> >> >
> > > > > >>> > >>> >> > I appreciate if I will get a response as soon as
> > > > > possible, as
> > > > > >>> I am
> > > > > >>> > >>> stuck
> > > > > >>> > >>> >> > at this point.
> > > > > >>> > >>> >> >
> > > > > >>> > >>> >> > Thanks,
> > > > > >>> > >>> >> > ---------------------
> > > > > >>> > >>> >> > Kuldeep Singh Budania
> > > > > >>> > >>> >> > Software Architect
> > > > > >>> > >>> >> >
> > > > > >>> > >>> >> >
> > > > > >>> > >>> >> >
> > > > > >>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico
> Olivelli -
> > > > > Diennea
> > > > > >>> > >>> >> > <en...@diennea.com.invalid> wrote:
> > > > > >>> > >>> >> >
> > > > > >>> > >>> >> >> I mean in zoo.cfg
> > > > > >>> > >>> >> >> Not as a system property
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> Enrico
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli -
> > > > Diennea" <
> > > > > >>> > >>> >> >> enrico.olivelli@diennea.com.INVALID> ha
> scritto:
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> Hi
> > > > > >>> > >>> >> >> You have to enable Netty on the server side
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> Something like:
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> >
> > > > >
> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> Hope that helps
> > > > > >>> > >>> >> >> Enrico
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
> > > > > >>> > >>> >> kuldeep.singh08@gmail.com>
> > > > > >>> > >>> >> >> ha scritto:
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> Hi,
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> I got below error while setting SSL
> > > > properties
> > > > > in
> > > > > >>> > zkEnv.sh
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> ==========================================================================================
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
> > > > > >>> > [main:QuorumPeerConfig@133]
> > > > > >>> > >>> -
> > > > > >>> > >>> >> >> Reading
> > > > > >>> > >>> >> >> configuration from:
> /etc/zookeeper/zoo.cfg
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> > > > > >>> > [main:QuorumPeerConfig@385]
> > > > > >>> > >>> -
> > > > > >>> > >>> >> >> clientPortAddress is
> 0.0.0.0/0.0.0.0:10181
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> > > > > >>> > [main:QuorumPeerConfig@399]
> > > > > >>> > >>> -
> > > > > >>> > >>> >> >> secureClientPortAddress is
> > > > > 0.0.0.0/0.0.0.0:2281
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,878 - INFO
> > > > > [main:X509Util@79] -
> > > > > >>> > >>> Setting
> > > > > >>> > >>> >> -D
> > > > > >>> > >>> >> >>
> > > > > jdk.tls.rejectClientInitiatedRenegotiation=true to
> > > > > >>> > disable
> > > > > >>> > >>> >> >> client-initiated
> > > > > >>> > >>> >> >> TLS renegotiation
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> > > > > >>> > >>> [main:DatadirCleanupManager@78]
> > > > > >>> > >>> >> -
> > > > > >>> > >>> >> >> autopurge.snapRetainCount set to 3
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> > > > > >>> > >>> [main:DatadirCleanupManager@79]
> > > > > >>> > >>> >> -
> > > > > >>> > >>> >> >> autopurge.purgeInterval set to 1
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,898 - INFO [
> > > > > >>> > >>> >> >>
> > > PurgeTask:DatadirCleanupManager$PurgeTask@138
> > > > ]
> > > > > -
> > > > > >>> Purge
> > > > > >>> > >>> task
> > > > > >>> > >>> >> >> started.
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,899 - INFO
> > > > > [main:ManagedUtil@46]
> > > > > >>> -
> > > > > >>> > >>> Log4j
> > > > > >>> > >>> >> >> found with
> > > > > >>> > >>> >> >> jmx enabled.
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
> > > > > >>> > >>> [PurgeTask:FileTxnSnapLog@103]
> > > > > >>> > >>> >> -
> > > > > >>> > >>> >> >> zookeeper.snapshot.trust.empty : false
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,910 - INFO [
> > > > > >>> > >>> >> >>
> > > PurgeTask:DatadirCleanupManager$PurgeTask@144
> > > > ]
> > > > > -
> > > > > >>> Purge
> > > > > >>> > >>> task
> > > > > >>> > >>> >> >> completed.
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
> > > > > >>> [main:QuorumPeerMain@141
> > > > > >>> > ]
> > > > > >>> > >>> -
> > > > > >>> > >>> >> >> Starting quorum
> > > > > >>> > >>> >> >> peer
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
> > > > > >>> > [main:ServerCnxnFactory@135]
> > > > > >>> > >>> -
> > > > > >>> > >>> >> >> Using
> > > > > >>> > >>> >> >>
> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > > > > >>> > server
> > > > > >>> > >>> >> >> connection
> > > > > >>> > >>> >> >> factory
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
> > > > > >>> > >>> [main:NIOServerCnxnFactory@673]
> > > > > >>> > >>> >> -
> > > > > >>> > >>> >> >> Configuring NIO connection handler
> with 10s
> > > > > >>> sessionless
> > > > > >>> > >>> >> >> connection timeout,
> > > > > >>> > >>> >> >> 2 selector thread(s), 16 worker
> threads,
> > > and
> > > > > 64 kB
> > > > > >>> direct
> > > > > >>> > >>> >> buffers.
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
> > > > > >>> > >>> [main:NIOServerCnxnFactory@686
> > > > > >>> > >>> >> ]
> > > > > >>> > >>> >> >> - binding
> > > > > >>> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
> > > > > >>> > [main:ServerCnxnFactory@135]
> > > > > >>> > >>> -
> > > > > >>> > >>> >> >> Using
> > > > > >>> > >>> >> >>
> > > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > > > > >>> > server
> > > > > >>> > >>> >> >> connection
> > > > > >>> > >>> >> >> factory
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
> > > > > >>> [main:QuorumPeerMain@101
> > > > > >>> > ]
> > > > > >>> > >>> -
> > > > > >>> > >>> >> >> Unexpected
> > > > > >>> > >>> >> >> exception, exiting abnormally
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> java.lang.UnsupportedOperationException:
> > > SSL
> > > > > isn't
> > > > > >>> > >>> supported in
> > > > > >>> > >>> >> >> NIOServerCnxn
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> at
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> at
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> at
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> at
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> I have set the following properties in
> > > > > >>> SERVER_JVMFLAGS in
> > > > > >>> > >>> >> >> zkEnv.sh file :
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> > > > > >>> > >>> >> >>
> > > > > -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> > > > > >>> > >>> >> >>
> > > > > -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> Thanks,
> > > > > >>> > >>> >> >> ---------------------
> > > > > >>> > >>> >> >> Kuldeep Singh Budania
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan
> > > > > Zimmerman <
> > > > > >>> > >>> >> >> jordan@jordanzimmerman.com>
> > > > > >>> > >>> >> >> wrote:
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> > It's the same as the normal ZooKeeper
> > > > client:
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > > > > >>> > >>> >> >> > <
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > > > > >>> > >>> >> >> > >
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >> > -Jordan
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >> > > On Jun 22, 2020, at 5:50 AM,
> kuldeep
> > > > singh
> > > > > <
> > > > > >>> > >>> >> >> kuldeep.singh08@gmail.com>
> > > > > >>> > >>> >> >> > wrote:
> > > > > >>> > >>> >> >> > >
> > > > > >>> > >>> >> >> > > Hi Team,
> > > > > >>> > >>> >> >> > > How we will do secure communication
> > > > > between the
> > > > > >>> > Curator
> > > > > >>> > >>> >> >> framework and
> > > > > >>> > >>> >> >> > > zookeeper 3.5.6 ?
> > > > > >>> > >>> >> >> > > I didn't get any solution right
> now.
> > > > > >>> > >>> >> >> > > I appreciate it if someone could
> help
> > > me
> > > > > with the
> > > > > >>> > same.
> > > > > >>> > >>> >> >> > >
> > > > > >>> > >>> >> >> > > Thanks,
> > > > > >>> > >>> >> >> > > ---------------------
> > > > > >>> > >>> >> >> > > Kuldeep Singh Budania
> > > > > >>> > >>> >> >> > > Software Architect
> > > > > >>> > >>> >> >> > >
> > > > > >>> > >>> >> >> > >
> > > > > >>> > >>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM
> > > > > Szalay-Bekő Máté
> > > > > >>> <
> > > > > >>> > >>> >> >> > szalay.beko.mate@gmail.com>
> > > > > >>> > >>> >> >> > > wrote:
> > > > > >>> > >>> >> >> > >
> > > > > >>> > >>> >> >> > >> Hello Kuldeep,
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> > >> did you download the source from
> the
> > > > > ZooKeeper
> > > > > >>> > >>> webpage, or
> > > > > >>> > >>> >> >> checked out
> > > > > >>> > >>> >> >> > from
> > > > > >>> > >>> >> >> > >> git?
> > > > > >>> > >>> >> >> > >> Anyway, the following commands
> should
> > > > > work:
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> > >> wget
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> > > > > >>> > >>> >> >> > >> tar xzvf
> > > ./apache-zookeeper-3.5.7.tar.gz
> > > > > >>> > >>> >> >> > >> cd apache-zookeeper-3.5.7
> > > > > >>> > >>> >> >> > >> mvn clean install -DskipTests
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> > >> I tested it with OpenJDK 8u424 and
> > > maven
> > > > > 3.6.0.
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> > >> Kind regards,
> > > > > >>> > >>> >> >> > >> Mate
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM
> > > kuldeep
> > > > > singh <
> > > > > >>> > >>> >> >> > kuldeep.singh08@gmail.com>
> > > > > >>> > >>> >> >> > >> wrote:
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> > >>> Hi All,
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>> I have download the zookeeper
> source
> > > > > code and
> > > > > >>> run
> > > > > >>> > >>> the mvn
> > > > > >>> > >>> >> >> command for
> > > > > >>> > >>> >> >> > >>> packaging but get problem on
> > > > > "zookeeper-server"
> > > > > >>> > >>> >> directory.
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>> *command :- mvn clean package*
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>> [ERROR] Failed to execute goal
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >>
> > > > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > > > > >>> > >>> >> >> > >>> (default-compile) on project
> > > zookeeper:
> > > > > Fatal
> > > > > >>> error
> > > > > >>> > >>> >> >> compiling:
> > > > > >>> > >>> >> >> > >>> java.lang.NullPointerException ->
> > > [Help
> > > > > 1]
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>>
> org.apache.maven.lifecycle.LifecycleExecutionException:
> > > > > >>> > >>> >> >> Failed to
> > > > > >>> > >>> >> >> > execute
> > > > > >>> > >>> >> >> > >>> goal
> > > > > >>> > >>> >> >>
> > > > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > > > > >>> > >>> >> >> > >>> (default-compile) on project
> > > zookeeper:
> > > > > Fatal
> > > > > >>> error
> > > > > >>> > >>> >> >> compiling
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >>
> > > > > org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >>
> > > > > org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >>
> > > > > org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >>
> > > > org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >>
> > > org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >>
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > > > > Method)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> java.lang.reflect.Method.invoke(Method.java:498)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > >
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> > > > > >>> > >>> >> >> > >>> Caused by:
> > > > > >>> > >>> >> org.apache.maven.plugin.MojoExecutionException:
> > > > > >>> > >>> >> >> Fatal error
> > > > > >>> > >>> >> >> > >>> compiling
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> > > > > >>> > >>> >> >> > >>> ... 19 more
> > > > > >>> > >>> >> >> > >>> Caused by:
> > > > > >>> > >>> >> org.codehaus.plexus.compiler.CompilerException:
> > > > > >>> > >>> >> >> > >>> java.lang.NullPointerException
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> > > > > >>> > >>> >> >> > >>> ... 22 more
> > > > > >>> > >>> >> >> > >>> Caused by:
> > > java.lang.RuntimeException:
> > > > > >>> > >>> >> >> java.lang.NullPointerException
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >>
> > > com.sun.tools.javac.main.Main.compile(Main.java:559)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>>
> > > > > >>>
> > > > >
> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> >
> > > > > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> > > > > >>> > >>> >> >> > >>> ... 24 more
> > > > > >>> > >>> >> >> > >>> Caused by:
> > > > java.lang.NullPointerException
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >>
> > > com.sun.tools.doclint.Checker.scan(Checker.java:144)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >>
> > > > > com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>>
> > > > > >>>
> > > > >
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>>
> > > > > >>>
> > > > >
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> >
> > > > > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>>
> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> >
> > > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> >
> > > > > com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> >
> > > > > com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>>
> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> >
> > > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> >
> > > > > com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > >
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > >
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>>
> > > > > >>>
> > > > >
> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>>
> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> >
> > > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >>
> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> >
> > > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >>
> > > > > >>>
> > > com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>>
> > > > > >>>
> > > > >
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>>
> > > > > >>>
> > > > >
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> >
> > > > > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>>
> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >>
> > > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> >
> > > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > >
> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>>
> > > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >>
> > > > > com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>>
> > > > > >>>
> > > > >
> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>>
> > > > > >>>
> > > > >
> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>>
> > > > > >>>
> > > > >
> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> > > > > >>> > >>> >> >> > >>> at
> > > > > >>> > >>> >> >>
> > > com.sun.tools.javac.main.Main.compile(Main.java:523)
> > > > > >>> > >>> >> >> > >>> ... 27 more
> > > > > >>> > >>> >> >> > >>> [ERROR]
> > > > > >>> > >>> >> >> > >>> [ERROR] Re-run Maven using the -X
> > > > switch
> > > > > to
> > > > > >>> enable
> > > > > >>> > >>> full
> > > > > >>> > >>> >> >> debug logging.
> > > > > >>> > >>> >> >> > >>> [ERROR]
> > > > > >>> > >>> >> >> > >>> [ERROR] For more information
> about
> > > the
> > > > > errors
> > > > > >>> and
> > > > > >>> > >>> >> possible
> > > > > >>> > >>> >> >> solutions,
> > > > > >>> > >>> >> >> > >>> please read the following
> articles:
> > > > > >>> > >>> >> >> > >>> [ERROR] [Help 1]
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > >
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>> Can someone help me on this
> issue?
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>> Thanks,
> > > > > >>> > >>> >> >> > >>> ---------------------
> > > > > >>> > >>> >> >> > >>> Kuldeep Singh Budania
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM
> > > > > Szalay-Bekő
> > > > > >>> Máté <
> > > > > >>> > >>> >> >> > >>> szalay.beko.mate@gmail.com>
> > > > > >>> > >>> >> >> > >>> wrote:
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>>> these exceptions can mean many
> > > > > things... I
> > > > > >>> think
> > > > > >>> > >>> this
> > > > > >>> > >>> >> can
> > > > > >>> > >>> >> >> be even
> > > > > >>> > >>> >> >> > >> normal
> > > > > >>> > >>> >> >> > >>>> duding rolling restart (as some
> > > > > connections
> > > > > >>> get
> > > > > >>> > >>> broken
> > > > > >>> > >>> >> in
> > > > > >>> > >>> >> >> this case)
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>> However, I saw cases already
> when
> > > > > exceptions
> > > > > >>> like
> > > > > >>> > >>> these
> > > > > >>> > >>> >> >> killed
> > > > > >>> > >>> >> >> > receiver
> > > > > >>> > >>> >> >> > >>> or
> > > > > >>> > >>> >> >> > >>>> sender threads in
> QuorumCnxManager /
> > > > > Leader
> > > > > >>> > >>> Election in
> > > > > >>> > >>> >> >> such a way
> > > > > >>> > >>> >> >> > that
> > > > > >>> > >>> >> >> > >>>> they were not able to recover,
> so
> > > the
> > > > > node was
> > > > > >>> > >>> unable to
> > > > > >>> > >>> >> >> connect to
> > > > > >>> > >>> >> >> > any
> > > > > >>> > >>> >> >> > >>>> quorum until restart. I remember
> > > > seeing
> > > > > this
> > > > > >>> in
> > > > > >>> > 3.4
> > > > > >>> > >>> too.
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>> Do you see these exceptions in
> the
> > > > > second
> > > > > >>> server
> > > > > >>> > >>> (the
> > > > > >>> > >>> >> one
> > > > > >>> > >>> >> >> which you
> > > > > >>> > >>> >> >> > >> just
> > > > > >>> > >>> >> >> > >>>> upgraded in step 3)?
> > > > > >>> > >>> >> >> > >>>> Is this issue reproducible?
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>> What is the tickTime and
> initLimit
> > > you
> > > > > use?
> > > > > >>> Maybe
> > > > > >>> > >>> the
> > > > > >>> > >>> >> >> server just
> > > > > >>> > >>> >> >> > >> require
> > > > > >>> > >>> >> >> > >>>> more time to sync?
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>> I would need more logs to
> really see
> > > > > what
> > > > > >>> > happened.
> > > > > >>> > >>> Can
> > > > > >>> > >>> >> >> you create a
> > > > > >>> > >>> >> >> > >> Jira
> > > > > >>> > >>> >> >> > >>>> issue and upload the logs and
> also
> > > the
> > > > > >>> ZooKeeper
> > > > > >>> > >>> >> configs?
> > > > > >>> > >>> >> >> I am happy
> > > > > >>> > >>> >> >> > to
> > > > > >>> > >>> >> >> > >>>> take a closer look.
> > > > > >>> > >>> >> >> > >>>> (if you need to re-run the test
> to
> > > > > collect the
> > > > > >>> > logs,
> > > > > >>> > >>> >> then
> > > > > >>> > >>> >> >> enabling
> > > > > >>> > >>> >> >> > >> DEBUG
> > > > > >>> > >>> >> >> > >>>> logs would be great. The INFO
> level
> > > > > logs are
> > > > > >>> > usually
> > > > > >>> > >>> >> >> enough for these
> > > > > >>> > >>> >> >> > >>>> problems, but one can never
> know...)
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>> Kind regards,
> > > > > >>> > >>> >> >> > >>>> Mate
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM
> > > > kuldeep
> > > > > singh
> > > > > >>> <
> > > > > >>> > >>> >> >> > >> kuldeep.singh08@gmail.com
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>> wrote:
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>>> Hi Team,
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> I have done some POC on rolling
> > > > > upgrade and
> > > > > >>> found
> > > > > >>> > >>> below
> > > > > >>> > >>> >> >> result.
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> 1. On 1st node upgrade
> zookeeper
> > > .
> > > > > Traffic
> > > > > >>> was
> > > > > >>> > >>> >> running
> > > > > >>> > >>> >> >> fine
> > > > > >>> > >>> >> >> > >> because
> > > > > >>> > >>> >> >> > >>> 2
> > > > > >>> > >>> >> >> > >>>>> nodes are already on old
> > > zookeeper.
> > > > > >>> > >>> >> >> > >>>>> 2. On 1st node upgrade our
> > > > > application and
> > > > > >>> > didn’t
> > > > > >>> > >>> >> find
> > > > > >>> > >>> >> >> any issue
> > > > > >>> > >>> >> >> > >>>>> 3. On 2nd node upgrade
> zookeeper
> > > > but
> > > > > got
> > > > > >>> below
> > > > > >>> > >>> error
> > > > > >>> > >>> >> >> and zookeeper
> > > > > >>> > >>> >> >> > >>> is
> > > > > >>> > >>> >> >> > >>>>> not taking any requests
> > > > > >>> > >>> >> >> > >>>>> 4.
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> at
> > > > > >>> > >>> >> >>
> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> at
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
> > > > > >>> > >>> >> >> > >>>>>
> > > > > [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
> > > > > >>> -
> > > > > >>> > >>> >> >> Interrupting
> > > > > >>> > >>> >> >> > >>> SendWorker
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR
> > > > > >>> [LearnerHandler-/
> > > > > >>> > >>> >> >> 192.168.44.73:33754
> > > > > >>> > >>> >> >> > >>>>> :LearnerHandler@562] -
> Unexpected
> > > > > exception
> > > > > >>> > >>> causing
> > > > > >>> > >>> >> >> shutdown while
> > > > > >>> > >>> >> >> > >>> sock
> > > > > >>> > >>> >> >> > >>>>> still open
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> at
> > > > > >>> > >>> >> >>
> > > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> at
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>>
> > > > > >>>
> > > > >
> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> at
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> at
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> at
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >>
> > > > > >>> > >>>
> > > > > >>> >
> > > > > >>>
> > > > >
> > > >
> > >
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
> > > > > >>> > >>> >> >> > >>>>>
> > > > > [SendWorker:1:QuorumCnxManager$SendWorker@679]
> > > > > >>> -
> > > > > >>> > >>> >> >> Interrupted while
> > > > > >>> > >>> >> >> > >>>> waiting
> > > > > >>> > >>> >> >> > >>>>> for message on queue
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> Please let me know is this the
> > > known
> > > > > issue or
> > > > > >>> > this
> > > > > >>> > >>> is
> > > > > >>> > >>> >> >> different issue
> > > > > >>> > >>> >> >> > >>>> which
> > > > > >>> > >>> >> >> > >>>>> is mention in Apache zookeeper
> > > > > documentation
> > > > > >>> when
> > > > > >>> > >>> >> >> upgrading from
> > > > > >>> > >>> >> >> > >> 3.4.5
> > > > > >>> > >>> >> >> > >>> to
> > > > > >>> > >>> >> >> > >>>>> 3.5.6
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> Thanks,
> > > > > >>> > >>> >> >> > >>>>> ---------------------
> > > > > >>> > >>> >> >> > >>>>> Kuldeep Singh Budania
> > > > > >>> > >>> >> >> > >>>>> Software Architect
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM
> > > > > Alexander
> > > > > >>> Shraer
> > > > > >>> > <
> > > > > >>> > >>> >> >> shralex@gmail.com>
> > > > > >>> > >>> >> >> > >>>>> wrote:
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>>> +1 to what Mate said (I wrote
> the
> > > > > quoted
> > > > > >>> > >>> >> instructions).
> > > > > >>> > >>> >> >> > >>>>>>
> > > > > >>> > >>> >> >> > >>>>>>
> > > > > >>> > >>> >> >> > >>>>>>
> > > > > >>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03
> AM
> > > > > Szalay-Bekő
> > > > > >>> > Máté <
> > > > > >>> > >>> >> >> > >>>>>> szalay.beko.mate@gmail.com>
> > > > > >>> > >>> >> >> > >>>>>> wrote:
> > > > > >>> > >>> >> >> > >>>>>>
> > > > > >>> > >>> >> >> > >>>>>>> Hi Kuldeep,
> > > > > >>> > >>> >> >> > >>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>> I just want to provide you
> some
> > > > > background
> > > > > >>> info
> > > > > >>> > >>> about
> > > > > >>> > >>> >> >> our
> > > > > >>> > >>> >> >> > >>>>> documentation.
> > > > > >>> > >>> >> >> > >>>>>>> The reason to upgrade to
> 3.4.6
> > > > first
> > > > > is to
> > > > > >>> > avoid
> > > > > >>> > >>> the
> > > > > >>> > >>> >> >> following
> > > > > >>> > >>> >> >> > >>> error:
> > > > > >>> > >>> >> >> > >>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663
> > > [myid:2] -
> > > > > WARN
> > > > > >>> > >>> [localhost/
> > > > > >>> > >>> >> >> > >>> 127.0.0.1:2784
> > > > > >>> > >>> >> >> > >>>>>>> :QuorumCnxManager@349] -
> Invalid
> > > > > server
> > > > > >>> id:
> > > > > >>> > >>> -65536
> > > > > >>> > >>> >> >> > >>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>> This error comes because of
> the
> > > > > protocol
> > > > > >>> > changes
> > > > > >>> > >>> >> between
> > > > > >>> > >>> >> >> > >> ZooKeeper
> > > > > >>> > >>> >> >> > >>>>> server
> > > > > >>> > >>> >> >> > >>>>>>> nodes during connection
> > > initiation
> > > > > for
> > > > > >>> leader
> > > > > >>> > >>> >> election.
> > > > > >>> > >>> >> >> In
> > > > > >>> > >>> >> >> > >>> ZooKeeper
> > > > > >>> > >>> >> >> > >>>>> 3.5
> > > > > >>> > >>> >> >> > >>>>>> a
> > > > > >>> > >>> >> >> > >>>>>>> protocol version was
> introduced
> > > > (see
> > > > > >>> > >>> ZOOKEEPER-107)
> > > > > >>> > >>> >> and
> > > > > >>> > >>> >> >> since
> > > > > >>> > >>> >> >> > >> that
> > > > > >>> > >>> >> >> > >>>> time
> > > > > >>> > >>> >> >> > >>>>>> the
> > > > > >>> > >>> >> >> > >>>>>>> fist long value sent in the
> > > initial
> > > > > >>> message is
> > > > > >>> > >>> not
> > > > > >>> > >>> >> the
> > > > > >>> > >>> >> >> server ID
> > > > > >>> > >>> >> >> > >>> but
> > > > > >>> > >>> >> >> > >>>>> the
> > > > > >>> > >>> >> >> > >>>>>>> protocol version (-65536). In
> > > > > ZooKeeper
> > > > > >>> 3.4.6
> > > > > >>> > we
> > > > > >>> > >>> made
> > > > > >>> > >>> >> >> the old 3.4
> > > > > >>> > >>> >> >> > >>>>>>> ZooKeepers backward
> compatible,
> > > so
> > > > > they are
> > > > > >>> > able
> > > > > >>> > >>> to
> > > > > >>> > >>> >> >> parse both
> > > > > >>> > >>> >> >> > >> the
> > > > > >>> > >>> >> >> > >>>> old
> > > > > >>> > >>> >> >> > >>>>>> and
> > > > > >>> > >>> >> >> > >>>>>>> the new protocol format (see
> > > > > >>> ZOOKEEPER-1633).
> > > > > >>> > >>> This
> > > > > >>> > >>> >> >> issue happens
> > > > > >>> > >>> >> >> > >>> only
> > > > > >>> > >>> >> >> > >>>>>> when
> > > > > >>> > >>> >> >> > >>>>>>> you need to use old (3.4.0 -
> > > 3.4.5)
> > > > > and new
> > > > > >>> > >>> (3.5.0+)
> > > > > >>> > >>> >> >> ZooKeeper
> > > > > >>> > >>> >> >> > >>>> servers
> > > > > >>> > >>> >> >> > >>>>>>> together in the same cluster.
> > > > During
> > > > > a
> > > > > >>> rolling
> > > > > >>> > >>> >> upgrade,
> > > > > >>> > >>> >> >> this is
> > > > > >>> > >>> >> >> > >>>> usually
> > > > > >>> > >>> >> >> > >>>>>> the
> > > > > >>> > >>> >> >> > >>>>>>> case to have old and new
> > > ZooKeepers
> > > > > present
> > > > > >>> > >>> together.
> > > > > >>> > >>> >> >> > >>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>> The fact that you haven't
> seen
> > > any
> > > > > issues
> > > > > >>> might
> > > > > >>> > >>> be
> > > > > >>> > >>> >> >> caused by the
> > > > > >>> > >>> >> >> > >>>> order
> > > > > >>> > >>> >> >> > >>>>> of
> > > > > >>> > >>> >> >> > >>>>>>> the servers. In ZooKeeper the
> > > > > connection
> > > > > >>> > >>> initiation
> > > > > >>> > >>> >> >> between the
> > > > > >>> > >>> >> >> > >>>> servers
> > > > > >>> > >>> >> >> > >>>>>>> during the leader election
> > > follows
> > > > a
> > > > > >>> specific
> > > > > >>> > >>> rule.
> > > > > >>> > >>> >> As
> > > > > >>> > >>> >> >> far as I
> > > > > >>> > >>> >> >> > >>>>> remember
> > > > > >>> > >>> >> >> > >>>>>>> always the server with the
> larger
> > > > ID
> > > > > 'wins
> > > > > >>> the
> > > > > >>> > >>> >> >> challenge', so it
> > > > > >>> > >>> >> >> > >> is
> > > > > >>> > >>> >> >> > >>>>>>> possible, that the old server
> > > > didn't
> > > > > need
> > > > > >>> to
> > > > > >>> > >>> parse
> > > > > >>> > >>> >> any
> > > > > >>> > >>> >> >> initial
> > > > > >>> > >>> >> >> > >>>> message
> > > > > >>> > >>> >> >> > >>>>>> (if
> > > > > >>> > >>> >> >> > >>>>>>> it had the largest ID) and
> this
> > > is
> > > > > why you
> > > > > >>> > >>> haven't
> > > > > >>> > >>> >> seen
> > > > > >>> > >>> >> >> the
> > > > > >>> > >>> >> >> > >> issue.
> > > > > >>> > >>> >> >> > >>>> Also
> > > > > >>> > >>> >> >> > >>>>>>> having 2 nodes up from the 3
> > > nodes
> > > > > cluster
> > > > > >>> > still
> > > > > >>> > >>> >> makes
> > > > > >>> > >>> >> >> the
> > > > > >>> > >>> >> >> > >> cluster
> > > > > >>> > >>> >> >> > >>>> work
> > > > > >>> > >>> >> >> > >>>>>> (so
> > > > > >>> > >>> >> >> > >>>>>>> you should also check if all
> the
> > > > > servers
> > > > > >>> are
> > > > > >>> > >>> part of
> > > > > >>> > >>> >> >> the quorum).
> > > > > >>> > >>> >> >> > >>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>> I agree with Enrico and
> Norbert,
> > > > the
> > > > > >>> safest and
> > > > > >>> > >>> most
> > > > > >>> > >>> >> >> stable way
> > > > > >>> > >>> >> >> > >> is
> > > > > >>> > >>> >> >> > >>>>>> upgrade
> > > > > >>> > >>> >> >> > >>>>>>> first to 3.4.latest, then go
> to
> > > > > 3.5.latest.
> > > > > >>> > >>> Still, if
> > > > > >>> > >>> >> >> you don't
> > > > > >>> > >>> >> >> > >> see
> > > > > >>> > >>> >> >> > >>>>> that
> > > > > >>> > >>> >> >> > >>>>>>> you would hit this specific
> issue
> > > > > (e.g. no
> > > > > >>> > >>> "Invalid
> > > > > >>> > >>> >> >> server id" in
> > > > > >>> > >>> >> >> > >>> the
> > > > > >>> > >>> >> >> > >>>>> log
> > > > > >>> > >>> >> >> > >>>>>>> files), and all the three
> servers
> > > > can
> > > > > >>> handle
> > > > > >>> > >>> traffic,
> > > > > >>> > >>> >> >> then maybe
> > > > > >>> > >>> >> >> > >>> you
> > > > > >>> > >>> >> >> > >>>>>> don't
> > > > > >>> > >>> >> >> > >>>>>>> need to upgrade first to
> > > > 3.4.latest,
> > > > > it is
> > > > > >>> your
> > > > > >>> > >>> >> >> decision.
> > > > > >>> > >>> >> >> > >>> Definitely
> > > > > >>> > >>> >> >> > >>>>> you
> > > > > >>> > >>> >> >> > >>>>>>> should test it first, as
> > > suggested
> > > > > by the
> > > > > >>> > others.
> > > > > >>> > >>> >> >> > >>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>> Kind regards,
> > > > > >>> > >>> >> >> > >>>>>>> Mate
> > > > > >>> > >>> >> >> > >>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at
> 12:29 PM
> > > > > Norbert
> > > > > >>> Kalmar
> > > > > >>> > >>> >> >> > >>>>>>> <nkalmar@cloudera.com.invalid
> >
> > > > > wrote:
> > > > > >>> > >>> >> >> > >>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>> Hi,
> > > > > >>> > >>> >> >> > >>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>> That guide is to upgrade to
> > > 3.5.0,
> > > > > which
> > > > > >>> was
> > > > > >>> > an
> > > > > >>> > >>> >> alpha
> > > > > >>> > >>> >> >> version.
> > > > > >>> > >>> >> >> > >> A
> > > > > >>> > >>> >> >> > >>>> lot
> > > > > >>> > >>> >> >> > >>>>>> has
> > > > > >>> > >>> >> >> > >>>>>>>> changed for the first stable
> > > > > release of
> > > > > >>> 3.5.5
> > > > > >>> > >>> and
> > > > > >>> > >>> >> then
> > > > > >>> > >>> >> >> a few
> > > > > >>> > >>> >> >> > >>> more,
> > > > > >>> > >>> >> >> > >>>>> even
> > > > > >>> > >>> >> >> > >>>>>>>> rolling upgrade issues have
> been
> > > > > fixed for
> > > > > >>> > >>> 3.5.6.
> > > > > >>> > >>> >> >> > >>>>>>>> This is a more up-to-date
> guide:
> > > > > >>> > >>> >> >> > >>>>>>>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >>
> > > > > >>> >
> > > > > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> > > > > >>> > >>> >> >> > >>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>> If you have done your
> testing
> > > > (with
> > > > > prod
> > > > > >>> > >>> snapshot!),
> > > > > >>> > >>> >> >> then you
> > > > > >>> > >>> >> >> > >> can
> > > > > >>> > >>> >> >> > >>>>> skip
> > > > > >>> > >>> >> >> > >>>>>>> 3.4
> > > > > >>> > >>> >> >> > >>>>>>>> latest upgrade, but keep in
> mind
> > > > we
> > > > > do our
> > > > > >>> > >>> >> >> recommendations for
> > > > > >>> > >>> >> >> > >> a
> > > > > >>> > >>> >> >> > >>>>>> reason.
> > > > > >>> > >>> >> >> > >>>>>>>> There were issues reported
> > > and/or
> > > > > found
> > > > > >>> during
> > > > > >>> > >>> >> >> testing. Some
> > > > > >>> > >>> >> >> > >> are
> > > > > >>> > >>> >> >> > >>>>> fixed
> > > > > >>> > >>> >> >> > >>>>>>> with
> > > > > >>> > >>> >> >> > >>>>>>>> 3.5.6, some only happens if
> > > > certain
> > > > > >>> conditions
> > > > > >>> > >>> stand
> > > > > >>> > >>> >> >> > >>> (IOException:
> > > > > >>> > >>> >> >> > >>>> No
> > > > > >>> > >>> >> >> > >>>>>>>> snapshot found - mentioned
> in
> > > the
> > > > > guide,
> > > > > >>> fixed
> > > > > >>> > >>> in
> > > > > >>> > >>> >> >> 3.5.6).
> > > > > >>> > >>> >> >> > >>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>> So it is up to you, I would
> > > still
> > > > > >>> recommend to
> > > > > >>> > >>> do an
> > > > > >>> > >>> >> >> 3.4
> > > > > >>> > >>> >> >> > >> upgrade
> > > > > >>> > >>> >> >> > >>>>> first,
> > > > > >>> > >>> >> >> > >>>>>>> if
> > > > > >>> > >>> >> >> > >>>>>>>> it's feasible.
> > > > > >>> > >>> >> >> > >>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>> Regards,
> > > > > >>> > >>> >> >> > >>>>>>>> Norbert
> > > > > >>> > >>> >> >> > >>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at
> 11:45 AM
> > > > > kuldeep
> > > > > >>> > singh <
> > > > > >>> > >>> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
> > > > > >>> > >>> >> >> > >>>>>>>> wrote:
> > > > > >>> > >>> >> >> > >>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>> Hi,
> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>> Current Zookeeper version
> :-
> > > > 3.4.5
> > > > > >>> > >>> >> >> > >>>>>>>>> Upgraded version
> > > > :-
> > > > > 3.5.6
> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>> We are not going with
> 3.5.7.
> > > Our
> > > > > final
> > > > > >>> > >>> decision is
> > > > > >>> > >>> >> >> zookeeper
> > > > > >>> > >>> >> >> > >>>>> version
> > > > > >>> > >>> >> >> > >>>>>> is
> > > > > >>> > >>> >> >> > >>>>>>>>> 3.5.6
> > > > > >>> > >>> >> >> > >>>>>>>>> as per your reply first we
> need
> > > > to
> > > > > move
> > > > > >>> > latest
> > > > > >>> > >>> >> >> version of
> > > > > >>> > >>> >> >> > >>> 3.4.x,
> > > > > >>> > >>> >> >> > >>>>> like
> > > > > >>> > >>> >> >> > >>>>>>>> below
> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6
> > > (Correct
> > > > > me if
> > > > > >>> I am
> > > > > >>> > >>> wrong
> > > > > >>> > >>> >> >> here)
> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>> But if We are not facing
> any
> > > > > problem
> > > > > >>> that i
> > > > > >>> > >>> have
> > > > > >>> > >>> >> >> shared you
> > > > > >>> > >>> >> >> > >>> that
> > > > > >>> > >>> >> >> > >>>> we
> > > > > >>> > >>> >> >> > >>>>>>> have
> > > > > >>> > >>> >> >> > >>>>>>>>> set up of 3 node cluster
> where
> > > 2
> > > > > node
> > > > > >>> are on
> > > > > >>> > >>> 3.5.6
> > > > > >>> > >>> >> >> version
> > > > > >>> > >>> >> >> > >> and
> > > > > >>> > >>> >> >> > >>> 1
> > > > > >>> > >>> >> >> > >>>>> node
> > > > > >>> > >>> >> >> > >>>>>>> on
> > > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything is
> running
> > > fine
> > > > > and
> > > > > >>> didn't
> > > > > >>> > >>> get
> > > > > >>> > >>> >> any
> > > > > >>> > >>> >> >> issue,
> > > > > >>> > >>> >> >> > >> So
> > > > > >>> > >>> >> >> > >>>> what
> > > > > >>> > >>> >> >> > >>>>>>> other
> > > > > >>> > >>> >> >> > >>>>>>>>> problem we can face if we
> > > > directly
> > > > > move
> > > > > >>> to
> > > > > >>> > >>> 3.5.6
> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>> Thanks,
> > > > > >>> > >>> >> >> > >>>>>>>>> ---------------------
> > > > > >>> > >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
> > > > > >>> > >>> >> >> > >>>>>>>>> Software Architect
> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at
> 3:58 PM
> > > > > Enrico
> > > > > >>> > >>> Olivelli <
> > > > > >>> > >>> >> >> > >>>>> eolivelli@gmail.com
> > > > > >>> > >>> >> >> > >>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>> wrote:
> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>> Hi
> > > > > >>> > >>> >> >> > >>>>>>>>>> You have to upgrade to
> latest
> > > > > 3.4.x
> > > > > >>> > Zookeeper
> > > > > >>> > >>> then
> > > > > >>> > >>> >> >> you will
> > > > > >>> > >>> >> >> > >>>>> upgrade
> > > > > >>> > >>> >> >> > >>>>>>> to
> > > > > >>> > >>> >> >> > >>>>>>>>>> 3.5.7.
> > > > > >>> > >>> >> >> > >>>>>>>>>> All should run well
> without
> > > > issues
> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>> Enrico
> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18
> > > > kuldeep
> > > > > singh
> > > > > >>> <
> > > > > >>> > >>> >> >> > >>>>> kuldeep.singh08@gmail.com
> > > > > >>> > >>> >> >> > >>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>> ha
> > > > > >>> > >>> >> >> > >>>>>>>>>> scritto:
> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>>> Hi Team,
> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>>> We are upgrading
> zookeeper
> > > from
> > > > > 3.4.5
> > > > > >>> to
> > > > > >>> > >>> 3.5.6. I
> > > > > >>> > >>> >> >> have
> > > > > >>> > >>> >> >> > >> set
> > > > > >>> > >>> >> >> > >>>> up 3
> > > > > >>> > >>> >> >> > >>>>>>> node
> > > > > >>> > >>> >> >> > >>>>>>>>>>> cluster where 2 node are
> on
> > > > 3.5.6
> > > > > >>> version
> > > > > >>> > >>> and 1
> > > > > >>> > >>> >> >> node on
> > > > > >>> > >>> >> >> > >>>> 3.4.5.
> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>>> Everything is running
> fine
> > > and
> > > > > didn't
> > > > > >>> get
> > > > > >>> > any
> > > > > >>> > >>> >> issue
> > > > > >>> > >>> >> >> on my
> > > > > >>> > >>> >> >> > >>>>> system.
> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>>> but I found something on
> > > apache
> > > > > site
> > > > > >>> that
> > > > > >>> > >>> first
> > > > > >>> > >>> >> we
> > > > > >>> > >>> >> >> need
> > > > > >>> > >>> >> >> > >> to
> > > > > >>> > >>> >> >> > >>>>>> upgrade
> > > > > >>> > >>> >> >> > >>>>>>>> on
> > > > > >>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can
> upgrade to
> > > > > 3.5.6. So
> > > > > >>> is
> > > > > >>> > it
> > > > > >>> > >>> >> >> mandatory
> > > > > >>> > >>> >> >> > >> to
> > > > > >>> > >>> >> >> > >>> go
> > > > > >>> > >>> >> >> > >>>>> on
> > > > > >>> > >>> >> >> > >>>>>>>> 3.4.6
> > > > > >>> > >>> >> >> > >>>>>>>>>>> first.
> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>>> Upgrading a running
> ZooKeeper
> > > > > ensemble
> > > > > >>> to
> > > > > >>> > >>> 3.5.0
> > > > > >>> > >>> >> >> should be
> > > > > >>> > >>> >> >> > >>>> done
> > > > > >>> > >>> >> >> > >>>>>> only
> > > > > >>> > >>> >> >> > >>>>>>>>> after
> > > > > >>> > >>> >> >> > >>>>>>>>>>> upgrading your ensemble
> to
> > > the
> > > > > 3.4.6
> > > > > >>> > release.
> > > > > >>> > >>> >> Note
> > > > > >>> > >>> >> >> that
> > > > > >>> > >>> >> >> > >>> this
> > > > > >>> > >>> >> >> > >>>> is
> > > > > >>> > >>> >> >> > >>>>>>> only
> > > > > >>> > >>> >> >> > >>>>>>>>>>> necessary for rolling
> > > upgrades
> > > > > (if
> > > > > >>> you're
> > > > > >>> > >>> fine
> > > > > >>> > >>> >> with
> > > > > >>> > >>> >> >> > >>> shutting
> > > > > >>> > >>> >> >> > >>>>> down
> > > > > >>> > >>> >> >> > >>>>>>> the
> > > > > >>> > >>> >> >> > >>>>>>>>>>> system completely, you
> don't
> > > > > have to go
> > > > > >>> > >>> through
> > > > > >>> > >>> >> >> 3.4.6).
> > > > > >>> > >>> >> >> > >> If
> > > > > >>> > >>> >> >> > >>>> you
> > > > > >>> > >>> >> >> > >>>>>>>> attempt
> > > > > >>> > >>> >> >> > >>>>>>>>> a
> > > > > >>> > >>> >> >> > >>>>>>>>>>> rolling upgrade without
> going
> > > > > through
> > > > > >>> 3.4.6
> > > > > >>> > >>> (for
> > > > > >>> > >>> >> >> example
> > > > > >>> > >>> >> >> > >>> from
> > > > > >>> > >>> >> >> > >>>>>>> 3.4.5),
> > > > > >>> > >>> >> >> > >>>>>>>>> you
> > > > > >>> > >>> >> >> > >>>>>>>>>>> may get the following
> error:
> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663
> > > > [myid:2]
> > > > > - INFO
> > > > > >>> > >>> >> [localhost/
> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > :QuorumCnxManager$Listener@498
> > > > ]
> > > > > -
> > > > > >>> Received
> > > > > >>> > >>> >> >> connection
> > > > > >>> > >>> >> >> > >>>> request
> > > > > >>> > >>> >> >> > >>>>> /
> > > > > >>> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663
> > > > [myid:2]
> > > > > - WARN
> > > > > >>> > >>> >> [localhost/
> > > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > > > > >>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349] -
> > > > Invalid
> > > > > >>> server
> > > > > >>> > id:
> > > > > >>> > >>> >> -65536
> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>>> During a rolling upgrade,
> > > each
> > > > > server
> > > > > >>> is
> > > > > >>> > >>> taken
> > > > > >>> > >>> >> down
> > > > > >>> > >>> >> >> in
> > > > > >>> > >>> >> >> > >> turn
> > > > > >>> > >>> >> >> > >>>> and
> > > > > >>> > >>> >> >> > >>>>>>>>> rebooted
> > > > > >>> > >>> >> >> > >>>>>>>>>>> with the new 3.5.0
> binaries.
> > > > > Before
> > > > > >>> > starting
> > > > > >>> > >>> the
> > > > > >>> > >>> >> >> server
> > > > > >>> > >>> >> >> > >>> with
> > > > > >>> > >>> >> >> > >>>>>> 3.5.0
> > > > > >>> > >>> >> >> > >>>>>>>>>>> binaries, we highly
> recommend
> > > > > updating
> > > > > >>> the
> > > > > >>> > >>> >> >> configuration
> > > > > >>> > >>> >> >> > >>> file
> > > > > >>> > >>> >> >> > >>>>> so
> > > > > >>> > >>> >> >> > >>>>>>> that
> > > > > >>> > >>> >> >> > >>>>>>>>> all
> > > > > >>> > >>> >> >> > >>>>>>>>>>> server statements
> > > > "server.x=..."
> > > > > >>> contain
> > > > > >>> > >>> client
> > > > > >>> > >>> >> >> ports
> > > > > >>> > >>> >> >> > >> (see
> > > > > >>> > >>> >> >> > >>>> the
> > > > > >>> > >>> >> >> > >>>>>>>> section
> > > > > >>> > >>> >> >> > >>>>>>>>>>> Specifying
> > > > > >>> > >>> >> >> > >>>>>>>>>>> the client port). As
> > > explained
> > > > > earlier
> > > > > >>> you
> > > > > >>> > >>> may
> > > > > >>> > >>> >> >> leave the
> > > > > >>> > >>> >> >> > >>>>>>>> configuration
> > > > > >>> > >>> >> >> > >>>>>>>>>> in a
> > > > > >>> > >>> >> >> > >>>>>>>>>>> single file, as well as
> leave
> > > > the
> > > > > >>> > >>> >> >> > >>>> clientPort/clientPortAddress
> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> > > > > >>> > >>> >> >> > >>>>>>>>>>> (although if you specify
> > > client
> > > > > ports
> > > > > >>> in
> > > > > >>> > the
> > > > > >>> > >>> new
> > > > > >>> > >>> >> >> format,
> > > > > >>> > >>> >> >> > >>>> these
> > > > > >>> > >>> >> >> > >>>>>>>>> statements
> > > > > >>> > >>> >> >> > >>>>>>>>>>> are now redundant).
> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>>> Could you please let me
> know
> > > > > about this
> > > > > >>> > case.
> > > > > >>> > >>> >> >> Appreciate
> > > > > >>> > >>> >> >> > >> if
> > > > > >>> > >>> >> >> > >>>>>> respond
> > > > > >>> > >>> >> >> > >>>>>>>>> soon.
> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>>> Thanks,
> > > > > >>> > >>> >> >> > >>>>>>>>>>> ---------------------
> > > > > >>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
> > > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>>
> > > > > >>> > >>> >> >> > >>>>>>
> > > > > >>> > >>> >> >> > >>>>>
> > > > > >>> > >>> >> >> > >>>>
> > > > > >>> > >>> >> >> > >>>
> > > > > >>> > >>> >> >> > >>
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >> >
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> ________________________________
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > > > > >>> > >>> >> >> This e-mail (including any attachments) is
> > > > strictly
> > > > > >>> > >>> confidential
> > > > > >>> > >>> >> and
> > > > > >>> > >>> >> >> may also contain privileged information. If
> you are
> > > > > not the
> > > > > >>> > >>> intended
> > > > > >>> > >>> >> >> recipient you are not authorised to read,
> print,
> > > > save,
> > > > > >>> process or
> > > > > >>> > >>> >> disclose
> > > > > >>> > >>> >> >> this message. If you have received this
> message by
> > > > > mistake,
> > > > > >>> > please
> > > > > >>> > >>> >> inform
> > > > > >>> > >>> >> >> the sender immediately and destroy this
> e-mail, its
> > > > > >>> attachments
> > > > > >>> > >>> and any
> > > > > >>> > >>> >> >> copies. Any use, distribution, reproduction or
> > > > > disclosure by
> > > > > >>> any
> > > > > >>> > >>> person
> > > > > >>> > >>> >> >> other than the intended recipient is strictly
> > > > > prohibited and
> > > > > >>> the
> > > > > >>> > >>> person
> > > > > >>> > >>> >> >> responsible may incur in penalties.
> > > > > >>> > >>> >> >> The use of this e-mail is only for
> professional
> > > > > purposes;
> > > > > >>> > >>> there is
> > > > > >>> > >>> >> no
> > > > > >>> > >>> >> >> guarantee that the correspondence towards this
> > > e-mail
> > > > > will be
> > > > > >>> > read
> > > > > >>> > >>> >> only by
> > > > > >>> > >>> >> >> the recipient, because, under certain
> > > circumstances,
> > > > > there
> > > > > >>> may
> > > > > >>> > be a
> > > > > >>> > >>> >> need to
> > > > > >>> > >>> >> >> access this email by third subjects belonging
> to
> > > the
> > > > > Company.
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> ________________________________
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > > > > >>> > >>> >> >> This e-mail (including any attachments) is
> strictly
> > > > > >>> confidential
> > > > > >>> > >>> and
> > > > > >>> > >>> >> may
> > > > > >>> > >>> >> >> also contain privileged information. If you
> are not
> > > > the
> > > > > >>> intended
> > > > > >>> > >>> >> recipient
> > > > > >>> > >>> >> >> you are not authorised to read, print, save,
> > > process
> > > > or
> > > > > >>> disclose
> > > > > >>> > >>> this
> > > > > >>> > >>> >> >> message. If you have received this message by
> > > > mistake,
> > > > > please
> > > > > >>> > >>> inform
> > > > > >>> > >>> >> the
> > > > > >>> > >>> >> >> sender immediately and destroy this e-mail, its
> > > > > attachments
> > > > > >>> and
> > > > > >>> > any
> > > > > >>> > >>> >> copies.
> > > > > >>> > >>> >> >> Any use, distribution, reproduction or
> disclosure
> > > by
> > > > > any
> > > > > >>> person
> > > > > >>> > >>> other
> > > > > >>> > >>> >> than
> > > > > >>> > >>> >> >> the intended recipient is strictly prohibited
> and
> > > the
> > > > > person
> > > > > >>> > >>> >> responsible
> > > > > >>> > >>> >> >> may incur in penalties.
> > > > > >>> > >>> >> >> The use of this e-mail is only for professional
> > > > > purposes;
> > > > > >>> there
> > > > > >>> > is
> > > > > >>> > >>> no
> > > > > >>> > >>> >> >> guarantee that the correspondence towards this
> > > e-mail
> > > > > will be
> > > > > >>> > read
> > > > > >>> > >>> >> only by
> > > > > >>> > >>> >> >> the recipient, because, under certain
> > > circumstances,
> > > > > there
> > > > > >>> may
> > > > > >>> > be a
> > > > > >>> > >>> >> need to
> > > > > >>> > >>> >> >> access this email by third subjects belonging
> to
> > > the
> > > > > Company.
> > > > > >>> > >>> >> >>
> > > > > >>> > >>> >> >
> > > > > >>> > >>> >>
> > > > > >>> > >>> >
> > > > > >>> > >>>
> > > > > >>> > >>
> > > > > >>> >
> > > > > >>>
> > > > > >>
> > > > >
> > > > >
> > > > > ________________________________
> > > > >
> > > > > CONFIDENTIALITY & PRIVACY NOTICE
> > > > > This e-mail (including any attachments) is strictly confidential
> and
> > > may
> > > > > also contain privileged information. If you are not the intended
> > > > recipient
> > > > > you are not authorised to read, print, save, process or disclose
> this
> > > > > message. If you have received this message by mistake, please
> inform
> > > the
> > > > > sender immediately and destroy this e-mail, its attachments and any
> > > > copies.
> > > > > Any use, distribution, reproduction or disclosure by any person
> other
> > > > than
> > > > > the intended recipient is strictly prohibited and the person
> > > responsible
> > > > > may incur in penalties.
> > > > > The use of this e-mail is only for professional purposes; there is
> no
> > > > > guarantee that the correspondence towards this e-mail will be read
> only
> > > > by
> > > > > the recipient, because, under certain circumstances, there may be a
> > > need
> > > > to
> > > > > access this email by third subjects belonging to the Company.
> > > > >
> > > >
> > >
>
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by Szalay-Bekő Máté <sz...@gmail.com>.
Sounds like a bug or a configuration issue...
can you share the configs (before and after the scale-up) and the logs?
also: does the truststores recognise all the keys used on all the 5
nodes? (e.g. the truststores on the old nodes accept the new keys?)
Best Regards,
Mate
On Thu, Oct 8, 2020 at 2:31 PM kuldeep singh <ku...@gmail.com> wrote:
>
> Hi,
>
> Yes, My client and server both are using certificate and have added in ZK
> and client as well.
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Thu, Oct 8, 2020 at 5:56 PM Enrico Olivelli <eo...@gmail.com> wrote:
>
> > Il giorno gio 8 ott 2020 alle ore 14:17 kuldeep singh <
> > kuldeep.singh08@gmail.com> ha scritto:
> >
> > > Hi Team,
> > >
> > > I am facing one issue in SSL communication between client and zookeeper
> > > server.
> > >
> > > ZK 3.5.6 version
> > >
> > > 1. Mi on 3 node
> > > 2. Applying SSL and 3 nodes cluster is working fine
> > > 3. Scaled my cluster with 2 nodes and now my cluster have 5 nodes over
> > SSL
> > >
> > > but after scaling my SSL is not working between client and ZK server and
> > > even not able to login using zkCli as well.
> > >
> > > Can someone provide the details please why it is happening?
> > >
> >
> > Is your client configured to use SSL ?
> >
> > Enrico
> >
> >
> >
> > >
> > > Thanks,
> > > ---------------------
> > > Kuldeep Singh Budania
> > > Software Architect
> > >
> > >
> > >
> > > On Mon, Jul 13, 2020 at 2:19 PM Enrico Olivelli - Diennea
> > > <en...@diennea.com.invalid> wrote:
> > >
> > > > It looks like we ported it to 3.5.
> > > >
> > > > See the subtask
> > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2792
> > > >
> > > > Enrico
> > > >
> > > > Il giorno 13/07/20, 10:37 "kuldeep singh" <ku...@gmail.com>
> > > ha
> > > > scritto:
> > > >
> > > > Hi Team,
> > > >
> > > > I appreciate it if I will get a response as soon as possible, as I
> > am
> > > > stuck
> > > > at this point.
> > > >
> > > > Thanks,
> > > > ---------------------
> > > > Kuldeep Singh Budania
> > > >
> > > >
> > > >
> > > > On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <
> > > > kuldeep.singh08@gmail.com>
> > > > wrote:
> > > >
> > > > > Hi Team,
> > > > >
> > > > > Server to Server communication is not supported in 3.5.6 version
> > > as
> > > > per
> > > > > below JIRA issue?
> > > > >
> > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2639
> > > > >
> > > > > Thanks,
> > > > > ---------------------
> > > > > Kuldeep Singh Budania
> > > > >
> > > > >
> > > > >
> > > > > On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <
> > > > kuldeep.singh08@gmail.com>
> > > > > wrote:
> > > > >
> > > > >> Thanks for the reply.
> > > > >>
> > > > >> Now my ZKCli cmd is working fine as we use some our customized
> > > > >> authentication and we resolve the issue.
> > > > >>
> > > > >> Now I am going to implement Server to Server communication.
> > > > >>
> > > > >> Thanks,
> > > > >> ---------------------
> > > > >> Kuldeep Singh Budania
> > > > >>
> > > > >>
> > > > >>
> > > > >> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
> > > > >> szalay.beko.mate@gmail.com> wrote:
> > > > >>
> > > > >>> I think SSL is working for you already... If you managed to
> > start
> > > > the
> > > > >>> zkCli.sh and be able to connect to ZooKeeper on the secure port
> > > > and issue
> > > > >>> any kind of command (like: " ls / "), then the wire encryption
> > is
> > > > working
> > > > >>> and your server/client communication is secured by ZooKeeper.
> > > > >>>
> > > > >>> Why you want to run the following command?
> > > > >>> addauth ztpasswd zooadmin:<password>
> > > > >>>
> > > > >>> Do you also want to configure a superDigest user in ZooKeeper?
> > > > Please
> > > > >>> note
> > > > >>> that this command is independent from SSL. If you need to
> > create
> > > a
> > > > >>> username-password pair for digest authentication then please
> > use
> > > > the
> > > > >>> command in the following way:
> > > > >>> addauth digest zooadmin:yourSuperSecretPassword
> > > > >>>
> > > > >>> Kind regards,
> > > > >>> Mate
> > > > >>>
> > > > >>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <
> > > > kuldeep.singh08@gmail.com>
> > > > >>> wrote:
> > > > >>>
> > > > >>> > 1. sh zkCli.sh --config /etc/zookeeper -server localhost:2281
> > > > >>> >
> > > > >>> > 2. addauth ztpasswd zooadmin:<password>
> > > > >>> >
> > > > >>> >
> > > > >>> > Thanks,
> > > > >>> > ---------------------
> > > > >>> > Kuldeep Singh Budania
> > > > >>> >
> > > > >>> >
> > > > >>> >
> > > > >>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
> > > > >>> kuldeep.singh08@gmail.com>
> > > > >>> > wrote:
> > > > >>> >
> > > > >>> > > Hi Team,
> > > > >>> > >
> > > > >>> > > Any update on this?
> > > > >>> > >
> > > > >>> > > Thanks,
> > > > >>> > > ---------------------
> > > > >>> > > Kuldeep Singh Budania
> > > > >>> > >
> > > > >>> > >
> > > > >>> > >
> > > > >>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
> > > > >>> kuldeep.singh08@gmail.com>
> > > > >>> > > wrote:
> > > > >>> > >
> > > > >>> > >> Sorry this is my bad, there were server setting like below
> > > > >>> > >>
> > > > >>> > >> export SERVER_JVMFLAGS="
> > > > >>> > >>
> > > > >>> > >>
> > > > >>> > >>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > > >>> > >>
> > > > >>> > >>
> > > > >>>
> > > > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > > > >>> > >>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > > >>> > >>
> > > > >>> > >>
> > > > >>> > >>
> > > > >>> > >> export CLIENT_JVMFLAGS="
> > > > >>> > >>
> > > > >>> > >>
> > > > >>>
> > > > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > > >>> > >> -Dzookeeper.client.secure=true
> > > > >>> > >>
> > > > >>>
> > > > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > > > >>> > >>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > > >>> > >>
> > > > >>> > >> I want to have SSL between client to server communication
> > > > >>> > >>
> > > > >>> > >> I am already following the same link which you have shared
> > > > with me
> > > > >>> but
> > > > >>> > >> that is not working.
> > > > >>> > >>
> > > > >>> > >> Zoo.cfg
> > > > >>> > >>
> > > > >>> > >> secureClientPort=2281
> > > > >>> > >> initLimit=10
> > > > >>> > >> syncLimit=5
> > > > >>> > >> dataDir=/var/lib/zookeeper/data
> > > > >>> > >> tickTime=2000
> > > > >>> > >> autopurge.snapRetainCount=3
> > > > >>> > >> autopurge.purgeInterval=1
> > > > >>> > >> admin.enableServer=false
> > > > >>> > >> standaloneEnabled=false
> > > > >>> > >> jute.maxbuffer=2147483648
> > > > >>> > >>
> > > > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > > >>> > >> server.1=host1_priv:10288:10388
> > > > >>> > >> server.2=host2_priv:10288:10388
> > > > >>> > >> server.3=host3_priv:10288:10388
> > > > >>> > >>
> > > > >>> > >>
> > > > >>> > >> command to connect using zkcli
> > > > >>> > >>
> > > > >>> > >> 1. zkcli zoo.cfg localhost:2281
> > > > >>> > >> 2. addauth ztpasswd usernaem:password
> > > > >>> > >>
> > > > >>> > >> after second step we are getting below error
> > > > >>> > >>
> > > > >>> > >> WatchedEvent state:AuthFailed type:None path:null
> > > > >>> > >>
> > > > >>> > >>
> > > > >>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > > > >>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> > > > authentication
> > > > >>> > provider
> > > > >>> > >> for scheme: ztpasswd has x509 ip digest*
> > > > >>> > >>
> > > > >>> > >> Thanks,
> > > > >>> > >> ---------------------
> > > > >>> > >> Kuldeep Singh Budania
> > > > >>> > >>
> > > > >>> > >>
> > > > >>> > >>
> > > > >>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
> > > > >>> > >> szalay.beko.mate@gmail.com> wrote:
> > > > >>> > >>
> > > > >>> > >>> > No authentication provider for scheme: ztpasswd has
> > x509
> > > > ip
> > > > >>> digest*
> > > > >>> > >>>
> > > > >>> > >>> This suggest you have some configuration error... Where
> > did
> > > > you
> > > > >>> use the
> > > > >>> > >>> "ztpasswd" string in your configs / commands?
> > > > >>> > >>>
> > > > >>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
> > > > >>> > >>> szalay.beko.mate@gmail.com>
> > > > >>> > >>> wrote:
> > > > >>> > >>>
> > > > >>> > >>> > > My ZK server is up and running in secure mode
> > > > >>> > >>> >
> > > > >>> > >>> > What is your goal? You want to setup client-server SSL
> > > > >>> connection?
> > > > >>> > >>> >
> > > > >>> > >>> > see:
> > > > >>> > >>> >
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
> > > > >>> > >>> >
> > > > >>> > >>> > (or you want to have both SSL and SASL enabled?)
> > > > >>> > >>> >
> > > > >>> > >>> > Anyway, please remove the following line from the
> > > > >>> SERVER_JVMFLAGS:
> > > > >>> > >>> >
> > > > >>> >
> > > > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > > >>> > >>> > This is a configuration that makes sense only for the
> > > > ZooKeeper
> > > > >>> > client,
> > > > >>> > >>> > not for the server. For the server, use the following:
> > > > >>> > >>> >
> > > > >>> > >>> >
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > > >>> > >>> >
> > > > >>> > >>> > If it doesn't solve the issue, then can you please send
> > > > your
> > > > >>> zoo.cfg
> > > > >>> > >>> file?
> > > > >>> > >>> > Also can you please send the zkCli command you execute?
> > > > (you
> > > > >>> need to
> > > > >>> > >>> > connect to the secure ZooKeeper port, unless
> > > > portUnification is
> > > > >>> > >>> enabled)
> > > > >>> > >>> >
> > > > >>> > >>> > Kind regards,
> > > > >>> > >>> > Mate
> > > > >>> > >>> >
> > > > >>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
> > > > >>> > >>> kuldeep.singh08@gmail.com>
> > > > >>> > >>> > wrote:
> > > > >>> > >>> >
> > > > >>> > >>> >> Hi,
> > > > >>> > >>> >>
> > > > >>> > >>> >> we have done below changes in java.env file
> > > > >>> > >>> >>
> > > > >>> > >>> >> export SERVER_JVMFLAGS="
> > > > >>> > >>> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>>
> > > > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > > >>> > >>> >>
> > > > >>> >
> > > > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > > >>> > >>> >>
> > > > >>> > >>> >>
> > > > >>> > >>> >>
> > > > >>> > >>> >> export CLIENT_JVMFLAGS="
> > > > >>> > >>> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>>
> > > > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > > >>> > >>> >> -Dzookeeper.client.secure=true
> > > > >>> > >>> >>
> > > > >>> >
> > > > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > > >>> > >>> >>
> > > > >>> > >>> >> I have started the ZK server and it is up without any
> > > > issue.
> > > > >>> > >>> >>
> > > > >>> > >>> >> But now when I login to ZkCli then it gives the below
> > > > error.
> > > > >>> > >>> >>
> > > > >>> > >>> >> WatchedEvent state:AuthFailed type:None path:null
> > > > >>> > >>> >>
> > > > >>> > >>> >>
> > > > >>> > >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > > > >>> > >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> > > > >>> authentication
> > > > >>> > >>> provider
> > > > >>> > >>> >> for scheme: ztpasswd has x509 ip digest*
> > > > >>> > >>> >>
> > > > >>> > >>> >> Please help me on this issue
> > > > >>> > >>> >>
> > > > >>> > >>> >> Thanks,
> > > > >>> > >>> >> ---------------------
> > > > >>> > >>> >> Kuldeep Singh Budania
> > > > >>> > >>> >> Software Architect
> > > > >>> > >>> >>
> > > > >>> > >>> >>
> > > > >>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
> > > > >>> > >>> kuldeep.singh08@gmail.com>
> > > > >>> > >>> >> wrote:
> > > > >>> > >>> >>
> > > > >>> > >>> >> > Hi,
> > > > >>> > >>> >> >
> > > > >>> > >>> >> > My ZK server is up and running in secure mode, But
> > > > When I am
> > > > >>> > >>> trying to
> > > > >>> > >>> >> > connect to the ZK server using ZKCli, it gives the
> > > below
> > > > >>> error.
> > > > >>> > >>> >> >
> > > > >>> > >>> >> > WatchedEvent state:AuthFailed type:None path:null
> > > > >>> > >>> >> >
> > > > >>> > >>> >> >
> > > > >>> > >>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > > > >>> > >>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> > > > >>> authentication
> > > > >>> > >>> >> provider
> > > > >>> > >>> >> > for scheme: ztpasswd has x509 ip digest*
> > > > >>> > >>> >> >
> > > > >>> > >>> >> > Can someone please help me on this issue. we are
> > using
> > > > the
> > > > >>> 3.5.6
> > > > >>> > >>> >> version.
> > > > >>> > >>> >> >
> > > > >>> > >>> >> > I appreciate if I will get a response as soon as
> > > > possible, as
> > > > >>> I am
> > > > >>> > >>> stuck
> > > > >>> > >>> >> > at this point.
> > > > >>> > >>> >> >
> > > > >>> > >>> >> > Thanks,
> > > > >>> > >>> >> > ---------------------
> > > > >>> > >>> >> > Kuldeep Singh Budania
> > > > >>> > >>> >> > Software Architect
> > > > >>> > >>> >> >
> > > > >>> > >>> >> >
> > > > >>> > >>> >> >
> > > > >>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli -
> > > > Diennea
> > > > >>> > >>> >> > <en...@diennea.com.invalid> wrote:
> > > > >>> > >>> >> >
> > > > >>> > >>> >> >> I mean in zoo.cfg
> > > > >>> > >>> >> >> Not as a system property
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> Enrico
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli -
> > > Diennea" <
> > > > >>> > >>> >> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> Hi
> > > > >>> > >>> >> >> You have to enable Netty on the server side
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> Something like:
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> >
> > > > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> Hope that helps
> > > > >>> > >>> >> >> Enrico
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
> > > > >>> > >>> >> kuldeep.singh08@gmail.com>
> > > > >>> > >>> >> >> ha scritto:
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> Hi,
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> I got below error while setting SSL
> > > properties
> > > > in
> > > > >>> > zkEnv.sh
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > ==========================================================================================
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
> > > > >>> > [main:QuorumPeerConfig@133]
> > > > >>> > >>> -
> > > > >>> > >>> >> >> Reading
> > > > >>> > >>> >> >> configuration from: /etc/zookeeper/zoo.cfg
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> > > > >>> > [main:QuorumPeerConfig@385]
> > > > >>> > >>> -
> > > > >>> > >>> >> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> > > > >>> > [main:QuorumPeerConfig@399]
> > > > >>> > >>> -
> > > > >>> > >>> >> >> secureClientPortAddress is
> > > > 0.0.0.0/0.0.0.0:2281
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,878 - INFO
> > > > [main:X509Util@79] -
> > > > >>> > >>> Setting
> > > > >>> > >>> >> -D
> > > > >>> > >>> >> >>
> > > > jdk.tls.rejectClientInitiatedRenegotiation=true to
> > > > >>> > disable
> > > > >>> > >>> >> >> client-initiated
> > > > >>> > >>> >> >> TLS renegotiation
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> > > > >>> > >>> [main:DatadirCleanupManager@78]
> > > > >>> > >>> >> -
> > > > >>> > >>> >> >> autopurge.snapRetainCount set to 3
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> > > > >>> > >>> [main:DatadirCleanupManager@79]
> > > > >>> > >>> >> -
> > > > >>> > >>> >> >> autopurge.purgeInterval set to 1
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,898 - INFO [
> > > > >>> > >>> >> >>
> > PurgeTask:DatadirCleanupManager$PurgeTask@138
> > > ]
> > > > -
> > > > >>> Purge
> > > > >>> > >>> task
> > > > >>> > >>> >> >> started.
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,899 - INFO
> > > > [main:ManagedUtil@46]
> > > > >>> -
> > > > >>> > >>> Log4j
> > > > >>> > >>> >> >> found with
> > > > >>> > >>> >> >> jmx enabled.
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
> > > > >>> > >>> [PurgeTask:FileTxnSnapLog@103]
> > > > >>> > >>> >> -
> > > > >>> > >>> >> >> zookeeper.snapshot.trust.empty : false
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,910 - INFO [
> > > > >>> > >>> >> >>
> > PurgeTask:DatadirCleanupManager$PurgeTask@144
> > > ]
> > > > -
> > > > >>> Purge
> > > > >>> > >>> task
> > > > >>> > >>> >> >> completed.
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
> > > > >>> [main:QuorumPeerMain@141
> > > > >>> > ]
> > > > >>> > >>> -
> > > > >>> > >>> >> >> Starting quorum
> > > > >>> > >>> >> >> peer
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
> > > > >>> > [main:ServerCnxnFactory@135]
> > > > >>> > >>> -
> > > > >>> > >>> >> >> Using
> > > > >>> > >>> >> >>
> > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > > > >>> > server
> > > > >>> > >>> >> >> connection
> > > > >>> > >>> >> >> factory
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
> > > > >>> > >>> [main:NIOServerCnxnFactory@673]
> > > > >>> > >>> >> -
> > > > >>> > >>> >> >> Configuring NIO connection handler with 10s
> > > > >>> sessionless
> > > > >>> > >>> >> >> connection timeout,
> > > > >>> > >>> >> >> 2 selector thread(s), 16 worker threads,
> > and
> > > > 64 kB
> > > > >>> direct
> > > > >>> > >>> >> buffers.
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
> > > > >>> > >>> [main:NIOServerCnxnFactory@686
> > > > >>> > >>> >> ]
> > > > >>> > >>> >> >> - binding
> > > > >>> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
> > > > >>> > [main:ServerCnxnFactory@135]
> > > > >>> > >>> -
> > > > >>> > >>> >> >> Using
> > > > >>> > >>> >> >>
> > > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > > > >>> > server
> > > > >>> > >>> >> >> connection
> > > > >>> > >>> >> >> factory
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
> > > > >>> [main:QuorumPeerMain@101
> > > > >>> > ]
> > > > >>> > >>> -
> > > > >>> > >>> >> >> Unexpected
> > > > >>> > >>> >> >> exception, exiting abnormally
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> java.lang.UnsupportedOperationException:
> > SSL
> > > > isn't
> > > > >>> > >>> supported in
> > > > >>> > >>> >> >> NIOServerCnxn
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> at
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> at
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> at
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> at
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> I have set the following properties in
> > > > >>> SERVER_JVMFLAGS in
> > > > >>> > >>> >> >> zkEnv.sh file :
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> > > > >>> > >>> >> >>
> > > > -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> > > > >>> > >>> >> >>
> > > > -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> Thanks,
> > > > >>> > >>> >> >> ---------------------
> > > > >>> > >>> >> >> Kuldeep Singh Budania
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan
> > > > Zimmerman <
> > > > >>> > >>> >> >> jordan@jordanzimmerman.com>
> > > > >>> > >>> >> >> wrote:
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> > It's the same as the normal ZooKeeper
> > > client:
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > > > >>> > >>> >> >> > <
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > > > >>> > >>> >> >> > >
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >> > -Jordan
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep
> > > singh
> > > > <
> > > > >>> > >>> >> >> kuldeep.singh08@gmail.com>
> > > > >>> > >>> >> >> > wrote:
> > > > >>> > >>> >> >> > >
> > > > >>> > >>> >> >> > > Hi Team,
> > > > >>> > >>> >> >> > > How we will do secure communication
> > > > between the
> > > > >>> > Curator
> > > > >>> > >>> >> >> framework and
> > > > >>> > >>> >> >> > > zookeeper 3.5.6 ?
> > > > >>> > >>> >> >> > > I didn't get any solution right now.
> > > > >>> > >>> >> >> > > I appreciate it if someone could help
> > me
> > > > with the
> > > > >>> > same.
> > > > >>> > >>> >> >> > >
> > > > >>> > >>> >> >> > > Thanks,
> > > > >>> > >>> >> >> > > ---------------------
> > > > >>> > >>> >> >> > > Kuldeep Singh Budania
> > > > >>> > >>> >> >> > > Software Architect
> > > > >>> > >>> >> >> > >
> > > > >>> > >>> >> >> > >
> > > > >>> > >>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM
> > > > Szalay-Bekő Máté
> > > > >>> <
> > > > >>> > >>> >> >> > szalay.beko.mate@gmail.com>
> > > > >>> > >>> >> >> > > wrote:
> > > > >>> > >>> >> >> > >
> > > > >>> > >>> >> >> > >> Hello Kuldeep,
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> > >> did you download the source from the
> > > > ZooKeeper
> > > > >>> > >>> webpage, or
> > > > >>> > >>> >> >> checked out
> > > > >>> > >>> >> >> > from
> > > > >>> > >>> >> >> > >> git?
> > > > >>> > >>> >> >> > >> Anyway, the following commands should
> > > > work:
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> > >> wget
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> > > > >>> > >>> >> >> > >> tar xzvf
> > ./apache-zookeeper-3.5.7.tar.gz
> > > > >>> > >>> >> >> > >> cd apache-zookeeper-3.5.7
> > > > >>> > >>> >> >> > >> mvn clean install -DskipTests
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> > >> I tested it with OpenJDK 8u424 and
> > maven
> > > > 3.6.0.
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> > >> Kind regards,
> > > > >>> > >>> >> >> > >> Mate
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM
> > kuldeep
> > > > singh <
> > > > >>> > >>> >> >> > kuldeep.singh08@gmail.com>
> > > > >>> > >>> >> >> > >> wrote:
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> > >>> Hi All,
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>> I have download the zookeeper source
> > > > code and
> > > > >>> run
> > > > >>> > >>> the mvn
> > > > >>> > >>> >> >> command for
> > > > >>> > >>> >> >> > >>> packaging but get problem on
> > > > "zookeeper-server"
> > > > >>> > >>> >> directory.
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>> *command :- mvn clean package*
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>> [ERROR] Failed to execute goal
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >>
> > > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > > > >>> > >>> >> >> > >>> (default-compile) on project
> > zookeeper:
> > > > Fatal
> > > > >>> error
> > > > >>> > >>> >> >> compiling:
> > > > >>> > >>> >> >> > >>> java.lang.NullPointerException ->
> > [Help
> > > > 1]
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> org.apache.maven.lifecycle.LifecycleExecutionException:
> > > > >>> > >>> >> >> Failed to
> > > > >>> > >>> >> >> > execute
> > > > >>> > >>> >> >> > >>> goal
> > > > >>> > >>> >> >>
> > > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > > > >>> > >>> >> >> > >>> (default-compile) on project
> > zookeeper:
> > > > Fatal
> > > > >>> error
> > > > >>> > >>> >> >> compiling
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >>
> > > > org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >>
> > > > org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >>
> > > > org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >>
> > > org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >>
> > org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > > > Method)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> java.lang.reflect.Method.invoke(Method.java:498)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> > > > >>> > >>> >> >> > >>> Caused by:
> > > > >>> > >>> >> org.apache.maven.plugin.MojoExecutionException:
> > > > >>> > >>> >> >> Fatal error
> > > > >>> > >>> >> >> > >>> compiling
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> > > > >>> > >>> >> >> > >>> ... 19 more
> > > > >>> > >>> >> >> > >>> Caused by:
> > > > >>> > >>> >> org.codehaus.plexus.compiler.CompilerException:
> > > > >>> > >>> >> >> > >>> java.lang.NullPointerException
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> > > > >>> > >>> >> >> > >>> ... 22 more
> > > > >>> > >>> >> >> > >>> Caused by:
> > java.lang.RuntimeException:
> > > > >>> > >>> >> >> java.lang.NullPointerException
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >>
> > com.sun.tools.javac.main.Main.compile(Main.java:559)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> > >>>
> > > > >>>
> > > > com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> >
> > > > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> > > > >>> > >>> >> >> > >>> ... 24 more
> > > > >>> > >>> >> >> > >>> Caused by:
> > > java.lang.NullPointerException
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >>
> > com.sun.tools.doclint.Checker.scan(Checker.java:144)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >>
> > > > com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> > >>>
> > > > >>>
> > > > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> > >>>
> > > > >>>
> > > > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> >
> > > > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>>
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> >
> > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> >
> > > > com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> >
> > > > com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>>
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> >
> > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> >
> > > > com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> > >>>
> > > > >>>
> > > > com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>>
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> >
> > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >>
> > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> >
> > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >>
> > > > >>>
> > com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> > >>>
> > > > >>>
> > > > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> > >>>
> > > > >>>
> > > > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> >
> > > > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>>
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >>
> > > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> >
> > > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>>
> > com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >>
> > > > com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> > >>>
> > > > >>>
> > > > com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> > >>>
> > > > >>>
> > > > com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> > >>>
> > > > >>>
> > > > com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> > > > >>> > >>> >> >> > >>> at
> > > > >>> > >>> >> >>
> > com.sun.tools.javac.main.Main.compile(Main.java:523)
> > > > >>> > >>> >> >> > >>> ... 27 more
> > > > >>> > >>> >> >> > >>> [ERROR]
> > > > >>> > >>> >> >> > >>> [ERROR] Re-run Maven using the -X
> > > switch
> > > > to
> > > > >>> enable
> > > > >>> > >>> full
> > > > >>> > >>> >> >> debug logging.
> > > > >>> > >>> >> >> > >>> [ERROR]
> > > > >>> > >>> >> >> > >>> [ERROR] For more information about
> > the
> > > > errors
> > > > >>> and
> > > > >>> > >>> >> possible
> > > > >>> > >>> >> >> solutions,
> > > > >>> > >>> >> >> > >>> please read the following articles:
> > > > >>> > >>> >> >> > >>> [ERROR] [Help 1]
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>> Can someone help me on this issue?
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>> Thanks,
> > > > >>> > >>> >> >> > >>> ---------------------
> > > > >>> > >>> >> >> > >>> Kuldeep Singh Budania
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM
> > > > Szalay-Bekő
> > > > >>> Máté <
> > > > >>> > >>> >> >> > >>> szalay.beko.mate@gmail.com>
> > > > >>> > >>> >> >> > >>> wrote:
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>>> these exceptions can mean many
> > > > things... I
> > > > >>> think
> > > > >>> > >>> this
> > > > >>> > >>> >> can
> > > > >>> > >>> >> >> be even
> > > > >>> > >>> >> >> > >> normal
> > > > >>> > >>> >> >> > >>>> duding rolling restart (as some
> > > > connections
> > > > >>> get
> > > > >>> > >>> broken
> > > > >>> > >>> >> in
> > > > >>> > >>> >> >> this case)
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>> However, I saw cases already when
> > > > exceptions
> > > > >>> like
> > > > >>> > >>> these
> > > > >>> > >>> >> >> killed
> > > > >>> > >>> >> >> > receiver
> > > > >>> > >>> >> >> > >>> or
> > > > >>> > >>> >> >> > >>>> sender threads in QuorumCnxManager /
> > > > Leader
> > > > >>> > >>> Election in
> > > > >>> > >>> >> >> such a way
> > > > >>> > >>> >> >> > that
> > > > >>> > >>> >> >> > >>>> they were not able to recover, so
> > the
> > > > node was
> > > > >>> > >>> unable to
> > > > >>> > >>> >> >> connect to
> > > > >>> > >>> >> >> > any
> > > > >>> > >>> >> >> > >>>> quorum until restart. I remember
> > > seeing
> > > > this
> > > > >>> in
> > > > >>> > 3.4
> > > > >>> > >>> too.
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>> Do you see these exceptions in the
> > > > second
> > > > >>> server
> > > > >>> > >>> (the
> > > > >>> > >>> >> one
> > > > >>> > >>> >> >> which you
> > > > >>> > >>> >> >> > >> just
> > > > >>> > >>> >> >> > >>>> upgraded in step 3)?
> > > > >>> > >>> >> >> > >>>> Is this issue reproducible?
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>> What is the tickTime and initLimit
> > you
> > > > use?
> > > > >>> Maybe
> > > > >>> > >>> the
> > > > >>> > >>> >> >> server just
> > > > >>> > >>> >> >> > >> require
> > > > >>> > >>> >> >> > >>>> more time to sync?
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>> I would need more logs to really see
> > > > what
> > > > >>> > happened.
> > > > >>> > >>> Can
> > > > >>> > >>> >> >> you create a
> > > > >>> > >>> >> >> > >> Jira
> > > > >>> > >>> >> >> > >>>> issue and upload the logs and also
> > the
> > > > >>> ZooKeeper
> > > > >>> > >>> >> configs?
> > > > >>> > >>> >> >> I am happy
> > > > >>> > >>> >> >> > to
> > > > >>> > >>> >> >> > >>>> take a closer look.
> > > > >>> > >>> >> >> > >>>> (if you need to re-run the test to
> > > > collect the
> > > > >>> > logs,
> > > > >>> > >>> >> then
> > > > >>> > >>> >> >> enabling
> > > > >>> > >>> >> >> > >> DEBUG
> > > > >>> > >>> >> >> > >>>> logs would be great. The INFO level
> > > > logs are
> > > > >>> > usually
> > > > >>> > >>> >> >> enough for these
> > > > >>> > >>> >> >> > >>>> problems, but one can never know...)
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>> Kind regards,
> > > > >>> > >>> >> >> > >>>> Mate
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM
> > > kuldeep
> > > > singh
> > > > >>> <
> > > > >>> > >>> >> >> > >> kuldeep.singh08@gmail.com
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>> wrote:
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>>> Hi Team,
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> I have done some POC on rolling
> > > > upgrade and
> > > > >>> found
> > > > >>> > >>> below
> > > > >>> > >>> >> >> result.
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> 1. On 1st node upgrade zookeeper
> > .
> > > > Traffic
> > > > >>> was
> > > > >>> > >>> >> running
> > > > >>> > >>> >> >> fine
> > > > >>> > >>> >> >> > >> because
> > > > >>> > >>> >> >> > >>> 2
> > > > >>> > >>> >> >> > >>>>> nodes are already on old
> > zookeeper.
> > > > >>> > >>> >> >> > >>>>> 2. On 1st node upgrade our
> > > > application and
> > > > >>> > didn’t
> > > > >>> > >>> >> find
> > > > >>> > >>> >> >> any issue
> > > > >>> > >>> >> >> > >>>>> 3. On 2nd node upgrade zookeeper
> > > but
> > > > got
> > > > >>> below
> > > > >>> > >>> error
> > > > >>> > >>> >> >> and zookeeper
> > > > >>> > >>> >> >> > >>> is
> > > > >>> > >>> >> >> > >>>>> not taking any requests
> > > > >>> > >>> >> >> > >>>>> 4.
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> at
> > > > >>> > >>> >> >>
> > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> at
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
> > > > >>> > >>> >> >> > >>>>>
> > > > [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
> > > > >>> -
> > > > >>> > >>> >> >> Interrupting
> > > > >>> > >>> >> >> > >>> SendWorker
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR
> > > > >>> [LearnerHandler-/
> > > > >>> > >>> >> >> 192.168.44.73:33754
> > > > >>> > >>> >> >> > >>>>> :LearnerHandler@562] - Unexpected
> > > > exception
> > > > >>> > >>> causing
> > > > >>> > >>> >> >> shutdown while
> > > > >>> > >>> >> >> > >>> sock
> > > > >>> > >>> >> >> > >>>>> still open
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> java.io.EOFException
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> at
> > > > >>> > >>> >> >>
> > > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> at
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >>
> > > > >>> > >>>
> > > > >>>
> > > > org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> at
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> at
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> at
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >>
> > > > >>> > >>>
> > > > >>> >
> > > > >>>
> > > >
> > >
> > org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
> > > > >>> > >>> >> >> > >>>>>
> > > > [SendWorker:1:QuorumCnxManager$SendWorker@679]
> > > > >>> -
> > > > >>> > >>> >> >> Interrupted while
> > > > >>> > >>> >> >> > >>>> waiting
> > > > >>> > >>> >> >> > >>>>> for message on queue
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> Please let me know is this the
> > known
> > > > issue or
> > > > >>> > this
> > > > >>> > >>> is
> > > > >>> > >>> >> >> different issue
> > > > >>> > >>> >> >> > >>>> which
> > > > >>> > >>> >> >> > >>>>> is mention in Apache zookeeper
> > > > documentation
> > > > >>> when
> > > > >>> > >>> >> >> upgrading from
> > > > >>> > >>> >> >> > >> 3.4.5
> > > > >>> > >>> >> >> > >>> to
> > > > >>> > >>> >> >> > >>>>> 3.5.6
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> Thanks,
> > > > >>> > >>> >> >> > >>>>> ---------------------
> > > > >>> > >>> >> >> > >>>>> Kuldeep Singh Budania
> > > > >>> > >>> >> >> > >>>>> Software Architect
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM
> > > > Alexander
> > > > >>> Shraer
> > > > >>> > <
> > > > >>> > >>> >> >> shralex@gmail.com>
> > > > >>> > >>> >> >> > >>>>> wrote:
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>>> +1 to what Mate said (I wrote the
> > > > quoted
> > > > >>> > >>> >> instructions).
> > > > >>> > >>> >> >> > >>>>>>
> > > > >>> > >>> >> >> > >>>>>>
> > > > >>> > >>> >> >> > >>>>>>
> > > > >>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM
> > > > Szalay-Bekő
> > > > >>> > Máté <
> > > > >>> > >>> >> >> > >>>>>> szalay.beko.mate@gmail.com>
> > > > >>> > >>> >> >> > >>>>>> wrote:
> > > > >>> > >>> >> >> > >>>>>>
> > > > >>> > >>> >> >> > >>>>>>> Hi Kuldeep,
> > > > >>> > >>> >> >> > >>>>>>>
> > > > >>> > >>> >> >> > >>>>>>> I just want to provide you some
> > > > background
> > > > >>> info
> > > > >>> > >>> about
> > > > >>> > >>> >> >> our
> > > > >>> > >>> >> >> > >>>>> documentation.
> > > > >>> > >>> >> >> > >>>>>>> The reason to upgrade to 3.4.6
> > > first
> > > > is to
> > > > >>> > avoid
> > > > >>> > >>> the
> > > > >>> > >>> >> >> following
> > > > >>> > >>> >> >> > >>> error:
> > > > >>> > >>> >> >> > >>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663
> > [myid:2] -
> > > > WARN
> > > > >>> > >>> [localhost/
> > > > >>> > >>> >> >> > >>> 127.0.0.1:2784
> > > > >>> > >>> >> >> > >>>>>>> :QuorumCnxManager@349] - Invalid
> > > > server
> > > > >>> id:
> > > > >>> > >>> -65536
> > > > >>> > >>> >> >> > >>>>>>>
> > > > >>> > >>> >> >> > >>>>>>> This error comes because of the
> > > > protocol
> > > > >>> > changes
> > > > >>> > >>> >> between
> > > > >>> > >>> >> >> > >> ZooKeeper
> > > > >>> > >>> >> >> > >>>>> server
> > > > >>> > >>> >> >> > >>>>>>> nodes during connection
> > initiation
> > > > for
> > > > >>> leader
> > > > >>> > >>> >> election.
> > > > >>> > >>> >> >> In
> > > > >>> > >>> >> >> > >>> ZooKeeper
> > > > >>> > >>> >> >> > >>>>> 3.5
> > > > >>> > >>> >> >> > >>>>>> a
> > > > >>> > >>> >> >> > >>>>>>> protocol version was introduced
> > > (see
> > > > >>> > >>> ZOOKEEPER-107)
> > > > >>> > >>> >> and
> > > > >>> > >>> >> >> since
> > > > >>> > >>> >> >> > >> that
> > > > >>> > >>> >> >> > >>>> time
> > > > >>> > >>> >> >> > >>>>>> the
> > > > >>> > >>> >> >> > >>>>>>> fist long value sent in the
> > initial
> > > > >>> message is
> > > > >>> > >>> not
> > > > >>> > >>> >> the
> > > > >>> > >>> >> >> server ID
> > > > >>> > >>> >> >> > >>> but
> > > > >>> > >>> >> >> > >>>>> the
> > > > >>> > >>> >> >> > >>>>>>> protocol version (-65536). In
> > > > ZooKeeper
> > > > >>> 3.4.6
> > > > >>> > we
> > > > >>> > >>> made
> > > > >>> > >>> >> >> the old 3.4
> > > > >>> > >>> >> >> > >>>>>>> ZooKeepers backward compatible,
> > so
> > > > they are
> > > > >>> > able
> > > > >>> > >>> to
> > > > >>> > >>> >> >> parse both
> > > > >>> > >>> >> >> > >> the
> > > > >>> > >>> >> >> > >>>> old
> > > > >>> > >>> >> >> > >>>>>> and
> > > > >>> > >>> >> >> > >>>>>>> the new protocol format (see
> > > > >>> ZOOKEEPER-1633).
> > > > >>> > >>> This
> > > > >>> > >>> >> >> issue happens
> > > > >>> > >>> >> >> > >>> only
> > > > >>> > >>> >> >> > >>>>>> when
> > > > >>> > >>> >> >> > >>>>>>> you need to use old (3.4.0 -
> > 3.4.5)
> > > > and new
> > > > >>> > >>> (3.5.0+)
> > > > >>> > >>> >> >> ZooKeeper
> > > > >>> > >>> >> >> > >>>> servers
> > > > >>> > >>> >> >> > >>>>>>> together in the same cluster.
> > > During
> > > > a
> > > > >>> rolling
> > > > >>> > >>> >> upgrade,
> > > > >>> > >>> >> >> this is
> > > > >>> > >>> >> >> > >>>> usually
> > > > >>> > >>> >> >> > >>>>>> the
> > > > >>> > >>> >> >> > >>>>>>> case to have old and new
> > ZooKeepers
> > > > present
> > > > >>> > >>> together.
> > > > >>> > >>> >> >> > >>>>>>>
> > > > >>> > >>> >> >> > >>>>>>> The fact that you haven't seen
> > any
> > > > issues
> > > > >>> might
> > > > >>> > >>> be
> > > > >>> > >>> >> >> caused by the
> > > > >>> > >>> >> >> > >>>> order
> > > > >>> > >>> >> >> > >>>>> of
> > > > >>> > >>> >> >> > >>>>>>> the servers. In ZooKeeper the
> > > > connection
> > > > >>> > >>> initiation
> > > > >>> > >>> >> >> between the
> > > > >>> > >>> >> >> > >>>> servers
> > > > >>> > >>> >> >> > >>>>>>> during the leader election
> > follows
> > > a
> > > > >>> specific
> > > > >>> > >>> rule.
> > > > >>> > >>> >> As
> > > > >>> > >>> >> >> far as I
> > > > >>> > >>> >> >> > >>>>> remember
> > > > >>> > >>> >> >> > >>>>>>> always the server with the larger
> > > ID
> > > > 'wins
> > > > >>> the
> > > > >>> > >>> >> >> challenge', so it
> > > > >>> > >>> >> >> > >> is
> > > > >>> > >>> >> >> > >>>>>>> possible, that the old server
> > > didn't
> > > > need
> > > > >>> to
> > > > >>> > >>> parse
> > > > >>> > >>> >> any
> > > > >>> > >>> >> >> initial
> > > > >>> > >>> >> >> > >>>> message
> > > > >>> > >>> >> >> > >>>>>> (if
> > > > >>> > >>> >> >> > >>>>>>> it had the largest ID) and this
> > is
> > > > why you
> > > > >>> > >>> haven't
> > > > >>> > >>> >> seen
> > > > >>> > >>> >> >> the
> > > > >>> > >>> >> >> > >> issue.
> > > > >>> > >>> >> >> > >>>> Also
> > > > >>> > >>> >> >> > >>>>>>> having 2 nodes up from the 3
> > nodes
> > > > cluster
> > > > >>> > still
> > > > >>> > >>> >> makes
> > > > >>> > >>> >> >> the
> > > > >>> > >>> >> >> > >> cluster
> > > > >>> > >>> >> >> > >>>> work
> > > > >>> > >>> >> >> > >>>>>> (so
> > > > >>> > >>> >> >> > >>>>>>> you should also check if all the
> > > > servers
> > > > >>> are
> > > > >>> > >>> part of
> > > > >>> > >>> >> >> the quorum).
> > > > >>> > >>> >> >> > >>>>>>>
> > > > >>> > >>> >> >> > >>>>>>> I agree with Enrico and Norbert,
> > > the
> > > > >>> safest and
> > > > >>> > >>> most
> > > > >>> > >>> >> >> stable way
> > > > >>> > >>> >> >> > >> is
> > > > >>> > >>> >> >> > >>>>>> upgrade
> > > > >>> > >>> >> >> > >>>>>>> first to 3.4.latest, then go to
> > > > 3.5.latest.
> > > > >>> > >>> Still, if
> > > > >>> > >>> >> >> you don't
> > > > >>> > >>> >> >> > >> see
> > > > >>> > >>> >> >> > >>>>> that
> > > > >>> > >>> >> >> > >>>>>>> you would hit this specific issue
> > > > (e.g. no
> > > > >>> > >>> "Invalid
> > > > >>> > >>> >> >> server id" in
> > > > >>> > >>> >> >> > >>> the
> > > > >>> > >>> >> >> > >>>>> log
> > > > >>> > >>> >> >> > >>>>>>> files), and all the three servers
> > > can
> > > > >>> handle
> > > > >>> > >>> traffic,
> > > > >>> > >>> >> >> then maybe
> > > > >>> > >>> >> >> > >>> you
> > > > >>> > >>> >> >> > >>>>>> don't
> > > > >>> > >>> >> >> > >>>>>>> need to upgrade first to
> > > 3.4.latest,
> > > > it is
> > > > >>> your
> > > > >>> > >>> >> >> decision.
> > > > >>> > >>> >> >> > >>> Definitely
> > > > >>> > >>> >> >> > >>>>> you
> > > > >>> > >>> >> >> > >>>>>>> should test it first, as
> > suggested
> > > > by the
> > > > >>> > others.
> > > > >>> > >>> >> >> > >>>>>>>
> > > > >>> > >>> >> >> > >>>>>>> Kind regards,
> > > > >>> > >>> >> >> > >>>>>>> Mate
> > > > >>> > >>> >> >> > >>>>>>>
> > > > >>> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM
> > > > Norbert
> > > > >>> Kalmar
> > > > >>> > >>> >> >> > >>>>>>> <nk...@cloudera.com.invalid>
> > > > wrote:
> > > > >>> > >>> >> >> > >>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>> Hi,
> > > > >>> > >>> >> >> > >>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>> That guide is to upgrade to
> > 3.5.0,
> > > > which
> > > > >>> was
> > > > >>> > an
> > > > >>> > >>> >> alpha
> > > > >>> > >>> >> >> version.
> > > > >>> > >>> >> >> > >> A
> > > > >>> > >>> >> >> > >>>> lot
> > > > >>> > >>> >> >> > >>>>>> has
> > > > >>> > >>> >> >> > >>>>>>>> changed for the first stable
> > > > release of
> > > > >>> 3.5.5
> > > > >>> > >>> and
> > > > >>> > >>> >> then
> > > > >>> > >>> >> >> a few
> > > > >>> > >>> >> >> > >>> more,
> > > > >>> > >>> >> >> > >>>>> even
> > > > >>> > >>> >> >> > >>>>>>>> rolling upgrade issues have been
> > > > fixed for
> > > > >>> > >>> 3.5.6.
> > > > >>> > >>> >> >> > >>>>>>>> This is a more up-to-date guide:
> > > > >>> > >>> >> >> > >>>>>>>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >>
> > > > >>> >
> > > > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> > > > >>> > >>> >> >> > >>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>> If you have done your testing
> > > (with
> > > > prod
> > > > >>> > >>> snapshot!),
> > > > >>> > >>> >> >> then you
> > > > >>> > >>> >> >> > >> can
> > > > >>> > >>> >> >> > >>>>> skip
> > > > >>> > >>> >> >> > >>>>>>> 3.4
> > > > >>> > >>> >> >> > >>>>>>>> latest upgrade, but keep in mind
> > > we
> > > > do our
> > > > >>> > >>> >> >> recommendations for
> > > > >>> > >>> >> >> > >> a
> > > > >>> > >>> >> >> > >>>>>> reason.
> > > > >>> > >>> >> >> > >>>>>>>> There were issues reported
> > and/or
> > > > found
> > > > >>> during
> > > > >>> > >>> >> >> testing. Some
> > > > >>> > >>> >> >> > >> are
> > > > >>> > >>> >> >> > >>>>> fixed
> > > > >>> > >>> >> >> > >>>>>>> with
> > > > >>> > >>> >> >> > >>>>>>>> 3.5.6, some only happens if
> > > certain
> > > > >>> conditions
> > > > >>> > >>> stand
> > > > >>> > >>> >> >> > >>> (IOException:
> > > > >>> > >>> >> >> > >>>> No
> > > > >>> > >>> >> >> > >>>>>>>> snapshot found - mentioned in
> > the
> > > > guide,
> > > > >>> fixed
> > > > >>> > >>> in
> > > > >>> > >>> >> >> 3.5.6).
> > > > >>> > >>> >> >> > >>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>> So it is up to you, I would
> > still
> > > > >>> recommend to
> > > > >>> > >>> do an
> > > > >>> > >>> >> >> 3.4
> > > > >>> > >>> >> >> > >> upgrade
> > > > >>> > >>> >> >> > >>>>> first,
> > > > >>> > >>> >> >> > >>>>>>> if
> > > > >>> > >>> >> >> > >>>>>>>> it's feasible.
> > > > >>> > >>> >> >> > >>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>> Regards,
> > > > >>> > >>> >> >> > >>>>>>>> Norbert
> > > > >>> > >>> >> >> > >>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM
> > > > kuldeep
> > > > >>> > singh <
> > > > >>> > >>> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
> > > > >>> > >>> >> >> > >>>>>>>> wrote:
> > > > >>> > >>> >> >> > >>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>> Hi,
> > > > >>> > >>> >> >> > >>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>> Current Zookeeper version :-
> > > 3.4.5
> > > > >>> > >>> >> >> > >>>>>>>>> Upgraded version
> > > :-
> > > > 3.5.6
> > > > >>> > >>> >> >> > >>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>> We are not going with 3.5.7.
> > Our
> > > > final
> > > > >>> > >>> decision is
> > > > >>> > >>> >> >> zookeeper
> > > > >>> > >>> >> >> > >>>>> version
> > > > >>> > >>> >> >> > >>>>>> is
> > > > >>> > >>> >> >> > >>>>>>>>> 3.5.6
> > > > >>> > >>> >> >> > >>>>>>>>> as per your reply first we need
> > > to
> > > > move
> > > > >>> > latest
> > > > >>> > >>> >> >> version of
> > > > >>> > >>> >> >> > >>> 3.4.x,
> > > > >>> > >>> >> >> > >>>>> like
> > > > >>> > >>> >> >> > >>>>>>>> below
> > > > >>> > >>> >> >> > >>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6
> > (Correct
> > > > me if
> > > > >>> I am
> > > > >>> > >>> wrong
> > > > >>> > >>> >> >> here)
> > > > >>> > >>> >> >> > >>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>> But if We are not facing any
> > > > problem
> > > > >>> that i
> > > > >>> > >>> have
> > > > >>> > >>> >> >> shared you
> > > > >>> > >>> >> >> > >>> that
> > > > >>> > >>> >> >> > >>>> we
> > > > >>> > >>> >> >> > >>>>>>> have
> > > > >>> > >>> >> >> > >>>>>>>>> set up of 3 node cluster where
> > 2
> > > > node
> > > > >>> are on
> > > > >>> > >>> 3.5.6
> > > > >>> > >>> >> >> version
> > > > >>> > >>> >> >> > >> and
> > > > >>> > >>> >> >> > >>> 1
> > > > >>> > >>> >> >> > >>>>> node
> > > > >>> > >>> >> >> > >>>>>>> on
> > > > >>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything is running
> > fine
> > > > and
> > > > >>> didn't
> > > > >>> > >>> get
> > > > >>> > >>> >> any
> > > > >>> > >>> >> >> issue,
> > > > >>> > >>> >> >> > >> So
> > > > >>> > >>> >> >> > >>>> what
> > > > >>> > >>> >> >> > >>>>>>> other
> > > > >>> > >>> >> >> > >>>>>>>>> problem we can face if we
> > > directly
> > > > move
> > > > >>> to
> > > > >>> > >>> 3.5.6
> > > > >>> > >>> >> >> > >>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>> Thanks,
> > > > >>> > >>> >> >> > >>>>>>>>> ---------------------
> > > > >>> > >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
> > > > >>> > >>> >> >> > >>>>>>>>> Software Architect
> > > > >>> > >>> >> >> > >>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM
> > > > Enrico
> > > > >>> > >>> Olivelli <
> > > > >>> > >>> >> >> > >>>>> eolivelli@gmail.com
> > > > >>> > >>> >> >> > >>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>> wrote:
> > > > >>> > >>> >> >> > >>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>> Hi
> > > > >>> > >>> >> >> > >>>>>>>>>> You have to upgrade to latest
> > > > 3.4.x
> > > > >>> > Zookeeper
> > > > >>> > >>> then
> > > > >>> > >>> >> >> you will
> > > > >>> > >>> >> >> > >>>>> upgrade
> > > > >>> > >>> >> >> > >>>>>>> to
> > > > >>> > >>> >> >> > >>>>>>>>>> 3.5.7.
> > > > >>> > >>> >> >> > >>>>>>>>>> All should run well without
> > > issues
> > > > >>> > >>> >> >> > >>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>> Enrico
> > > > >>> > >>> >> >> > >>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18
> > > kuldeep
> > > > singh
> > > > >>> <
> > > > >>> > >>> >> >> > >>>>> kuldeep.singh08@gmail.com
> > > > >>> > >>> >> >> > >>>>>>>
> > > > >>> > >>> >> >> > >>>>>>> ha
> > > > >>> > >>> >> >> > >>>>>>>>>> scritto:
> > > > >>> > >>> >> >> > >>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>>> Hi Team,
> > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>>> We are upgrading zookeeper
> > from
> > > > 3.4.5
> > > > >>> to
> > > > >>> > >>> 3.5.6. I
> > > > >>> > >>> >> >> have
> > > > >>> > >>> >> >> > >> set
> > > > >>> > >>> >> >> > >>>> up 3
> > > > >>> > >>> >> >> > >>>>>>> node
> > > > >>> > >>> >> >> > >>>>>>>>>>> cluster where 2 node are on
> > > 3.5.6
> > > > >>> version
> > > > >>> > >>> and 1
> > > > >>> > >>> >> >> node on
> > > > >>> > >>> >> >> > >>>> 3.4.5.
> > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>>> Everything is running fine
> > and
> > > > didn't
> > > > >>> get
> > > > >>> > any
> > > > >>> > >>> >> issue
> > > > >>> > >>> >> >> on my
> > > > >>> > >>> >> >> > >>>>> system.
> > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>>> but I found something on
> > apache
> > > > site
> > > > >>> that
> > > > >>> > >>> first
> > > > >>> > >>> >> we
> > > > >>> > >>> >> >> need
> > > > >>> > >>> >> >> > >> to
> > > > >>> > >>> >> >> > >>>>>> upgrade
> > > > >>> > >>> >> >> > >>>>>>>> on
> > > > >>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to
> > > > 3.5.6. So
> > > > >>> is
> > > > >>> > it
> > > > >>> > >>> >> >> mandatory
> > > > >>> > >>> >> >> > >> to
> > > > >>> > >>> >> >> > >>> go
> > > > >>> > >>> >> >> > >>>>> on
> > > > >>> > >>> >> >> > >>>>>>>> 3.4.6
> > > > >>> > >>> >> >> > >>>>>>>>>>> first.
> > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
> > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>>> Upgrading a running ZooKeeper
> > > > ensemble
> > > > >>> to
> > > > >>> > >>> 3.5.0
> > > > >>> > >>> >> >> should be
> > > > >>> > >>> >> >> > >>>> done
> > > > >>> > >>> >> >> > >>>>>> only
> > > > >>> > >>> >> >> > >>>>>>>>> after
> > > > >>> > >>> >> >> > >>>>>>>>>>> upgrading your ensemble to
> > the
> > > > 3.4.6
> > > > >>> > release.
> > > > >>> > >>> >> Note
> > > > >>> > >>> >> >> that
> > > > >>> > >>> >> >> > >>> this
> > > > >>> > >>> >> >> > >>>> is
> > > > >>> > >>> >> >> > >>>>>>> only
> > > > >>> > >>> >> >> > >>>>>>>>>>> necessary for rolling
> > upgrades
> > > > (if
> > > > >>> you're
> > > > >>> > >>> fine
> > > > >>> > >>> >> with
> > > > >>> > >>> >> >> > >>> shutting
> > > > >>> > >>> >> >> > >>>>> down
> > > > >>> > >>> >> >> > >>>>>>> the
> > > > >>> > >>> >> >> > >>>>>>>>>>> system completely, you don't
> > > > have to go
> > > > >>> > >>> through
> > > > >>> > >>> >> >> 3.4.6).
> > > > >>> > >>> >> >> > >> If
> > > > >>> > >>> >> >> > >>>> you
> > > > >>> > >>> >> >> > >>>>>>>> attempt
> > > > >>> > >>> >> >> > >>>>>>>>> a
> > > > >>> > >>> >> >> > >>>>>>>>>>> rolling upgrade without going
> > > > through
> > > > >>> 3.4.6
> > > > >>> > >>> (for
> > > > >>> > >>> >> >> example
> > > > >>> > >>> >> >> > >>> from
> > > > >>> > >>> >> >> > >>>>>>> 3.4.5),
> > > > >>> > >>> >> >> > >>>>>>>>> you
> > > > >>> > >>> >> >> > >>>>>>>>>>> may get the following error:
> > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663
> > > [myid:2]
> > > > - INFO
> > > > >>> > >>> >> [localhost/
> > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > > > >>> > >>> >> >> > >>>>>>>>>>>
> > :QuorumCnxManager$Listener@498
> > > ]
> > > > -
> > > > >>> Received
> > > > >>> > >>> >> >> connection
> > > > >>> > >>> >> >> > >>>> request
> > > > >>> > >>> >> >> > >>>>> /
> > > > >>> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
> > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663
> > > [myid:2]
> > > > - WARN
> > > > >>> > >>> >> [localhost/
> > > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > > > >>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349] -
> > > Invalid
> > > > >>> server
> > > > >>> > id:
> > > > >>> > >>> >> -65536
> > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>>> During a rolling upgrade,
> > each
> > > > server
> > > > >>> is
> > > > >>> > >>> taken
> > > > >>> > >>> >> down
> > > > >>> > >>> >> >> in
> > > > >>> > >>> >> >> > >> turn
> > > > >>> > >>> >> >> > >>>> and
> > > > >>> > >>> >> >> > >>>>>>>>> rebooted
> > > > >>> > >>> >> >> > >>>>>>>>>>> with the new 3.5.0 binaries.
> > > > Before
> > > > >>> > starting
> > > > >>> > >>> the
> > > > >>> > >>> >> >> server
> > > > >>> > >>> >> >> > >>> with
> > > > >>> > >>> >> >> > >>>>>> 3.5.0
> > > > >>> > >>> >> >> > >>>>>>>>>>> binaries, we highly recommend
> > > > updating
> > > > >>> the
> > > > >>> > >>> >> >> configuration
> > > > >>> > >>> >> >> > >>> file
> > > > >>> > >>> >> >> > >>>>> so
> > > > >>> > >>> >> >> > >>>>>>> that
> > > > >>> > >>> >> >> > >>>>>>>>> all
> > > > >>> > >>> >> >> > >>>>>>>>>>> server statements
> > > "server.x=..."
> > > > >>> contain
> > > > >>> > >>> client
> > > > >>> > >>> >> >> ports
> > > > >>> > >>> >> >> > >> (see
> > > > >>> > >>> >> >> > >>>> the
> > > > >>> > >>> >> >> > >>>>>>>> section
> > > > >>> > >>> >> >> > >>>>>>>>>>> Specifying
> > > > >>> > >>> >> >> > >>>>>>>>>>> the client port). As
> > explained
> > > > earlier
> > > > >>> you
> > > > >>> > >>> may
> > > > >>> > >>> >> >> leave the
> > > > >>> > >>> >> >> > >>>>>>>> configuration
> > > > >>> > >>> >> >> > >>>>>>>>>> in a
> > > > >>> > >>> >> >> > >>>>>>>>>>> single file, as well as leave
> > > the
> > > > >>> > >>> >> >> > >>>> clientPort/clientPortAddress
> > > > >>> > >>> >> >> > >>>>>>>>> statements
> > > > >>> > >>> >> >> > >>>>>>>>>>> (although if you specify
> > client
> > > > ports
> > > > >>> in
> > > > >>> > the
> > > > >>> > >>> new
> > > > >>> > >>> >> >> format,
> > > > >>> > >>> >> >> > >>>> these
> > > > >>> > >>> >> >> > >>>>>>>>> statements
> > > > >>> > >>> >> >> > >>>>>>>>>>> are now redundant).
> > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>>> Could you please let me know
> > > > about this
> > > > >>> > case.
> > > > >>> > >>> >> >> Appreciate
> > > > >>> > >>> >> >> > >> if
> > > > >>> > >>> >> >> > >>>>>> respond
> > > > >>> > >>> >> >> > >>>>>>>>> soon.
> > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>>> Thanks,
> > > > >>> > >>> >> >> > >>>>>>>>>>> ---------------------
> > > > >>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
> > > > >>> > >>> >> >> > >>>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>>
> > > > >>> > >>> >> >> > >>>>>>>
> > > > >>> > >>> >> >> > >>>>>>
> > > > >>> > >>> >> >> > >>>>>
> > > > >>> > >>> >> >> > >>>>
> > > > >>> > >>> >> >> > >>>
> > > > >>> > >>> >> >> > >>
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >> >
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> ________________________________
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > > > >>> > >>> >> >> This e-mail (including any attachments) is
> > > strictly
> > > > >>> > >>> confidential
> > > > >>> > >>> >> and
> > > > >>> > >>> >> >> may also contain privileged information. If you are
> > > > not the
> > > > >>> > >>> intended
> > > > >>> > >>> >> >> recipient you are not authorised to read, print,
> > > save,
> > > > >>> process or
> > > > >>> > >>> >> disclose
> > > > >>> > >>> >> >> this message. If you have received this message by
> > > > mistake,
> > > > >>> > please
> > > > >>> > >>> >> inform
> > > > >>> > >>> >> >> the sender immediately and destroy this e-mail, its
> > > > >>> attachments
> > > > >>> > >>> and any
> > > > >>> > >>> >> >> copies. Any use, distribution, reproduction or
> > > > disclosure by
> > > > >>> any
> > > > >>> > >>> person
> > > > >>> > >>> >> >> other than the intended recipient is strictly
> > > > prohibited and
> > > > >>> the
> > > > >>> > >>> person
> > > > >>> > >>> >> >> responsible may incur in penalties.
> > > > >>> > >>> >> >> The use of this e-mail is only for professional
> > > > purposes;
> > > > >>> > >>> there is
> > > > >>> > >>> >> no
> > > > >>> > >>> >> >> guarantee that the correspondence towards this
> > e-mail
> > > > will be
> > > > >>> > read
> > > > >>> > >>> >> only by
> > > > >>> > >>> >> >> the recipient, because, under certain
> > circumstances,
> > > > there
> > > > >>> may
> > > > >>> > be a
> > > > >>> > >>> >> need to
> > > > >>> > >>> >> >> access this email by third subjects belonging to
> > the
> > > > Company.
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> ________________________________
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > > > >>> > >>> >> >> This e-mail (including any attachments) is strictly
> > > > >>> confidential
> > > > >>> > >>> and
> > > > >>> > >>> >> may
> > > > >>> > >>> >> >> also contain privileged information. If you are not
> > > the
> > > > >>> intended
> > > > >>> > >>> >> recipient
> > > > >>> > >>> >> >> you are not authorised to read, print, save,
> > process
> > > or
> > > > >>> disclose
> > > > >>> > >>> this
> > > > >>> > >>> >> >> message. If you have received this message by
> > > mistake,
> > > > please
> > > > >>> > >>> inform
> > > > >>> > >>> >> the
> > > > >>> > >>> >> >> sender immediately and destroy this e-mail, its
> > > > attachments
> > > > >>> and
> > > > >>> > any
> > > > >>> > >>> >> copies.
> > > > >>> > >>> >> >> Any use, distribution, reproduction or disclosure
> > by
> > > > any
> > > > >>> person
> > > > >>> > >>> other
> > > > >>> > >>> >> than
> > > > >>> > >>> >> >> the intended recipient is strictly prohibited and
> > the
> > > > person
> > > > >>> > >>> >> responsible
> > > > >>> > >>> >> >> may incur in penalties.
> > > > >>> > >>> >> >> The use of this e-mail is only for professional
> > > > purposes;
> > > > >>> there
> > > > >>> > is
> > > > >>> > >>> no
> > > > >>> > >>> >> >> guarantee that the correspondence towards this
> > e-mail
> > > > will be
> > > > >>> > read
> > > > >>> > >>> >> only by
> > > > >>> > >>> >> >> the recipient, because, under certain
> > circumstances,
> > > > there
> > > > >>> may
> > > > >>> > be a
> > > > >>> > >>> >> need to
> > > > >>> > >>> >> >> access this email by third subjects belonging to
> > the
> > > > Company.
> > > > >>> > >>> >> >>
> > > > >>> > >>> >> >
> > > > >>> > >>> >>
> > > > >>> > >>> >
> > > > >>> > >>>
> > > > >>> > >>
> > > > >>> >
> > > > >>>
> > > > >>
> > > >
> > > >
> > > > ________________________________
> > > >
> > > > CONFIDENTIALITY & PRIVACY NOTICE
> > > > This e-mail (including any attachments) is strictly confidential and
> > may
> > > > also contain privileged information. If you are not the intended
> > > recipient
> > > > you are not authorised to read, print, save, process or disclose this
> > > > message. If you have received this message by mistake, please inform
> > the
> > > > sender immediately and destroy this e-mail, its attachments and any
> > > copies.
> > > > Any use, distribution, reproduction or disclosure by any person other
> > > than
> > > > the intended recipient is strictly prohibited and the person
> > responsible
> > > > may incur in penalties.
> > > > The use of this e-mail is only for professional purposes; there is no
> > > > guarantee that the correspondence towards this e-mail will be read only
> > > by
> > > > the recipient, because, under certain circumstances, there may be a
> > need
> > > to
> > > > access this email by third subjects belonging to the Company.
> > > >
> > >
> >
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Hi,
Yes, My client and server both are using certificate and have added in ZK
and client as well.
Thanks,
---------------------
Kuldeep Singh Budania
On Thu, Oct 8, 2020 at 5:56 PM Enrico Olivelli <eo...@gmail.com> wrote:
> Il giorno gio 8 ott 2020 alle ore 14:17 kuldeep singh <
> kuldeep.singh08@gmail.com> ha scritto:
>
> > Hi Team,
> >
> > I am facing one issue in SSL communication between client and zookeeper
> > server.
> >
> > ZK 3.5.6 version
> >
> > 1. Mi on 3 node
> > 2. Applying SSL and 3 nodes cluster is working fine
> > 3. Scaled my cluster with 2 nodes and now my cluster have 5 nodes over
> SSL
> >
> > but after scaling my SSL is not working between client and ZK server and
> > even not able to login using zkCli as well.
> >
> > Can someone provide the details please why it is happening?
> >
>
> Is your client configured to use SSL ?
>
> Enrico
>
>
>
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> > Software Architect
> >
> >
> >
> > On Mon, Jul 13, 2020 at 2:19 PM Enrico Olivelli - Diennea
> > <en...@diennea.com.invalid> wrote:
> >
> > > It looks like we ported it to 3.5.
> > >
> > > See the subtask
> > > https://issues.apache.org/jira/browse/ZOOKEEPER-2792
> > >
> > > Enrico
> > >
> > > Il giorno 13/07/20, 10:37 "kuldeep singh" <ku...@gmail.com>
> > ha
> > > scritto:
> > >
> > > Hi Team,
> > >
> > > I appreciate it if I will get a response as soon as possible, as I
> am
> > > stuck
> > > at this point.
> > >
> > > Thanks,
> > > ---------------------
> > > Kuldeep Singh Budania
> > >
> > >
> > >
> > > On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <
> > > kuldeep.singh08@gmail.com>
> > > wrote:
> > >
> > > > Hi Team,
> > > >
> > > > Server to Server communication is not supported in 3.5.6 version
> > as
> > > per
> > > > below JIRA issue?
> > > >
> > > > https://issues.apache.org/jira/browse/ZOOKEEPER-2639
> > > >
> > > > Thanks,
> > > > ---------------------
> > > > Kuldeep Singh Budania
> > > >
> > > >
> > > >
> > > > On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <
> > > kuldeep.singh08@gmail.com>
> > > > wrote:
> > > >
> > > >> Thanks for the reply.
> > > >>
> > > >> Now my ZKCli cmd is working fine as we use some our customized
> > > >> authentication and we resolve the issue.
> > > >>
> > > >> Now I am going to implement Server to Server communication.
> > > >>
> > > >> Thanks,
> > > >> ---------------------
> > > >> Kuldeep Singh Budania
> > > >>
> > > >>
> > > >>
> > > >> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
> > > >> szalay.beko.mate@gmail.com> wrote:
> > > >>
> > > >>> I think SSL is working for you already... If you managed to
> start
> > > the
> > > >>> zkCli.sh and be able to connect to ZooKeeper on the secure port
> > > and issue
> > > >>> any kind of command (like: " ls / "), then the wire encryption
> is
> > > working
> > > >>> and your server/client communication is secured by ZooKeeper.
> > > >>>
> > > >>> Why you want to run the following command?
> > > >>> addauth ztpasswd zooadmin:<password>
> > > >>>
> > > >>> Do you also want to configure a superDigest user in ZooKeeper?
> > > Please
> > > >>> note
> > > >>> that this command is independent from SSL. If you need to
> create
> > a
> > > >>> username-password pair for digest authentication then please
> use
> > > the
> > > >>> command in the following way:
> > > >>> addauth digest zooadmin:yourSuperSecretPassword
> > > >>>
> > > >>> Kind regards,
> > > >>> Mate
> > > >>>
> > > >>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <
> > > kuldeep.singh08@gmail.com>
> > > >>> wrote:
> > > >>>
> > > >>> > 1. sh zkCli.sh --config /etc/zookeeper -server localhost:2281
> > > >>> >
> > > >>> > 2. addauth ztpasswd zooadmin:<password>
> > > >>> >
> > > >>> >
> > > >>> > Thanks,
> > > >>> > ---------------------
> > > >>> > Kuldeep Singh Budania
> > > >>> >
> > > >>> >
> > > >>> >
> > > >>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
> > > >>> kuldeep.singh08@gmail.com>
> > > >>> > wrote:
> > > >>> >
> > > >>> > > Hi Team,
> > > >>> > >
> > > >>> > > Any update on this?
> > > >>> > >
> > > >>> > > Thanks,
> > > >>> > > ---------------------
> > > >>> > > Kuldeep Singh Budania
> > > >>> > >
> > > >>> > >
> > > >>> > >
> > > >>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
> > > >>> kuldeep.singh08@gmail.com>
> > > >>> > > wrote:
> > > >>> > >
> > > >>> > >> Sorry this is my bad, there were server setting like below
> > > >>> > >>
> > > >>> > >> export SERVER_JVMFLAGS="
> > > >>> > >>
> > > >>> > >>
> > > >>> > >>
> > > >>> >
> > > >>>
> > >
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > >>> > >>
> > > >>> > >>
> > > >>>
> > > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > > >>> > >>
> > > >>> >
> > > >>>
> > >
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > >>> > >>
> > > >>> > >>
> > > >>> > >>
> > > >>> > >> export CLIENT_JVMFLAGS="
> > > >>> > >>
> > > >>> > >>
> > > >>>
> > > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > >>> > >> -Dzookeeper.client.secure=true
> > > >>> > >>
> > > >>>
> > > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > > >>> > >>
> > > >>> >
> > > >>>
> > >
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > >>> > >>
> > > >>> > >> I want to have SSL between client to server communication
> > > >>> > >>
> > > >>> > >> I am already following the same link which you have shared
> > > with me
> > > >>> but
> > > >>> > >> that is not working.
> > > >>> > >>
> > > >>> > >> Zoo.cfg
> > > >>> > >>
> > > >>> > >> secureClientPort=2281
> > > >>> > >> initLimit=10
> > > >>> > >> syncLimit=5
> > > >>> > >> dataDir=/var/lib/zookeeper/data
> > > >>> > >> tickTime=2000
> > > >>> > >> autopurge.snapRetainCount=3
> > > >>> > >> autopurge.purgeInterval=1
> > > >>> > >> admin.enableServer=false
> > > >>> > >> standaloneEnabled=false
> > > >>> > >> jute.maxbuffer=2147483648
> > > >>> > >>
> > > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > >>> > >> server.1=host1_priv:10288:10388
> > > >>> > >> server.2=host2_priv:10288:10388
> > > >>> > >> server.3=host3_priv:10288:10388
> > > >>> > >>
> > > >>> > >>
> > > >>> > >> command to connect using zkcli
> > > >>> > >>
> > > >>> > >> 1. zkcli zoo.cfg localhost:2281
> > > >>> > >> 2. addauth ztpasswd usernaem:password
> > > >>> > >>
> > > >>> > >> after second step we are getting below error
> > > >>> > >>
> > > >>> > >> WatchedEvent state:AuthFailed type:None path:null
> > > >>> > >>
> > > >>> > >>
> > > >>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > > >>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> > > authentication
> > > >>> > provider
> > > >>> > >> for scheme: ztpasswd has x509 ip digest*
> > > >>> > >>
> > > >>> > >> Thanks,
> > > >>> > >> ---------------------
> > > >>> > >> Kuldeep Singh Budania
> > > >>> > >>
> > > >>> > >>
> > > >>> > >>
> > > >>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
> > > >>> > >> szalay.beko.mate@gmail.com> wrote:
> > > >>> > >>
> > > >>> > >>> > No authentication provider for scheme: ztpasswd has
> x509
> > > ip
> > > >>> digest*
> > > >>> > >>>
> > > >>> > >>> This suggest you have some configuration error... Where
> did
> > > you
> > > >>> use the
> > > >>> > >>> "ztpasswd" string in your configs / commands?
> > > >>> > >>>
> > > >>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
> > > >>> > >>> szalay.beko.mate@gmail.com>
> > > >>> > >>> wrote:
> > > >>> > >>>
> > > >>> > >>> > > My ZK server is up and running in secure mode
> > > >>> > >>> >
> > > >>> > >>> > What is your goal? You want to setup client-server SSL
> > > >>> connection?
> > > >>> > >>> >
> > > >>> > >>> > see:
> > > >>> > >>> >
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
> > > >>> > >>> >
> > > >>> > >>> > (or you want to have both SSL and SASL enabled?)
> > > >>> > >>> >
> > > >>> > >>> > Anyway, please remove the following line from the
> > > >>> SERVER_JVMFLAGS:
> > > >>> > >>> >
> > > >>> >
> > > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > >>> > >>> > This is a configuration that makes sense only for the
> > > ZooKeeper
> > > >>> > client,
> > > >>> > >>> > not for the server. For the server, use the following:
> > > >>> > >>> >
> > > >>> > >>> >
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > >>> > >>> >
> > > >>> > >>> > If it doesn't solve the issue, then can you please send
> > > your
> > > >>> zoo.cfg
> > > >>> > >>> file?
> > > >>> > >>> > Also can you please send the zkCli command you execute?
> > > (you
> > > >>> need to
> > > >>> > >>> > connect to the secure ZooKeeper port, unless
> > > portUnification is
> > > >>> > >>> enabled)
> > > >>> > >>> >
> > > >>> > >>> > Kind regards,
> > > >>> > >>> > Mate
> > > >>> > >>> >
> > > >>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
> > > >>> > >>> kuldeep.singh08@gmail.com>
> > > >>> > >>> > wrote:
> > > >>> > >>> >
> > > >>> > >>> >> Hi,
> > > >>> > >>> >>
> > > >>> > >>> >> we have done below changes in java.env file
> > > >>> > >>> >>
> > > >>> > >>> >> export SERVER_JVMFLAGS="
> > > >>> > >>> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>>
> > > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > >>> > >>> >>
> > > >>> >
> > > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > >>> > >>> >>
> > > >>> > >>> >>
> > > >>> > >>> >>
> > > >>> > >>> >> export CLIENT_JVMFLAGS="
> > > >>> > >>> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>>
> > > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > > >>> > >>> >> -Dzookeeper.client.secure=true
> > > >>> > >>> >>
> > > >>> >
> > > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> > > >>> > >>> >>
> > > >>> > >>> >> I have started the ZK server and it is up without any
> > > issue.
> > > >>> > >>> >>
> > > >>> > >>> >> But now when I login to ZkCli then it gives the below
> > > error.
> > > >>> > >>> >>
> > > >>> > >>> >> WatchedEvent state:AuthFailed type:None path:null
> > > >>> > >>> >>
> > > >>> > >>> >>
> > > >>> > >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > > >>> > >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> > > >>> authentication
> > > >>> > >>> provider
> > > >>> > >>> >> for scheme: ztpasswd has x509 ip digest*
> > > >>> > >>> >>
> > > >>> > >>> >> Please help me on this issue
> > > >>> > >>> >>
> > > >>> > >>> >> Thanks,
> > > >>> > >>> >> ---------------------
> > > >>> > >>> >> Kuldeep Singh Budania
> > > >>> > >>> >> Software Architect
> > > >>> > >>> >>
> > > >>> > >>> >>
> > > >>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
> > > >>> > >>> kuldeep.singh08@gmail.com>
> > > >>> > >>> >> wrote:
> > > >>> > >>> >>
> > > >>> > >>> >> > Hi,
> > > >>> > >>> >> >
> > > >>> > >>> >> > My ZK server is up and running in secure mode, But
> > > When I am
> > > >>> > >>> trying to
> > > >>> > >>> >> > connect to the ZK server using ZKCli, it gives the
> > below
> > > >>> error.
> > > >>> > >>> >> >
> > > >>> > >>> >> > WatchedEvent state:AuthFailed type:None path:null
> > > >>> > >>> >> >
> > > >>> > >>> >> >
> > > >>> > >>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > > >>> > >>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> > > >>> authentication
> > > >>> > >>> >> provider
> > > >>> > >>> >> > for scheme: ztpasswd has x509 ip digest*
> > > >>> > >>> >> >
> > > >>> > >>> >> > Can someone please help me on this issue. we are
> using
> > > the
> > > >>> 3.5.6
> > > >>> > >>> >> version.
> > > >>> > >>> >> >
> > > >>> > >>> >> > I appreciate if I will get a response as soon as
> > > possible, as
> > > >>> I am
> > > >>> > >>> stuck
> > > >>> > >>> >> > at this point.
> > > >>> > >>> >> >
> > > >>> > >>> >> > Thanks,
> > > >>> > >>> >> > ---------------------
> > > >>> > >>> >> > Kuldeep Singh Budania
> > > >>> > >>> >> > Software Architect
> > > >>> > >>> >> >
> > > >>> > >>> >> >
> > > >>> > >>> >> >
> > > >>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli -
> > > Diennea
> > > >>> > >>> >> > <en...@diennea.com.invalid> wrote:
> > > >>> > >>> >> >
> > > >>> > >>> >> >> I mean in zoo.cfg
> > > >>> > >>> >> >> Not as a system property
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> Enrico
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli -
> > Diennea" <
> > > >>> > >>> >> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> Hi
> > > >>> > >>> >> >> You have to enable Netty on the server side
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> Something like:
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> >
> > > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> Hope that helps
> > > >>> > >>> >> >> Enrico
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
> > > >>> > >>> >> kuldeep.singh08@gmail.com>
> > > >>> > >>> >> >> ha scritto:
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> Hi,
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> I got below error while setting SSL
> > properties
> > > in
> > > >>> > zkEnv.sh
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> ==========================================================================================
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
> > > >>> > [main:QuorumPeerConfig@133]
> > > >>> > >>> -
> > > >>> > >>> >> >> Reading
> > > >>> > >>> >> >> configuration from: /etc/zookeeper/zoo.cfg
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> > > >>> > [main:QuorumPeerConfig@385]
> > > >>> > >>> -
> > > >>> > >>> >> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> > > >>> > [main:QuorumPeerConfig@399]
> > > >>> > >>> -
> > > >>> > >>> >> >> secureClientPortAddress is
> > > 0.0.0.0/0.0.0.0:2281
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,878 - INFO
> > > [main:X509Util@79] -
> > > >>> > >>> Setting
> > > >>> > >>> >> -D
> > > >>> > >>> >> >>
> > > jdk.tls.rejectClientInitiatedRenegotiation=true to
> > > >>> > disable
> > > >>> > >>> >> >> client-initiated
> > > >>> > >>> >> >> TLS renegotiation
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> > > >>> > >>> [main:DatadirCleanupManager@78]
> > > >>> > >>> >> -
> > > >>> > >>> >> >> autopurge.snapRetainCount set to 3
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> > > >>> > >>> [main:DatadirCleanupManager@79]
> > > >>> > >>> >> -
> > > >>> > >>> >> >> autopurge.purgeInterval set to 1
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,898 - INFO [
> > > >>> > >>> >> >>
> PurgeTask:DatadirCleanupManager$PurgeTask@138
> > ]
> > > -
> > > >>> Purge
> > > >>> > >>> task
> > > >>> > >>> >> >> started.
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,899 - INFO
> > > [main:ManagedUtil@46]
> > > >>> -
> > > >>> > >>> Log4j
> > > >>> > >>> >> >> found with
> > > >>> > >>> >> >> jmx enabled.
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
> > > >>> > >>> [PurgeTask:FileTxnSnapLog@103]
> > > >>> > >>> >> -
> > > >>> > >>> >> >> zookeeper.snapshot.trust.empty : false
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,910 - INFO [
> > > >>> > >>> >> >>
> PurgeTask:DatadirCleanupManager$PurgeTask@144
> > ]
> > > -
> > > >>> Purge
> > > >>> > >>> task
> > > >>> > >>> >> >> completed.
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
> > > >>> [main:QuorumPeerMain@141
> > > >>> > ]
> > > >>> > >>> -
> > > >>> > >>> >> >> Starting quorum
> > > >>> > >>> >> >> peer
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
> > > >>> > [main:ServerCnxnFactory@135]
> > > >>> > >>> -
> > > >>> > >>> >> >> Using
> > > >>> > >>> >> >>
> > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > > >>> > server
> > > >>> > >>> >> >> connection
> > > >>> > >>> >> >> factory
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
> > > >>> > >>> [main:NIOServerCnxnFactory@673]
> > > >>> > >>> >> -
> > > >>> > >>> >> >> Configuring NIO connection handler with 10s
> > > >>> sessionless
> > > >>> > >>> >> >> connection timeout,
> > > >>> > >>> >> >> 2 selector thread(s), 16 worker threads,
> and
> > > 64 kB
> > > >>> direct
> > > >>> > >>> >> buffers.
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
> > > >>> > >>> [main:NIOServerCnxnFactory@686
> > > >>> > >>> >> ]
> > > >>> > >>> >> >> - binding
> > > >>> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
> > > >>> > [main:ServerCnxnFactory@135]
> > > >>> > >>> -
> > > >>> > >>> >> >> Using
> > > >>> > >>> >> >>
> > > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > > >>> > server
> > > >>> > >>> >> >> connection
> > > >>> > >>> >> >> factory
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
> > > >>> [main:QuorumPeerMain@101
> > > >>> > ]
> > > >>> > >>> -
> > > >>> > >>> >> >> Unexpected
> > > >>> > >>> >> >> exception, exiting abnormally
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> java.lang.UnsupportedOperationException:
> SSL
> > > isn't
> > > >>> > >>> supported in
> > > >>> > >>> >> >> NIOServerCnxn
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> at
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> at
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> at
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> at
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> I have set the following properties in
> > > >>> SERVER_JVMFLAGS in
> > > >>> > >>> >> >> zkEnv.sh file :
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> > > >>> > >>> >> >>
> > > -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> > > >>> > >>> >> >>
> > > -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> Thanks,
> > > >>> > >>> >> >> ---------------------
> > > >>> > >>> >> >> Kuldeep Singh Budania
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan
> > > Zimmerman <
> > > >>> > >>> >> >> jordan@jordanzimmerman.com>
> > > >>> > >>> >> >> wrote:
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> > It's the same as the normal ZooKeeper
> > client:
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > > >>> > >>> >> >> > <
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > > >>> > >>> >> >> > >
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >> > -Jordan
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep
> > singh
> > > <
> > > >>> > >>> >> >> kuldeep.singh08@gmail.com>
> > > >>> > >>> >> >> > wrote:
> > > >>> > >>> >> >> > >
> > > >>> > >>> >> >> > > Hi Team,
> > > >>> > >>> >> >> > > How we will do secure communication
> > > between the
> > > >>> > Curator
> > > >>> > >>> >> >> framework and
> > > >>> > >>> >> >> > > zookeeper 3.5.6 ?
> > > >>> > >>> >> >> > > I didn't get any solution right now.
> > > >>> > >>> >> >> > > I appreciate it if someone could help
> me
> > > with the
> > > >>> > same.
> > > >>> > >>> >> >> > >
> > > >>> > >>> >> >> > > Thanks,
> > > >>> > >>> >> >> > > ---------------------
> > > >>> > >>> >> >> > > Kuldeep Singh Budania
> > > >>> > >>> >> >> > > Software Architect
> > > >>> > >>> >> >> > >
> > > >>> > >>> >> >> > >
> > > >>> > >>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM
> > > Szalay-Bekő Máté
> > > >>> <
> > > >>> > >>> >> >> > szalay.beko.mate@gmail.com>
> > > >>> > >>> >> >> > > wrote:
> > > >>> > >>> >> >> > >
> > > >>> > >>> >> >> > >> Hello Kuldeep,
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> > >> did you download the source from the
> > > ZooKeeper
> > > >>> > >>> webpage, or
> > > >>> > >>> >> >> checked out
> > > >>> > >>> >> >> > from
> > > >>> > >>> >> >> > >> git?
> > > >>> > >>> >> >> > >> Anyway, the following commands should
> > > work:
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> > >> wget
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> > > >>> > >>> >> >> > >> tar xzvf
> ./apache-zookeeper-3.5.7.tar.gz
> > > >>> > >>> >> >> > >> cd apache-zookeeper-3.5.7
> > > >>> > >>> >> >> > >> mvn clean install -DskipTests
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> > >> I tested it with OpenJDK 8u424 and
> maven
> > > 3.6.0.
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> > >> Kind regards,
> > > >>> > >>> >> >> > >> Mate
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM
> kuldeep
> > > singh <
> > > >>> > >>> >> >> > kuldeep.singh08@gmail.com>
> > > >>> > >>> >> >> > >> wrote:
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> > >>> Hi All,
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>> I have download the zookeeper source
> > > code and
> > > >>> run
> > > >>> > >>> the mvn
> > > >>> > >>> >> >> command for
> > > >>> > >>> >> >> > >>> packaging but get problem on
> > > "zookeeper-server"
> > > >>> > >>> >> directory.
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>> *command :- mvn clean package*
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>> [ERROR] Failed to execute goal
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >>
> > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > > >>> > >>> >> >> > >>> (default-compile) on project
> zookeeper:
> > > Fatal
> > > >>> error
> > > >>> > >>> >> >> compiling:
> > > >>> > >>> >> >> > >>> java.lang.NullPointerException ->
> [Help
> > > 1]
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> org.apache.maven.lifecycle.LifecycleExecutionException:
> > > >>> > >>> >> >> Failed to
> > > >>> > >>> >> >> > execute
> > > >>> > >>> >> >> > >>> goal
> > > >>> > >>> >> >>
> > > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > > >>> > >>> >> >> > >>> (default-compile) on project
> zookeeper:
> > > Fatal
> > > >>> error
> > > >>> > >>> >> >> compiling
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> >
> > > >>> > >>> >>
> > > org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >>
> > > org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >>
> > > org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >>
> > org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >>
> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > > Method)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> java.lang.reflect.Method.invoke(Method.java:498)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> > > >>> > >>> >> >> > >>> Caused by:
> > > >>> > >>> >> org.apache.maven.plugin.MojoExecutionException:
> > > >>> > >>> >> >> Fatal error
> > > >>> > >>> >> >> > >>> compiling
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> > > >>> > >>> >> >> > >>> ... 19 more
> > > >>> > >>> >> >> > >>> Caused by:
> > > >>> > >>> >> org.codehaus.plexus.compiler.CompilerException:
> > > >>> > >>> >> >> > >>> java.lang.NullPointerException
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> > > >>> > >>> >> >> > >>> ... 22 more
> > > >>> > >>> >> >> > >>> Caused by:
> java.lang.RuntimeException:
> > > >>> > >>> >> >> java.lang.NullPointerException
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >>
> com.sun.tools.javac.main.Main.compile(Main.java:559)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> > >>>
> > > >>>
> > > com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> >
> > > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> > > >>> > >>> >> >> > >>> ... 24 more
> > > >>> > >>> >> >> > >>> Caused by:
> > java.lang.NullPointerException
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >>
> com.sun.tools.doclint.Checker.scan(Checker.java:144)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >>
> > > com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> > >>>
> > > >>>
> > > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> > >>>
> > > >>>
> > > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> >
> > > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> >
> > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> >
> > > com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> >
> > > com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> >
> > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> >
> > > com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> > >>>
> > > >>>
> > > com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> >
> > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >>
> > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> >
> > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >>
> > > >>>
> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> > >>>
> > > >>>
> > > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> > >>>
> > > >>>
> > > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> >
> > > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >>
> > > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> >
> > > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >>
> > > com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> > >>>
> > > >>>
> > > com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> > >>>
> > > >>>
> > > com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> > >>>
> > > >>>
> > > com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> > > >>> > >>> >> >> > >>> at
> > > >>> > >>> >> >>
> com.sun.tools.javac.main.Main.compile(Main.java:523)
> > > >>> > >>> >> >> > >>> ... 27 more
> > > >>> > >>> >> >> > >>> [ERROR]
> > > >>> > >>> >> >> > >>> [ERROR] Re-run Maven using the -X
> > switch
> > > to
> > > >>> enable
> > > >>> > >>> full
> > > >>> > >>> >> >> debug logging.
> > > >>> > >>> >> >> > >>> [ERROR]
> > > >>> > >>> >> >> > >>> [ERROR] For more information about
> the
> > > errors
> > > >>> and
> > > >>> > >>> >> possible
> > > >>> > >>> >> >> solutions,
> > > >>> > >>> >> >> > >>> please read the following articles:
> > > >>> > >>> >> >> > >>> [ERROR] [Help 1]
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>> Can someone help me on this issue?
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>> Thanks,
> > > >>> > >>> >> >> > >>> ---------------------
> > > >>> > >>> >> >> > >>> Kuldeep Singh Budania
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM
> > > Szalay-Bekő
> > > >>> Máté <
> > > >>> > >>> >> >> > >>> szalay.beko.mate@gmail.com>
> > > >>> > >>> >> >> > >>> wrote:
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>>> these exceptions can mean many
> > > things... I
> > > >>> think
> > > >>> > >>> this
> > > >>> > >>> >> can
> > > >>> > >>> >> >> be even
> > > >>> > >>> >> >> > >> normal
> > > >>> > >>> >> >> > >>>> duding rolling restart (as some
> > > connections
> > > >>> get
> > > >>> > >>> broken
> > > >>> > >>> >> in
> > > >>> > >>> >> >> this case)
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>> However, I saw cases already when
> > > exceptions
> > > >>> like
> > > >>> > >>> these
> > > >>> > >>> >> >> killed
> > > >>> > >>> >> >> > receiver
> > > >>> > >>> >> >> > >>> or
> > > >>> > >>> >> >> > >>>> sender threads in QuorumCnxManager /
> > > Leader
> > > >>> > >>> Election in
> > > >>> > >>> >> >> such a way
> > > >>> > >>> >> >> > that
> > > >>> > >>> >> >> > >>>> they were not able to recover, so
> the
> > > node was
> > > >>> > >>> unable to
> > > >>> > >>> >> >> connect to
> > > >>> > >>> >> >> > any
> > > >>> > >>> >> >> > >>>> quorum until restart. I remember
> > seeing
> > > this
> > > >>> in
> > > >>> > 3.4
> > > >>> > >>> too.
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>> Do you see these exceptions in the
> > > second
> > > >>> server
> > > >>> > >>> (the
> > > >>> > >>> >> one
> > > >>> > >>> >> >> which you
> > > >>> > >>> >> >> > >> just
> > > >>> > >>> >> >> > >>>> upgraded in step 3)?
> > > >>> > >>> >> >> > >>>> Is this issue reproducible?
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>> What is the tickTime and initLimit
> you
> > > use?
> > > >>> Maybe
> > > >>> > >>> the
> > > >>> > >>> >> >> server just
> > > >>> > >>> >> >> > >> require
> > > >>> > >>> >> >> > >>>> more time to sync?
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>> I would need more logs to really see
> > > what
> > > >>> > happened.
> > > >>> > >>> Can
> > > >>> > >>> >> >> you create a
> > > >>> > >>> >> >> > >> Jira
> > > >>> > >>> >> >> > >>>> issue and upload the logs and also
> the
> > > >>> ZooKeeper
> > > >>> > >>> >> configs?
> > > >>> > >>> >> >> I am happy
> > > >>> > >>> >> >> > to
> > > >>> > >>> >> >> > >>>> take a closer look.
> > > >>> > >>> >> >> > >>>> (if you need to re-run the test to
> > > collect the
> > > >>> > logs,
> > > >>> > >>> >> then
> > > >>> > >>> >> >> enabling
> > > >>> > >>> >> >> > >> DEBUG
> > > >>> > >>> >> >> > >>>> logs would be great. The INFO level
> > > logs are
> > > >>> > usually
> > > >>> > >>> >> >> enough for these
> > > >>> > >>> >> >> > >>>> problems, but one can never know...)
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>> Kind regards,
> > > >>> > >>> >> >> > >>>> Mate
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM
> > kuldeep
> > > singh
> > > >>> <
> > > >>> > >>> >> >> > >> kuldeep.singh08@gmail.com
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>> wrote:
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>>> Hi Team,
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> I have done some POC on rolling
> > > upgrade and
> > > >>> found
> > > >>> > >>> below
> > > >>> > >>> >> >> result.
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> 1. On 1st node upgrade zookeeper
> .
> > > Traffic
> > > >>> was
> > > >>> > >>> >> running
> > > >>> > >>> >> >> fine
> > > >>> > >>> >> >> > >> because
> > > >>> > >>> >> >> > >>> 2
> > > >>> > >>> >> >> > >>>>> nodes are already on old
> zookeeper.
> > > >>> > >>> >> >> > >>>>> 2. On 1st node upgrade our
> > > application and
> > > >>> > didn’t
> > > >>> > >>> >> find
> > > >>> > >>> >> >> any issue
> > > >>> > >>> >> >> > >>>>> 3. On 2nd node upgrade zookeeper
> > but
> > > got
> > > >>> below
> > > >>> > >>> error
> > > >>> > >>> >> >> and zookeeper
> > > >>> > >>> >> >> > >>> is
> > > >>> > >>> >> >> > >>>>> not taking any requests
> > > >>> > >>> >> >> > >>>>> 4.
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> java.io.EOFException
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> at
> > > >>> > >>> >> >>
> > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> at
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
> > > >>> > >>> >> >> > >>>>>
> > > [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
> > > >>> -
> > > >>> > >>> >> >> Interrupting
> > > >>> > >>> >> >> > >>> SendWorker
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR
> > > >>> [LearnerHandler-/
> > > >>> > >>> >> >> 192.168.44.73:33754
> > > >>> > >>> >> >> > >>>>> :LearnerHandler@562] - Unexpected
> > > exception
> > > >>> > >>> causing
> > > >>> > >>> >> >> shutdown while
> > > >>> > >>> >> >> > >>> sock
> > > >>> > >>> >> >> > >>>>> still open
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> java.io.EOFException
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> at
> > > >>> > >>> >> >>
> > > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> at
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >>
> > > >>> > >>>
> > > >>>
> > > org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> at
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> at
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> at
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >>
> > > >>> > >>>
> > > >>> >
> > > >>>
> > >
> >
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
> > > >>> > >>> >> >> > >>>>>
> > > [SendWorker:1:QuorumCnxManager$SendWorker@679]
> > > >>> -
> > > >>> > >>> >> >> Interrupted while
> > > >>> > >>> >> >> > >>>> waiting
> > > >>> > >>> >> >> > >>>>> for message on queue
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> Please let me know is this the
> known
> > > issue or
> > > >>> > this
> > > >>> > >>> is
> > > >>> > >>> >> >> different issue
> > > >>> > >>> >> >> > >>>> which
> > > >>> > >>> >> >> > >>>>> is mention in Apache zookeeper
> > > documentation
> > > >>> when
> > > >>> > >>> >> >> upgrading from
> > > >>> > >>> >> >> > >> 3.4.5
> > > >>> > >>> >> >> > >>> to
> > > >>> > >>> >> >> > >>>>> 3.5.6
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> Thanks,
> > > >>> > >>> >> >> > >>>>> ---------------------
> > > >>> > >>> >> >> > >>>>> Kuldeep Singh Budania
> > > >>> > >>> >> >> > >>>>> Software Architect
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM
> > > Alexander
> > > >>> Shraer
> > > >>> > <
> > > >>> > >>> >> >> shralex@gmail.com>
> > > >>> > >>> >> >> > >>>>> wrote:
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>>> +1 to what Mate said (I wrote the
> > > quoted
> > > >>> > >>> >> instructions).
> > > >>> > >>> >> >> > >>>>>>
> > > >>> > >>> >> >> > >>>>>>
> > > >>> > >>> >> >> > >>>>>>
> > > >>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM
> > > Szalay-Bekő
> > > >>> > Máté <
> > > >>> > >>> >> >> > >>>>>> szalay.beko.mate@gmail.com>
> > > >>> > >>> >> >> > >>>>>> wrote:
> > > >>> > >>> >> >> > >>>>>>
> > > >>> > >>> >> >> > >>>>>>> Hi Kuldeep,
> > > >>> > >>> >> >> > >>>>>>>
> > > >>> > >>> >> >> > >>>>>>> I just want to provide you some
> > > background
> > > >>> info
> > > >>> > >>> about
> > > >>> > >>> >> >> our
> > > >>> > >>> >> >> > >>>>> documentation.
> > > >>> > >>> >> >> > >>>>>>> The reason to upgrade to 3.4.6
> > first
> > > is to
> > > >>> > avoid
> > > >>> > >>> the
> > > >>> > >>> >> >> following
> > > >>> > >>> >> >> > >>> error:
> > > >>> > >>> >> >> > >>>>>>>
> > > >>> > >>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663
> [myid:2] -
> > > WARN
> > > >>> > >>> [localhost/
> > > >>> > >>> >> >> > >>> 127.0.0.1:2784
> > > >>> > >>> >> >> > >>>>>>> :QuorumCnxManager@349] - Invalid
> > > server
> > > >>> id:
> > > >>> > >>> -65536
> > > >>> > >>> >> >> > >>>>>>>
> > > >>> > >>> >> >> > >>>>>>> This error comes because of the
> > > protocol
> > > >>> > changes
> > > >>> > >>> >> between
> > > >>> > >>> >> >> > >> ZooKeeper
> > > >>> > >>> >> >> > >>>>> server
> > > >>> > >>> >> >> > >>>>>>> nodes during connection
> initiation
> > > for
> > > >>> leader
> > > >>> > >>> >> election.
> > > >>> > >>> >> >> In
> > > >>> > >>> >> >> > >>> ZooKeeper
> > > >>> > >>> >> >> > >>>>> 3.5
> > > >>> > >>> >> >> > >>>>>> a
> > > >>> > >>> >> >> > >>>>>>> protocol version was introduced
> > (see
> > > >>> > >>> ZOOKEEPER-107)
> > > >>> > >>> >> and
> > > >>> > >>> >> >> since
> > > >>> > >>> >> >> > >> that
> > > >>> > >>> >> >> > >>>> time
> > > >>> > >>> >> >> > >>>>>> the
> > > >>> > >>> >> >> > >>>>>>> fist long value sent in the
> initial
> > > >>> message is
> > > >>> > >>> not
> > > >>> > >>> >> the
> > > >>> > >>> >> >> server ID
> > > >>> > >>> >> >> > >>> but
> > > >>> > >>> >> >> > >>>>> the
> > > >>> > >>> >> >> > >>>>>>> protocol version (-65536). In
> > > ZooKeeper
> > > >>> 3.4.6
> > > >>> > we
> > > >>> > >>> made
> > > >>> > >>> >> >> the old 3.4
> > > >>> > >>> >> >> > >>>>>>> ZooKeepers backward compatible,
> so
> > > they are
> > > >>> > able
> > > >>> > >>> to
> > > >>> > >>> >> >> parse both
> > > >>> > >>> >> >> > >> the
> > > >>> > >>> >> >> > >>>> old
> > > >>> > >>> >> >> > >>>>>> and
> > > >>> > >>> >> >> > >>>>>>> the new protocol format (see
> > > >>> ZOOKEEPER-1633).
> > > >>> > >>> This
> > > >>> > >>> >> >> issue happens
> > > >>> > >>> >> >> > >>> only
> > > >>> > >>> >> >> > >>>>>> when
> > > >>> > >>> >> >> > >>>>>>> you need to use old (3.4.0 -
> 3.4.5)
> > > and new
> > > >>> > >>> (3.5.0+)
> > > >>> > >>> >> >> ZooKeeper
> > > >>> > >>> >> >> > >>>> servers
> > > >>> > >>> >> >> > >>>>>>> together in the same cluster.
> > During
> > > a
> > > >>> rolling
> > > >>> > >>> >> upgrade,
> > > >>> > >>> >> >> this is
> > > >>> > >>> >> >> > >>>> usually
> > > >>> > >>> >> >> > >>>>>> the
> > > >>> > >>> >> >> > >>>>>>> case to have old and new
> ZooKeepers
> > > present
> > > >>> > >>> together.
> > > >>> > >>> >> >> > >>>>>>>
> > > >>> > >>> >> >> > >>>>>>> The fact that you haven't seen
> any
> > > issues
> > > >>> might
> > > >>> > >>> be
> > > >>> > >>> >> >> caused by the
> > > >>> > >>> >> >> > >>>> order
> > > >>> > >>> >> >> > >>>>> of
> > > >>> > >>> >> >> > >>>>>>> the servers. In ZooKeeper the
> > > connection
> > > >>> > >>> initiation
> > > >>> > >>> >> >> between the
> > > >>> > >>> >> >> > >>>> servers
> > > >>> > >>> >> >> > >>>>>>> during the leader election
> follows
> > a
> > > >>> specific
> > > >>> > >>> rule.
> > > >>> > >>> >> As
> > > >>> > >>> >> >> far as I
> > > >>> > >>> >> >> > >>>>> remember
> > > >>> > >>> >> >> > >>>>>>> always the server with the larger
> > ID
> > > 'wins
> > > >>> the
> > > >>> > >>> >> >> challenge', so it
> > > >>> > >>> >> >> > >> is
> > > >>> > >>> >> >> > >>>>>>> possible, that the old server
> > didn't
> > > need
> > > >>> to
> > > >>> > >>> parse
> > > >>> > >>> >> any
> > > >>> > >>> >> >> initial
> > > >>> > >>> >> >> > >>>> message
> > > >>> > >>> >> >> > >>>>>> (if
> > > >>> > >>> >> >> > >>>>>>> it had the largest ID) and this
> is
> > > why you
> > > >>> > >>> haven't
> > > >>> > >>> >> seen
> > > >>> > >>> >> >> the
> > > >>> > >>> >> >> > >> issue.
> > > >>> > >>> >> >> > >>>> Also
> > > >>> > >>> >> >> > >>>>>>> having 2 nodes up from the 3
> nodes
> > > cluster
> > > >>> > still
> > > >>> > >>> >> makes
> > > >>> > >>> >> >> the
> > > >>> > >>> >> >> > >> cluster
> > > >>> > >>> >> >> > >>>> work
> > > >>> > >>> >> >> > >>>>>> (so
> > > >>> > >>> >> >> > >>>>>>> you should also check if all the
> > > servers
> > > >>> are
> > > >>> > >>> part of
> > > >>> > >>> >> >> the quorum).
> > > >>> > >>> >> >> > >>>>>>>
> > > >>> > >>> >> >> > >>>>>>> I agree with Enrico and Norbert,
> > the
> > > >>> safest and
> > > >>> > >>> most
> > > >>> > >>> >> >> stable way
> > > >>> > >>> >> >> > >> is
> > > >>> > >>> >> >> > >>>>>> upgrade
> > > >>> > >>> >> >> > >>>>>>> first to 3.4.latest, then go to
> > > 3.5.latest.
> > > >>> > >>> Still, if
> > > >>> > >>> >> >> you don't
> > > >>> > >>> >> >> > >> see
> > > >>> > >>> >> >> > >>>>> that
> > > >>> > >>> >> >> > >>>>>>> you would hit this specific issue
> > > (e.g. no
> > > >>> > >>> "Invalid
> > > >>> > >>> >> >> server id" in
> > > >>> > >>> >> >> > >>> the
> > > >>> > >>> >> >> > >>>>> log
> > > >>> > >>> >> >> > >>>>>>> files), and all the three servers
> > can
> > > >>> handle
> > > >>> > >>> traffic,
> > > >>> > >>> >> >> then maybe
> > > >>> > >>> >> >> > >>> you
> > > >>> > >>> >> >> > >>>>>> don't
> > > >>> > >>> >> >> > >>>>>>> need to upgrade first to
> > 3.4.latest,
> > > it is
> > > >>> your
> > > >>> > >>> >> >> decision.
> > > >>> > >>> >> >> > >>> Definitely
> > > >>> > >>> >> >> > >>>>> you
> > > >>> > >>> >> >> > >>>>>>> should test it first, as
> suggested
> > > by the
> > > >>> > others.
> > > >>> > >>> >> >> > >>>>>>>
> > > >>> > >>> >> >> > >>>>>>> Kind regards,
> > > >>> > >>> >> >> > >>>>>>> Mate
> > > >>> > >>> >> >> > >>>>>>>
> > > >>> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM
> > > Norbert
> > > >>> Kalmar
> > > >>> > >>> >> >> > >>>>>>> <nk...@cloudera.com.invalid>
> > > wrote:
> > > >>> > >>> >> >> > >>>>>>>
> > > >>> > >>> >> >> > >>>>>>>> Hi,
> > > >>> > >>> >> >> > >>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>> That guide is to upgrade to
> 3.5.0,
> > > which
> > > >>> was
> > > >>> > an
> > > >>> > >>> >> alpha
> > > >>> > >>> >> >> version.
> > > >>> > >>> >> >> > >> A
> > > >>> > >>> >> >> > >>>> lot
> > > >>> > >>> >> >> > >>>>>> has
> > > >>> > >>> >> >> > >>>>>>>> changed for the first stable
> > > release of
> > > >>> 3.5.5
> > > >>> > >>> and
> > > >>> > >>> >> then
> > > >>> > >>> >> >> a few
> > > >>> > >>> >> >> > >>> more,
> > > >>> > >>> >> >> > >>>>> even
> > > >>> > >>> >> >> > >>>>>>>> rolling upgrade issues have been
> > > fixed for
> > > >>> > >>> 3.5.6.
> > > >>> > >>> >> >> > >>>>>>>> This is a more up-to-date guide:
> > > >>> > >>> >> >> > >>>>>>>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >>
> > > >>> >
> > > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> > > >>> > >>> >> >> > >>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>> If you have done your testing
> > (with
> > > prod
> > > >>> > >>> snapshot!),
> > > >>> > >>> >> >> then you
> > > >>> > >>> >> >> > >> can
> > > >>> > >>> >> >> > >>>>> skip
> > > >>> > >>> >> >> > >>>>>>> 3.4
> > > >>> > >>> >> >> > >>>>>>>> latest upgrade, but keep in mind
> > we
> > > do our
> > > >>> > >>> >> >> recommendations for
> > > >>> > >>> >> >> > >> a
> > > >>> > >>> >> >> > >>>>>> reason.
> > > >>> > >>> >> >> > >>>>>>>> There were issues reported
> and/or
> > > found
> > > >>> during
> > > >>> > >>> >> >> testing. Some
> > > >>> > >>> >> >> > >> are
> > > >>> > >>> >> >> > >>>>> fixed
> > > >>> > >>> >> >> > >>>>>>> with
> > > >>> > >>> >> >> > >>>>>>>> 3.5.6, some only happens if
> > certain
> > > >>> conditions
> > > >>> > >>> stand
> > > >>> > >>> >> >> > >>> (IOException:
> > > >>> > >>> >> >> > >>>> No
> > > >>> > >>> >> >> > >>>>>>>> snapshot found - mentioned in
> the
> > > guide,
> > > >>> fixed
> > > >>> > >>> in
> > > >>> > >>> >> >> 3.5.6).
> > > >>> > >>> >> >> > >>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>> So it is up to you, I would
> still
> > > >>> recommend to
> > > >>> > >>> do an
> > > >>> > >>> >> >> 3.4
> > > >>> > >>> >> >> > >> upgrade
> > > >>> > >>> >> >> > >>>>> first,
> > > >>> > >>> >> >> > >>>>>>> if
> > > >>> > >>> >> >> > >>>>>>>> it's feasible.
> > > >>> > >>> >> >> > >>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>> Regards,
> > > >>> > >>> >> >> > >>>>>>>> Norbert
> > > >>> > >>> >> >> > >>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM
> > > kuldeep
> > > >>> > singh <
> > > >>> > >>> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
> > > >>> > >>> >> >> > >>>>>>>> wrote:
> > > >>> > >>> >> >> > >>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>> Hi,
> > > >>> > >>> >> >> > >>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>> Current Zookeeper version :-
> > 3.4.5
> > > >>> > >>> >> >> > >>>>>>>>> Upgraded version
> > :-
> > > 3.5.6
> > > >>> > >>> >> >> > >>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>> We are not going with 3.5.7.
> Our
> > > final
> > > >>> > >>> decision is
> > > >>> > >>> >> >> zookeeper
> > > >>> > >>> >> >> > >>>>> version
> > > >>> > >>> >> >> > >>>>>> is
> > > >>> > >>> >> >> > >>>>>>>>> 3.5.6
> > > >>> > >>> >> >> > >>>>>>>>> as per your reply first we need
> > to
> > > move
> > > >>> > latest
> > > >>> > >>> >> >> version of
> > > >>> > >>> >> >> > >>> 3.4.x,
> > > >>> > >>> >> >> > >>>>> like
> > > >>> > >>> >> >> > >>>>>>>> below
> > > >>> > >>> >> >> > >>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6
> (Correct
> > > me if
> > > >>> I am
> > > >>> > >>> wrong
> > > >>> > >>> >> >> here)
> > > >>> > >>> >> >> > >>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>> But if We are not facing any
> > > problem
> > > >>> that i
> > > >>> > >>> have
> > > >>> > >>> >> >> shared you
> > > >>> > >>> >> >> > >>> that
> > > >>> > >>> >> >> > >>>> we
> > > >>> > >>> >> >> > >>>>>>> have
> > > >>> > >>> >> >> > >>>>>>>>> set up of 3 node cluster where
> 2
> > > node
> > > >>> are on
> > > >>> > >>> 3.5.6
> > > >>> > >>> >> >> version
> > > >>> > >>> >> >> > >> and
> > > >>> > >>> >> >> > >>> 1
> > > >>> > >>> >> >> > >>>>> node
> > > >>> > >>> >> >> > >>>>>>> on
> > > >>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything is running
> fine
> > > and
> > > >>> didn't
> > > >>> > >>> get
> > > >>> > >>> >> any
> > > >>> > >>> >> >> issue,
> > > >>> > >>> >> >> > >> So
> > > >>> > >>> >> >> > >>>> what
> > > >>> > >>> >> >> > >>>>>>> other
> > > >>> > >>> >> >> > >>>>>>>>> problem we can face if we
> > directly
> > > move
> > > >>> to
> > > >>> > >>> 3.5.6
> > > >>> > >>> >> >> > >>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>> Thanks,
> > > >>> > >>> >> >> > >>>>>>>>> ---------------------
> > > >>> > >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
> > > >>> > >>> >> >> > >>>>>>>>> Software Architect
> > > >>> > >>> >> >> > >>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM
> > > Enrico
> > > >>> > >>> Olivelli <
> > > >>> > >>> >> >> > >>>>> eolivelli@gmail.com
> > > >>> > >>> >> >> > >>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>> wrote:
> > > >>> > >>> >> >> > >>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>> Hi
> > > >>> > >>> >> >> > >>>>>>>>>> You have to upgrade to latest
> > > 3.4.x
> > > >>> > Zookeeper
> > > >>> > >>> then
> > > >>> > >>> >> >> you will
> > > >>> > >>> >> >> > >>>>> upgrade
> > > >>> > >>> >> >> > >>>>>>> to
> > > >>> > >>> >> >> > >>>>>>>>>> 3.5.7.
> > > >>> > >>> >> >> > >>>>>>>>>> All should run well without
> > issues
> > > >>> > >>> >> >> > >>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>> Enrico
> > > >>> > >>> >> >> > >>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18
> > kuldeep
> > > singh
> > > >>> <
> > > >>> > >>> >> >> > >>>>> kuldeep.singh08@gmail.com
> > > >>> > >>> >> >> > >>>>>>>
> > > >>> > >>> >> >> > >>>>>>> ha
> > > >>> > >>> >> >> > >>>>>>>>>> scritto:
> > > >>> > >>> >> >> > >>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>>> Hi Team,
> > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>>> We are upgrading zookeeper
> from
> > > 3.4.5
> > > >>> to
> > > >>> > >>> 3.5.6. I
> > > >>> > >>> >> >> have
> > > >>> > >>> >> >> > >> set
> > > >>> > >>> >> >> > >>>> up 3
> > > >>> > >>> >> >> > >>>>>>> node
> > > >>> > >>> >> >> > >>>>>>>>>>> cluster where 2 node are on
> > 3.5.6
> > > >>> version
> > > >>> > >>> and 1
> > > >>> > >>> >> >> node on
> > > >>> > >>> >> >> > >>>> 3.4.5.
> > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>>> Everything is running fine
> and
> > > didn't
> > > >>> get
> > > >>> > any
> > > >>> > >>> >> issue
> > > >>> > >>> >> >> on my
> > > >>> > >>> >> >> > >>>>> system.
> > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>>> but I found something on
> apache
> > > site
> > > >>> that
> > > >>> > >>> first
> > > >>> > >>> >> we
> > > >>> > >>> >> >> need
> > > >>> > >>> >> >> > >> to
> > > >>> > >>> >> >> > >>>>>> upgrade
> > > >>> > >>> >> >> > >>>>>>>> on
> > > >>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to
> > > 3.5.6. So
> > > >>> is
> > > >>> > it
> > > >>> > >>> >> >> mandatory
> > > >>> > >>> >> >> > >> to
> > > >>> > >>> >> >> > >>> go
> > > >>> > >>> >> >> > >>>>> on
> > > >>> > >>> >> >> > >>>>>>>> 3.4.6
> > > >>> > >>> >> >> > >>>>>>>>>>> first.
> > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
> > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>>> Upgrading a running ZooKeeper
> > > ensemble
> > > >>> to
> > > >>> > >>> 3.5.0
> > > >>> > >>> >> >> should be
> > > >>> > >>> >> >> > >>>> done
> > > >>> > >>> >> >> > >>>>>> only
> > > >>> > >>> >> >> > >>>>>>>>> after
> > > >>> > >>> >> >> > >>>>>>>>>>> upgrading your ensemble to
> the
> > > 3.4.6
> > > >>> > release.
> > > >>> > >>> >> Note
> > > >>> > >>> >> >> that
> > > >>> > >>> >> >> > >>> this
> > > >>> > >>> >> >> > >>>> is
> > > >>> > >>> >> >> > >>>>>>> only
> > > >>> > >>> >> >> > >>>>>>>>>>> necessary for rolling
> upgrades
> > > (if
> > > >>> you're
> > > >>> > >>> fine
> > > >>> > >>> >> with
> > > >>> > >>> >> >> > >>> shutting
> > > >>> > >>> >> >> > >>>>> down
> > > >>> > >>> >> >> > >>>>>>> the
> > > >>> > >>> >> >> > >>>>>>>>>>> system completely, you don't
> > > have to go
> > > >>> > >>> through
> > > >>> > >>> >> >> 3.4.6).
> > > >>> > >>> >> >> > >> If
> > > >>> > >>> >> >> > >>>> you
> > > >>> > >>> >> >> > >>>>>>>> attempt
> > > >>> > >>> >> >> > >>>>>>>>> a
> > > >>> > >>> >> >> > >>>>>>>>>>> rolling upgrade without going
> > > through
> > > >>> 3.4.6
> > > >>> > >>> (for
> > > >>> > >>> >> >> example
> > > >>> > >>> >> >> > >>> from
> > > >>> > >>> >> >> > >>>>>>> 3.4.5),
> > > >>> > >>> >> >> > >>>>>>>>> you
> > > >>> > >>> >> >> > >>>>>>>>>>> may get the following error:
> > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663
> > [myid:2]
> > > - INFO
> > > >>> > >>> >> [localhost/
> > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > > >>> > >>> >> >> > >>>>>>>>>>>
> :QuorumCnxManager$Listener@498
> > ]
> > > -
> > > >>> Received
> > > >>> > >>> >> >> connection
> > > >>> > >>> >> >> > >>>> request
> > > >>> > >>> >> >> > >>>>> /
> > > >>> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
> > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663
> > [myid:2]
> > > - WARN
> > > >>> > >>> >> [localhost/
> > > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > > >>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349] -
> > Invalid
> > > >>> server
> > > >>> > id:
> > > >>> > >>> >> -65536
> > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>>> During a rolling upgrade,
> each
> > > server
> > > >>> is
> > > >>> > >>> taken
> > > >>> > >>> >> down
> > > >>> > >>> >> >> in
> > > >>> > >>> >> >> > >> turn
> > > >>> > >>> >> >> > >>>> and
> > > >>> > >>> >> >> > >>>>>>>>> rebooted
> > > >>> > >>> >> >> > >>>>>>>>>>> with the new 3.5.0 binaries.
> > > Before
> > > >>> > starting
> > > >>> > >>> the
> > > >>> > >>> >> >> server
> > > >>> > >>> >> >> > >>> with
> > > >>> > >>> >> >> > >>>>>> 3.5.0
> > > >>> > >>> >> >> > >>>>>>>>>>> binaries, we highly recommend
> > > updating
> > > >>> the
> > > >>> > >>> >> >> configuration
> > > >>> > >>> >> >> > >>> file
> > > >>> > >>> >> >> > >>>>> so
> > > >>> > >>> >> >> > >>>>>>> that
> > > >>> > >>> >> >> > >>>>>>>>> all
> > > >>> > >>> >> >> > >>>>>>>>>>> server statements
> > "server.x=..."
> > > >>> contain
> > > >>> > >>> client
> > > >>> > >>> >> >> ports
> > > >>> > >>> >> >> > >> (see
> > > >>> > >>> >> >> > >>>> the
> > > >>> > >>> >> >> > >>>>>>>> section
> > > >>> > >>> >> >> > >>>>>>>>>>> Specifying
> > > >>> > >>> >> >> > >>>>>>>>>>> the client port). As
> explained
> > > earlier
> > > >>> you
> > > >>> > >>> may
> > > >>> > >>> >> >> leave the
> > > >>> > >>> >> >> > >>>>>>>> configuration
> > > >>> > >>> >> >> > >>>>>>>>>> in a
> > > >>> > >>> >> >> > >>>>>>>>>>> single file, as well as leave
> > the
> > > >>> > >>> >> >> > >>>> clientPort/clientPortAddress
> > > >>> > >>> >> >> > >>>>>>>>> statements
> > > >>> > >>> >> >> > >>>>>>>>>>> (although if you specify
> client
> > > ports
> > > >>> in
> > > >>> > the
> > > >>> > >>> new
> > > >>> > >>> >> >> format,
> > > >>> > >>> >> >> > >>>> these
> > > >>> > >>> >> >> > >>>>>>>>> statements
> > > >>> > >>> >> >> > >>>>>>>>>>> are now redundant).
> > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>>> Could you please let me know
> > > about this
> > > >>> > case.
> > > >>> > >>> >> >> Appreciate
> > > >>> > >>> >> >> > >> if
> > > >>> > >>> >> >> > >>>>>> respond
> > > >>> > >>> >> >> > >>>>>>>>> soon.
> > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>>> Thanks,
> > > >>> > >>> >> >> > >>>>>>>>>>> ---------------------
> > > >>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
> > > >>> > >>> >> >> > >>>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>>
> > > >>> > >>> >> >> > >>>>>>>
> > > >>> > >>> >> >> > >>>>>>
> > > >>> > >>> >> >> > >>>>>
> > > >>> > >>> >> >> > >>>>
> > > >>> > >>> >> >> > >>>
> > > >>> > >>> >> >> > >>
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >> >
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> ________________________________
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > > >>> > >>> >> >> This e-mail (including any attachments) is
> > strictly
> > > >>> > >>> confidential
> > > >>> > >>> >> and
> > > >>> > >>> >> >> may also contain privileged information. If you are
> > > not the
> > > >>> > >>> intended
> > > >>> > >>> >> >> recipient you are not authorised to read, print,
> > save,
> > > >>> process or
> > > >>> > >>> >> disclose
> > > >>> > >>> >> >> this message. If you have received this message by
> > > mistake,
> > > >>> > please
> > > >>> > >>> >> inform
> > > >>> > >>> >> >> the sender immediately and destroy this e-mail, its
> > > >>> attachments
> > > >>> > >>> and any
> > > >>> > >>> >> >> copies. Any use, distribution, reproduction or
> > > disclosure by
> > > >>> any
> > > >>> > >>> person
> > > >>> > >>> >> >> other than the intended recipient is strictly
> > > prohibited and
> > > >>> the
> > > >>> > >>> person
> > > >>> > >>> >> >> responsible may incur in penalties.
> > > >>> > >>> >> >> The use of this e-mail is only for professional
> > > purposes;
> > > >>> > >>> there is
> > > >>> > >>> >> no
> > > >>> > >>> >> >> guarantee that the correspondence towards this
> e-mail
> > > will be
> > > >>> > read
> > > >>> > >>> >> only by
> > > >>> > >>> >> >> the recipient, because, under certain
> circumstances,
> > > there
> > > >>> may
> > > >>> > be a
> > > >>> > >>> >> need to
> > > >>> > >>> >> >> access this email by third subjects belonging to
> the
> > > Company.
> > > >>> > >>> >> >>
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> ________________________________
> > > >>> > >>> >> >>
> > > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > > >>> > >>> >> >> This e-mail (including any attachments) is strictly
> > > >>> confidential
> > > >>> > >>> and
> > > >>> > >>> >> may
> > > >>> > >>> >> >> also contain privileged information. If you are not
> > the
> > > >>> intended
> > > >>> > >>> >> recipient
> > > >>> > >>> >> >> you are not authorised to read, print, save,
> process
> > or
> > > >>> disclose
> > > >>> > >>> this
> > > >>> > >>> >> >> message. If you have received this message by
> > mistake,
> > > please
> > > >>> > >>> inform
> > > >>> > >>> >> the
> > > >>> > >>> >> >> sender immediately and destroy this e-mail, its
> > > attachments
> > > >>> and
> > > >>> > any
> > > >>> > >>> >> copies.
> > > >>> > >>> >> >> Any use, distribution, reproduction or disclosure
> by
> > > any
> > > >>> person
> > > >>> > >>> other
> > > >>> > >>> >> than
> > > >>> > >>> >> >> the intended recipient is strictly prohibited and
> the
> > > person
> > > >>> > >>> >> responsible
> > > >>> > >>> >> >> may incur in penalties.
> > > >>> > >>> >> >> The use of this e-mail is only for professional
> > > purposes;
> > > >>> there
> > > >>> > is
> > > >>> > >>> no
> > > >>> > >>> >> >> guarantee that the correspondence towards this
> e-mail
> > > will be
> > > >>> > read
> > > >>> > >>> >> only by
> > > >>> > >>> >> >> the recipient, because, under certain
> circumstances,
> > > there
> > > >>> may
> > > >>> > be a
> > > >>> > >>> >> need to
> > > >>> > >>> >> >> access this email by third subjects belonging to
> the
> > > Company.
> > > >>> > >>> >> >>
> > > >>> > >>> >> >
> > > >>> > >>> >>
> > > >>> > >>> >
> > > >>> > >>>
> > > >>> > >>
> > > >>> >
> > > >>>
> > > >>
> > >
> > >
> > > ________________________________
> > >
> > > CONFIDENTIALITY & PRIVACY NOTICE
> > > This e-mail (including any attachments) is strictly confidential and
> may
> > > also contain privileged information. If you are not the intended
> > recipient
> > > you are not authorised to read, print, save, process or disclose this
> > > message. If you have received this message by mistake, please inform
> the
> > > sender immediately and destroy this e-mail, its attachments and any
> > copies.
> > > Any use, distribution, reproduction or disclosure by any person other
> > than
> > > the intended recipient is strictly prohibited and the person
> responsible
> > > may incur in penalties.
> > > The use of this e-mail is only for professional purposes; there is no
> > > guarantee that the correspondence towards this e-mail will be read only
> > by
> > > the recipient, because, under certain circumstances, there may be a
> need
> > to
> > > access this email by third subjects belonging to the Company.
> > >
> >
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by Enrico Olivelli <eo...@gmail.com>.
Il giorno gio 8 ott 2020 alle ore 14:17 kuldeep singh <
kuldeep.singh08@gmail.com> ha scritto:
> Hi Team,
>
> I am facing one issue in SSL communication between client and zookeeper
> server.
>
> ZK 3.5.6 version
>
> 1. Mi on 3 node
> 2. Applying SSL and 3 nodes cluster is working fine
> 3. Scaled my cluster with 2 nodes and now my cluster have 5 nodes over SSL
>
> but after scaling my SSL is not working between client and ZK server and
> even not able to login using zkCli as well.
>
> Can someone provide the details please why it is happening?
>
Is your client configured to use SSL ?
Enrico
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
> Software Architect
>
>
>
> On Mon, Jul 13, 2020 at 2:19 PM Enrico Olivelli - Diennea
> <en...@diennea.com.invalid> wrote:
>
> > It looks like we ported it to 3.5.
> >
> > See the subtask
> > https://issues.apache.org/jira/browse/ZOOKEEPER-2792
> >
> > Enrico
> >
> > Il giorno 13/07/20, 10:37 "kuldeep singh" <ku...@gmail.com>
> ha
> > scritto:
> >
> > Hi Team,
> >
> > I appreciate it if I will get a response as soon as possible, as I am
> > stuck
> > at this point.
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> >
> >
> >
> > On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <
> > kuldeep.singh08@gmail.com>
> > wrote:
> >
> > > Hi Team,
> > >
> > > Server to Server communication is not supported in 3.5.6 version
> as
> > per
> > > below JIRA issue?
> > >
> > > https://issues.apache.org/jira/browse/ZOOKEEPER-2639
> > >
> > > Thanks,
> > > ---------------------
> > > Kuldeep Singh Budania
> > >
> > >
> > >
> > > On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <
> > kuldeep.singh08@gmail.com>
> > > wrote:
> > >
> > >> Thanks for the reply.
> > >>
> > >> Now my ZKCli cmd is working fine as we use some our customized
> > >> authentication and we resolve the issue.
> > >>
> > >> Now I am going to implement Server to Server communication.
> > >>
> > >> Thanks,
> > >> ---------------------
> > >> Kuldeep Singh Budania
> > >>
> > >>
> > >>
> > >> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
> > >> szalay.beko.mate@gmail.com> wrote:
> > >>
> > >>> I think SSL is working for you already... If you managed to start
> > the
> > >>> zkCli.sh and be able to connect to ZooKeeper on the secure port
> > and issue
> > >>> any kind of command (like: " ls / "), then the wire encryption is
> > working
> > >>> and your server/client communication is secured by ZooKeeper.
> > >>>
> > >>> Why you want to run the following command?
> > >>> addauth ztpasswd zooadmin:<password>
> > >>>
> > >>> Do you also want to configure a superDigest user in ZooKeeper?
> > Please
> > >>> note
> > >>> that this command is independent from SSL. If you need to create
> a
> > >>> username-password pair for digest authentication then please use
> > the
> > >>> command in the following way:
> > >>> addauth digest zooadmin:yourSuperSecretPassword
> > >>>
> > >>> Kind regards,
> > >>> Mate
> > >>>
> > >>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <
> > kuldeep.singh08@gmail.com>
> > >>> wrote:
> > >>>
> > >>> > 1. sh zkCli.sh --config /etc/zookeeper -server localhost:2281
> > >>> >
> > >>> > 2. addauth ztpasswd zooadmin:<password>
> > >>> >
> > >>> >
> > >>> > Thanks,
> > >>> > ---------------------
> > >>> > Kuldeep Singh Budania
> > >>> >
> > >>> >
> > >>> >
> > >>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
> > >>> kuldeep.singh08@gmail.com>
> > >>> > wrote:
> > >>> >
> > >>> > > Hi Team,
> > >>> > >
> > >>> > > Any update on this?
> > >>> > >
> > >>> > > Thanks,
> > >>> > > ---------------------
> > >>> > > Kuldeep Singh Budania
> > >>> > >
> > >>> > >
> > >>> > >
> > >>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
> > >>> kuldeep.singh08@gmail.com>
> > >>> > > wrote:
> > >>> > >
> > >>> > >> Sorry this is my bad, there were server setting like below
> > >>> > >>
> > >>> > >> export SERVER_JVMFLAGS="
> > >>> > >>
> > >>> > >>
> > >>> > >>
> > >>> >
> > >>>
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >>> > >>
> > >>> > >>
> > >>>
> > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > >>> > >>
> > >>> >
> > >>>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >>> > >>
> > >>> > >>
> > >>> > >>
> > >>> > >> export CLIENT_JVMFLAGS="
> > >>> > >>
> > >>> > >>
> > >>>
> > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >>> > >> -Dzookeeper.client.secure=true
> > >>> > >>
> > >>>
> > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > >>> > >>
> > >>> >
> > >>>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >>> > >>
> > >>> > >> I want to have SSL between client to server communication
> > >>> > >>
> > >>> > >> I am already following the same link which you have shared
> > with me
> > >>> but
> > >>> > >> that is not working.
> > >>> > >>
> > >>> > >> Zoo.cfg
> > >>> > >>
> > >>> > >> secureClientPort=2281
> > >>> > >> initLimit=10
> > >>> > >> syncLimit=5
> > >>> > >> dataDir=/var/lib/zookeeper/data
> > >>> > >> tickTime=2000
> > >>> > >> autopurge.snapRetainCount=3
> > >>> > >> autopurge.purgeInterval=1
> > >>> > >> admin.enableServer=false
> > >>> > >> standaloneEnabled=false
> > >>> > >> jute.maxbuffer=2147483648
> > >>> > >>
> > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >>> > >> server.1=host1_priv:10288:10388
> > >>> > >> server.2=host2_priv:10288:10388
> > >>> > >> server.3=host3_priv:10288:10388
> > >>> > >>
> > >>> > >>
> > >>> > >> command to connect using zkcli
> > >>> > >>
> > >>> > >> 1. zkcli zoo.cfg localhost:2281
> > >>> > >> 2. addauth ztpasswd usernaem:password
> > >>> > >>
> > >>> > >> after second step we are getting below error
> > >>> > >>
> > >>> > >> WatchedEvent state:AuthFailed type:None path:null
> > >>> > >>
> > >>> > >>
> > >>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > >>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> > authentication
> > >>> > provider
> > >>> > >> for scheme: ztpasswd has x509 ip digest*
> > >>> > >>
> > >>> > >> Thanks,
> > >>> > >> ---------------------
> > >>> > >> Kuldeep Singh Budania
> > >>> > >>
> > >>> > >>
> > >>> > >>
> > >>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
> > >>> > >> szalay.beko.mate@gmail.com> wrote:
> > >>> > >>
> > >>> > >>> > No authentication provider for scheme: ztpasswd has x509
> > ip
> > >>> digest*
> > >>> > >>>
> > >>> > >>> This suggest you have some configuration error... Where did
> > you
> > >>> use the
> > >>> > >>> "ztpasswd" string in your configs / commands?
> > >>> > >>>
> > >>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
> > >>> > >>> szalay.beko.mate@gmail.com>
> > >>> > >>> wrote:
> > >>> > >>>
> > >>> > >>> > > My ZK server is up and running in secure mode
> > >>> > >>> >
> > >>> > >>> > What is your goal? You want to setup client-server SSL
> > >>> connection?
> > >>> > >>> >
> > >>> > >>> > see:
> > >>> > >>> >
> > >>> > >>>
> > >>> >
> > >>>
> >
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
> > >>> > >>> >
> > >>> > >>> > (or you want to have both SSL and SASL enabled?)
> > >>> > >>> >
> > >>> > >>> > Anyway, please remove the following line from the
> > >>> SERVER_JVMFLAGS:
> > >>> > >>> >
> > >>> >
> > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >>> > >>> > This is a configuration that makes sense only for the
> > ZooKeeper
> > >>> > client,
> > >>> > >>> > not for the server. For the server, use the following:
> > >>> > >>> >
> > >>> > >>> >
> > >>> > >>>
> > >>> >
> > >>>
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >>> > >>> >
> > >>> > >>> > If it doesn't solve the issue, then can you please send
> > your
> > >>> zoo.cfg
> > >>> > >>> file?
> > >>> > >>> > Also can you please send the zkCli command you execute?
> > (you
> > >>> need to
> > >>> > >>> > connect to the secure ZooKeeper port, unless
> > portUnification is
> > >>> > >>> enabled)
> > >>> > >>> >
> > >>> > >>> > Kind regards,
> > >>> > >>> > Mate
> > >>> > >>> >
> > >>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
> > >>> > >>> kuldeep.singh08@gmail.com>
> > >>> > >>> > wrote:
> > >>> > >>> >
> > >>> > >>> >> Hi,
> > >>> > >>> >>
> > >>> > >>> >> we have done below changes in java.env file
> > >>> > >>> >>
> > >>> > >>> >> export SERVER_JVMFLAGS="
> > >>> > >>> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>>
> > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >>> > >>> >>
> > >>> >
> > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >>> > >>> >>
> > >>> > >>> >>
> > >>> > >>> >>
> > >>> > >>> >> export CLIENT_JVMFLAGS="
> > >>> > >>> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>>
> > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >>> > >>> >> -Dzookeeper.client.secure=true
> > >>> > >>> >>
> > >>> >
> > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >>> > >>> >>
> > >>> > >>> >> I have started the ZK server and it is up without any
> > issue.
> > >>> > >>> >>
> > >>> > >>> >> But now when I login to ZkCli then it gives the below
> > error.
> > >>> > >>> >>
> > >>> > >>> >> WatchedEvent state:AuthFailed type:None path:null
> > >>> > >>> >>
> > >>> > >>> >>
> > >>> > >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > >>> > >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> > >>> authentication
> > >>> > >>> provider
> > >>> > >>> >> for scheme: ztpasswd has x509 ip digest*
> > >>> > >>> >>
> > >>> > >>> >> Please help me on this issue
> > >>> > >>> >>
> > >>> > >>> >> Thanks,
> > >>> > >>> >> ---------------------
> > >>> > >>> >> Kuldeep Singh Budania
> > >>> > >>> >> Software Architect
> > >>> > >>> >>
> > >>> > >>> >>
> > >>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
> > >>> > >>> kuldeep.singh08@gmail.com>
> > >>> > >>> >> wrote:
> > >>> > >>> >>
> > >>> > >>> >> > Hi,
> > >>> > >>> >> >
> > >>> > >>> >> > My ZK server is up and running in secure mode, But
> > When I am
> > >>> > >>> trying to
> > >>> > >>> >> > connect to the ZK server using ZKCli, it gives the
> below
> > >>> error.
> > >>> > >>> >> >
> > >>> > >>> >> > WatchedEvent state:AuthFailed type:None path:null
> > >>> > >>> >> >
> > >>> > >>> >> >
> > >>> > >>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > >>> > >>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> > >>> authentication
> > >>> > >>> >> provider
> > >>> > >>> >> > for scheme: ztpasswd has x509 ip digest*
> > >>> > >>> >> >
> > >>> > >>> >> > Can someone please help me on this issue. we are using
> > the
> > >>> 3.5.6
> > >>> > >>> >> version.
> > >>> > >>> >> >
> > >>> > >>> >> > I appreciate if I will get a response as soon as
> > possible, as
> > >>> I am
> > >>> > >>> stuck
> > >>> > >>> >> > at this point.
> > >>> > >>> >> >
> > >>> > >>> >> > Thanks,
> > >>> > >>> >> > ---------------------
> > >>> > >>> >> > Kuldeep Singh Budania
> > >>> > >>> >> > Software Architect
> > >>> > >>> >> >
> > >>> > >>> >> >
> > >>> > >>> >> >
> > >>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli -
> > Diennea
> > >>> > >>> >> > <en...@diennea.com.invalid> wrote:
> > >>> > >>> >> >
> > >>> > >>> >> >> I mean in zoo.cfg
> > >>> > >>> >> >> Not as a system property
> > >>> > >>> >> >>
> > >>> > >>> >> >> Enrico
> > >>> > >>> >> >>
> > >>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli -
> Diennea" <
> > >>> > >>> >> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
> > >>> > >>> >> >>
> > >>> > >>> >> >> Hi
> > >>> > >>> >> >> You have to enable Netty on the server side
> > >>> > >>> >> >>
> > >>> > >>> >> >> Something like:
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> >
> > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >>> > >>> >> >>
> > >>> > >>> >> >> Hope that helps
> > >>> > >>> >> >> Enrico
> > >>> > >>> >> >>
> > >>> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
> > >>> > >>> >> kuldeep.singh08@gmail.com>
> > >>> > >>> >> >> ha scritto:
> > >>> > >>> >> >>
> > >>> > >>> >> >> Hi,
> > >>> > >>> >> >>
> > >>> > >>> >> >> I got below error while setting SSL
> properties
> > in
> > >>> > zkEnv.sh
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> ==========================================================================================
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
> > >>> > [main:QuorumPeerConfig@133]
> > >>> > >>> -
> > >>> > >>> >> >> Reading
> > >>> > >>> >> >> configuration from: /etc/zookeeper/zoo.cfg
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> > >>> > [main:QuorumPeerConfig@385]
> > >>> > >>> -
> > >>> > >>> >> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> > >>> > [main:QuorumPeerConfig@399]
> > >>> > >>> -
> > >>> > >>> >> >> secureClientPortAddress is
> > 0.0.0.0/0.0.0.0:2281
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,878 - INFO
> > [main:X509Util@79] -
> > >>> > >>> Setting
> > >>> > >>> >> -D
> > >>> > >>> >> >>
> > jdk.tls.rejectClientInitiatedRenegotiation=true to
> > >>> > disable
> > >>> > >>> >> >> client-initiated
> > >>> > >>> >> >> TLS renegotiation
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> > >>> > >>> [main:DatadirCleanupManager@78]
> > >>> > >>> >> -
> > >>> > >>> >> >> autopurge.snapRetainCount set to 3
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> > >>> > >>> [main:DatadirCleanupManager@79]
> > >>> > >>> >> -
> > >>> > >>> >> >> autopurge.purgeInterval set to 1
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,898 - INFO [
> > >>> > >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@138
> ]
> > -
> > >>> Purge
> > >>> > >>> task
> > >>> > >>> >> >> started.
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,899 - INFO
> > [main:ManagedUtil@46]
> > >>> -
> > >>> > >>> Log4j
> > >>> > >>> >> >> found with
> > >>> > >>> >> >> jmx enabled.
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
> > >>> > >>> [PurgeTask:FileTxnSnapLog@103]
> > >>> > >>> >> -
> > >>> > >>> >> >> zookeeper.snapshot.trust.empty : false
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,910 - INFO [
> > >>> > >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@144
> ]
> > -
> > >>> Purge
> > >>> > >>> task
> > >>> > >>> >> >> completed.
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
> > >>> [main:QuorumPeerMain@141
> > >>> > ]
> > >>> > >>> -
> > >>> > >>> >> >> Starting quorum
> > >>> > >>> >> >> peer
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
> > >>> > [main:ServerCnxnFactory@135]
> > >>> > >>> -
> > >>> > >>> >> >> Using
> > >>> > >>> >> >>
> > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > >>> > server
> > >>> > >>> >> >> connection
> > >>> > >>> >> >> factory
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
> > >>> > >>> [main:NIOServerCnxnFactory@673]
> > >>> > >>> >> -
> > >>> > >>> >> >> Configuring NIO connection handler with 10s
> > >>> sessionless
> > >>> > >>> >> >> connection timeout,
> > >>> > >>> >> >> 2 selector thread(s), 16 worker threads, and
> > 64 kB
> > >>> direct
> > >>> > >>> >> buffers.
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
> > >>> > >>> [main:NIOServerCnxnFactory@686
> > >>> > >>> >> ]
> > >>> > >>> >> >> - binding
> > >>> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
> > >>> > [main:ServerCnxnFactory@135]
> > >>> > >>> -
> > >>> > >>> >> >> Using
> > >>> > >>> >> >>
> > org.apache.zookeeper.server.NIOServerCnxnFactory as
> > >>> > server
> > >>> > >>> >> >> connection
> > >>> > >>> >> >> factory
> > >>> > >>> >> >>
> > >>> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
> > >>> [main:QuorumPeerMain@101
> > >>> > ]
> > >>> > >>> -
> > >>> > >>> >> >> Unexpected
> > >>> > >>> >> >> exception, exiting abnormally
> > >>> > >>> >> >>
> > >>> > >>> >> >> java.lang.UnsupportedOperationException: SSL
> > isn't
> > >>> > >>> supported in
> > >>> > >>> >> >> NIOServerCnxn
> > >>> > >>> >> >>
> > >>> > >>> >> >> at
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> > >>> > >>> >> >>
> > >>> > >>> >> >> at
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> > >>> > >>> >> >>
> > >>> > >>> >> >> at
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> > >>> > >>> >> >>
> > >>> > >>> >> >> at
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >> >> I have set the following properties in
> > >>> SERVER_JVMFLAGS in
> > >>> > >>> >> >> zkEnv.sh file :
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> > >>> > >>> >> >>
> > -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> > >>> > >>> >> >>
> > -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> > >>> > >>> >> >>
> > >>> > >>> >> >> Thanks,
> > >>> > >>> >> >> ---------------------
> > >>> > >>> >> >> Kuldeep Singh Budania
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan
> > Zimmerman <
> > >>> > >>> >> >> jordan@jordanzimmerman.com>
> > >>> > >>> >> >> wrote:
> > >>> > >>> >> >>
> > >>> > >>> >> >> > It's the same as the normal ZooKeeper
> client:
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > >>> > >>> >> >> > <
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > >>> > >>> >> >> > >
> > >>> > >>> >> >> >
> > >>> > >>> >> >> > -Jordan
> > >>> > >>> >> >> >
> > >>> > >>> >> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep
> singh
> > <
> > >>> > >>> >> >> kuldeep.singh08@gmail.com>
> > >>> > >>> >> >> > wrote:
> > >>> > >>> >> >> > >
> > >>> > >>> >> >> > > Hi Team,
> > >>> > >>> >> >> > > How we will do secure communication
> > between the
> > >>> > Curator
> > >>> > >>> >> >> framework and
> > >>> > >>> >> >> > > zookeeper 3.5.6 ?
> > >>> > >>> >> >> > > I didn't get any solution right now.
> > >>> > >>> >> >> > > I appreciate it if someone could help me
> > with the
> > >>> > same.
> > >>> > >>> >> >> > >
> > >>> > >>> >> >> > > Thanks,
> > >>> > >>> >> >> > > ---------------------
> > >>> > >>> >> >> > > Kuldeep Singh Budania
> > >>> > >>> >> >> > > Software Architect
> > >>> > >>> >> >> > >
> > >>> > >>> >> >> > >
> > >>> > >>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM
> > Szalay-Bekő Máté
> > >>> <
> > >>> > >>> >> >> > szalay.beko.mate@gmail.com>
> > >>> > >>> >> >> > > wrote:
> > >>> > >>> >> >> > >
> > >>> > >>> >> >> > >> Hello Kuldeep,
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> > >> did you download the source from the
> > ZooKeeper
> > >>> > >>> webpage, or
> > >>> > >>> >> >> checked out
> > >>> > >>> >> >> > from
> > >>> > >>> >> >> > >> git?
> > >>> > >>> >> >> > >> Anyway, the following commands should
> > work:
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> > >> wget
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> > >>> > >>> >> >> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
> > >>> > >>> >> >> > >> cd apache-zookeeper-3.5.7
> > >>> > >>> >> >> > >> mvn clean install -DskipTests
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> > >> I tested it with OpenJDK 8u424 and maven
> > 3.6.0.
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> > >> Kind regards,
> > >>> > >>> >> >> > >> Mate
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep
> > singh <
> > >>> > >>> >> >> > kuldeep.singh08@gmail.com>
> > >>> > >>> >> >> > >> wrote:
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> > >>> Hi All,
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>> I have download the zookeeper source
> > code and
> > >>> run
> > >>> > >>> the mvn
> > >>> > >>> >> >> command for
> > >>> > >>> >> >> > >>> packaging but get problem on
> > "zookeeper-server"
> > >>> > >>> >> directory.
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>> *command :- mvn clean package*
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>> [ERROR] Failed to execute goal
> > >>> > >>> >> >> > >>>
> > >>> > >>> >>
> > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > >>> > >>> >> >> > >>> (default-compile) on project zookeeper:
> > Fatal
> > >>> error
> > >>> > >>> >> >> compiling:
> > >>> > >>> >> >> > >>> java.lang.NullPointerException -> [Help
> > 1]
> > >>> > >>> >> >> > >>>
> > >>> > >>> org.apache.maven.lifecycle.LifecycleExecutionException:
> > >>> > >>> >> >> Failed to
> > >>> > >>> >> >> > execute
> > >>> > >>> >> >> > >>> goal
> > >>> > >>> >> >>
> > org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > >>> > >>> >> >> > >>> (default-compile) on project zookeeper:
> > Fatal
> > >>> error
> > >>> > >>> >> >> compiling
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> >
> > >>> > >>> >>
> > org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >>
> > org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >>
> > org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >>
> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > Method)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> java.lang.reflect.Method.invoke(Method.java:498)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> > >>> > >>> >> >> > >>> Caused by:
> > >>> > >>> >> org.apache.maven.plugin.MojoExecutionException:
> > >>> > >>> >> >> Fatal error
> > >>> > >>> >> >> > >>> compiling
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> > >>> > >>> >> >> > >>> ... 19 more
> > >>> > >>> >> >> > >>> Caused by:
> > >>> > >>> >> org.codehaus.plexus.compiler.CompilerException:
> > >>> > >>> >> >> > >>> java.lang.NullPointerException
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> > >>> > >>> >> >> > >>> ... 22 more
> > >>> > >>> >> >> > >>> Caused by: java.lang.RuntimeException:
> > >>> > >>> >> >> java.lang.NullPointerException
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:559)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> > >>>
> > >>>
> > com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> >
> > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> > >>> > >>> >> >> > >>> ... 24 more
> > >>> > >>> >> >> > >>> Caused by:
> java.lang.NullPointerException
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> com.sun.tools.doclint.Checker.scan(Checker.java:144)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >>
> > com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> > >>>
> > >>>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> > >>>
> > >>>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> >
> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> >
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> >
> > com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> >
> > com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> >
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> >
> > com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> > >>>
> > >>>
> > com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> >
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >>
> > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> >
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >>
> > >>> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> > >>>
> > >>>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> > >>>
> > >>>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> >
> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >>
> > com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> >
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> > com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >>
> > com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> > >>>
> > >>>
> > com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> > >>>
> > >>>
> > com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> > >>>
> > >>>
> > com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> > >>> > >>> >> >> > >>> at
> > >>> > >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:523)
> > >>> > >>> >> >> > >>> ... 27 more
> > >>> > >>> >> >> > >>> [ERROR]
> > >>> > >>> >> >> > >>> [ERROR] Re-run Maven using the -X
> switch
> > to
> > >>> enable
> > >>> > >>> full
> > >>> > >>> >> >> debug logging.
> > >>> > >>> >> >> > >>> [ERROR]
> > >>> > >>> >> >> > >>> [ERROR] For more information about the
> > errors
> > >>> and
> > >>> > >>> >> possible
> > >>> > >>> >> >> solutions,
> > >>> > >>> >> >> > >>> please read the following articles:
> > >>> > >>> >> >> > >>> [ERROR] [Help 1]
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>> Can someone help me on this issue?
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>> Thanks,
> > >>> > >>> >> >> > >>> ---------------------
> > >>> > >>> >> >> > >>> Kuldeep Singh Budania
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM
> > Szalay-Bekő
> > >>> Máté <
> > >>> > >>> >> >> > >>> szalay.beko.mate@gmail.com>
> > >>> > >>> >> >> > >>> wrote:
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>>> these exceptions can mean many
> > things... I
> > >>> think
> > >>> > >>> this
> > >>> > >>> >> can
> > >>> > >>> >> >> be even
> > >>> > >>> >> >> > >> normal
> > >>> > >>> >> >> > >>>> duding rolling restart (as some
> > connections
> > >>> get
> > >>> > >>> broken
> > >>> > >>> >> in
> > >>> > >>> >> >> this case)
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>> However, I saw cases already when
> > exceptions
> > >>> like
> > >>> > >>> these
> > >>> > >>> >> >> killed
> > >>> > >>> >> >> > receiver
> > >>> > >>> >> >> > >>> or
> > >>> > >>> >> >> > >>>> sender threads in QuorumCnxManager /
> > Leader
> > >>> > >>> Election in
> > >>> > >>> >> >> such a way
> > >>> > >>> >> >> > that
> > >>> > >>> >> >> > >>>> they were not able to recover, so the
> > node was
> > >>> > >>> unable to
> > >>> > >>> >> >> connect to
> > >>> > >>> >> >> > any
> > >>> > >>> >> >> > >>>> quorum until restart. I remember
> seeing
> > this
> > >>> in
> > >>> > 3.4
> > >>> > >>> too.
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>> Do you see these exceptions in the
> > second
> > >>> server
> > >>> > >>> (the
> > >>> > >>> >> one
> > >>> > >>> >> >> which you
> > >>> > >>> >> >> > >> just
> > >>> > >>> >> >> > >>>> upgraded in step 3)?
> > >>> > >>> >> >> > >>>> Is this issue reproducible?
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>> What is the tickTime and initLimit you
> > use?
> > >>> Maybe
> > >>> > >>> the
> > >>> > >>> >> >> server just
> > >>> > >>> >> >> > >> require
> > >>> > >>> >> >> > >>>> more time to sync?
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>> I would need more logs to really see
> > what
> > >>> > happened.
> > >>> > >>> Can
> > >>> > >>> >> >> you create a
> > >>> > >>> >> >> > >> Jira
> > >>> > >>> >> >> > >>>> issue and upload the logs and also the
> > >>> ZooKeeper
> > >>> > >>> >> configs?
> > >>> > >>> >> >> I am happy
> > >>> > >>> >> >> > to
> > >>> > >>> >> >> > >>>> take a closer look.
> > >>> > >>> >> >> > >>>> (if you need to re-run the test to
> > collect the
> > >>> > logs,
> > >>> > >>> >> then
> > >>> > >>> >> >> enabling
> > >>> > >>> >> >> > >> DEBUG
> > >>> > >>> >> >> > >>>> logs would be great. The INFO level
> > logs are
> > >>> > usually
> > >>> > >>> >> >> enough for these
> > >>> > >>> >> >> > >>>> problems, but one can never know...)
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>> Kind regards,
> > >>> > >>> >> >> > >>>> Mate
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM
> kuldeep
> > singh
> > >>> <
> > >>> > >>> >> >> > >> kuldeep.singh08@gmail.com
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>> wrote:
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>>> Hi Team,
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> I have done some POC on rolling
> > upgrade and
> > >>> found
> > >>> > >>> below
> > >>> > >>> >> >> result.
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> 1. On 1st node upgrade zookeeper .
> > Traffic
> > >>> was
> > >>> > >>> >> running
> > >>> > >>> >> >> fine
> > >>> > >>> >> >> > >> because
> > >>> > >>> >> >> > >>> 2
> > >>> > >>> >> >> > >>>>> nodes are already on old zookeeper.
> > >>> > >>> >> >> > >>>>> 2. On 1st node upgrade our
> > application and
> > >>> > didn’t
> > >>> > >>> >> find
> > >>> > >>> >> >> any issue
> > >>> > >>> >> >> > >>>>> 3. On 2nd node upgrade zookeeper
> but
> > got
> > >>> below
> > >>> > >>> error
> > >>> > >>> >> >> and zookeeper
> > >>> > >>> >> >> > >>> is
> > >>> > >>> >> >> > >>>>> not taking any requests
> > >>> > >>> >> >> > >>>>> 4.
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> java.io.EOFException
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> at
> > >>> > >>> >> >>
> > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> at
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
> > >>> > >>> >> >> > >>>>>
> > [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
> > >>> -
> > >>> > >>> >> >> Interrupting
> > >>> > >>> >> >> > >>> SendWorker
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR
> > >>> [LearnerHandler-/
> > >>> > >>> >> >> 192.168.44.73:33754
> > >>> > >>> >> >> > >>>>> :LearnerHandler@562] - Unexpected
> > exception
> > >>> > >>> causing
> > >>> > >>> >> >> shutdown while
> > >>> > >>> >> >> > >>> sock
> > >>> > >>> >> >> > >>>>> still open
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> java.io.EOFException
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> at
> > >>> > >>> >> >>
> > java.io.DataInputStream.readInt(DataInputStream.java:392)
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> at
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >>
> > >>> > >>>
> > >>>
> > org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> at
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> at
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> at
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >>
> > >>> > >>>
> > >>> >
> > >>>
> >
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
> > >>> > >>> >> >> > >>>>>
> > [SendWorker:1:QuorumCnxManager$SendWorker@679]
> > >>> -
> > >>> > >>> >> >> Interrupted while
> > >>> > >>> >> >> > >>>> waiting
> > >>> > >>> >> >> > >>>>> for message on queue
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> Please let me know is this the known
> > issue or
> > >>> > this
> > >>> > >>> is
> > >>> > >>> >> >> different issue
> > >>> > >>> >> >> > >>>> which
> > >>> > >>> >> >> > >>>>> is mention in Apache zookeeper
> > documentation
> > >>> when
> > >>> > >>> >> >> upgrading from
> > >>> > >>> >> >> > >> 3.4.5
> > >>> > >>> >> >> > >>> to
> > >>> > >>> >> >> > >>>>> 3.5.6
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> Thanks,
> > >>> > >>> >> >> > >>>>> ---------------------
> > >>> > >>> >> >> > >>>>> Kuldeep Singh Budania
> > >>> > >>> >> >> > >>>>> Software Architect
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM
> > Alexander
> > >>> Shraer
> > >>> > <
> > >>> > >>> >> >> shralex@gmail.com>
> > >>> > >>> >> >> > >>>>> wrote:
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>>> +1 to what Mate said (I wrote the
> > quoted
> > >>> > >>> >> instructions).
> > >>> > >>> >> >> > >>>>>>
> > >>> > >>> >> >> > >>>>>>
> > >>> > >>> >> >> > >>>>>>
> > >>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM
> > Szalay-Bekő
> > >>> > Máté <
> > >>> > >>> >> >> > >>>>>> szalay.beko.mate@gmail.com>
> > >>> > >>> >> >> > >>>>>> wrote:
> > >>> > >>> >> >> > >>>>>>
> > >>> > >>> >> >> > >>>>>>> Hi Kuldeep,
> > >>> > >>> >> >> > >>>>>>>
> > >>> > >>> >> >> > >>>>>>> I just want to provide you some
> > background
> > >>> info
> > >>> > >>> about
> > >>> > >>> >> >> our
> > >>> > >>> >> >> > >>>>> documentation.
> > >>> > >>> >> >> > >>>>>>> The reason to upgrade to 3.4.6
> first
> > is to
> > >>> > avoid
> > >>> > >>> the
> > >>> > >>> >> >> following
> > >>> > >>> >> >> > >>> error:
> > >>> > >>> >> >> > >>>>>>>
> > >>> > >>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] -
> > WARN
> > >>> > >>> [localhost/
> > >>> > >>> >> >> > >>> 127.0.0.1:2784
> > >>> > >>> >> >> > >>>>>>> :QuorumCnxManager@349] - Invalid
> > server
> > >>> id:
> > >>> > >>> -65536
> > >>> > >>> >> >> > >>>>>>>
> > >>> > >>> >> >> > >>>>>>> This error comes because of the
> > protocol
> > >>> > changes
> > >>> > >>> >> between
> > >>> > >>> >> >> > >> ZooKeeper
> > >>> > >>> >> >> > >>>>> server
> > >>> > >>> >> >> > >>>>>>> nodes during connection initiation
> > for
> > >>> leader
> > >>> > >>> >> election.
> > >>> > >>> >> >> In
> > >>> > >>> >> >> > >>> ZooKeeper
> > >>> > >>> >> >> > >>>>> 3.5
> > >>> > >>> >> >> > >>>>>> a
> > >>> > >>> >> >> > >>>>>>> protocol version was introduced
> (see
> > >>> > >>> ZOOKEEPER-107)
> > >>> > >>> >> and
> > >>> > >>> >> >> since
> > >>> > >>> >> >> > >> that
> > >>> > >>> >> >> > >>>> time
> > >>> > >>> >> >> > >>>>>> the
> > >>> > >>> >> >> > >>>>>>> fist long value sent in the initial
> > >>> message is
> > >>> > >>> not
> > >>> > >>> >> the
> > >>> > >>> >> >> server ID
> > >>> > >>> >> >> > >>> but
> > >>> > >>> >> >> > >>>>> the
> > >>> > >>> >> >> > >>>>>>> protocol version (-65536). In
> > ZooKeeper
> > >>> 3.4.6
> > >>> > we
> > >>> > >>> made
> > >>> > >>> >> >> the old 3.4
> > >>> > >>> >> >> > >>>>>>> ZooKeepers backward compatible, so
> > they are
> > >>> > able
> > >>> > >>> to
> > >>> > >>> >> >> parse both
> > >>> > >>> >> >> > >> the
> > >>> > >>> >> >> > >>>> old
> > >>> > >>> >> >> > >>>>>> and
> > >>> > >>> >> >> > >>>>>>> the new protocol format (see
> > >>> ZOOKEEPER-1633).
> > >>> > >>> This
> > >>> > >>> >> >> issue happens
> > >>> > >>> >> >> > >>> only
> > >>> > >>> >> >> > >>>>>> when
> > >>> > >>> >> >> > >>>>>>> you need to use old (3.4.0 - 3.4.5)
> > and new
> > >>> > >>> (3.5.0+)
> > >>> > >>> >> >> ZooKeeper
> > >>> > >>> >> >> > >>>> servers
> > >>> > >>> >> >> > >>>>>>> together in the same cluster.
> During
> > a
> > >>> rolling
> > >>> > >>> >> upgrade,
> > >>> > >>> >> >> this is
> > >>> > >>> >> >> > >>>> usually
> > >>> > >>> >> >> > >>>>>> the
> > >>> > >>> >> >> > >>>>>>> case to have old and new ZooKeepers
> > present
> > >>> > >>> together.
> > >>> > >>> >> >> > >>>>>>>
> > >>> > >>> >> >> > >>>>>>> The fact that you haven't seen any
> > issues
> > >>> might
> > >>> > >>> be
> > >>> > >>> >> >> caused by the
> > >>> > >>> >> >> > >>>> order
> > >>> > >>> >> >> > >>>>> of
> > >>> > >>> >> >> > >>>>>>> the servers. In ZooKeeper the
> > connection
> > >>> > >>> initiation
> > >>> > >>> >> >> between the
> > >>> > >>> >> >> > >>>> servers
> > >>> > >>> >> >> > >>>>>>> during the leader election follows
> a
> > >>> specific
> > >>> > >>> rule.
> > >>> > >>> >> As
> > >>> > >>> >> >> far as I
> > >>> > >>> >> >> > >>>>> remember
> > >>> > >>> >> >> > >>>>>>> always the server with the larger
> ID
> > 'wins
> > >>> the
> > >>> > >>> >> >> challenge', so it
> > >>> > >>> >> >> > >> is
> > >>> > >>> >> >> > >>>>>>> possible, that the old server
> didn't
> > need
> > >>> to
> > >>> > >>> parse
> > >>> > >>> >> any
> > >>> > >>> >> >> initial
> > >>> > >>> >> >> > >>>> message
> > >>> > >>> >> >> > >>>>>> (if
> > >>> > >>> >> >> > >>>>>>> it had the largest ID) and this is
> > why you
> > >>> > >>> haven't
> > >>> > >>> >> seen
> > >>> > >>> >> >> the
> > >>> > >>> >> >> > >> issue.
> > >>> > >>> >> >> > >>>> Also
> > >>> > >>> >> >> > >>>>>>> having 2 nodes up from the 3 nodes
> > cluster
> > >>> > still
> > >>> > >>> >> makes
> > >>> > >>> >> >> the
> > >>> > >>> >> >> > >> cluster
> > >>> > >>> >> >> > >>>> work
> > >>> > >>> >> >> > >>>>>> (so
> > >>> > >>> >> >> > >>>>>>> you should also check if all the
> > servers
> > >>> are
> > >>> > >>> part of
> > >>> > >>> >> >> the quorum).
> > >>> > >>> >> >> > >>>>>>>
> > >>> > >>> >> >> > >>>>>>> I agree with Enrico and Norbert,
> the
> > >>> safest and
> > >>> > >>> most
> > >>> > >>> >> >> stable way
> > >>> > >>> >> >> > >> is
> > >>> > >>> >> >> > >>>>>> upgrade
> > >>> > >>> >> >> > >>>>>>> first to 3.4.latest, then go to
> > 3.5.latest.
> > >>> > >>> Still, if
> > >>> > >>> >> >> you don't
> > >>> > >>> >> >> > >> see
> > >>> > >>> >> >> > >>>>> that
> > >>> > >>> >> >> > >>>>>>> you would hit this specific issue
> > (e.g. no
> > >>> > >>> "Invalid
> > >>> > >>> >> >> server id" in
> > >>> > >>> >> >> > >>> the
> > >>> > >>> >> >> > >>>>> log
> > >>> > >>> >> >> > >>>>>>> files), and all the three servers
> can
> > >>> handle
> > >>> > >>> traffic,
> > >>> > >>> >> >> then maybe
> > >>> > >>> >> >> > >>> you
> > >>> > >>> >> >> > >>>>>> don't
> > >>> > >>> >> >> > >>>>>>> need to upgrade first to
> 3.4.latest,
> > it is
> > >>> your
> > >>> > >>> >> >> decision.
> > >>> > >>> >> >> > >>> Definitely
> > >>> > >>> >> >> > >>>>> you
> > >>> > >>> >> >> > >>>>>>> should test it first, as suggested
> > by the
> > >>> > others.
> > >>> > >>> >> >> > >>>>>>>
> > >>> > >>> >> >> > >>>>>>> Kind regards,
> > >>> > >>> >> >> > >>>>>>> Mate
> > >>> > >>> >> >> > >>>>>>>
> > >>> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM
> > Norbert
> > >>> Kalmar
> > >>> > >>> >> >> > >>>>>>> <nk...@cloudera.com.invalid>
> > wrote:
> > >>> > >>> >> >> > >>>>>>>
> > >>> > >>> >> >> > >>>>>>>> Hi,
> > >>> > >>> >> >> > >>>>>>>>
> > >>> > >>> >> >> > >>>>>>>> That guide is to upgrade to 3.5.0,
> > which
> > >>> was
> > >>> > an
> > >>> > >>> >> alpha
> > >>> > >>> >> >> version.
> > >>> > >>> >> >> > >> A
> > >>> > >>> >> >> > >>>> lot
> > >>> > >>> >> >> > >>>>>> has
> > >>> > >>> >> >> > >>>>>>>> changed for the first stable
> > release of
> > >>> 3.5.5
> > >>> > >>> and
> > >>> > >>> >> then
> > >>> > >>> >> >> a few
> > >>> > >>> >> >> > >>> more,
> > >>> > >>> >> >> > >>>>> even
> > >>> > >>> >> >> > >>>>>>>> rolling upgrade issues have been
> > fixed for
> > >>> > >>> 3.5.6.
> > >>> > >>> >> >> > >>>>>>>> This is a more up-to-date guide:
> > >>> > >>> >> >> > >>>>>>>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >>
> > >>> >
> > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> > >>> > >>> >> >> > >>>>>>>>
> > >>> > >>> >> >> > >>>>>>>> If you have done your testing
> (with
> > prod
> > >>> > >>> snapshot!),
> > >>> > >>> >> >> then you
> > >>> > >>> >> >> > >> can
> > >>> > >>> >> >> > >>>>> skip
> > >>> > >>> >> >> > >>>>>>> 3.4
> > >>> > >>> >> >> > >>>>>>>> latest upgrade, but keep in mind
> we
> > do our
> > >>> > >>> >> >> recommendations for
> > >>> > >>> >> >> > >> a
> > >>> > >>> >> >> > >>>>>> reason.
> > >>> > >>> >> >> > >>>>>>>> There were issues reported and/or
> > found
> > >>> during
> > >>> > >>> >> >> testing. Some
> > >>> > >>> >> >> > >> are
> > >>> > >>> >> >> > >>>>> fixed
> > >>> > >>> >> >> > >>>>>>> with
> > >>> > >>> >> >> > >>>>>>>> 3.5.6, some only happens if
> certain
> > >>> conditions
> > >>> > >>> stand
> > >>> > >>> >> >> > >>> (IOException:
> > >>> > >>> >> >> > >>>> No
> > >>> > >>> >> >> > >>>>>>>> snapshot found - mentioned in the
> > guide,
> > >>> fixed
> > >>> > >>> in
> > >>> > >>> >> >> 3.5.6).
> > >>> > >>> >> >> > >>>>>>>>
> > >>> > >>> >> >> > >>>>>>>> So it is up to you, I would still
> > >>> recommend to
> > >>> > >>> do an
> > >>> > >>> >> >> 3.4
> > >>> > >>> >> >> > >> upgrade
> > >>> > >>> >> >> > >>>>> first,
> > >>> > >>> >> >> > >>>>>>> if
> > >>> > >>> >> >> > >>>>>>>> it's feasible.
> > >>> > >>> >> >> > >>>>>>>>
> > >>> > >>> >> >> > >>>>>>>> Regards,
> > >>> > >>> >> >> > >>>>>>>> Norbert
> > >>> > >>> >> >> > >>>>>>>>
> > >>> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM
> > kuldeep
> > >>> > singh <
> > >>> > >>> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
> > >>> > >>> >> >> > >>>>>>>> wrote:
> > >>> > >>> >> >> > >>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>> Hi,
> > >>> > >>> >> >> > >>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>> Current Zookeeper version :-
> 3.4.5
> > >>> > >>> >> >> > >>>>>>>>> Upgraded version
> :-
> > 3.5.6
> > >>> > >>> >> >> > >>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>> We are not going with 3.5.7. Our
> > final
> > >>> > >>> decision is
> > >>> > >>> >> >> zookeeper
> > >>> > >>> >> >> > >>>>> version
> > >>> > >>> >> >> > >>>>>> is
> > >>> > >>> >> >> > >>>>>>>>> 3.5.6
> > >>> > >>> >> >> > >>>>>>>>> as per your reply first we need
> to
> > move
> > >>> > latest
> > >>> > >>> >> >> version of
> > >>> > >>> >> >> > >>> 3.4.x,
> > >>> > >>> >> >> > >>>>> like
> > >>> > >>> >> >> > >>>>>>>> below
> > >>> > >>> >> >> > >>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct
> > me if
> > >>> I am
> > >>> > >>> wrong
> > >>> > >>> >> >> here)
> > >>> > >>> >> >> > >>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>> But if We are not facing any
> > problem
> > >>> that i
> > >>> > >>> have
> > >>> > >>> >> >> shared you
> > >>> > >>> >> >> > >>> that
> > >>> > >>> >> >> > >>>> we
> > >>> > >>> >> >> > >>>>>>> have
> > >>> > >>> >> >> > >>>>>>>>> set up of 3 node cluster where 2
> > node
> > >>> are on
> > >>> > >>> 3.5.6
> > >>> > >>> >> >> version
> > >>> > >>> >> >> > >> and
> > >>> > >>> >> >> > >>> 1
> > >>> > >>> >> >> > >>>>> node
> > >>> > >>> >> >> > >>>>>>> on
> > >>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything is running fine
> > and
> > >>> didn't
> > >>> > >>> get
> > >>> > >>> >> any
> > >>> > >>> >> >> issue,
> > >>> > >>> >> >> > >> So
> > >>> > >>> >> >> > >>>> what
> > >>> > >>> >> >> > >>>>>>> other
> > >>> > >>> >> >> > >>>>>>>>> problem we can face if we
> directly
> > move
> > >>> to
> > >>> > >>> 3.5.6
> > >>> > >>> >> >> > >>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>> Thanks,
> > >>> > >>> >> >> > >>>>>>>>> ---------------------
> > >>> > >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
> > >>> > >>> >> >> > >>>>>>>>> Software Architect
> > >>> > >>> >> >> > >>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM
> > Enrico
> > >>> > >>> Olivelli <
> > >>> > >>> >> >> > >>>>> eolivelli@gmail.com
> > >>> > >>> >> >> > >>>>>>>
> > >>> > >>> >> >> > >>>>>>>>> wrote:
> > >>> > >>> >> >> > >>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>> Hi
> > >>> > >>> >> >> > >>>>>>>>>> You have to upgrade to latest
> > 3.4.x
> > >>> > Zookeeper
> > >>> > >>> then
> > >>> > >>> >> >> you will
> > >>> > >>> >> >> > >>>>> upgrade
> > >>> > >>> >> >> > >>>>>>> to
> > >>> > >>> >> >> > >>>>>>>>>> 3.5.7.
> > >>> > >>> >> >> > >>>>>>>>>> All should run well without
> issues
> > >>> > >>> >> >> > >>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>> Enrico
> > >>> > >>> >> >> > >>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18
> kuldeep
> > singh
> > >>> <
> > >>> > >>> >> >> > >>>>> kuldeep.singh08@gmail.com
> > >>> > >>> >> >> > >>>>>>>
> > >>> > >>> >> >> > >>>>>>> ha
> > >>> > >>> >> >> > >>>>>>>>>> scritto:
> > >>> > >>> >> >> > >>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>>> Hi Team,
> > >>> > >>> >> >> > >>>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>>> We are upgrading zookeeper from
> > 3.4.5
> > >>> to
> > >>> > >>> 3.5.6. I
> > >>> > >>> >> >> have
> > >>> > >>> >> >> > >> set
> > >>> > >>> >> >> > >>>> up 3
> > >>> > >>> >> >> > >>>>>>> node
> > >>> > >>> >> >> > >>>>>>>>>>> cluster where 2 node are on
> 3.5.6
> > >>> version
> > >>> > >>> and 1
> > >>> > >>> >> >> node on
> > >>> > >>> >> >> > >>>> 3.4.5.
> > >>> > >>> >> >> > >>>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>>> Everything is running fine and
> > didn't
> > >>> get
> > >>> > any
> > >>> > >>> >> issue
> > >>> > >>> >> >> on my
> > >>> > >>> >> >> > >>>>> system.
> > >>> > >>> >> >> > >>>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>>> but I found something on apache
> > site
> > >>> that
> > >>> > >>> first
> > >>> > >>> >> we
> > >>> > >>> >> >> need
> > >>> > >>> >> >> > >> to
> > >>> > >>> >> >> > >>>>>> upgrade
> > >>> > >>> >> >> > >>>>>>>> on
> > >>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to
> > 3.5.6. So
> > >>> is
> > >>> > it
> > >>> > >>> >> >> mandatory
> > >>> > >>> >> >> > >> to
> > >>> > >>> >> >> > >>> go
> > >>> > >>> >> >> > >>>>> on
> > >>> > >>> >> >> > >>>>>>>> 3.4.6
> > >>> > >>> >> >> > >>>>>>>>>>> first.
> > >>> > >>> >> >> > >>>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
> > >>> > >>> >> >> > >>>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>>> Upgrading a running ZooKeeper
> > ensemble
> > >>> to
> > >>> > >>> 3.5.0
> > >>> > >>> >> >> should be
> > >>> > >>> >> >> > >>>> done
> > >>> > >>> >> >> > >>>>>> only
> > >>> > >>> >> >> > >>>>>>>>> after
> > >>> > >>> >> >> > >>>>>>>>>>> upgrading your ensemble to the
> > 3.4.6
> > >>> > release.
> > >>> > >>> >> Note
> > >>> > >>> >> >> that
> > >>> > >>> >> >> > >>> this
> > >>> > >>> >> >> > >>>> is
> > >>> > >>> >> >> > >>>>>>> only
> > >>> > >>> >> >> > >>>>>>>>>>> necessary for rolling upgrades
> > (if
> > >>> you're
> > >>> > >>> fine
> > >>> > >>> >> with
> > >>> > >>> >> >> > >>> shutting
> > >>> > >>> >> >> > >>>>> down
> > >>> > >>> >> >> > >>>>>>> the
> > >>> > >>> >> >> > >>>>>>>>>>> system completely, you don't
> > have to go
> > >>> > >>> through
> > >>> > >>> >> >> 3.4.6).
> > >>> > >>> >> >> > >> If
> > >>> > >>> >> >> > >>>> you
> > >>> > >>> >> >> > >>>>>>>> attempt
> > >>> > >>> >> >> > >>>>>>>>> a
> > >>> > >>> >> >> > >>>>>>>>>>> rolling upgrade without going
> > through
> > >>> 3.4.6
> > >>> > >>> (for
> > >>> > >>> >> >> example
> > >>> > >>> >> >> > >>> from
> > >>> > >>> >> >> > >>>>>>> 3.4.5),
> > >>> > >>> >> >> > >>>>>>>>> you
> > >>> > >>> >> >> > >>>>>>>>>>> may get the following error:
> > >>> > >>> >> >> > >>>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663
> [myid:2]
> > - INFO
> > >>> > >>> >> [localhost/
> > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > >>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager$Listener@498
> ]
> > -
> > >>> Received
> > >>> > >>> >> >> connection
> > >>> > >>> >> >> > >>>> request
> > >>> > >>> >> >> > >>>>> /
> > >>> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
> > >>> > >>> >> >> > >>>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663
> [myid:2]
> > - WARN
> > >>> > >>> >> [localhost/
> > >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > >>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349] -
> Invalid
> > >>> server
> > >>> > id:
> > >>> > >>> >> -65536
> > >>> > >>> >> >> > >>>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>>> During a rolling upgrade, each
> > server
> > >>> is
> > >>> > >>> taken
> > >>> > >>> >> down
> > >>> > >>> >> >> in
> > >>> > >>> >> >> > >> turn
> > >>> > >>> >> >> > >>>> and
> > >>> > >>> >> >> > >>>>>>>>> rebooted
> > >>> > >>> >> >> > >>>>>>>>>>> with the new 3.5.0 binaries.
> > Before
> > >>> > starting
> > >>> > >>> the
> > >>> > >>> >> >> server
> > >>> > >>> >> >> > >>> with
> > >>> > >>> >> >> > >>>>>> 3.5.0
> > >>> > >>> >> >> > >>>>>>>>>>> binaries, we highly recommend
> > updating
> > >>> the
> > >>> > >>> >> >> configuration
> > >>> > >>> >> >> > >>> file
> > >>> > >>> >> >> > >>>>> so
> > >>> > >>> >> >> > >>>>>>> that
> > >>> > >>> >> >> > >>>>>>>>> all
> > >>> > >>> >> >> > >>>>>>>>>>> server statements
> "server.x=..."
> > >>> contain
> > >>> > >>> client
> > >>> > >>> >> >> ports
> > >>> > >>> >> >> > >> (see
> > >>> > >>> >> >> > >>>> the
> > >>> > >>> >> >> > >>>>>>>> section
> > >>> > >>> >> >> > >>>>>>>>>>> Specifying
> > >>> > >>> >> >> > >>>>>>>>>>> the client port). As explained
> > earlier
> > >>> you
> > >>> > >>> may
> > >>> > >>> >> >> leave the
> > >>> > >>> >> >> > >>>>>>>> configuration
> > >>> > >>> >> >> > >>>>>>>>>> in a
> > >>> > >>> >> >> > >>>>>>>>>>> single file, as well as leave
> the
> > >>> > >>> >> >> > >>>> clientPort/clientPortAddress
> > >>> > >>> >> >> > >>>>>>>>> statements
> > >>> > >>> >> >> > >>>>>>>>>>> (although if you specify client
> > ports
> > >>> in
> > >>> > the
> > >>> > >>> new
> > >>> > >>> >> >> format,
> > >>> > >>> >> >> > >>>> these
> > >>> > >>> >> >> > >>>>>>>>> statements
> > >>> > >>> >> >> > >>>>>>>>>>> are now redundant).
> > >>> > >>> >> >> > >>>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>>> Could you please let me know
> > about this
> > >>> > case.
> > >>> > >>> >> >> Appreciate
> > >>> > >>> >> >> > >> if
> > >>> > >>> >> >> > >>>>>> respond
> > >>> > >>> >> >> > >>>>>>>>> soon.
> > >>> > >>> >> >> > >>>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>>> Thanks,
> > >>> > >>> >> >> > >>>>>>>>>>> ---------------------
> > >>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
> > >>> > >>> >> >> > >>>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>>
> > >>> > >>> >> >> > >>>>>>>>
> > >>> > >>> >> >> > >>>>>>>
> > >>> > >>> >> >> > >>>>>>
> > >>> > >>> >> >> > >>>>>
> > >>> > >>> >> >> > >>>>
> > >>> > >>> >> >> > >>>
> > >>> > >>> >> >> > >>
> > >>> > >>> >> >> >
> > >>> > >>> >> >> >
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >> >> ________________________________
> > >>> > >>> >> >>
> > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > >>> > >>> >> >> This e-mail (including any attachments) is
> strictly
> > >>> > >>> confidential
> > >>> > >>> >> and
> > >>> > >>> >> >> may also contain privileged information. If you are
> > not the
> > >>> > >>> intended
> > >>> > >>> >> >> recipient you are not authorised to read, print,
> save,
> > >>> process or
> > >>> > >>> >> disclose
> > >>> > >>> >> >> this message. If you have received this message by
> > mistake,
> > >>> > please
> > >>> > >>> >> inform
> > >>> > >>> >> >> the sender immediately and destroy this e-mail, its
> > >>> attachments
> > >>> > >>> and any
> > >>> > >>> >> >> copies. Any use, distribution, reproduction or
> > disclosure by
> > >>> any
> > >>> > >>> person
> > >>> > >>> >> >> other than the intended recipient is strictly
> > prohibited and
> > >>> the
> > >>> > >>> person
> > >>> > >>> >> >> responsible may incur in penalties.
> > >>> > >>> >> >> The use of this e-mail is only for professional
> > purposes;
> > >>> > >>> there is
> > >>> > >>> >> no
> > >>> > >>> >> >> guarantee that the correspondence towards this e-mail
> > will be
> > >>> > read
> > >>> > >>> >> only by
> > >>> > >>> >> >> the recipient, because, under certain circumstances,
> > there
> > >>> may
> > >>> > be a
> > >>> > >>> >> need to
> > >>> > >>> >> >> access this email by third subjects belonging to the
> > Company.
> > >>> > >>> >> >>
> > >>> > >>> >> >>
> > >>> > >>> >> >> ________________________________
> > >>> > >>> >> >>
> > >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > >>> > >>> >> >> This e-mail (including any attachments) is strictly
> > >>> confidential
> > >>> > >>> and
> > >>> > >>> >> may
> > >>> > >>> >> >> also contain privileged information. If you are not
> the
> > >>> intended
> > >>> > >>> >> recipient
> > >>> > >>> >> >> you are not authorised to read, print, save, process
> or
> > >>> disclose
> > >>> > >>> this
> > >>> > >>> >> >> message. If you have received this message by
> mistake,
> > please
> > >>> > >>> inform
> > >>> > >>> >> the
> > >>> > >>> >> >> sender immediately and destroy this e-mail, its
> > attachments
> > >>> and
> > >>> > any
> > >>> > >>> >> copies.
> > >>> > >>> >> >> Any use, distribution, reproduction or disclosure by
> > any
> > >>> person
> > >>> > >>> other
> > >>> > >>> >> than
> > >>> > >>> >> >> the intended recipient is strictly prohibited and the
> > person
> > >>> > >>> >> responsible
> > >>> > >>> >> >> may incur in penalties.
> > >>> > >>> >> >> The use of this e-mail is only for professional
> > purposes;
> > >>> there
> > >>> > is
> > >>> > >>> no
> > >>> > >>> >> >> guarantee that the correspondence towards this e-mail
> > will be
> > >>> > read
> > >>> > >>> >> only by
> > >>> > >>> >> >> the recipient, because, under certain circumstances,
> > there
> > >>> may
> > >>> > be a
> > >>> > >>> >> need to
> > >>> > >>> >> >> access this email by third subjects belonging to the
> > Company.
> > >>> > >>> >> >>
> > >>> > >>> >> >
> > >>> > >>> >>
> > >>> > >>> >
> > >>> > >>>
> > >>> > >>
> > >>> >
> > >>>
> > >>
> >
> >
> > ________________________________
> >
> > CONFIDENTIALITY & PRIVACY NOTICE
> > This e-mail (including any attachments) is strictly confidential and may
> > also contain privileged information. If you are not the intended
> recipient
> > you are not authorised to read, print, save, process or disclose this
> > message. If you have received this message by mistake, please inform the
> > sender immediately and destroy this e-mail, its attachments and any
> copies.
> > Any use, distribution, reproduction or disclosure by any person other
> than
> > the intended recipient is strictly prohibited and the person responsible
> > may incur in penalties.
> > The use of this e-mail is only for professional purposes; there is no
> > guarantee that the correspondence towards this e-mail will be read only
> by
> > the recipient, because, under certain circumstances, there may be a need
> to
> > access this email by third subjects belonging to the Company.
> >
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Hi Team,
I am facing one issue in SSL communication between client and zookeeper
server.
ZK 3.5.6 version
1. Mi on 3 node
2. Applying SSL and 3 nodes cluster is working fine
3. Scaled my cluster with 2 nodes and now my cluster have 5 nodes over SSL
but after scaling my SSL is not working between client and ZK server and
even not able to login using zkCli as well.
Can someone provide the details please why it is happening?
Thanks,
---------------------
Kuldeep Singh Budania
Software Architect
On Mon, Jul 13, 2020 at 2:19 PM Enrico Olivelli - Diennea
<en...@diennea.com.invalid> wrote:
> It looks like we ported it to 3.5.
>
> See the subtask
> https://issues.apache.org/jira/browse/ZOOKEEPER-2792
>
> Enrico
>
> Il giorno 13/07/20, 10:37 "kuldeep singh" <ku...@gmail.com> ha
> scritto:
>
> Hi Team,
>
> I appreciate it if I will get a response as soon as possible, as I am
> stuck
> at this point.
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <
> kuldeep.singh08@gmail.com>
> wrote:
>
> > Hi Team,
> >
> > Server to Server communication is not supported in 3.5.6 version as
> per
> > below JIRA issue?
> >
> > https://issues.apache.org/jira/browse/ZOOKEEPER-2639
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> >
> >
> >
> > On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <
> kuldeep.singh08@gmail.com>
> > wrote:
> >
> >> Thanks for the reply.
> >>
> >> Now my ZKCli cmd is working fine as we use some our customized
> >> authentication and we resolve the issue.
> >>
> >> Now I am going to implement Server to Server communication.
> >>
> >> Thanks,
> >> ---------------------
> >> Kuldeep Singh Budania
> >>
> >>
> >>
> >> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
> >> szalay.beko.mate@gmail.com> wrote:
> >>
> >>> I think SSL is working for you already... If you managed to start
> the
> >>> zkCli.sh and be able to connect to ZooKeeper on the secure port
> and issue
> >>> any kind of command (like: " ls / "), then the wire encryption is
> working
> >>> and your server/client communication is secured by ZooKeeper.
> >>>
> >>> Why you want to run the following command?
> >>> addauth ztpasswd zooadmin:<password>
> >>>
> >>> Do you also want to configure a superDigest user in ZooKeeper?
> Please
> >>> note
> >>> that this command is independent from SSL. If you need to create a
> >>> username-password pair for digest authentication then please use
> the
> >>> command in the following way:
> >>> addauth digest zooadmin:yourSuperSecretPassword
> >>>
> >>> Kind regards,
> >>> Mate
> >>>
> >>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <
> kuldeep.singh08@gmail.com>
> >>> wrote:
> >>>
> >>> > 1. sh zkCli.sh --config /etc/zookeeper -server localhost:2281
> >>> >
> >>> > 2. addauth ztpasswd zooadmin:<password>
> >>> >
> >>> >
> >>> > Thanks,
> >>> > ---------------------
> >>> > Kuldeep Singh Budania
> >>> >
> >>> >
> >>> >
> >>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
> >>> kuldeep.singh08@gmail.com>
> >>> > wrote:
> >>> >
> >>> > > Hi Team,
> >>> > >
> >>> > > Any update on this?
> >>> > >
> >>> > > Thanks,
> >>> > > ---------------------
> >>> > > Kuldeep Singh Budania
> >>> > >
> >>> > >
> >>> > >
> >>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
> >>> kuldeep.singh08@gmail.com>
> >>> > > wrote:
> >>> > >
> >>> > >> Sorry this is my bad, there were server setting like below
> >>> > >>
> >>> > >> export SERVER_JVMFLAGS="
> >>> > >>
> >>> > >>
> >>> > >>
> >>> >
> >>>
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >>> > >>
> >>> > >>
> >>>
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> >>> > >>
> >>> >
> >>>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> >>> > >>
> >>> > >>
> >>> > >>
> >>> > >> export CLIENT_JVMFLAGS="
> >>> > >>
> >>> > >>
> >>>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >>> > >> -Dzookeeper.client.secure=true
> >>> > >>
> >>>
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >>> > >> -Dzookeeper.ssl.keyStore.password=testpass
> >>> > >>
> >>> >
> >>>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> >>> > >>
> >>> > >> I want to have SSL between client to server communication
> >>> > >>
> >>> > >> I am already following the same link which you have shared
> with me
> >>> but
> >>> > >> that is not working.
> >>> > >>
> >>> > >> Zoo.cfg
> >>> > >>
> >>> > >> secureClientPort=2281
> >>> > >> initLimit=10
> >>> > >> syncLimit=5
> >>> > >> dataDir=/var/lib/zookeeper/data
> >>> > >> tickTime=2000
> >>> > >> autopurge.snapRetainCount=3
> >>> > >> autopurge.purgeInterval=1
> >>> > >> admin.enableServer=false
> >>> > >> standaloneEnabled=false
> >>> > >> jute.maxbuffer=2147483648
> >>> > >>
> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >>> > >> server.1=host1_priv:10288:10388
> >>> > >> server.2=host2_priv:10288:10388
> >>> > >> server.3=host3_priv:10288:10388
> >>> > >>
> >>> > >>
> >>> > >> command to connect using zkcli
> >>> > >>
> >>> > >> 1. zkcli zoo.cfg localhost:2281
> >>> > >> 2. addauth ztpasswd usernaem:password
> >>> > >>
> >>> > >> after second step we are getting below error
> >>> > >>
> >>> > >> WatchedEvent state:AuthFailed type:None path:null
> >>> > >>
> >>> > >>
> >>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> >>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> authentication
> >>> > provider
> >>> > >> for scheme: ztpasswd has x509 ip digest*
> >>> > >>
> >>> > >> Thanks,
> >>> > >> ---------------------
> >>> > >> Kuldeep Singh Budania
> >>> > >>
> >>> > >>
> >>> > >>
> >>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
> >>> > >> szalay.beko.mate@gmail.com> wrote:
> >>> > >>
> >>> > >>> > No authentication provider for scheme: ztpasswd has x509
> ip
> >>> digest*
> >>> > >>>
> >>> > >>> This suggest you have some configuration error... Where did
> you
> >>> use the
> >>> > >>> "ztpasswd" string in your configs / commands?
> >>> > >>>
> >>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
> >>> > >>> szalay.beko.mate@gmail.com>
> >>> > >>> wrote:
> >>> > >>>
> >>> > >>> > > My ZK server is up and running in secure mode
> >>> > >>> >
> >>> > >>> > What is your goal? You want to setup client-server SSL
> >>> connection?
> >>> > >>> >
> >>> > >>> > see:
> >>> > >>> >
> >>> > >>>
> >>> >
> >>>
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
> >>> > >>> >
> >>> > >>> > (or you want to have both SSL and SASL enabled?)
> >>> > >>> >
> >>> > >>> > Anyway, please remove the following line from the
> >>> SERVER_JVMFLAGS:
> >>> > >>> >
> >>> >
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >>> > >>> > This is a configuration that makes sense only for the
> ZooKeeper
> >>> > client,
> >>> > >>> > not for the server. For the server, use the following:
> >>> > >>> >
> >>> > >>> >
> >>> > >>>
> >>> >
> >>>
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >>> > >>> >
> >>> > >>> > If it doesn't solve the issue, then can you please send
> your
> >>> zoo.cfg
> >>> > >>> file?
> >>> > >>> > Also can you please send the zkCli command you execute?
> (you
> >>> need to
> >>> > >>> > connect to the secure ZooKeeper port, unless
> portUnification is
> >>> > >>> enabled)
> >>> > >>> >
> >>> > >>> > Kind regards,
> >>> > >>> > Mate
> >>> > >>> >
> >>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
> >>> > >>> kuldeep.singh08@gmail.com>
> >>> > >>> > wrote:
> >>> > >>> >
> >>> > >>> >> Hi,
> >>> > >>> >>
> >>> > >>> >> we have done below changes in java.env file
> >>> > >>> >>
> >>> > >>> >> export SERVER_JVMFLAGS="
> >>> > >>> >>
> >>> > >>> >>
> >>> > >>>
> >>>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >>> > >>> >>
> >>> >
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> >>> > >>> >>
> >>> > >>> >>
> >>> > >>> >>
> >>> > >>> >> export CLIENT_JVMFLAGS="
> >>> > >>> >>
> >>> > >>> >>
> >>> > >>>
> >>>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >>> > >>> >> -Dzookeeper.client.secure=true
> >>> > >>> >>
> >>> >
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> >>> > >>> >>
> >>> > >>> >> I have started the ZK server and it is up without any
> issue.
> >>> > >>> >>
> >>> > >>> >> But now when I login to ZkCli then it gives the below
> error.
> >>> > >>> >>
> >>> > >>> >> WatchedEvent state:AuthFailed type:None path:null
> >>> > >>> >>
> >>> > >>> >>
> >>> > >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> >>> > >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> >>> authentication
> >>> > >>> provider
> >>> > >>> >> for scheme: ztpasswd has x509 ip digest*
> >>> > >>> >>
> >>> > >>> >> Please help me on this issue
> >>> > >>> >>
> >>> > >>> >> Thanks,
> >>> > >>> >> ---------------------
> >>> > >>> >> Kuldeep Singh Budania
> >>> > >>> >> Software Architect
> >>> > >>> >>
> >>> > >>> >>
> >>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
> >>> > >>> kuldeep.singh08@gmail.com>
> >>> > >>> >> wrote:
> >>> > >>> >>
> >>> > >>> >> > Hi,
> >>> > >>> >> >
> >>> > >>> >> > My ZK server is up and running in secure mode, But
> When I am
> >>> > >>> trying to
> >>> > >>> >> > connect to the ZK server using ZKCli, it gives the below
> >>> error.
> >>> > >>> >> >
> >>> > >>> >> > WatchedEvent state:AuthFailed type:None path:null
> >>> > >>> >> >
> >>> > >>> >> >
> >>> > >>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> >>> > >>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> >>> authentication
> >>> > >>> >> provider
> >>> > >>> >> > for scheme: ztpasswd has x509 ip digest*
> >>> > >>> >> >
> >>> > >>> >> > Can someone please help me on this issue. we are using
> the
> >>> 3.5.6
> >>> > >>> >> version.
> >>> > >>> >> >
> >>> > >>> >> > I appreciate if I will get a response as soon as
> possible, as
> >>> I am
> >>> > >>> stuck
> >>> > >>> >> > at this point.
> >>> > >>> >> >
> >>> > >>> >> > Thanks,
> >>> > >>> >> > ---------------------
> >>> > >>> >> > Kuldeep Singh Budania
> >>> > >>> >> > Software Architect
> >>> > >>> >> >
> >>> > >>> >> >
> >>> > >>> >> >
> >>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli -
> Diennea
> >>> > >>> >> > <en...@diennea.com.invalid> wrote:
> >>> > >>> >> >
> >>> > >>> >> >> I mean in zoo.cfg
> >>> > >>> >> >> Not as a system property
> >>> > >>> >> >>
> >>> > >>> >> >> Enrico
> >>> > >>> >> >>
> >>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <
> >>> > >>> >> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
> >>> > >>> >> >>
> >>> > >>> >> >> Hi
> >>> > >>> >> >> You have to enable Netty on the server side
> >>> > >>> >> >>
> >>> > >>> >> >> Something like:
> >>> > >>> >> >>
> >>> > >>> >>
> >>> >
> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >>> > >>> >> >>
> >>> > >>> >> >> Hope that helps
> >>> > >>> >> >> Enrico
> >>> > >>> >> >>
> >>> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
> >>> > >>> >> kuldeep.singh08@gmail.com>
> >>> > >>> >> >> ha scritto:
> >>> > >>> >> >>
> >>> > >>> >> >> Hi,
> >>> > >>> >> >>
> >>> > >>> >> >> I got below error while setting SSL properties
> in
> >>> > zkEnv.sh
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> ==========================================================================================
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
> >>> > [main:QuorumPeerConfig@133]
> >>> > >>> -
> >>> > >>> >> >> Reading
> >>> > >>> >> >> configuration from: /etc/zookeeper/zoo.cfg
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> >>> > [main:QuorumPeerConfig@385]
> >>> > >>> -
> >>> > >>> >> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> >>> > [main:QuorumPeerConfig@399]
> >>> > >>> -
> >>> > >>> >> >> secureClientPortAddress is
> 0.0.0.0/0.0.0.0:2281
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,878 - INFO
> [main:X509Util@79] -
> >>> > >>> Setting
> >>> > >>> >> -D
> >>> > >>> >> >>
> jdk.tls.rejectClientInitiatedRenegotiation=true to
> >>> > disable
> >>> > >>> >> >> client-initiated
> >>> > >>> >> >> TLS renegotiation
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> >>> > >>> [main:DatadirCleanupManager@78]
> >>> > >>> >> -
> >>> > >>> >> >> autopurge.snapRetainCount set to 3
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> >>> > >>> [main:DatadirCleanupManager@79]
> >>> > >>> >> -
> >>> > >>> >> >> autopurge.purgeInterval set to 1
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,898 - INFO [
> >>> > >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@138]
> -
> >>> Purge
> >>> > >>> task
> >>> > >>> >> >> started.
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,899 - INFO
> [main:ManagedUtil@46]
> >>> -
> >>> > >>> Log4j
> >>> > >>> >> >> found with
> >>> > >>> >> >> jmx enabled.
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
> >>> > >>> [PurgeTask:FileTxnSnapLog@103]
> >>> > >>> >> -
> >>> > >>> >> >> zookeeper.snapshot.trust.empty : false
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,910 - INFO [
> >>> > >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@144]
> -
> >>> Purge
> >>> > >>> task
> >>> > >>> >> >> completed.
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
> >>> [main:QuorumPeerMain@141
> >>> > ]
> >>> > >>> -
> >>> > >>> >> >> Starting quorum
> >>> > >>> >> >> peer
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
> >>> > [main:ServerCnxnFactory@135]
> >>> > >>> -
> >>> > >>> >> >> Using
> >>> > >>> >> >>
> org.apache.zookeeper.server.NIOServerCnxnFactory as
> >>> > server
> >>> > >>> >> >> connection
> >>> > >>> >> >> factory
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
> >>> > >>> [main:NIOServerCnxnFactory@673]
> >>> > >>> >> -
> >>> > >>> >> >> Configuring NIO connection handler with 10s
> >>> sessionless
> >>> > >>> >> >> connection timeout,
> >>> > >>> >> >> 2 selector thread(s), 16 worker threads, and
> 64 kB
> >>> direct
> >>> > >>> >> buffers.
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
> >>> > >>> [main:NIOServerCnxnFactory@686
> >>> > >>> >> ]
> >>> > >>> >> >> - binding
> >>> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
> >>> > [main:ServerCnxnFactory@135]
> >>> > >>> -
> >>> > >>> >> >> Using
> >>> > >>> >> >>
> org.apache.zookeeper.server.NIOServerCnxnFactory as
> >>> > server
> >>> > >>> >> >> connection
> >>> > >>> >> >> factory
> >>> > >>> >> >>
> >>> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
> >>> [main:QuorumPeerMain@101
> >>> > ]
> >>> > >>> -
> >>> > >>> >> >> Unexpected
> >>> > >>> >> >> exception, exiting abnormally
> >>> > >>> >> >>
> >>> > >>> >> >> java.lang.UnsupportedOperationException: SSL
> isn't
> >>> > >>> supported in
> >>> > >>> >> >> NIOServerCnxn
> >>> > >>> >> >>
> >>> > >>> >> >> at
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> >>> > >>> >> >>
> >>> > >>> >> >> at
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> >>> > >>> >> >>
> >>> > >>> >> >> at
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> >>> > >>> >> >>
> >>> > >>> >> >> at
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >> >> I have set the following properties in
> >>> SERVER_JVMFLAGS in
> >>> > >>> >> >> zkEnv.sh file :
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> >>> > >>> >> >>
> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> >>> > >>> >> >>
> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> >>> > >>> >> >>
> >>> > >>> >> >> Thanks,
> >>> > >>> >> >> ---------------------
> >>> > >>> >> >> Kuldeep Singh Budania
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan
> Zimmerman <
> >>> > >>> >> >> jordan@jordanzimmerman.com>
> >>> > >>> >> >> wrote:
> >>> > >>> >> >>
> >>> > >>> >> >> > It's the same as the normal ZooKeeper client:
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >>> > >>> >> >> > <
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >>> > >>> >> >> > >
> >>> > >>> >> >> >
> >>> > >>> >> >> > -Jordan
> >>> > >>> >> >> >
> >>> > >>> >> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep singh
> <
> >>> > >>> >> >> kuldeep.singh08@gmail.com>
> >>> > >>> >> >> > wrote:
> >>> > >>> >> >> > >
> >>> > >>> >> >> > > Hi Team,
> >>> > >>> >> >> > > How we will do secure communication
> between the
> >>> > Curator
> >>> > >>> >> >> framework and
> >>> > >>> >> >> > > zookeeper 3.5.6 ?
> >>> > >>> >> >> > > I didn't get any solution right now.
> >>> > >>> >> >> > > I appreciate it if someone could help me
> with the
> >>> > same.
> >>> > >>> >> >> > >
> >>> > >>> >> >> > > Thanks,
> >>> > >>> >> >> > > ---------------------
> >>> > >>> >> >> > > Kuldeep Singh Budania
> >>> > >>> >> >> > > Software Architect
> >>> > >>> >> >> > >
> >>> > >>> >> >> > >
> >>> > >>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM
> Szalay-Bekő Máté
> >>> <
> >>> > >>> >> >> > szalay.beko.mate@gmail.com>
> >>> > >>> >> >> > > wrote:
> >>> > >>> >> >> > >
> >>> > >>> >> >> > >> Hello Kuldeep,
> >>> > >>> >> >> > >>
> >>> > >>> >> >> > >> did you download the source from the
> ZooKeeper
> >>> > >>> webpage, or
> >>> > >>> >> >> checked out
> >>> > >>> >> >> > from
> >>> > >>> >> >> > >> git?
> >>> > >>> >> >> > >> Anyway, the following commands should
> work:
> >>> > >>> >> >> > >>
> >>> > >>> >> >> > >> wget
> >>> > >>> >> >> > >>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> >>> > >>> >> >> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
> >>> > >>> >> >> > >> cd apache-zookeeper-3.5.7
> >>> > >>> >> >> > >> mvn clean install -DskipTests
> >>> > >>> >> >> > >>
> >>> > >>> >> >> > >> I tested it with OpenJDK 8u424 and maven
> 3.6.0.
> >>> > >>> >> >> > >>
> >>> > >>> >> >> > >> Kind regards,
> >>> > >>> >> >> > >> Mate
> >>> > >>> >> >> > >>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep
> singh <
> >>> > >>> >> >> > kuldeep.singh08@gmail.com>
> >>> > >>> >> >> > >> wrote:
> >>> > >>> >> >> > >>
> >>> > >>> >> >> > >>> Hi All,
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>> I have download the zookeeper source
> code and
> >>> run
> >>> > >>> the mvn
> >>> > >>> >> >> command for
> >>> > >>> >> >> > >>> packaging but get problem on
> "zookeeper-server"
> >>> > >>> >> directory.
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>> *command :- mvn clean package*
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>> [ERROR] Failed to execute goal
> >>> > >>> >> >> > >>>
> >>> > >>> >>
> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >>> > >>> >> >> > >>> (default-compile) on project zookeeper:
> Fatal
> >>> error
> >>> > >>> >> >> compiling:
> >>> > >>> >> >> > >>> java.lang.NullPointerException -> [Help
> 1]
> >>> > >>> >> >> > >>>
> >>> > >>> org.apache.maven.lifecycle.LifecycleExecutionException:
> >>> > >>> >> >> Failed to
> >>> > >>> >> >> > execute
> >>> > >>> >> >> > >>> goal
> >>> > >>> >> >>
> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >>> > >>> >> >> > >>> (default-compile) on project zookeeper:
> Fatal
> >>> error
> >>> > >>> >> >> compiling
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> >
> >>> > >>> >>
> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >>
> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >>
> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> java.lang.reflect.Method.invoke(Method.java:498)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> >>> > >>> >> >> > >>> Caused by:
> >>> > >>> >> org.apache.maven.plugin.MojoExecutionException:
> >>> > >>> >> >> Fatal error
> >>> > >>> >> >> > >>> compiling
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> >>> > >>> >> >> > >>> ... 19 more
> >>> > >>> >> >> > >>> Caused by:
> >>> > >>> >> org.codehaus.plexus.compiler.CompilerException:
> >>> > >>> >> >> > >>> java.lang.NullPointerException
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> >>> > >>> >> >> > >>> ... 22 more
> >>> > >>> >> >> > >>> Caused by: java.lang.RuntimeException:
> >>> > >>> >> >> java.lang.NullPointerException
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:559)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> > >>>
> >>>
> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> >
> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> >>> > >>> >> >> > >>> ... 24 more
> >>> > >>> >> >> > >>> Caused by: java.lang.NullPointerException
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> com.sun.tools.doclint.Checker.scan(Checker.java:144)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >>
> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> > >>>
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> > >>>
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> >
> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> >
> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> >
> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> >
> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> > >>>
> >>>
> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >>
> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>
> >>> > >>> >> >>
> >>> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> > >>>
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> > >>>
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> >
> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >>
> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> >
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >>
> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> > >>>
> >>>
> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> > >>>
> >>>
> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> > >>>
> >>>
> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> >>> > >>> >> >> > >>> at
> >>> > >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:523)
> >>> > >>> >> >> > >>> ... 27 more
> >>> > >>> >> >> > >>> [ERROR]
> >>> > >>> >> >> > >>> [ERROR] Re-run Maven using the -X switch
> to
> >>> enable
> >>> > >>> full
> >>> > >>> >> >> debug logging.
> >>> > >>> >> >> > >>> [ERROR]
> >>> > >>> >> >> > >>> [ERROR] For more information about the
> errors
> >>> and
> >>> > >>> >> possible
> >>> > >>> >> >> solutions,
> >>> > >>> >> >> > >>> please read the following articles:
> >>> > >>> >> >> > >>> [ERROR] [Help 1]
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>> Can someone help me on this issue?
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>> Thanks,
> >>> > >>> >> >> > >>> ---------------------
> >>> > >>> >> >> > >>> Kuldeep Singh Budania
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM
> Szalay-Bekő
> >>> Máté <
> >>> > >>> >> >> > >>> szalay.beko.mate@gmail.com>
> >>> > >>> >> >> > >>> wrote:
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>>> these exceptions can mean many
> things... I
> >>> think
> >>> > >>> this
> >>> > >>> >> can
> >>> > >>> >> >> be even
> >>> > >>> >> >> > >> normal
> >>> > >>> >> >> > >>>> duding rolling restart (as some
> connections
> >>> get
> >>> > >>> broken
> >>> > >>> >> in
> >>> > >>> >> >> this case)
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>> However, I saw cases already when
> exceptions
> >>> like
> >>> > >>> these
> >>> > >>> >> >> killed
> >>> > >>> >> >> > receiver
> >>> > >>> >> >> > >>> or
> >>> > >>> >> >> > >>>> sender threads in QuorumCnxManager /
> Leader
> >>> > >>> Election in
> >>> > >>> >> >> such a way
> >>> > >>> >> >> > that
> >>> > >>> >> >> > >>>> they were not able to recover, so the
> node was
> >>> > >>> unable to
> >>> > >>> >> >> connect to
> >>> > >>> >> >> > any
> >>> > >>> >> >> > >>>> quorum until restart. I remember seeing
> this
> >>> in
> >>> > 3.4
> >>> > >>> too.
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>> Do you see these exceptions in the
> second
> >>> server
> >>> > >>> (the
> >>> > >>> >> one
> >>> > >>> >> >> which you
> >>> > >>> >> >> > >> just
> >>> > >>> >> >> > >>>> upgraded in step 3)?
> >>> > >>> >> >> > >>>> Is this issue reproducible?
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>> What is the tickTime and initLimit you
> use?
> >>> Maybe
> >>> > >>> the
> >>> > >>> >> >> server just
> >>> > >>> >> >> > >> require
> >>> > >>> >> >> > >>>> more time to sync?
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>> I would need more logs to really see
> what
> >>> > happened.
> >>> > >>> Can
> >>> > >>> >> >> you create a
> >>> > >>> >> >> > >> Jira
> >>> > >>> >> >> > >>>> issue and upload the logs and also the
> >>> ZooKeeper
> >>> > >>> >> configs?
> >>> > >>> >> >> I am happy
> >>> > >>> >> >> > to
> >>> > >>> >> >> > >>>> take a closer look.
> >>> > >>> >> >> > >>>> (if you need to re-run the test to
> collect the
> >>> > logs,
> >>> > >>> >> then
> >>> > >>> >> >> enabling
> >>> > >>> >> >> > >> DEBUG
> >>> > >>> >> >> > >>>> logs would be great. The INFO level
> logs are
> >>> > usually
> >>> > >>> >> >> enough for these
> >>> > >>> >> >> > >>>> problems, but one can never know...)
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>> Kind regards,
> >>> > >>> >> >> > >>>> Mate
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep
> singh
> >>> <
> >>> > >>> >> >> > >> kuldeep.singh08@gmail.com
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>> wrote:
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>>> Hi Team,
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> I have done some POC on rolling
> upgrade and
> >>> found
> >>> > >>> below
> >>> > >>> >> >> result.
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> 1. On 1st node upgrade zookeeper .
> Traffic
> >>> was
> >>> > >>> >> running
> >>> > >>> >> >> fine
> >>> > >>> >> >> > >> because
> >>> > >>> >> >> > >>> 2
> >>> > >>> >> >> > >>>>> nodes are already on old zookeeper.
> >>> > >>> >> >> > >>>>> 2. On 1st node upgrade our
> application and
> >>> > didn’t
> >>> > >>> >> find
> >>> > >>> >> >> any issue
> >>> > >>> >> >> > >>>>> 3. On 2nd node upgrade zookeeper but
> got
> >>> below
> >>> > >>> error
> >>> > >>> >> >> and zookeeper
> >>> > >>> >> >> > >>> is
> >>> > >>> >> >> > >>>>> not taking any requests
> >>> > >>> >> >> > >>>>> 4.
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> java.io.EOFException
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> at
> >>> > >>> >> >>
> java.io.DataInputStream.readInt(DataInputStream.java:392)
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> at
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
> >>> > >>> >> >> > >>>>>
> [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
> >>> -
> >>> > >>> >> >> Interrupting
> >>> > >>> >> >> > >>> SendWorker
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR
> >>> [LearnerHandler-/
> >>> > >>> >> >> 192.168.44.73:33754
> >>> > >>> >> >> > >>>>> :LearnerHandler@562] - Unexpected
> exception
> >>> > >>> causing
> >>> > >>> >> >> shutdown while
> >>> > >>> >> >> > >>> sock
> >>> > >>> >> >> > >>>>> still open
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> java.io.EOFException
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> at
> >>> > >>> >> >>
> java.io.DataInputStream.readInt(DataInputStream.java:392)
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> at
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >>
> >>> > >>>
> >>>
> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> at
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> at
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> at
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >>
> >>> > >>>
> >>> >
> >>>
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
> >>> > >>> >> >> > >>>>>
> [SendWorker:1:QuorumCnxManager$SendWorker@679]
> >>> -
> >>> > >>> >> >> Interrupted while
> >>> > >>> >> >> > >>>> waiting
> >>> > >>> >> >> > >>>>> for message on queue
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> Please let me know is this the known
> issue or
> >>> > this
> >>> > >>> is
> >>> > >>> >> >> different issue
> >>> > >>> >> >> > >>>> which
> >>> > >>> >> >> > >>>>> is mention in Apache zookeeper
> documentation
> >>> when
> >>> > >>> >> >> upgrading from
> >>> > >>> >> >> > >> 3.4.5
> >>> > >>> >> >> > >>> to
> >>> > >>> >> >> > >>>>> 3.5.6
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> Thanks,
> >>> > >>> >> >> > >>>>> ---------------------
> >>> > >>> >> >> > >>>>> Kuldeep Singh Budania
> >>> > >>> >> >> > >>>>> Software Architect
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM
> Alexander
> >>> Shraer
> >>> > <
> >>> > >>> >> >> shralex@gmail.com>
> >>> > >>> >> >> > >>>>> wrote:
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>>> +1 to what Mate said (I wrote the
> quoted
> >>> > >>> >> instructions).
> >>> > >>> >> >> > >>>>>>
> >>> > >>> >> >> > >>>>>>
> >>> > >>> >> >> > >>>>>>
> >>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM
> Szalay-Bekő
> >>> > Máté <
> >>> > >>> >> >> > >>>>>> szalay.beko.mate@gmail.com>
> >>> > >>> >> >> > >>>>>> wrote:
> >>> > >>> >> >> > >>>>>>
> >>> > >>> >> >> > >>>>>>> Hi Kuldeep,
> >>> > >>> >> >> > >>>>>>>
> >>> > >>> >> >> > >>>>>>> I just want to provide you some
> background
> >>> info
> >>> > >>> about
> >>> > >>> >> >> our
> >>> > >>> >> >> > >>>>> documentation.
> >>> > >>> >> >> > >>>>>>> The reason to upgrade to 3.4.6 first
> is to
> >>> > avoid
> >>> > >>> the
> >>> > >>> >> >> following
> >>> > >>> >> >> > >>> error:
> >>> > >>> >> >> > >>>>>>>
> >>> > >>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] -
> WARN
> >>> > >>> [localhost/
> >>> > >>> >> >> > >>> 127.0.0.1:2784
> >>> > >>> >> >> > >>>>>>> :QuorumCnxManager@349] - Invalid
> server
> >>> id:
> >>> > >>> -65536
> >>> > >>> >> >> > >>>>>>>
> >>> > >>> >> >> > >>>>>>> This error comes because of the
> protocol
> >>> > changes
> >>> > >>> >> between
> >>> > >>> >> >> > >> ZooKeeper
> >>> > >>> >> >> > >>>>> server
> >>> > >>> >> >> > >>>>>>> nodes during connection initiation
> for
> >>> leader
> >>> > >>> >> election.
> >>> > >>> >> >> In
> >>> > >>> >> >> > >>> ZooKeeper
> >>> > >>> >> >> > >>>>> 3.5
> >>> > >>> >> >> > >>>>>> a
> >>> > >>> >> >> > >>>>>>> protocol version was introduced (see
> >>> > >>> ZOOKEEPER-107)
> >>> > >>> >> and
> >>> > >>> >> >> since
> >>> > >>> >> >> > >> that
> >>> > >>> >> >> > >>>> time
> >>> > >>> >> >> > >>>>>> the
> >>> > >>> >> >> > >>>>>>> fist long value sent in the initial
> >>> message is
> >>> > >>> not
> >>> > >>> >> the
> >>> > >>> >> >> server ID
> >>> > >>> >> >> > >>> but
> >>> > >>> >> >> > >>>>> the
> >>> > >>> >> >> > >>>>>>> protocol version (-65536). In
> ZooKeeper
> >>> 3.4.6
> >>> > we
> >>> > >>> made
> >>> > >>> >> >> the old 3.4
> >>> > >>> >> >> > >>>>>>> ZooKeepers backward compatible, so
> they are
> >>> > able
> >>> > >>> to
> >>> > >>> >> >> parse both
> >>> > >>> >> >> > >> the
> >>> > >>> >> >> > >>>> old
> >>> > >>> >> >> > >>>>>> and
> >>> > >>> >> >> > >>>>>>> the new protocol format (see
> >>> ZOOKEEPER-1633).
> >>> > >>> This
> >>> > >>> >> >> issue happens
> >>> > >>> >> >> > >>> only
> >>> > >>> >> >> > >>>>>> when
> >>> > >>> >> >> > >>>>>>> you need to use old (3.4.0 - 3.4.5)
> and new
> >>> > >>> (3.5.0+)
> >>> > >>> >> >> ZooKeeper
> >>> > >>> >> >> > >>>> servers
> >>> > >>> >> >> > >>>>>>> together in the same cluster. During
> a
> >>> rolling
> >>> > >>> >> upgrade,
> >>> > >>> >> >> this is
> >>> > >>> >> >> > >>>> usually
> >>> > >>> >> >> > >>>>>> the
> >>> > >>> >> >> > >>>>>>> case to have old and new ZooKeepers
> present
> >>> > >>> together.
> >>> > >>> >> >> > >>>>>>>
> >>> > >>> >> >> > >>>>>>> The fact that you haven't seen any
> issues
> >>> might
> >>> > >>> be
> >>> > >>> >> >> caused by the
> >>> > >>> >> >> > >>>> order
> >>> > >>> >> >> > >>>>> of
> >>> > >>> >> >> > >>>>>>> the servers. In ZooKeeper the
> connection
> >>> > >>> initiation
> >>> > >>> >> >> between the
> >>> > >>> >> >> > >>>> servers
> >>> > >>> >> >> > >>>>>>> during the leader election follows a
> >>> specific
> >>> > >>> rule.
> >>> > >>> >> As
> >>> > >>> >> >> far as I
> >>> > >>> >> >> > >>>>> remember
> >>> > >>> >> >> > >>>>>>> always the server with the larger ID
> 'wins
> >>> the
> >>> > >>> >> >> challenge', so it
> >>> > >>> >> >> > >> is
> >>> > >>> >> >> > >>>>>>> possible, that the old server didn't
> need
> >>> to
> >>> > >>> parse
> >>> > >>> >> any
> >>> > >>> >> >> initial
> >>> > >>> >> >> > >>>> message
> >>> > >>> >> >> > >>>>>> (if
> >>> > >>> >> >> > >>>>>>> it had the largest ID) and this is
> why you
> >>> > >>> haven't
> >>> > >>> >> seen
> >>> > >>> >> >> the
> >>> > >>> >> >> > >> issue.
> >>> > >>> >> >> > >>>> Also
> >>> > >>> >> >> > >>>>>>> having 2 nodes up from the 3 nodes
> cluster
> >>> > still
> >>> > >>> >> makes
> >>> > >>> >> >> the
> >>> > >>> >> >> > >> cluster
> >>> > >>> >> >> > >>>> work
> >>> > >>> >> >> > >>>>>> (so
> >>> > >>> >> >> > >>>>>>> you should also check if all the
> servers
> >>> are
> >>> > >>> part of
> >>> > >>> >> >> the quorum).
> >>> > >>> >> >> > >>>>>>>
> >>> > >>> >> >> > >>>>>>> I agree with Enrico and Norbert, the
> >>> safest and
> >>> > >>> most
> >>> > >>> >> >> stable way
> >>> > >>> >> >> > >> is
> >>> > >>> >> >> > >>>>>> upgrade
> >>> > >>> >> >> > >>>>>>> first to 3.4.latest, then go to
> 3.5.latest.
> >>> > >>> Still, if
> >>> > >>> >> >> you don't
> >>> > >>> >> >> > >> see
> >>> > >>> >> >> > >>>>> that
> >>> > >>> >> >> > >>>>>>> you would hit this specific issue
> (e.g. no
> >>> > >>> "Invalid
> >>> > >>> >> >> server id" in
> >>> > >>> >> >> > >>> the
> >>> > >>> >> >> > >>>>> log
> >>> > >>> >> >> > >>>>>>> files), and all the three servers can
> >>> handle
> >>> > >>> traffic,
> >>> > >>> >> >> then maybe
> >>> > >>> >> >> > >>> you
> >>> > >>> >> >> > >>>>>> don't
> >>> > >>> >> >> > >>>>>>> need to upgrade first to 3.4.latest,
> it is
> >>> your
> >>> > >>> >> >> decision.
> >>> > >>> >> >> > >>> Definitely
> >>> > >>> >> >> > >>>>> you
> >>> > >>> >> >> > >>>>>>> should test it first, as suggested
> by the
> >>> > others.
> >>> > >>> >> >> > >>>>>>>
> >>> > >>> >> >> > >>>>>>> Kind regards,
> >>> > >>> >> >> > >>>>>>> Mate
> >>> > >>> >> >> > >>>>>>>
> >>> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM
> Norbert
> >>> Kalmar
> >>> > >>> >> >> > >>>>>>> <nk...@cloudera.com.invalid>
> wrote:
> >>> > >>> >> >> > >>>>>>>
> >>> > >>> >> >> > >>>>>>>> Hi,
> >>> > >>> >> >> > >>>>>>>>
> >>> > >>> >> >> > >>>>>>>> That guide is to upgrade to 3.5.0,
> which
> >>> was
> >>> > an
> >>> > >>> >> alpha
> >>> > >>> >> >> version.
> >>> > >>> >> >> > >> A
> >>> > >>> >> >> > >>>> lot
> >>> > >>> >> >> > >>>>>> has
> >>> > >>> >> >> > >>>>>>>> changed for the first stable
> release of
> >>> 3.5.5
> >>> > >>> and
> >>> > >>> >> then
> >>> > >>> >> >> a few
> >>> > >>> >> >> > >>> more,
> >>> > >>> >> >> > >>>>> even
> >>> > >>> >> >> > >>>>>>>> rolling upgrade issues have been
> fixed for
> >>> > >>> 3.5.6.
> >>> > >>> >> >> > >>>>>>>> This is a more up-to-date guide:
> >>> > >>> >> >> > >>>>>>>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >>
> >>> >
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> >>> > >>> >> >> > >>>>>>>>
> >>> > >>> >> >> > >>>>>>>> If you have done your testing (with
> prod
> >>> > >>> snapshot!),
> >>> > >>> >> >> then you
> >>> > >>> >> >> > >> can
> >>> > >>> >> >> > >>>>> skip
> >>> > >>> >> >> > >>>>>>> 3.4
> >>> > >>> >> >> > >>>>>>>> latest upgrade, but keep in mind we
> do our
> >>> > >>> >> >> recommendations for
> >>> > >>> >> >> > >> a
> >>> > >>> >> >> > >>>>>> reason.
> >>> > >>> >> >> > >>>>>>>> There were issues reported and/or
> found
> >>> during
> >>> > >>> >> >> testing. Some
> >>> > >>> >> >> > >> are
> >>> > >>> >> >> > >>>>> fixed
> >>> > >>> >> >> > >>>>>>> with
> >>> > >>> >> >> > >>>>>>>> 3.5.6, some only happens if certain
> >>> conditions
> >>> > >>> stand
> >>> > >>> >> >> > >>> (IOException:
> >>> > >>> >> >> > >>>> No
> >>> > >>> >> >> > >>>>>>>> snapshot found - mentioned in the
> guide,
> >>> fixed
> >>> > >>> in
> >>> > >>> >> >> 3.5.6).
> >>> > >>> >> >> > >>>>>>>>
> >>> > >>> >> >> > >>>>>>>> So it is up to you, I would still
> >>> recommend to
> >>> > >>> do an
> >>> > >>> >> >> 3.4
> >>> > >>> >> >> > >> upgrade
> >>> > >>> >> >> > >>>>> first,
> >>> > >>> >> >> > >>>>>>> if
> >>> > >>> >> >> > >>>>>>>> it's feasible.
> >>> > >>> >> >> > >>>>>>>>
> >>> > >>> >> >> > >>>>>>>> Regards,
> >>> > >>> >> >> > >>>>>>>> Norbert
> >>> > >>> >> >> > >>>>>>>>
> >>> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM
> kuldeep
> >>> > singh <
> >>> > >>> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
> >>> > >>> >> >> > >>>>>>>> wrote:
> >>> > >>> >> >> > >>>>>>>>
> >>> > >>> >> >> > >>>>>>>>> Hi,
> >>> > >>> >> >> > >>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>> Current Zookeeper version :- 3.4.5
> >>> > >>> >> >> > >>>>>>>>> Upgraded version :-
> 3.5.6
> >>> > >>> >> >> > >>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>> We are not going with 3.5.7. Our
> final
> >>> > >>> decision is
> >>> > >>> >> >> zookeeper
> >>> > >>> >> >> > >>>>> version
> >>> > >>> >> >> > >>>>>> is
> >>> > >>> >> >> > >>>>>>>>> 3.5.6
> >>> > >>> >> >> > >>>>>>>>> as per your reply first we need to
> move
> >>> > latest
> >>> > >>> >> >> version of
> >>> > >>> >> >> > >>> 3.4.x,
> >>> > >>> >> >> > >>>>> like
> >>> > >>> >> >> > >>>>>>>> below
> >>> > >>> >> >> > >>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct
> me if
> >>> I am
> >>> > >>> wrong
> >>> > >>> >> >> here)
> >>> > >>> >> >> > >>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>> But if We are not facing any
> problem
> >>> that i
> >>> > >>> have
> >>> > >>> >> >> shared you
> >>> > >>> >> >> > >>> that
> >>> > >>> >> >> > >>>> we
> >>> > >>> >> >> > >>>>>>> have
> >>> > >>> >> >> > >>>>>>>>> set up of 3 node cluster where 2
> node
> >>> are on
> >>> > >>> 3.5.6
> >>> > >>> >> >> version
> >>> > >>> >> >> > >> and
> >>> > >>> >> >> > >>> 1
> >>> > >>> >> >> > >>>>> node
> >>> > >>> >> >> > >>>>>>> on
> >>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything is running fine
> and
> >>> didn't
> >>> > >>> get
> >>> > >>> >> any
> >>> > >>> >> >> issue,
> >>> > >>> >> >> > >> So
> >>> > >>> >> >> > >>>> what
> >>> > >>> >> >> > >>>>>>> other
> >>> > >>> >> >> > >>>>>>>>> problem we can face if we directly
> move
> >>> to
> >>> > >>> 3.5.6
> >>> > >>> >> >> > >>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>> Thanks,
> >>> > >>> >> >> > >>>>>>>>> ---------------------
> >>> > >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
> >>> > >>> >> >> > >>>>>>>>> Software Architect
> >>> > >>> >> >> > >>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM
> Enrico
> >>> > >>> Olivelli <
> >>> > >>> >> >> > >>>>> eolivelli@gmail.com
> >>> > >>> >> >> > >>>>>>>
> >>> > >>> >> >> > >>>>>>>>> wrote:
> >>> > >>> >> >> > >>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>> Hi
> >>> > >>> >> >> > >>>>>>>>>> You have to upgrade to latest
> 3.4.x
> >>> > Zookeeper
> >>> > >>> then
> >>> > >>> >> >> you will
> >>> > >>> >> >> > >>>>> upgrade
> >>> > >>> >> >> > >>>>>>> to
> >>> > >>> >> >> > >>>>>>>>>> 3.5.7.
> >>> > >>> >> >> > >>>>>>>>>> All should run well without issues
> >>> > >>> >> >> > >>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>> Enrico
> >>> > >>> >> >> > >>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep
> singh
> >>> <
> >>> > >>> >> >> > >>>>> kuldeep.singh08@gmail.com
> >>> > >>> >> >> > >>>>>>>
> >>> > >>> >> >> > >>>>>>> ha
> >>> > >>> >> >> > >>>>>>>>>> scritto:
> >>> > >>> >> >> > >>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>>> Hi Team,
> >>> > >>> >> >> > >>>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>>> We are upgrading zookeeper from
> 3.4.5
> >>> to
> >>> > >>> 3.5.6. I
> >>> > >>> >> >> have
> >>> > >>> >> >> > >> set
> >>> > >>> >> >> > >>>> up 3
> >>> > >>> >> >> > >>>>>>> node
> >>> > >>> >> >> > >>>>>>>>>>> cluster where 2 node are on 3.5.6
> >>> version
> >>> > >>> and 1
> >>> > >>> >> >> node on
> >>> > >>> >> >> > >>>> 3.4.5.
> >>> > >>> >> >> > >>>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>>> Everything is running fine and
> didn't
> >>> get
> >>> > any
> >>> > >>> >> issue
> >>> > >>> >> >> on my
> >>> > >>> >> >> > >>>>> system.
> >>> > >>> >> >> > >>>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>>> but I found something on apache
> site
> >>> that
> >>> > >>> first
> >>> > >>> >> we
> >>> > >>> >> >> need
> >>> > >>> >> >> > >> to
> >>> > >>> >> >> > >>>>>> upgrade
> >>> > >>> >> >> > >>>>>>>> on
> >>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to
> 3.5.6. So
> >>> is
> >>> > it
> >>> > >>> >> >> mandatory
> >>> > >>> >> >> > >> to
> >>> > >>> >> >> > >>> go
> >>> > >>> >> >> > >>>>> on
> >>> > >>> >> >> > >>>>>>>> 3.4.6
> >>> > >>> >> >> > >>>>>>>>>>> first.
> >>> > >>> >> >> > >>>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
> >>> > >>> >> >> > >>>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>>> Upgrading a running ZooKeeper
> ensemble
> >>> to
> >>> > >>> 3.5.0
> >>> > >>> >> >> should be
> >>> > >>> >> >> > >>>> done
> >>> > >>> >> >> > >>>>>> only
> >>> > >>> >> >> > >>>>>>>>> after
> >>> > >>> >> >> > >>>>>>>>>>> upgrading your ensemble to the
> 3.4.6
> >>> > release.
> >>> > >>> >> Note
> >>> > >>> >> >> that
> >>> > >>> >> >> > >>> this
> >>> > >>> >> >> > >>>> is
> >>> > >>> >> >> > >>>>>>> only
> >>> > >>> >> >> > >>>>>>>>>>> necessary for rolling upgrades
> (if
> >>> you're
> >>> > >>> fine
> >>> > >>> >> with
> >>> > >>> >> >> > >>> shutting
> >>> > >>> >> >> > >>>>> down
> >>> > >>> >> >> > >>>>>>> the
> >>> > >>> >> >> > >>>>>>>>>>> system completely, you don't
> have to go
> >>> > >>> through
> >>> > >>> >> >> 3.4.6).
> >>> > >>> >> >> > >> If
> >>> > >>> >> >> > >>>> you
> >>> > >>> >> >> > >>>>>>>> attempt
> >>> > >>> >> >> > >>>>>>>>> a
> >>> > >>> >> >> > >>>>>>>>>>> rolling upgrade without going
> through
> >>> 3.4.6
> >>> > >>> (for
> >>> > >>> >> >> example
> >>> > >>> >> >> > >>> from
> >>> > >>> >> >> > >>>>>>> 3.4.5),
> >>> > >>> >> >> > >>>>>>>>> you
> >>> > >>> >> >> > >>>>>>>>>>> may get the following error:
> >>> > >>> >> >> > >>>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2]
> - INFO
> >>> > >>> >> [localhost/
> >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> >>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager$Listener@498]
> -
> >>> Received
> >>> > >>> >> >> connection
> >>> > >>> >> >> > >>>> request
> >>> > >>> >> >> > >>>>> /
> >>> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
> >>> > >>> >> >> > >>>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2]
> - WARN
> >>> > >>> >> [localhost/
> >>> > >>> >> >> > >>>>>> 127.0.0.1:2784
> >>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349] - Invalid
> >>> server
> >>> > id:
> >>> > >>> >> -65536
> >>> > >>> >> >> > >>>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>>> During a rolling upgrade, each
> server
> >>> is
> >>> > >>> taken
> >>> > >>> >> down
> >>> > >>> >> >> in
> >>> > >>> >> >> > >> turn
> >>> > >>> >> >> > >>>> and
> >>> > >>> >> >> > >>>>>>>>> rebooted
> >>> > >>> >> >> > >>>>>>>>>>> with the new 3.5.0 binaries.
> Before
> >>> > starting
> >>> > >>> the
> >>> > >>> >> >> server
> >>> > >>> >> >> > >>> with
> >>> > >>> >> >> > >>>>>> 3.5.0
> >>> > >>> >> >> > >>>>>>>>>>> binaries, we highly recommend
> updating
> >>> the
> >>> > >>> >> >> configuration
> >>> > >>> >> >> > >>> file
> >>> > >>> >> >> > >>>>> so
> >>> > >>> >> >> > >>>>>>> that
> >>> > >>> >> >> > >>>>>>>>> all
> >>> > >>> >> >> > >>>>>>>>>>> server statements "server.x=..."
> >>> contain
> >>> > >>> client
> >>> > >>> >> >> ports
> >>> > >>> >> >> > >> (see
> >>> > >>> >> >> > >>>> the
> >>> > >>> >> >> > >>>>>>>> section
> >>> > >>> >> >> > >>>>>>>>>>> Specifying
> >>> > >>> >> >> > >>>>>>>>>>> the client port). As explained
> earlier
> >>> you
> >>> > >>> may
> >>> > >>> >> >> leave the
> >>> > >>> >> >> > >>>>>>>> configuration
> >>> > >>> >> >> > >>>>>>>>>> in a
> >>> > >>> >> >> > >>>>>>>>>>> single file, as well as leave the
> >>> > >>> >> >> > >>>> clientPort/clientPortAddress
> >>> > >>> >> >> > >>>>>>>>> statements
> >>> > >>> >> >> > >>>>>>>>>>> (although if you specify client
> ports
> >>> in
> >>> > the
> >>> > >>> new
> >>> > >>> >> >> format,
> >>> > >>> >> >> > >>>> these
> >>> > >>> >> >> > >>>>>>>>> statements
> >>> > >>> >> >> > >>>>>>>>>>> are now redundant).
> >>> > >>> >> >> > >>>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>>> Could you please let me know
> about this
> >>> > case.
> >>> > >>> >> >> Appreciate
> >>> > >>> >> >> > >> if
> >>> > >>> >> >> > >>>>>> respond
> >>> > >>> >> >> > >>>>>>>>> soon.
> >>> > >>> >> >> > >>>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>>> Thanks,
> >>> > >>> >> >> > >>>>>>>>>>> ---------------------
> >>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
> >>> > >>> >> >> > >>>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>>
> >>> > >>> >> >> > >>>>>>>>
> >>> > >>> >> >> > >>>>>>>
> >>> > >>> >> >> > >>>>>>
> >>> > >>> >> >> > >>>>>
> >>> > >>> >> >> > >>>>
> >>> > >>> >> >> > >>>
> >>> > >>> >> >> > >>
> >>> > >>> >> >> >
> >>> > >>> >> >> >
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >> >> ________________________________
> >>> > >>> >> >>
> >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> >>> > >>> >> >> This e-mail (including any attachments) is strictly
> >>> > >>> confidential
> >>> > >>> >> and
> >>> > >>> >> >> may also contain privileged information. If you are
> not the
> >>> > >>> intended
> >>> > >>> >> >> recipient you are not authorised to read, print, save,
> >>> process or
> >>> > >>> >> disclose
> >>> > >>> >> >> this message. If you have received this message by
> mistake,
> >>> > please
> >>> > >>> >> inform
> >>> > >>> >> >> the sender immediately and destroy this e-mail, its
> >>> attachments
> >>> > >>> and any
> >>> > >>> >> >> copies. Any use, distribution, reproduction or
> disclosure by
> >>> any
> >>> > >>> person
> >>> > >>> >> >> other than the intended recipient is strictly
> prohibited and
> >>> the
> >>> > >>> person
> >>> > >>> >> >> responsible may incur in penalties.
> >>> > >>> >> >> The use of this e-mail is only for professional
> purposes;
> >>> > >>> there is
> >>> > >>> >> no
> >>> > >>> >> >> guarantee that the correspondence towards this e-mail
> will be
> >>> > read
> >>> > >>> >> only by
> >>> > >>> >> >> the recipient, because, under certain circumstances,
> there
> >>> may
> >>> > be a
> >>> > >>> >> need to
> >>> > >>> >> >> access this email by third subjects belonging to the
> Company.
> >>> > >>> >> >>
> >>> > >>> >> >>
> >>> > >>> >> >> ________________________________
> >>> > >>> >> >>
> >>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> >>> > >>> >> >> This e-mail (including any attachments) is strictly
> >>> confidential
> >>> > >>> and
> >>> > >>> >> may
> >>> > >>> >> >> also contain privileged information. If you are not the
> >>> intended
> >>> > >>> >> recipient
> >>> > >>> >> >> you are not authorised to read, print, save, process or
> >>> disclose
> >>> > >>> this
> >>> > >>> >> >> message. If you have received this message by mistake,
> please
> >>> > >>> inform
> >>> > >>> >> the
> >>> > >>> >> >> sender immediately and destroy this e-mail, its
> attachments
> >>> and
> >>> > any
> >>> > >>> >> copies.
> >>> > >>> >> >> Any use, distribution, reproduction or disclosure by
> any
> >>> person
> >>> > >>> other
> >>> > >>> >> than
> >>> > >>> >> >> the intended recipient is strictly prohibited and the
> person
> >>> > >>> >> responsible
> >>> > >>> >> >> may incur in penalties.
> >>> > >>> >> >> The use of this e-mail is only for professional
> purposes;
> >>> there
> >>> > is
> >>> > >>> no
> >>> > >>> >> >> guarantee that the correspondence towards this e-mail
> will be
> >>> > read
> >>> > >>> >> only by
> >>> > >>> >> >> the recipient, because, under certain circumstances,
> there
> >>> may
> >>> > be a
> >>> > >>> >> need to
> >>> > >>> >> >> access this email by third subjects belonging to the
> Company.
> >>> > >>> >> >>
> >>> > >>> >> >
> >>> > >>> >>
> >>> > >>> >
> >>> > >>>
> >>> > >>
> >>> >
> >>>
> >>
>
>
> ________________________________
>
> CONFIDENTIALITY & PRIVACY NOTICE
> This e-mail (including any attachments) is strictly confidential and may
> also contain privileged information. If you are not the intended recipient
> you are not authorised to read, print, save, process or disclose this
> message. If you have received this message by mistake, please inform the
> sender immediately and destroy this e-mail, its attachments and any copies.
> Any use, distribution, reproduction or disclosure by any person other than
> the intended recipient is strictly prohibited and the person responsible
> may incur in penalties.
> The use of this e-mail is only for professional purposes; there is no
> guarantee that the correspondence towards this e-mail will be read only by
> the recipient, because, under certain circumstances, there may be a need to
> access this email by third subjects belonging to the Company.
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by Enrico Olivelli - Diennea <en...@diennea.com.INVALID>.
It looks like we ported it to 3.5.
See the subtask
https://issues.apache.org/jira/browse/ZOOKEEPER-2792
Enrico
Il giorno 13/07/20, 10:37 "kuldeep singh" <ku...@gmail.com> ha scritto:
Hi Team,
I appreciate it if I will get a response as soon as possible, as I am stuck
at this point.
Thanks,
---------------------
Kuldeep Singh Budania
On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <ku...@gmail.com>
wrote:
> Hi Team,
>
> Server to Server communication is not supported in 3.5.6 version as per
> below JIRA issue?
>
> https://issues.apache.org/jira/browse/ZOOKEEPER-2639
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <ku...@gmail.com>
> wrote:
>
>> Thanks for the reply.
>>
>> Now my ZKCli cmd is working fine as we use some our customized
>> authentication and we resolve the issue.
>>
>> Now I am going to implement Server to Server communication.
>>
>> Thanks,
>> ---------------------
>> Kuldeep Singh Budania
>>
>>
>>
>> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
>> szalay.beko.mate@gmail.com> wrote:
>>
>>> I think SSL is working for you already... If you managed to start the
>>> zkCli.sh and be able to connect to ZooKeeper on the secure port and issue
>>> any kind of command (like: " ls / "), then the wire encryption is working
>>> and your server/client communication is secured by ZooKeeper.
>>>
>>> Why you want to run the following command?
>>> addauth ztpasswd zooadmin:<password>
>>>
>>> Do you also want to configure a superDigest user in ZooKeeper? Please
>>> note
>>> that this command is independent from SSL. If you need to create a
>>> username-password pair for digest authentication then please use the
>>> command in the following way:
>>> addauth digest zooadmin:yourSuperSecretPassword
>>>
>>> Kind regards,
>>> Mate
>>>
>>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <ku...@gmail.com>
>>> wrote:
>>>
>>> > 1. sh zkCli.sh --config /etc/zookeeper -server localhost:2281
>>> >
>>> > 2. addauth ztpasswd zooadmin:<password>
>>> >
>>> >
>>> > Thanks,
>>> > ---------------------
>>> > Kuldeep Singh Budania
>>> >
>>> >
>>> >
>>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
>>> kuldeep.singh08@gmail.com>
>>> > wrote:
>>> >
>>> > > Hi Team,
>>> > >
>>> > > Any update on this?
>>> > >
>>> > > Thanks,
>>> > > ---------------------
>>> > > Kuldeep Singh Budania
>>> > >
>>> > >
>>> > >
>>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
>>> kuldeep.singh08@gmail.com>
>>> > > wrote:
>>> > >
>>> > >> Sorry this is my bad, there were server setting like below
>>> > >>
>>> > >> export SERVER_JVMFLAGS="
>>> > >>
>>> > >>
>>> > >>
>>> >
>>> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>> > >>
>>> > >>
>>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>>> > >> -Dzookeeper.ssl.keyStore.password=testpass
>>> > >>
>>> >
>>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
>>> > >>
>>> > >>
>>> > >>
>>> > >> export CLIENT_JVMFLAGS="
>>> > >>
>>> > >>
>>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>>> > >> -Dzookeeper.client.secure=true
>>> > >>
>>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>>> > >> -Dzookeeper.ssl.keyStore.password=testpass
>>> > >>
>>> >
>>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
>>> > >>
>>> > >> I want to have SSL between client to server communication
>>> > >>
>>> > >> I am already following the same link which you have shared with me
>>> but
>>> > >> that is not working.
>>> > >>
>>> > >> Zoo.cfg
>>> > >>
>>> > >> secureClientPort=2281
>>> > >> initLimit=10
>>> > >> syncLimit=5
>>> > >> dataDir=/var/lib/zookeeper/data
>>> > >> tickTime=2000
>>> > >> autopurge.snapRetainCount=3
>>> > >> autopurge.purgeInterval=1
>>> > >> admin.enableServer=false
>>> > >> standaloneEnabled=false
>>> > >> jute.maxbuffer=2147483648
>>> > >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>> > >> server.1=host1_priv:10288:10388
>>> > >> server.2=host2_priv:10288:10388
>>> > >> server.3=host3_priv:10288:10388
>>> > >>
>>> > >>
>>> > >> command to connect using zkcli
>>> > >>
>>> > >> 1. zkcli zoo.cfg localhost:2281
>>> > >> 2. addauth ztpasswd usernaem:password
>>> > >>
>>> > >> after second step we are getting below error
>>> > >>
>>> > >> WatchedEvent state:AuthFailed type:None path:null
>>> > >>
>>> > >>
>>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
>>> > provider
>>> > >> for scheme: ztpasswd has x509 ip digest*
>>> > >>
>>> > >> Thanks,
>>> > >> ---------------------
>>> > >> Kuldeep Singh Budania
>>> > >>
>>> > >>
>>> > >>
>>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
>>> > >> szalay.beko.mate@gmail.com> wrote:
>>> > >>
>>> > >>> > No authentication provider for scheme: ztpasswd has x509 ip
>>> digest*
>>> > >>>
>>> > >>> This suggest you have some configuration error... Where did you
>>> use the
>>> > >>> "ztpasswd" string in your configs / commands?
>>> > >>>
>>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
>>> > >>> szalay.beko.mate@gmail.com>
>>> > >>> wrote:
>>> > >>>
>>> > >>> > > My ZK server is up and running in secure mode
>>> > >>> >
>>> > >>> > What is your goal? You want to setup client-server SSL
>>> connection?
>>> > >>> >
>>> > >>> > see:
>>> > >>> >
>>> > >>>
>>> >
>>> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
>>> > >>> >
>>> > >>> > (or you want to have both SSL and SASL enabled?)
>>> > >>> >
>>> > >>> > Anyway, please remove the following line from the
>>> SERVER_JVMFLAGS:
>>> > >>> >
>>> > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>>> > >>> > This is a configuration that makes sense only for the ZooKeeper
>>> > client,
>>> > >>> > not for the server. For the server, use the following:
>>> > >>> >
>>> > >>> >
>>> > >>>
>>> >
>>> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>> > >>> >
>>> > >>> > If it doesn't solve the issue, then can you please send your
>>> zoo.cfg
>>> > >>> file?
>>> > >>> > Also can you please send the zkCli command you execute? (you
>>> need to
>>> > >>> > connect to the secure ZooKeeper port, unless portUnification is
>>> > >>> enabled)
>>> > >>> >
>>> > >>> > Kind regards,
>>> > >>> > Mate
>>> > >>> >
>>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
>>> > >>> kuldeep.singh08@gmail.com>
>>> > >>> > wrote:
>>> > >>> >
>>> > >>> >> Hi,
>>> > >>> >>
>>> > >>> >> we have done below changes in java.env file
>>> > >>> >>
>>> > >>> >> export SERVER_JVMFLAGS="
>>> > >>> >>
>>> > >>> >>
>>> > >>>
>>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>>> > >>> >>
>>> > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
>>> > >>> >>
>>> > >>>
>>> >
>>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
>>> > >>> >>
>>> > >>> >>
>>> > >>> >>
>>> > >>> >> export CLIENT_JVMFLAGS="
>>> > >>> >>
>>> > >>> >>
>>> > >>>
>>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>>> > >>> >> -Dzookeeper.client.secure=true
>>> > >>> >>
>>> > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
>>> > >>> >>
>>> > >>>
>>> >
>>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
>>> > >>> >>
>>> > >>> >> I have started the ZK server and it is up without any issue.
>>> > >>> >>
>>> > >>> >> But now when I login to ZkCli then it gives the below error.
>>> > >>> >>
>>> > >>> >> WatchedEvent state:AuthFailed type:None path:null
>>> > >>> >>
>>> > >>> >>
>>> > >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>>> > >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
>>> authentication
>>> > >>> provider
>>> > >>> >> for scheme: ztpasswd has x509 ip digest*
>>> > >>> >>
>>> > >>> >> Please help me on this issue
>>> > >>> >>
>>> > >>> >> Thanks,
>>> > >>> >> ---------------------
>>> > >>> >> Kuldeep Singh Budania
>>> > >>> >> Software Architect
>>> > >>> >>
>>> > >>> >>
>>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
>>> > >>> kuldeep.singh08@gmail.com>
>>> > >>> >> wrote:
>>> > >>> >>
>>> > >>> >> > Hi,
>>> > >>> >> >
>>> > >>> >> > My ZK server is up and running in secure mode, But When I am
>>> > >>> trying to
>>> > >>> >> > connect to the ZK server using ZKCli, it gives the below
>>> error.
>>> > >>> >> >
>>> > >>> >> > WatchedEvent state:AuthFailed type:None path:null
>>> > >>> >> >
>>> > >>> >> >
>>> > >>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>>> > >>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
>>> authentication
>>> > >>> >> provider
>>> > >>> >> > for scheme: ztpasswd has x509 ip digest*
>>> > >>> >> >
>>> > >>> >> > Can someone please help me on this issue. we are using the
>>> 3.5.6
>>> > >>> >> version.
>>> > >>> >> >
>>> > >>> >> > I appreciate if I will get a response as soon as possible, as
>>> I am
>>> > >>> stuck
>>> > >>> >> > at this point.
>>> > >>> >> >
>>> > >>> >> > Thanks,
>>> > >>> >> > ---------------------
>>> > >>> >> > Kuldeep Singh Budania
>>> > >>> >> > Software Architect
>>> > >>> >> >
>>> > >>> >> >
>>> > >>> >> >
>>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli - Diennea
>>> > >>> >> > <en...@diennea.com.invalid> wrote:
>>> > >>> >> >
>>> > >>> >> >> I mean in zoo.cfg
>>> > >>> >> >> Not as a system property
>>> > >>> >> >>
>>> > >>> >> >> Enrico
>>> > >>> >> >>
>>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <
>>> > >>> >> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
>>> > >>> >> >>
>>> > >>> >> >> Hi
>>> > >>> >> >> You have to enable Netty on the server side
>>> > >>> >> >>
>>> > >>> >> >> Something like:
>>> > >>> >> >>
>>> > >>> >>
>>> > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>> > >>> >> >>
>>> > >>> >> >> Hope that helps
>>> > >>> >> >> Enrico
>>> > >>> >> >>
>>> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
>>> > >>> >> kuldeep.singh08@gmail.com>
>>> > >>> >> >> ha scritto:
>>> > >>> >> >>
>>> > >>> >> >> Hi,
>>> > >>> >> >>
>>> > >>> >> >> I got below error while setting SSL properties in
>>> > zkEnv.sh
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> ==========================================================================================
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
>>> > [main:QuorumPeerConfig@133]
>>> > >>> -
>>> > >>> >> >> Reading
>>> > >>> >> >> configuration from: /etc/zookeeper/zoo.cfg
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
>>> > [main:QuorumPeerConfig@385]
>>> > >>> -
>>> > >>> >> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
>>> > [main:QuorumPeerConfig@399]
>>> > >>> -
>>> > >>> >> >> secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] -
>>> > >>> Setting
>>> > >>> >> -D
>>> > >>> >> >> jdk.tls.rejectClientInitiatedRenegotiation=true to
>>> > disable
>>> > >>> >> >> client-initiated
>>> > >>> >> >> TLS renegotiation
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
>>> > >>> [main:DatadirCleanupManager@78]
>>> > >>> >> -
>>> > >>> >> >> autopurge.snapRetainCount set to 3
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
>>> > >>> [main:DatadirCleanupManager@79]
>>> > >>> >> -
>>> > >>> >> >> autopurge.purgeInterval set to 1
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,898 - INFO [
>>> > >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@138] -
>>> Purge
>>> > >>> task
>>> > >>> >> >> started.
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46]
>>> -
>>> > >>> Log4j
>>> > >>> >> >> found with
>>> > >>> >> >> jmx enabled.
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
>>> > >>> [PurgeTask:FileTxnSnapLog@103]
>>> > >>> >> -
>>> > >>> >> >> zookeeper.snapshot.trust.empty : false
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,910 - INFO [
>>> > >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@144] -
>>> Purge
>>> > >>> task
>>> > >>> >> >> completed.
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
>>> [main:QuorumPeerMain@141
>>> > ]
>>> > >>> -
>>> > >>> >> >> Starting quorum
>>> > >>> >> >> peer
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
>>> > [main:ServerCnxnFactory@135]
>>> > >>> -
>>> > >>> >> >> Using
>>> > >>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as
>>> > server
>>> > >>> >> >> connection
>>> > >>> >> >> factory
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
>>> > >>> [main:NIOServerCnxnFactory@673]
>>> > >>> >> -
>>> > >>> >> >> Configuring NIO connection handler with 10s
>>> sessionless
>>> > >>> >> >> connection timeout,
>>> > >>> >> >> 2 selector thread(s), 16 worker threads, and 64 kB
>>> direct
>>> > >>> >> buffers.
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
>>> > >>> [main:NIOServerCnxnFactory@686
>>> > >>> >> ]
>>> > >>> >> >> - binding
>>> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
>>> > [main:ServerCnxnFactory@135]
>>> > >>> -
>>> > >>> >> >> Using
>>> > >>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as
>>> > server
>>> > >>> >> >> connection
>>> > >>> >> >> factory
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
>>> [main:QuorumPeerMain@101
>>> > ]
>>> > >>> -
>>> > >>> >> >> Unexpected
>>> > >>> >> >> exception, exiting abnormally
>>> > >>> >> >>
>>> > >>> >> >> java.lang.UnsupportedOperationException: SSL isn't
>>> > >>> supported in
>>> > >>> >> >> NIOServerCnxn
>>> > >>> >> >>
>>> > >>> >> >> at
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
>>> > >>> >> >>
>>> > >>> >> >> at
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
>>> > >>> >> >>
>>> > >>> >> >> at
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
>>> > >>> >> >>
>>> > >>> >> >> at
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >> I have set the following properties in
>>> SERVER_JVMFLAGS in
>>> > >>> >> >> zkEnv.sh file :
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
>>> > >>> >> >> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
>>> > >>> >> >> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
>>> > >>> >> >>
>>> > >>> >> >> Thanks,
>>> > >>> >> >> ---------------------
>>> > >>> >> >> Kuldeep Singh Budania
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <
>>> > >>> >> >> jordan@jordanzimmerman.com>
>>> > >>> >> >> wrote:
>>> > >>> >> >>
>>> > >>> >> >> > It's the same as the normal ZooKeeper client:
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>>> > >>> >> >> > <
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>>> > >>> >> >> > >
>>> > >>> >> >> >
>>> > >>> >> >> > -Jordan
>>> > >>> >> >> >
>>> > >>> >> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep singh <
>>> > >>> >> >> kuldeep.singh08@gmail.com>
>>> > >>> >> >> > wrote:
>>> > >>> >> >> > >
>>> > >>> >> >> > > Hi Team,
>>> > >>> >> >> > > How we will do secure communication between the
>>> > Curator
>>> > >>> >> >> framework and
>>> > >>> >> >> > > zookeeper 3.5.6 ?
>>> > >>> >> >> > > I didn't get any solution right now.
>>> > >>> >> >> > > I appreciate it if someone could help me with the
>>> > same.
>>> > >>> >> >> > >
>>> > >>> >> >> > > Thanks,
>>> > >>> >> >> > > ---------------------
>>> > >>> >> >> > > Kuldeep Singh Budania
>>> > >>> >> >> > > Software Architect
>>> > >>> >> >> > >
>>> > >>> >> >> > >
>>> > >>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté
>>> <
>>> > >>> >> >> > szalay.beko.mate@gmail.com>
>>> > >>> >> >> > > wrote:
>>> > >>> >> >> > >
>>> > >>> >> >> > >> Hello Kuldeep,
>>> > >>> >> >> > >>
>>> > >>> >> >> > >> did you download the source from the ZooKeeper
>>> > >>> webpage, or
>>> > >>> >> >> checked out
>>> > >>> >> >> > from
>>> > >>> >> >> > >> git?
>>> > >>> >> >> > >> Anyway, the following commands should work:
>>> > >>> >> >> > >>
>>> > >>> >> >> > >> wget
>>> > >>> >> >> > >>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
>>> > >>> >> >> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
>>> > >>> >> >> > >> cd apache-zookeeper-3.5.7
>>> > >>> >> >> > >> mvn clean install -DskipTests
>>> > >>> >> >> > >>
>>> > >>> >> >> > >> I tested it with OpenJDK 8u424 and maven 3.6.0.
>>> > >>> >> >> > >>
>>> > >>> >> >> > >> Kind regards,
>>> > >>> >> >> > >> Mate
>>> > >>> >> >> > >>
>>> > >>> >> >> > >>
>>> > >>> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
>>> > >>> >> >> > kuldeep.singh08@gmail.com>
>>> > >>> >> >> > >> wrote:
>>> > >>> >> >> > >>
>>> > >>> >> >> > >>> Hi All,
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>> I have download the zookeeper source code and
>>> run
>>> > >>> the mvn
>>> > >>> >> >> command for
>>> > >>> >> >> > >>> packaging but get problem on "zookeeper-server"
>>> > >>> >> directory.
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>> *command :- mvn clean package*
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>> [ERROR] Failed to execute goal
>>> > >>> >> >> > >>>
>>> > >>> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>>> > >>> >> >> > >>> (default-compile) on project zookeeper: Fatal
>>> error
>>> > >>> >> >> compiling:
>>> > >>> >> >> > >>> java.lang.NullPointerException -> [Help 1]
>>> > >>> >> >> > >>>
>>> > >>> org.apache.maven.lifecycle.LifecycleExecutionException:
>>> > >>> >> >> Failed to
>>> > >>> >> >> > execute
>>> > >>> >> >> > >>> goal
>>> > >>> >> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>>> > >>> >> >> > >>> (default-compile) on project zookeeper: Fatal
>>> error
>>> > >>> >> >> compiling
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> >
>>> > >>> >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> > >>> >> >> > >>> at
>>> > >>> >> java.lang.reflect.Method.invoke(Method.java:498)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>>> > >>> >> >> > >>> Caused by:
>>> > >>> >> org.apache.maven.plugin.MojoExecutionException:
>>> > >>> >> >> Fatal error
>>> > >>> >> >> > >>> compiling
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>>> > >>> >> >> > >>> ... 19 more
>>> > >>> >> >> > >>> Caused by:
>>> > >>> >> org.codehaus.plexus.compiler.CompilerException:
>>> > >>> >> >> > >>> java.lang.NullPointerException
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
>>> > >>> >> >> > >>> ... 22 more
>>> > >>> >> >> > >>> Caused by: java.lang.RuntimeException:
>>> > >>> >> >> java.lang.NullPointerException
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:559)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
>>> > >>> >> >> > >>> ... 24 more
>>> > >>> >> >> > >>> Caused by: java.lang.NullPointerException
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
>>> > >>> >> >> > >>> at
>>> > >>> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.tools.doclint.Checker.scan(Checker.java:144)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>
>>> > >>> >> >>
>>> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:523)
>>> > >>> >> >> > >>> ... 27 more
>>> > >>> >> >> > >>> [ERROR]
>>> > >>> >> >> > >>> [ERROR] Re-run Maven using the -X switch to
>>> enable
>>> > >>> full
>>> > >>> >> >> debug logging.
>>> > >>> >> >> > >>> [ERROR]
>>> > >>> >> >> > >>> [ERROR] For more information about the errors
>>> and
>>> > >>> >> possible
>>> > >>> >> >> solutions,
>>> > >>> >> >> > >>> please read the following articles:
>>> > >>> >> >> > >>> [ERROR] [Help 1]
>>> > >>> >> >> > >>>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>> Can someone help me on this issue?
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>> Thanks,
>>> > >>> >> >> > >>> ---------------------
>>> > >>> >> >> > >>> Kuldeep Singh Budania
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő
>>> Máté <
>>> > >>> >> >> > >>> szalay.beko.mate@gmail.com>
>>> > >>> >> >> > >>> wrote:
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>> these exceptions can mean many things... I
>>> think
>>> > >>> this
>>> > >>> >> can
>>> > >>> >> >> be even
>>> > >>> >> >> > >> normal
>>> > >>> >> >> > >>>> duding rolling restart (as some connections
>>> get
>>> > >>> broken
>>> > >>> >> in
>>> > >>> >> >> this case)
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> However, I saw cases already when exceptions
>>> like
>>> > >>> these
>>> > >>> >> >> killed
>>> > >>> >> >> > receiver
>>> > >>> >> >> > >>> or
>>> > >>> >> >> > >>>> sender threads in QuorumCnxManager / Leader
>>> > >>> Election in
>>> > >>> >> >> such a way
>>> > >>> >> >> > that
>>> > >>> >> >> > >>>> they were not able to recover, so the node was
>>> > >>> unable to
>>> > >>> >> >> connect to
>>> > >>> >> >> > any
>>> > >>> >> >> > >>>> quorum until restart. I remember seeing this
>>> in
>>> > 3.4
>>> > >>> too.
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> Do you see these exceptions in the second
>>> server
>>> > >>> (the
>>> > >>> >> one
>>> > >>> >> >> which you
>>> > >>> >> >> > >> just
>>> > >>> >> >> > >>>> upgraded in step 3)?
>>> > >>> >> >> > >>>> Is this issue reproducible?
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> What is the tickTime and initLimit you use?
>>> Maybe
>>> > >>> the
>>> > >>> >> >> server just
>>> > >>> >> >> > >> require
>>> > >>> >> >> > >>>> more time to sync?
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> I would need more logs to really see what
>>> > happened.
>>> > >>> Can
>>> > >>> >> >> you create a
>>> > >>> >> >> > >> Jira
>>> > >>> >> >> > >>>> issue and upload the logs and also the
>>> ZooKeeper
>>> > >>> >> configs?
>>> > >>> >> >> I am happy
>>> > >>> >> >> > to
>>> > >>> >> >> > >>>> take a closer look.
>>> > >>> >> >> > >>>> (if you need to re-run the test to collect the
>>> > logs,
>>> > >>> >> then
>>> > >>> >> >> enabling
>>> > >>> >> >> > >> DEBUG
>>> > >>> >> >> > >>>> logs would be great. The INFO level logs are
>>> > usually
>>> > >>> >> >> enough for these
>>> > >>> >> >> > >>>> problems, but one can never know...)
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> Kind regards,
>>> > >>> >> >> > >>>> Mate
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh
>>> <
>>> > >>> >> >> > >> kuldeep.singh08@gmail.com
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> wrote:
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>>> Hi Team,
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> I have done some POC on rolling upgrade and
>>> found
>>> > >>> below
>>> > >>> >> >> result.
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> 1. On 1st node upgrade zookeeper . Traffic
>>> was
>>> > >>> >> running
>>> > >>> >> >> fine
>>> > >>> >> >> > >> because
>>> > >>> >> >> > >>> 2
>>> > >>> >> >> > >>>>> nodes are already on old zookeeper.
>>> > >>> >> >> > >>>>> 2. On 1st node upgrade our application and
>>> > didn’t
>>> > >>> >> find
>>> > >>> >> >> any issue
>>> > >>> >> >> > >>>>> 3. On 2nd node upgrade zookeeper but got
>>> below
>>> > >>> error
>>> > >>> >> >> and zookeeper
>>> > >>> >> >> > >>> is
>>> > >>> >> >> > >>>>> not taking any requests
>>> > >>> >> >> > >>>>> 4.
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> java.io.EOFException
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
>>> > >>> >> >> > >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
>>> -
>>> > >>> >> >> Interrupting
>>> > >>> >> >> > >>> SendWorker
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR
>>> [LearnerHandler-/
>>> > >>> >> >> 192.168.44.73:33754
>>> > >>> >> >> > >>>>> :LearnerHandler@562] - Unexpected exception
>>> > >>> causing
>>> > >>> >> >> shutdown while
>>> > >>> >> >> > >>> sock
>>> > >>> >> >> > >>>>> still open
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> java.io.EOFException
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>
>>> > >>> >> >>
>>> > >>>
>>> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
>>> > >>> >> >> > >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679]
>>> -
>>> > >>> >> >> Interrupted while
>>> > >>> >> >> > >>>> waiting
>>> > >>> >> >> > >>>>> for message on queue
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> Please let me know is this the known issue or
>>> > this
>>> > >>> is
>>> > >>> >> >> different issue
>>> > >>> >> >> > >>>> which
>>> > >>> >> >> > >>>>> is mention in Apache zookeeper documentation
>>> when
>>> > >>> >> >> upgrading from
>>> > >>> >> >> > >> 3.4.5
>>> > >>> >> >> > >>> to
>>> > >>> >> >> > >>>>> 3.5.6
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> Thanks,
>>> > >>> >> >> > >>>>> ---------------------
>>> > >>> >> >> > >>>>> Kuldeep Singh Budania
>>> > >>> >> >> > >>>>> Software Architect
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander
>>> Shraer
>>> > <
>>> > >>> >> >> shralex@gmail.com>
>>> > >>> >> >> > >>>>> wrote:
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>> +1 to what Mate said (I wrote the quoted
>>> > >>> >> instructions).
>>> > >>> >> >> > >>>>>>
>>> > >>> >> >> > >>>>>>
>>> > >>> >> >> > >>>>>>
>>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő
>>> > Máté <
>>> > >>> >> >> > >>>>>> szalay.beko.mate@gmail.com>
>>> > >>> >> >> > >>>>>> wrote:
>>> > >>> >> >> > >>>>>>
>>> > >>> >> >> > >>>>>>> Hi Kuldeep,
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> I just want to provide you some background
>>> info
>>> > >>> about
>>> > >>> >> >> our
>>> > >>> >> >> > >>>>> documentation.
>>> > >>> >> >> > >>>>>>> The reason to upgrade to 3.4.6 first is to
>>> > avoid
>>> > >>> the
>>> > >>> >> >> following
>>> > >>> >> >> > >>> error:
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
>>> > >>> [localhost/
>>> > >>> >> >> > >>> 127.0.0.1:2784
>>> > >>> >> >> > >>>>>>> :QuorumCnxManager@349] - Invalid server
>>> id:
>>> > >>> -65536
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> This error comes because of the protocol
>>> > changes
>>> > >>> >> between
>>> > >>> >> >> > >> ZooKeeper
>>> > >>> >> >> > >>>>> server
>>> > >>> >> >> > >>>>>>> nodes during connection initiation for
>>> leader
>>> > >>> >> election.
>>> > >>> >> >> In
>>> > >>> >> >> > >>> ZooKeeper
>>> > >>> >> >> > >>>>> 3.5
>>> > >>> >> >> > >>>>>> a
>>> > >>> >> >> > >>>>>>> protocol version was introduced (see
>>> > >>> ZOOKEEPER-107)
>>> > >>> >> and
>>> > >>> >> >> since
>>> > >>> >> >> > >> that
>>> > >>> >> >> > >>>> time
>>> > >>> >> >> > >>>>>> the
>>> > >>> >> >> > >>>>>>> fist long value sent in the initial
>>> message is
>>> > >>> not
>>> > >>> >> the
>>> > >>> >> >> server ID
>>> > >>> >> >> > >>> but
>>> > >>> >> >> > >>>>> the
>>> > >>> >> >> > >>>>>>> protocol version (-65536). In ZooKeeper
>>> 3.4.6
>>> > we
>>> > >>> made
>>> > >>> >> >> the old 3.4
>>> > >>> >> >> > >>>>>>> ZooKeepers backward compatible, so they are
>>> > able
>>> > >>> to
>>> > >>> >> >> parse both
>>> > >>> >> >> > >> the
>>> > >>> >> >> > >>>> old
>>> > >>> >> >> > >>>>>> and
>>> > >>> >> >> > >>>>>>> the new protocol format (see
>>> ZOOKEEPER-1633).
>>> > >>> This
>>> > >>> >> >> issue happens
>>> > >>> >> >> > >>> only
>>> > >>> >> >> > >>>>>> when
>>> > >>> >> >> > >>>>>>> you need to use old (3.4.0 - 3.4.5) and new
>>> > >>> (3.5.0+)
>>> > >>> >> >> ZooKeeper
>>> > >>> >> >> > >>>> servers
>>> > >>> >> >> > >>>>>>> together in the same cluster. During a
>>> rolling
>>> > >>> >> upgrade,
>>> > >>> >> >> this is
>>> > >>> >> >> > >>>> usually
>>> > >>> >> >> > >>>>>> the
>>> > >>> >> >> > >>>>>>> case to have old and new ZooKeepers present
>>> > >>> together.
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> The fact that you haven't seen any issues
>>> might
>>> > >>> be
>>> > >>> >> >> caused by the
>>> > >>> >> >> > >>>> order
>>> > >>> >> >> > >>>>> of
>>> > >>> >> >> > >>>>>>> the servers. In ZooKeeper the connection
>>> > >>> initiation
>>> > >>> >> >> between the
>>> > >>> >> >> > >>>> servers
>>> > >>> >> >> > >>>>>>> during the leader election follows a
>>> specific
>>> > >>> rule.
>>> > >>> >> As
>>> > >>> >> >> far as I
>>> > >>> >> >> > >>>>> remember
>>> > >>> >> >> > >>>>>>> always the server with the larger ID 'wins
>>> the
>>> > >>> >> >> challenge', so it
>>> > >>> >> >> > >> is
>>> > >>> >> >> > >>>>>>> possible, that the old server didn't need
>>> to
>>> > >>> parse
>>> > >>> >> any
>>> > >>> >> >> initial
>>> > >>> >> >> > >>>> message
>>> > >>> >> >> > >>>>>> (if
>>> > >>> >> >> > >>>>>>> it had the largest ID) and this is why you
>>> > >>> haven't
>>> > >>> >> seen
>>> > >>> >> >> the
>>> > >>> >> >> > >> issue.
>>> > >>> >> >> > >>>> Also
>>> > >>> >> >> > >>>>>>> having 2 nodes up from the 3 nodes cluster
>>> > still
>>> > >>> >> makes
>>> > >>> >> >> the
>>> > >>> >> >> > >> cluster
>>> > >>> >> >> > >>>> work
>>> > >>> >> >> > >>>>>> (so
>>> > >>> >> >> > >>>>>>> you should also check if all the servers
>>> are
>>> > >>> part of
>>> > >>> >> >> the quorum).
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> I agree with Enrico and Norbert, the
>>> safest and
>>> > >>> most
>>> > >>> >> >> stable way
>>> > >>> >> >> > >> is
>>> > >>> >> >> > >>>>>> upgrade
>>> > >>> >> >> > >>>>>>> first to 3.4.latest, then go to 3.5.latest.
>>> > >>> Still, if
>>> > >>> >> >> you don't
>>> > >>> >> >> > >> see
>>> > >>> >> >> > >>>>> that
>>> > >>> >> >> > >>>>>>> you would hit this specific issue (e.g. no
>>> > >>> "Invalid
>>> > >>> >> >> server id" in
>>> > >>> >> >> > >>> the
>>> > >>> >> >> > >>>>> log
>>> > >>> >> >> > >>>>>>> files), and all the three servers can
>>> handle
>>> > >>> traffic,
>>> > >>> >> >> then maybe
>>> > >>> >> >> > >>> you
>>> > >>> >> >> > >>>>>> don't
>>> > >>> >> >> > >>>>>>> need to upgrade first to 3.4.latest, it is
>>> your
>>> > >>> >> >> decision.
>>> > >>> >> >> > >>> Definitely
>>> > >>> >> >> > >>>>> you
>>> > >>> >> >> > >>>>>>> should test it first, as suggested by the
>>> > others.
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> Kind regards,
>>> > >>> >> >> > >>>>>>> Mate
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert
>>> Kalmar
>>> > >>> >> >> > >>>>>>> <nk...@cloudera.com.invalid> wrote:
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>>> Hi,
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>> That guide is to upgrade to 3.5.0, which
>>> was
>>> > an
>>> > >>> >> alpha
>>> > >>> >> >> version.
>>> > >>> >> >> > >> A
>>> > >>> >> >> > >>>> lot
>>> > >>> >> >> > >>>>>> has
>>> > >>> >> >> > >>>>>>>> changed for the first stable release of
>>> 3.5.5
>>> > >>> and
>>> > >>> >> then
>>> > >>> >> >> a few
>>> > >>> >> >> > >>> more,
>>> > >>> >> >> > >>>>> even
>>> > >>> >> >> > >>>>>>>> rolling upgrade issues have been fixed for
>>> > >>> 3.5.6.
>>> > >>> >> >> > >>>>>>>> This is a more up-to-date guide:
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>> If you have done your testing (with prod
>>> > >>> snapshot!),
>>> > >>> >> >> then you
>>> > >>> >> >> > >> can
>>> > >>> >> >> > >>>>> skip
>>> > >>> >> >> > >>>>>>> 3.4
>>> > >>> >> >> > >>>>>>>> latest upgrade, but keep in mind we do our
>>> > >>> >> >> recommendations for
>>> > >>> >> >> > >> a
>>> > >>> >> >> > >>>>>> reason.
>>> > >>> >> >> > >>>>>>>> There were issues reported and/or found
>>> during
>>> > >>> >> >> testing. Some
>>> > >>> >> >> > >> are
>>> > >>> >> >> > >>>>> fixed
>>> > >>> >> >> > >>>>>>> with
>>> > >>> >> >> > >>>>>>>> 3.5.6, some only happens if certain
>>> conditions
>>> > >>> stand
>>> > >>> >> >> > >>> (IOException:
>>> > >>> >> >> > >>>> No
>>> > >>> >> >> > >>>>>>>> snapshot found - mentioned in the guide,
>>> fixed
>>> > >>> in
>>> > >>> >> >> 3.5.6).
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>> So it is up to you, I would still
>>> recommend to
>>> > >>> do an
>>> > >>> >> >> 3.4
>>> > >>> >> >> > >> upgrade
>>> > >>> >> >> > >>>>> first,
>>> > >>> >> >> > >>>>>>> if
>>> > >>> >> >> > >>>>>>>> it's feasible.
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>> Regards,
>>> > >>> >> >> > >>>>>>>> Norbert
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep
>>> > singh <
>>> > >>> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
>>> > >>> >> >> > >>>>>>>> wrote:
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>>> Hi,
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>> Current Zookeeper version :- 3.4.5
>>> > >>> >> >> > >>>>>>>>> Upgraded version :- 3.5.6
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>> We are not going with 3.5.7. Our final
>>> > >>> decision is
>>> > >>> >> >> zookeeper
>>> > >>> >> >> > >>>>> version
>>> > >>> >> >> > >>>>>> is
>>> > >>> >> >> > >>>>>>>>> 3.5.6
>>> > >>> >> >> > >>>>>>>>> as per your reply first we need to move
>>> > latest
>>> > >>> >> >> version of
>>> > >>> >> >> > >>> 3.4.x,
>>> > >>> >> >> > >>>>> like
>>> > >>> >> >> > >>>>>>>> below
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if
>>> I am
>>> > >>> wrong
>>> > >>> >> >> here)
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>> But if We are not facing any problem
>>> that i
>>> > >>> have
>>> > >>> >> >> shared you
>>> > >>> >> >> > >>> that
>>> > >>> >> >> > >>>> we
>>> > >>> >> >> > >>>>>>> have
>>> > >>> >> >> > >>>>>>>>> set up of 3 node cluster where 2 node
>>> are on
>>> > >>> 3.5.6
>>> > >>> >> >> version
>>> > >>> >> >> > >> and
>>> > >>> >> >> > >>> 1
>>> > >>> >> >> > >>>>> node
>>> > >>> >> >> > >>>>>>> on
>>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything is running fine and
>>> didn't
>>> > >>> get
>>> > >>> >> any
>>> > >>> >> >> issue,
>>> > >>> >> >> > >> So
>>> > >>> >> >> > >>>> what
>>> > >>> >> >> > >>>>>>> other
>>> > >>> >> >> > >>>>>>>>> problem we can face if we directly move
>>> to
>>> > >>> 3.5.6
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>> Thanks,
>>> > >>> >> >> > >>>>>>>>> ---------------------
>>> > >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
>>> > >>> >> >> > >>>>>>>>> Software Architect
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico
>>> > >>> Olivelli <
>>> > >>> >> >> > >>>>> eolivelli@gmail.com
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>>>> wrote:
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>> Hi
>>> > >>> >> >> > >>>>>>>>>> You have to upgrade to latest 3.4.x
>>> > Zookeeper
>>> > >>> then
>>> > >>> >> >> you will
>>> > >>> >> >> > >>>>> upgrade
>>> > >>> >> >> > >>>>>>> to
>>> > >>> >> >> > >>>>>>>>>> 3.5.7.
>>> > >>> >> >> > >>>>>>>>>> All should run well without issues
>>> > >>> >> >> > >>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>> Enrico
>>> > >>> >> >> > >>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh
>>> <
>>> > >>> >> >> > >>>>> kuldeep.singh08@gmail.com
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> ha
>>> > >>> >> >> > >>>>>>>>>> scritto:
>>> > >>> >> >> > >>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> Hi Team,
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> We are upgrading zookeeper from 3.4.5
>>> to
>>> > >>> 3.5.6. I
>>> > >>> >> >> have
>>> > >>> >> >> > >> set
>>> > >>> >> >> > >>>> up 3
>>> > >>> >> >> > >>>>>>> node
>>> > >>> >> >> > >>>>>>>>>>> cluster where 2 node are on 3.5.6
>>> version
>>> > >>> and 1
>>> > >>> >> >> node on
>>> > >>> >> >> > >>>> 3.4.5.
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> Everything is running fine and didn't
>>> get
>>> > any
>>> > >>> >> issue
>>> > >>> >> >> on my
>>> > >>> >> >> > >>>>> system.
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> but I found something on apache site
>>> that
>>> > >>> first
>>> > >>> >> we
>>> > >>> >> >> need
>>> > >>> >> >> > >> to
>>> > >>> >> >> > >>>>>> upgrade
>>> > >>> >> >> > >>>>>>>> on
>>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So
>>> is
>>> > it
>>> > >>> >> >> mandatory
>>> > >>> >> >> > >> to
>>> > >>> >> >> > >>> go
>>> > >>> >> >> > >>>>> on
>>> > >>> >> >> > >>>>>>>> 3.4.6
>>> > >>> >> >> > >>>>>>>>>>> first.
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> Upgrading a running ZooKeeper ensemble
>>> to
>>> > >>> 3.5.0
>>> > >>> >> >> should be
>>> > >>> >> >> > >>>> done
>>> > >>> >> >> > >>>>>> only
>>> > >>> >> >> > >>>>>>>>> after
>>> > >>> >> >> > >>>>>>>>>>> upgrading your ensemble to the 3.4.6
>>> > release.
>>> > >>> >> Note
>>> > >>> >> >> that
>>> > >>> >> >> > >>> this
>>> > >>> >> >> > >>>> is
>>> > >>> >> >> > >>>>>>> only
>>> > >>> >> >> > >>>>>>>>>>> necessary for rolling upgrades (if
>>> you're
>>> > >>> fine
>>> > >>> >> with
>>> > >>> >> >> > >>> shutting
>>> > >>> >> >> > >>>>> down
>>> > >>> >> >> > >>>>>>> the
>>> > >>> >> >> > >>>>>>>>>>> system completely, you don't have to go
>>> > >>> through
>>> > >>> >> >> 3.4.6).
>>> > >>> >> >> > >> If
>>> > >>> >> >> > >>>> you
>>> > >>> >> >> > >>>>>>>> attempt
>>> > >>> >> >> > >>>>>>>>> a
>>> > >>> >> >> > >>>>>>>>>>> rolling upgrade without going through
>>> 3.4.6
>>> > >>> (for
>>> > >>> >> >> example
>>> > >>> >> >> > >>> from
>>> > >>> >> >> > >>>>>>> 3.4.5),
>>> > >>> >> >> > >>>>>>>>> you
>>> > >>> >> >> > >>>>>>>>>>> may get the following error:
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO
>>> > >>> >> [localhost/
>>> > >>> >> >> > >>>>>> 127.0.0.1:2784
>>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager$Listener@498] -
>>> Received
>>> > >>> >> >> connection
>>> > >>> >> >> > >>>> request
>>> > >>> >> >> > >>>>> /
>>> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
>>> > >>> >> [localhost/
>>> > >>> >> >> > >>>>>> 127.0.0.1:2784
>>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349] - Invalid
>>> server
>>> > id:
>>> > >>> >> -65536
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> During a rolling upgrade, each server
>>> is
>>> > >>> taken
>>> > >>> >> down
>>> > >>> >> >> in
>>> > >>> >> >> > >> turn
>>> > >>> >> >> > >>>> and
>>> > >>> >> >> > >>>>>>>>> rebooted
>>> > >>> >> >> > >>>>>>>>>>> with the new 3.5.0 binaries. Before
>>> > starting
>>> > >>> the
>>> > >>> >> >> server
>>> > >>> >> >> > >>> with
>>> > >>> >> >> > >>>>>> 3.5.0
>>> > >>> >> >> > >>>>>>>>>>> binaries, we highly recommend updating
>>> the
>>> > >>> >> >> configuration
>>> > >>> >> >> > >>> file
>>> > >>> >> >> > >>>>> so
>>> > >>> >> >> > >>>>>>> that
>>> > >>> >> >> > >>>>>>>>> all
>>> > >>> >> >> > >>>>>>>>>>> server statements "server.x=..."
>>> contain
>>> > >>> client
>>> > >>> >> >> ports
>>> > >>> >> >> > >> (see
>>> > >>> >> >> > >>>> the
>>> > >>> >> >> > >>>>>>>> section
>>> > >>> >> >> > >>>>>>>>>>> Specifying
>>> > >>> >> >> > >>>>>>>>>>> the client port). As explained earlier
>>> you
>>> > >>> may
>>> > >>> >> >> leave the
>>> > >>> >> >> > >>>>>>>> configuration
>>> > >>> >> >> > >>>>>>>>>> in a
>>> > >>> >> >> > >>>>>>>>>>> single file, as well as leave the
>>> > >>> >> >> > >>>> clientPort/clientPortAddress
>>> > >>> >> >> > >>>>>>>>> statements
>>> > >>> >> >> > >>>>>>>>>>> (although if you specify client ports
>>> in
>>> > the
>>> > >>> new
>>> > >>> >> >> format,
>>> > >>> >> >> > >>>> these
>>> > >>> >> >> > >>>>>>>>> statements
>>> > >>> >> >> > >>>>>>>>>>> are now redundant).
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> Could you please let me know about this
>>> > case.
>>> > >>> >> >> Appreciate
>>> > >>> >> >> > >> if
>>> > >>> >> >> > >>>>>> respond
>>> > >>> >> >> > >>>>>>>>> soon.
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> Thanks,
>>> > >>> >> >> > >>>>>>>>>>> ---------------------
>>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >> ________________________________
>>> > >>> >> >>
>>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>>> > >>> >> >> This e-mail (including any attachments) is strictly
>>> > >>> confidential
>>> > >>> >> and
>>> > >>> >> >> may also contain privileged information. If you are not the
>>> > >>> intended
>>> > >>> >> >> recipient you are not authorised to read, print, save,
>>> process or
>>> > >>> >> disclose
>>> > >>> >> >> this message. If you have received this message by mistake,
>>> > please
>>> > >>> >> inform
>>> > >>> >> >> the sender immediately and destroy this e-mail, its
>>> attachments
>>> > >>> and any
>>> > >>> >> >> copies. Any use, distribution, reproduction or disclosure by
>>> any
>>> > >>> person
>>> > >>> >> >> other than the intended recipient is strictly prohibited and
>>> the
>>> > >>> person
>>> > >>> >> >> responsible may incur in penalties.
>>> > >>> >> >> The use of this e-mail is only for professional purposes;
>>> > >>> there is
>>> > >>> >> no
>>> > >>> >> >> guarantee that the correspondence towards this e-mail will be
>>> > read
>>> > >>> >> only by
>>> > >>> >> >> the recipient, because, under certain circumstances, there
>>> may
>>> > be a
>>> > >>> >> need to
>>> > >>> >> >> access this email by third subjects belonging to the Company.
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >> ________________________________
>>> > >>> >> >>
>>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>>> > >>> >> >> This e-mail (including any attachments) is strictly
>>> confidential
>>> > >>> and
>>> > >>> >> may
>>> > >>> >> >> also contain privileged information. If you are not the
>>> intended
>>> > >>> >> recipient
>>> > >>> >> >> you are not authorised to read, print, save, process or
>>> disclose
>>> > >>> this
>>> > >>> >> >> message. If you have received this message by mistake, please
>>> > >>> inform
>>> > >>> >> the
>>> > >>> >> >> sender immediately and destroy this e-mail, its attachments
>>> and
>>> > any
>>> > >>> >> copies.
>>> > >>> >> >> Any use, distribution, reproduction or disclosure by any
>>> person
>>> > >>> other
>>> > >>> >> than
>>> > >>> >> >> the intended recipient is strictly prohibited and the person
>>> > >>> >> responsible
>>> > >>> >> >> may incur in penalties.
>>> > >>> >> >> The use of this e-mail is only for professional purposes;
>>> there
>>> > is
>>> > >>> no
>>> > >>> >> >> guarantee that the correspondence towards this e-mail will be
>>> > read
>>> > >>> >> only by
>>> > >>> >> >> the recipient, because, under certain circumstances, there
>>> may
>>> > be a
>>> > >>> >> need to
>>> > >>> >> >> access this email by third subjects belonging to the Company.
>>> > >>> >> >>
>>> > >>> >> >
>>> > >>> >>
>>> > >>> >
>>> > >>>
>>> > >>
>>> >
>>>
>>
________________________________
CONFIDENTIALITY & PRIVACY NOTICE
This e-mail (including any attachments) is strictly confidential and may also contain privileged information. If you are not the intended recipient you are not authorised to read, print, save, process or disclose this message. If you have received this message by mistake, please inform the sender immediately and destroy this e-mail, its attachments and any copies. Any use, distribution, reproduction or disclosure by any person other than the intended recipient is strictly prohibited and the person responsible may incur in penalties.
The use of this e-mail is only for professional purposes; there is no guarantee that the correspondence towards this e-mail will be read only by the recipient, because, under certain circumstances, there may be a need to access this email by third subjects belonging to the Company.
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Hi Team,
I appreciate it if I will get a response as soon as possible, as I am stuck
at this point.
Thanks,
---------------------
Kuldeep Singh Budania
On Mon, Jul 13, 2020 at 11:10 AM kuldeep singh <ku...@gmail.com>
wrote:
> Hi Team,
>
> Server to Server communication is not supported in 3.5.6 version as per
> below JIRA issue?
>
> https://issues.apache.org/jira/browse/ZOOKEEPER-2639
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <ku...@gmail.com>
> wrote:
>
>> Thanks for the reply.
>>
>> Now my ZKCli cmd is working fine as we use some our customized
>> authentication and we resolve the issue.
>>
>> Now I am going to implement Server to Server communication.
>>
>> Thanks,
>> ---------------------
>> Kuldeep Singh Budania
>>
>>
>>
>> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
>> szalay.beko.mate@gmail.com> wrote:
>>
>>> I think SSL is working for you already... If you managed to start the
>>> zkCli.sh and be able to connect to ZooKeeper on the secure port and issue
>>> any kind of command (like: " ls / "), then the wire encryption is working
>>> and your server/client communication is secured by ZooKeeper.
>>>
>>> Why you want to run the following command?
>>> addauth ztpasswd zooadmin:<password>
>>>
>>> Do you also want to configure a superDigest user in ZooKeeper? Please
>>> note
>>> that this command is independent from SSL. If you need to create a
>>> username-password pair for digest authentication then please use the
>>> command in the following way:
>>> addauth digest zooadmin:yourSuperSecretPassword
>>>
>>> Kind regards,
>>> Mate
>>>
>>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <ku...@gmail.com>
>>> wrote:
>>>
>>> > 1. sh zkCli.sh --config /etc/zookeeper -server localhost:2281
>>> >
>>> > 2. addauth ztpasswd zooadmin:<password>
>>> >
>>> >
>>> > Thanks,
>>> > ---------------------
>>> > Kuldeep Singh Budania
>>> >
>>> >
>>> >
>>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <
>>> kuldeep.singh08@gmail.com>
>>> > wrote:
>>> >
>>> > > Hi Team,
>>> > >
>>> > > Any update on this?
>>> > >
>>> > > Thanks,
>>> > > ---------------------
>>> > > Kuldeep Singh Budania
>>> > >
>>> > >
>>> > >
>>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
>>> kuldeep.singh08@gmail.com>
>>> > > wrote:
>>> > >
>>> > >> Sorry this is my bad, there were server setting like below
>>> > >>
>>> > >> export SERVER_JVMFLAGS="
>>> > >>
>>> > >>
>>> > >>
>>> >
>>> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>> > >>
>>> > >>
>>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>>> > >> -Dzookeeper.ssl.keyStore.password=testpass
>>> > >>
>>> >
>>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
>>> > >>
>>> > >>
>>> > >>
>>> > >> export CLIENT_JVMFLAGS="
>>> > >>
>>> > >>
>>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>>> > >> -Dzookeeper.client.secure=true
>>> > >>
>>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>>> > >> -Dzookeeper.ssl.keyStore.password=testpass
>>> > >>
>>> >
>>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
>>> > >>
>>> > >> I want to have SSL between client to server communication
>>> > >>
>>> > >> I am already following the same link which you have shared with me
>>> but
>>> > >> that is not working.
>>> > >>
>>> > >> Zoo.cfg
>>> > >>
>>> > >> secureClientPort=2281
>>> > >> initLimit=10
>>> > >> syncLimit=5
>>> > >> dataDir=/var/lib/zookeeper/data
>>> > >> tickTime=2000
>>> > >> autopurge.snapRetainCount=3
>>> > >> autopurge.purgeInterval=1
>>> > >> admin.enableServer=false
>>> > >> standaloneEnabled=false
>>> > >> jute.maxbuffer=2147483648
>>> > >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>> > >> server.1=host1_priv:10288:10388
>>> > >> server.2=host2_priv:10288:10388
>>> > >> server.3=host3_priv:10288:10388
>>> > >>
>>> > >>
>>> > >> command to connect using zkcli
>>> > >>
>>> > >> 1. zkcli zoo.cfg localhost:2281
>>> > >> 2. addauth ztpasswd usernaem:password
>>> > >>
>>> > >> after second step we are getting below error
>>> > >>
>>> > >> WatchedEvent state:AuthFailed type:None path:null
>>> > >>
>>> > >>
>>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
>>> > provider
>>> > >> for scheme: ztpasswd has x509 ip digest*
>>> > >>
>>> > >> Thanks,
>>> > >> ---------------------
>>> > >> Kuldeep Singh Budania
>>> > >>
>>> > >>
>>> > >>
>>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
>>> > >> szalay.beko.mate@gmail.com> wrote:
>>> > >>
>>> > >>> > No authentication provider for scheme: ztpasswd has x509 ip
>>> digest*
>>> > >>>
>>> > >>> This suggest you have some configuration error... Where did you
>>> use the
>>> > >>> "ztpasswd" string in your configs / commands?
>>> > >>>
>>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
>>> > >>> szalay.beko.mate@gmail.com>
>>> > >>> wrote:
>>> > >>>
>>> > >>> > > My ZK server is up and running in secure mode
>>> > >>> >
>>> > >>> > What is your goal? You want to setup client-server SSL
>>> connection?
>>> > >>> >
>>> > >>> > see:
>>> > >>> >
>>> > >>>
>>> >
>>> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
>>> > >>> >
>>> > >>> > (or you want to have both SSL and SASL enabled?)
>>> > >>> >
>>> > >>> > Anyway, please remove the following line from the
>>> SERVER_JVMFLAGS:
>>> > >>> >
>>> > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>>> > >>> > This is a configuration that makes sense only for the ZooKeeper
>>> > client,
>>> > >>> > not for the server. For the server, use the following:
>>> > >>> >
>>> > >>> >
>>> > >>>
>>> >
>>> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>> > >>> >
>>> > >>> > If it doesn't solve the issue, then can you please send your
>>> zoo.cfg
>>> > >>> file?
>>> > >>> > Also can you please send the zkCli command you execute? (you
>>> need to
>>> > >>> > connect to the secure ZooKeeper port, unless portUnification is
>>> > >>> enabled)
>>> > >>> >
>>> > >>> > Kind regards,
>>> > >>> > Mate
>>> > >>> >
>>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
>>> > >>> kuldeep.singh08@gmail.com>
>>> > >>> > wrote:
>>> > >>> >
>>> > >>> >> Hi,
>>> > >>> >>
>>> > >>> >> we have done below changes in java.env file
>>> > >>> >>
>>> > >>> >> export SERVER_JVMFLAGS="
>>> > >>> >>
>>> > >>> >>
>>> > >>>
>>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>>> > >>> >>
>>> > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
>>> > >>> >>
>>> > >>>
>>> >
>>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
>>> > >>> >>
>>> > >>> >>
>>> > >>> >>
>>> > >>> >> export CLIENT_JVMFLAGS="
>>> > >>> >>
>>> > >>> >>
>>> > >>>
>>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>>> > >>> >> -Dzookeeper.client.secure=true
>>> > >>> >>
>>> > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
>>> > >>> >>
>>> > >>>
>>> >
>>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
>>> > >>> >>
>>> > >>> >> I have started the ZK server and it is up without any issue.
>>> > >>> >>
>>> > >>> >> But now when I login to ZkCli then it gives the below error.
>>> > >>> >>
>>> > >>> >> WatchedEvent state:AuthFailed type:None path:null
>>> > >>> >>
>>> > >>> >>
>>> > >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>>> > >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
>>> authentication
>>> > >>> provider
>>> > >>> >> for scheme: ztpasswd has x509 ip digest*
>>> > >>> >>
>>> > >>> >> Please help me on this issue
>>> > >>> >>
>>> > >>> >> Thanks,
>>> > >>> >> ---------------------
>>> > >>> >> Kuldeep Singh Budania
>>> > >>> >> Software Architect
>>> > >>> >>
>>> > >>> >>
>>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
>>> > >>> kuldeep.singh08@gmail.com>
>>> > >>> >> wrote:
>>> > >>> >>
>>> > >>> >> > Hi,
>>> > >>> >> >
>>> > >>> >> > My ZK server is up and running in secure mode, But When I am
>>> > >>> trying to
>>> > >>> >> > connect to the ZK server using ZKCli, it gives the below
>>> error.
>>> > >>> >> >
>>> > >>> >> > WatchedEvent state:AuthFailed type:None path:null
>>> > >>> >> >
>>> > >>> >> >
>>> > >>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>>> > >>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
>>> authentication
>>> > >>> >> provider
>>> > >>> >> > for scheme: ztpasswd has x509 ip digest*
>>> > >>> >> >
>>> > >>> >> > Can someone please help me on this issue. we are using the
>>> 3.5.6
>>> > >>> >> version.
>>> > >>> >> >
>>> > >>> >> > I appreciate if I will get a response as soon as possible, as
>>> I am
>>> > >>> stuck
>>> > >>> >> > at this point.
>>> > >>> >> >
>>> > >>> >> > Thanks,
>>> > >>> >> > ---------------------
>>> > >>> >> > Kuldeep Singh Budania
>>> > >>> >> > Software Architect
>>> > >>> >> >
>>> > >>> >> >
>>> > >>> >> >
>>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli - Diennea
>>> > >>> >> > <en...@diennea.com.invalid> wrote:
>>> > >>> >> >
>>> > >>> >> >> I mean in zoo.cfg
>>> > >>> >> >> Not as a system property
>>> > >>> >> >>
>>> > >>> >> >> Enrico
>>> > >>> >> >>
>>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <
>>> > >>> >> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
>>> > >>> >> >>
>>> > >>> >> >> Hi
>>> > >>> >> >> You have to enable Netty on the server side
>>> > >>> >> >>
>>> > >>> >> >> Something like:
>>> > >>> >> >>
>>> > >>> >>
>>> > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>> > >>> >> >>
>>> > >>> >> >> Hope that helps
>>> > >>> >> >> Enrico
>>> > >>> >> >>
>>> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
>>> > >>> >> kuldeep.singh08@gmail.com>
>>> > >>> >> >> ha scritto:
>>> > >>> >> >>
>>> > >>> >> >> Hi,
>>> > >>> >> >>
>>> > >>> >> >> I got below error while setting SSL properties in
>>> > zkEnv.sh
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> ==========================================================================================
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
>>> > [main:QuorumPeerConfig@133]
>>> > >>> -
>>> > >>> >> >> Reading
>>> > >>> >> >> configuration from: /etc/zookeeper/zoo.cfg
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
>>> > [main:QuorumPeerConfig@385]
>>> > >>> -
>>> > >>> >> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
>>> > [main:QuorumPeerConfig@399]
>>> > >>> -
>>> > >>> >> >> secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] -
>>> > >>> Setting
>>> > >>> >> -D
>>> > >>> >> >> jdk.tls.rejectClientInitiatedRenegotiation=true to
>>> > disable
>>> > >>> >> >> client-initiated
>>> > >>> >> >> TLS renegotiation
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
>>> > >>> [main:DatadirCleanupManager@78]
>>> > >>> >> -
>>> > >>> >> >> autopurge.snapRetainCount set to 3
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
>>> > >>> [main:DatadirCleanupManager@79]
>>> > >>> >> -
>>> > >>> >> >> autopurge.purgeInterval set to 1
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,898 - INFO [
>>> > >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@138] -
>>> Purge
>>> > >>> task
>>> > >>> >> >> started.
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46]
>>> -
>>> > >>> Log4j
>>> > >>> >> >> found with
>>> > >>> >> >> jmx enabled.
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
>>> > >>> [PurgeTask:FileTxnSnapLog@103]
>>> > >>> >> -
>>> > >>> >> >> zookeeper.snapshot.trust.empty : false
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,910 - INFO [
>>> > >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@144] -
>>> Purge
>>> > >>> task
>>> > >>> >> >> completed.
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
>>> [main:QuorumPeerMain@141
>>> > ]
>>> > >>> -
>>> > >>> >> >> Starting quorum
>>> > >>> >> >> peer
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
>>> > [main:ServerCnxnFactory@135]
>>> > >>> -
>>> > >>> >> >> Using
>>> > >>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as
>>> > server
>>> > >>> >> >> connection
>>> > >>> >> >> factory
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
>>> > >>> [main:NIOServerCnxnFactory@673]
>>> > >>> >> -
>>> > >>> >> >> Configuring NIO connection handler with 10s
>>> sessionless
>>> > >>> >> >> connection timeout,
>>> > >>> >> >> 2 selector thread(s), 16 worker threads, and 64 kB
>>> direct
>>> > >>> >> buffers.
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
>>> > >>> [main:NIOServerCnxnFactory@686
>>> > >>> >> ]
>>> > >>> >> >> - binding
>>> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
>>> > [main:ServerCnxnFactory@135]
>>> > >>> -
>>> > >>> >> >> Using
>>> > >>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as
>>> > server
>>> > >>> >> >> connection
>>> > >>> >> >> factory
>>> > >>> >> >>
>>> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
>>> [main:QuorumPeerMain@101
>>> > ]
>>> > >>> -
>>> > >>> >> >> Unexpected
>>> > >>> >> >> exception, exiting abnormally
>>> > >>> >> >>
>>> > >>> >> >> java.lang.UnsupportedOperationException: SSL isn't
>>> > >>> supported in
>>> > >>> >> >> NIOServerCnxn
>>> > >>> >> >>
>>> > >>> >> >> at
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
>>> > >>> >> >>
>>> > >>> >> >> at
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
>>> > >>> >> >>
>>> > >>> >> >> at
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
>>> > >>> >> >>
>>> > >>> >> >> at
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >> I have set the following properties in
>>> SERVER_JVMFLAGS in
>>> > >>> >> >> zkEnv.sh file :
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
>>> > >>> >> >> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
>>> > >>> >> >> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
>>> > >>> >> >>
>>> > >>> >> >> Thanks,
>>> > >>> >> >> ---------------------
>>> > >>> >> >> Kuldeep Singh Budania
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <
>>> > >>> >> >> jordan@jordanzimmerman.com>
>>> > >>> >> >> wrote:
>>> > >>> >> >>
>>> > >>> >> >> > It's the same as the normal ZooKeeper client:
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>>> > >>> >> >> > <
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>>> > >>> >> >> > >
>>> > >>> >> >> >
>>> > >>> >> >> > -Jordan
>>> > >>> >> >> >
>>> > >>> >> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep singh <
>>> > >>> >> >> kuldeep.singh08@gmail.com>
>>> > >>> >> >> > wrote:
>>> > >>> >> >> > >
>>> > >>> >> >> > > Hi Team,
>>> > >>> >> >> > > How we will do secure communication between the
>>> > Curator
>>> > >>> >> >> framework and
>>> > >>> >> >> > > zookeeper 3.5.6 ?
>>> > >>> >> >> > > I didn't get any solution right now.
>>> > >>> >> >> > > I appreciate it if someone could help me with the
>>> > same.
>>> > >>> >> >> > >
>>> > >>> >> >> > > Thanks,
>>> > >>> >> >> > > ---------------------
>>> > >>> >> >> > > Kuldeep Singh Budania
>>> > >>> >> >> > > Software Architect
>>> > >>> >> >> > >
>>> > >>> >> >> > >
>>> > >>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté
>>> <
>>> > >>> >> >> > szalay.beko.mate@gmail.com>
>>> > >>> >> >> > > wrote:
>>> > >>> >> >> > >
>>> > >>> >> >> > >> Hello Kuldeep,
>>> > >>> >> >> > >>
>>> > >>> >> >> > >> did you download the source from the ZooKeeper
>>> > >>> webpage, or
>>> > >>> >> >> checked out
>>> > >>> >> >> > from
>>> > >>> >> >> > >> git?
>>> > >>> >> >> > >> Anyway, the following commands should work:
>>> > >>> >> >> > >>
>>> > >>> >> >> > >> wget
>>> > >>> >> >> > >>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
>>> > >>> >> >> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
>>> > >>> >> >> > >> cd apache-zookeeper-3.5.7
>>> > >>> >> >> > >> mvn clean install -DskipTests
>>> > >>> >> >> > >>
>>> > >>> >> >> > >> I tested it with OpenJDK 8u424 and maven 3.6.0.
>>> > >>> >> >> > >>
>>> > >>> >> >> > >> Kind regards,
>>> > >>> >> >> > >> Mate
>>> > >>> >> >> > >>
>>> > >>> >> >> > >>
>>> > >>> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
>>> > >>> >> >> > kuldeep.singh08@gmail.com>
>>> > >>> >> >> > >> wrote:
>>> > >>> >> >> > >>
>>> > >>> >> >> > >>> Hi All,
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>> I have download the zookeeper source code and
>>> run
>>> > >>> the mvn
>>> > >>> >> >> command for
>>> > >>> >> >> > >>> packaging but get problem on "zookeeper-server"
>>> > >>> >> directory.
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>> *command :- mvn clean package*
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>> [ERROR] Failed to execute goal
>>> > >>> >> >> > >>>
>>> > >>> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>>> > >>> >> >> > >>> (default-compile) on project zookeeper: Fatal
>>> error
>>> > >>> >> >> compiling:
>>> > >>> >> >> > >>> java.lang.NullPointerException -> [Help 1]
>>> > >>> >> >> > >>>
>>> > >>> org.apache.maven.lifecycle.LifecycleExecutionException:
>>> > >>> >> >> Failed to
>>> > >>> >> >> > execute
>>> > >>> >> >> > >>> goal
>>> > >>> >> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>>> > >>> >> >> > >>> (default-compile) on project zookeeper: Fatal
>>> error
>>> > >>> >> >> compiling
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> >
>>> > >>> >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> > >>> >> >> > >>> at
>>> > >>> >> java.lang.reflect.Method.invoke(Method.java:498)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>>> > >>> >> >> > >>> Caused by:
>>> > >>> >> org.apache.maven.plugin.MojoExecutionException:
>>> > >>> >> >> Fatal error
>>> > >>> >> >> > >>> compiling
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>>> > >>> >> >> > >>> ... 19 more
>>> > >>> >> >> > >>> Caused by:
>>> > >>> >> org.codehaus.plexus.compiler.CompilerException:
>>> > >>> >> >> > >>> java.lang.NullPointerException
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
>>> > >>> >> >> > >>> ... 22 more
>>> > >>> >> >> > >>> Caused by: java.lang.RuntimeException:
>>> > >>> >> >> java.lang.NullPointerException
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:559)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
>>> > >>> >> >> > >>> ... 24 more
>>> > >>> >> >> > >>> Caused by: java.lang.NullPointerException
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
>>> > >>> >> >> > >>> at
>>> > >>> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.tools.doclint.Checker.scan(Checker.java:144)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>
>>> > >>> >> >>
>>> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > >>>
>>> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
>>> > >>> >> >> > >>> at
>>> > >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:523)
>>> > >>> >> >> > >>> ... 27 more
>>> > >>> >> >> > >>> [ERROR]
>>> > >>> >> >> > >>> [ERROR] Re-run Maven using the -X switch to
>>> enable
>>> > >>> full
>>> > >>> >> >> debug logging.
>>> > >>> >> >> > >>> [ERROR]
>>> > >>> >> >> > >>> [ERROR] For more information about the errors
>>> and
>>> > >>> >> possible
>>> > >>> >> >> solutions,
>>> > >>> >> >> > >>> please read the following articles:
>>> > >>> >> >> > >>> [ERROR] [Help 1]
>>> > >>> >> >> > >>>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>> Can someone help me on this issue?
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>> Thanks,
>>> > >>> >> >> > >>> ---------------------
>>> > >>> >> >> > >>> Kuldeep Singh Budania
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő
>>> Máté <
>>> > >>> >> >> > >>> szalay.beko.mate@gmail.com>
>>> > >>> >> >> > >>> wrote:
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>>> these exceptions can mean many things... I
>>> think
>>> > >>> this
>>> > >>> >> can
>>> > >>> >> >> be even
>>> > >>> >> >> > >> normal
>>> > >>> >> >> > >>>> duding rolling restart (as some connections
>>> get
>>> > >>> broken
>>> > >>> >> in
>>> > >>> >> >> this case)
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> However, I saw cases already when exceptions
>>> like
>>> > >>> these
>>> > >>> >> >> killed
>>> > >>> >> >> > receiver
>>> > >>> >> >> > >>> or
>>> > >>> >> >> > >>>> sender threads in QuorumCnxManager / Leader
>>> > >>> Election in
>>> > >>> >> >> such a way
>>> > >>> >> >> > that
>>> > >>> >> >> > >>>> they were not able to recover, so the node was
>>> > >>> unable to
>>> > >>> >> >> connect to
>>> > >>> >> >> > any
>>> > >>> >> >> > >>>> quorum until restart. I remember seeing this
>>> in
>>> > 3.4
>>> > >>> too.
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> Do you see these exceptions in the second
>>> server
>>> > >>> (the
>>> > >>> >> one
>>> > >>> >> >> which you
>>> > >>> >> >> > >> just
>>> > >>> >> >> > >>>> upgraded in step 3)?
>>> > >>> >> >> > >>>> Is this issue reproducible?
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> What is the tickTime and initLimit you use?
>>> Maybe
>>> > >>> the
>>> > >>> >> >> server just
>>> > >>> >> >> > >> require
>>> > >>> >> >> > >>>> more time to sync?
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> I would need more logs to really see what
>>> > happened.
>>> > >>> Can
>>> > >>> >> >> you create a
>>> > >>> >> >> > >> Jira
>>> > >>> >> >> > >>>> issue and upload the logs and also the
>>> ZooKeeper
>>> > >>> >> configs?
>>> > >>> >> >> I am happy
>>> > >>> >> >> > to
>>> > >>> >> >> > >>>> take a closer look.
>>> > >>> >> >> > >>>> (if you need to re-run the test to collect the
>>> > logs,
>>> > >>> >> then
>>> > >>> >> >> enabling
>>> > >>> >> >> > >> DEBUG
>>> > >>> >> >> > >>>> logs would be great. The INFO level logs are
>>> > usually
>>> > >>> >> >> enough for these
>>> > >>> >> >> > >>>> problems, but one can never know...)
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> Kind regards,
>>> > >>> >> >> > >>>> Mate
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh
>>> <
>>> > >>> >> >> > >> kuldeep.singh08@gmail.com
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>> wrote:
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>>> Hi Team,
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> I have done some POC on rolling upgrade and
>>> found
>>> > >>> below
>>> > >>> >> >> result.
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> 1. On 1st node upgrade zookeeper . Traffic
>>> was
>>> > >>> >> running
>>> > >>> >> >> fine
>>> > >>> >> >> > >> because
>>> > >>> >> >> > >>> 2
>>> > >>> >> >> > >>>>> nodes are already on old zookeeper.
>>> > >>> >> >> > >>>>> 2. On 1st node upgrade our application and
>>> > didn’t
>>> > >>> >> find
>>> > >>> >> >> any issue
>>> > >>> >> >> > >>>>> 3. On 2nd node upgrade zookeeper but got
>>> below
>>> > >>> error
>>> > >>> >> >> and zookeeper
>>> > >>> >> >> > >>> is
>>> > >>> >> >> > >>>>> not taking any requests
>>> > >>> >> >> > >>>>> 4.
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> java.io.EOFException
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
>>> > >>> >> >> > >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
>>> -
>>> > >>> >> >> Interrupting
>>> > >>> >> >> > >>> SendWorker
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR
>>> [LearnerHandler-/
>>> > >>> >> >> 192.168.44.73:33754
>>> > >>> >> >> > >>>>> :LearnerHandler@562] - Unexpected exception
>>> > >>> causing
>>> > >>> >> >> shutdown while
>>> > >>> >> >> > >>> sock
>>> > >>> >> >> > >>>>> still open
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> java.io.EOFException
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>
>>> > >>> >> >>
>>> > >>>
>>> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> at
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >>
>>> > >>>
>>> >
>>> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
>>> > >>> >> >> > >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679]
>>> -
>>> > >>> >> >> Interrupted while
>>> > >>> >> >> > >>>> waiting
>>> > >>> >> >> > >>>>> for message on queue
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> Please let me know is this the known issue or
>>> > this
>>> > >>> is
>>> > >>> >> >> different issue
>>> > >>> >> >> > >>>> which
>>> > >>> >> >> > >>>>> is mention in Apache zookeeper documentation
>>> when
>>> > >>> >> >> upgrading from
>>> > >>> >> >> > >> 3.4.5
>>> > >>> >> >> > >>> to
>>> > >>> >> >> > >>>>> 3.5.6
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> Thanks,
>>> > >>> >> >> > >>>>> ---------------------
>>> > >>> >> >> > >>>>> Kuldeep Singh Budania
>>> > >>> >> >> > >>>>> Software Architect
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander
>>> Shraer
>>> > <
>>> > >>> >> >> shralex@gmail.com>
>>> > >>> >> >> > >>>>> wrote:
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>>> +1 to what Mate said (I wrote the quoted
>>> > >>> >> instructions).
>>> > >>> >> >> > >>>>>>
>>> > >>> >> >> > >>>>>>
>>> > >>> >> >> > >>>>>>
>>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő
>>> > Máté <
>>> > >>> >> >> > >>>>>> szalay.beko.mate@gmail.com>
>>> > >>> >> >> > >>>>>> wrote:
>>> > >>> >> >> > >>>>>>
>>> > >>> >> >> > >>>>>>> Hi Kuldeep,
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> I just want to provide you some background
>>> info
>>> > >>> about
>>> > >>> >> >> our
>>> > >>> >> >> > >>>>> documentation.
>>> > >>> >> >> > >>>>>>> The reason to upgrade to 3.4.6 first is to
>>> > avoid
>>> > >>> the
>>> > >>> >> >> following
>>> > >>> >> >> > >>> error:
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
>>> > >>> [localhost/
>>> > >>> >> >> > >>> 127.0.0.1:2784
>>> > >>> >> >> > >>>>>>> :QuorumCnxManager@349] - Invalid server
>>> id:
>>> > >>> -65536
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> This error comes because of the protocol
>>> > changes
>>> > >>> >> between
>>> > >>> >> >> > >> ZooKeeper
>>> > >>> >> >> > >>>>> server
>>> > >>> >> >> > >>>>>>> nodes during connection initiation for
>>> leader
>>> > >>> >> election.
>>> > >>> >> >> In
>>> > >>> >> >> > >>> ZooKeeper
>>> > >>> >> >> > >>>>> 3.5
>>> > >>> >> >> > >>>>>> a
>>> > >>> >> >> > >>>>>>> protocol version was introduced (see
>>> > >>> ZOOKEEPER-107)
>>> > >>> >> and
>>> > >>> >> >> since
>>> > >>> >> >> > >> that
>>> > >>> >> >> > >>>> time
>>> > >>> >> >> > >>>>>> the
>>> > >>> >> >> > >>>>>>> fist long value sent in the initial
>>> message is
>>> > >>> not
>>> > >>> >> the
>>> > >>> >> >> server ID
>>> > >>> >> >> > >>> but
>>> > >>> >> >> > >>>>> the
>>> > >>> >> >> > >>>>>>> protocol version (-65536). In ZooKeeper
>>> 3.4.6
>>> > we
>>> > >>> made
>>> > >>> >> >> the old 3.4
>>> > >>> >> >> > >>>>>>> ZooKeepers backward compatible, so they are
>>> > able
>>> > >>> to
>>> > >>> >> >> parse both
>>> > >>> >> >> > >> the
>>> > >>> >> >> > >>>> old
>>> > >>> >> >> > >>>>>> and
>>> > >>> >> >> > >>>>>>> the new protocol format (see
>>> ZOOKEEPER-1633).
>>> > >>> This
>>> > >>> >> >> issue happens
>>> > >>> >> >> > >>> only
>>> > >>> >> >> > >>>>>> when
>>> > >>> >> >> > >>>>>>> you need to use old (3.4.0 - 3.4.5) and new
>>> > >>> (3.5.0+)
>>> > >>> >> >> ZooKeeper
>>> > >>> >> >> > >>>> servers
>>> > >>> >> >> > >>>>>>> together in the same cluster. During a
>>> rolling
>>> > >>> >> upgrade,
>>> > >>> >> >> this is
>>> > >>> >> >> > >>>> usually
>>> > >>> >> >> > >>>>>> the
>>> > >>> >> >> > >>>>>>> case to have old and new ZooKeepers present
>>> > >>> together.
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> The fact that you haven't seen any issues
>>> might
>>> > >>> be
>>> > >>> >> >> caused by the
>>> > >>> >> >> > >>>> order
>>> > >>> >> >> > >>>>> of
>>> > >>> >> >> > >>>>>>> the servers. In ZooKeeper the connection
>>> > >>> initiation
>>> > >>> >> >> between the
>>> > >>> >> >> > >>>> servers
>>> > >>> >> >> > >>>>>>> during the leader election follows a
>>> specific
>>> > >>> rule.
>>> > >>> >> As
>>> > >>> >> >> far as I
>>> > >>> >> >> > >>>>> remember
>>> > >>> >> >> > >>>>>>> always the server with the larger ID 'wins
>>> the
>>> > >>> >> >> challenge', so it
>>> > >>> >> >> > >> is
>>> > >>> >> >> > >>>>>>> possible, that the old server didn't need
>>> to
>>> > >>> parse
>>> > >>> >> any
>>> > >>> >> >> initial
>>> > >>> >> >> > >>>> message
>>> > >>> >> >> > >>>>>> (if
>>> > >>> >> >> > >>>>>>> it had the largest ID) and this is why you
>>> > >>> haven't
>>> > >>> >> seen
>>> > >>> >> >> the
>>> > >>> >> >> > >> issue.
>>> > >>> >> >> > >>>> Also
>>> > >>> >> >> > >>>>>>> having 2 nodes up from the 3 nodes cluster
>>> > still
>>> > >>> >> makes
>>> > >>> >> >> the
>>> > >>> >> >> > >> cluster
>>> > >>> >> >> > >>>> work
>>> > >>> >> >> > >>>>>> (so
>>> > >>> >> >> > >>>>>>> you should also check if all the servers
>>> are
>>> > >>> part of
>>> > >>> >> >> the quorum).
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> I agree with Enrico and Norbert, the
>>> safest and
>>> > >>> most
>>> > >>> >> >> stable way
>>> > >>> >> >> > >> is
>>> > >>> >> >> > >>>>>> upgrade
>>> > >>> >> >> > >>>>>>> first to 3.4.latest, then go to 3.5.latest.
>>> > >>> Still, if
>>> > >>> >> >> you don't
>>> > >>> >> >> > >> see
>>> > >>> >> >> > >>>>> that
>>> > >>> >> >> > >>>>>>> you would hit this specific issue (e.g. no
>>> > >>> "Invalid
>>> > >>> >> >> server id" in
>>> > >>> >> >> > >>> the
>>> > >>> >> >> > >>>>> log
>>> > >>> >> >> > >>>>>>> files), and all the three servers can
>>> handle
>>> > >>> traffic,
>>> > >>> >> >> then maybe
>>> > >>> >> >> > >>> you
>>> > >>> >> >> > >>>>>> don't
>>> > >>> >> >> > >>>>>>> need to upgrade first to 3.4.latest, it is
>>> your
>>> > >>> >> >> decision.
>>> > >>> >> >> > >>> Definitely
>>> > >>> >> >> > >>>>> you
>>> > >>> >> >> > >>>>>>> should test it first, as suggested by the
>>> > others.
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> Kind regards,
>>> > >>> >> >> > >>>>>>> Mate
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert
>>> Kalmar
>>> > >>> >> >> > >>>>>>> <nk...@cloudera.com.invalid> wrote:
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>>> Hi,
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>> That guide is to upgrade to 3.5.0, which
>>> was
>>> > an
>>> > >>> >> alpha
>>> > >>> >> >> version.
>>> > >>> >> >> > >> A
>>> > >>> >> >> > >>>> lot
>>> > >>> >> >> > >>>>>> has
>>> > >>> >> >> > >>>>>>>> changed for the first stable release of
>>> 3.5.5
>>> > >>> and
>>> > >>> >> then
>>> > >>> >> >> a few
>>> > >>> >> >> > >>> more,
>>> > >>> >> >> > >>>>> even
>>> > >>> >> >> > >>>>>>>> rolling upgrade issues have been fixed for
>>> > >>> 3.5.6.
>>> > >>> >> >> > >>>>>>>> This is a more up-to-date guide:
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>
>>> > >>> >> >>
>>> > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>> If you have done your testing (with prod
>>> > >>> snapshot!),
>>> > >>> >> >> then you
>>> > >>> >> >> > >> can
>>> > >>> >> >> > >>>>> skip
>>> > >>> >> >> > >>>>>>> 3.4
>>> > >>> >> >> > >>>>>>>> latest upgrade, but keep in mind we do our
>>> > >>> >> >> recommendations for
>>> > >>> >> >> > >> a
>>> > >>> >> >> > >>>>>> reason.
>>> > >>> >> >> > >>>>>>>> There were issues reported and/or found
>>> during
>>> > >>> >> >> testing. Some
>>> > >>> >> >> > >> are
>>> > >>> >> >> > >>>>> fixed
>>> > >>> >> >> > >>>>>>> with
>>> > >>> >> >> > >>>>>>>> 3.5.6, some only happens if certain
>>> conditions
>>> > >>> stand
>>> > >>> >> >> > >>> (IOException:
>>> > >>> >> >> > >>>> No
>>> > >>> >> >> > >>>>>>>> snapshot found - mentioned in the guide,
>>> fixed
>>> > >>> in
>>> > >>> >> >> 3.5.6).
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>> So it is up to you, I would still
>>> recommend to
>>> > >>> do an
>>> > >>> >> >> 3.4
>>> > >>> >> >> > >> upgrade
>>> > >>> >> >> > >>>>> first,
>>> > >>> >> >> > >>>>>>> if
>>> > >>> >> >> > >>>>>>>> it's feasible.
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>> Regards,
>>> > >>> >> >> > >>>>>>>> Norbert
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep
>>> > singh <
>>> > >>> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
>>> > >>> >> >> > >>>>>>>> wrote:
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>>> Hi,
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>> Current Zookeeper version :- 3.4.5
>>> > >>> >> >> > >>>>>>>>> Upgraded version :- 3.5.6
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>> We are not going with 3.5.7. Our final
>>> > >>> decision is
>>> > >>> >> >> zookeeper
>>> > >>> >> >> > >>>>> version
>>> > >>> >> >> > >>>>>> is
>>> > >>> >> >> > >>>>>>>>> 3.5.6
>>> > >>> >> >> > >>>>>>>>> as per your reply first we need to move
>>> > latest
>>> > >>> >> >> version of
>>> > >>> >> >> > >>> 3.4.x,
>>> > >>> >> >> > >>>>> like
>>> > >>> >> >> > >>>>>>>> below
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if
>>> I am
>>> > >>> wrong
>>> > >>> >> >> here)
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>> But if We are not facing any problem
>>> that i
>>> > >>> have
>>> > >>> >> >> shared you
>>> > >>> >> >> > >>> that
>>> > >>> >> >> > >>>> we
>>> > >>> >> >> > >>>>>>> have
>>> > >>> >> >> > >>>>>>>>> set up of 3 node cluster where 2 node
>>> are on
>>> > >>> 3.5.6
>>> > >>> >> >> version
>>> > >>> >> >> > >> and
>>> > >>> >> >> > >>> 1
>>> > >>> >> >> > >>>>> node
>>> > >>> >> >> > >>>>>>> on
>>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything is running fine and
>>> didn't
>>> > >>> get
>>> > >>> >> any
>>> > >>> >> >> issue,
>>> > >>> >> >> > >> So
>>> > >>> >> >> > >>>> what
>>> > >>> >> >> > >>>>>>> other
>>> > >>> >> >> > >>>>>>>>> problem we can face if we directly move
>>> to
>>> > >>> 3.5.6
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>> Thanks,
>>> > >>> >> >> > >>>>>>>>> ---------------------
>>> > >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
>>> > >>> >> >> > >>>>>>>>> Software Architect
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico
>>> > >>> Olivelli <
>>> > >>> >> >> > >>>>> eolivelli@gmail.com
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>>>> wrote:
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>> Hi
>>> > >>> >> >> > >>>>>>>>>> You have to upgrade to latest 3.4.x
>>> > Zookeeper
>>> > >>> then
>>> > >>> >> >> you will
>>> > >>> >> >> > >>>>> upgrade
>>> > >>> >> >> > >>>>>>> to
>>> > >>> >> >> > >>>>>>>>>> 3.5.7.
>>> > >>> >> >> > >>>>>>>>>> All should run well without issues
>>> > >>> >> >> > >>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>> Enrico
>>> > >>> >> >> > >>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh
>>> <
>>> > >>> >> >> > >>>>> kuldeep.singh08@gmail.com
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>> ha
>>> > >>> >> >> > >>>>>>>>>> scritto:
>>> > >>> >> >> > >>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> Hi Team,
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> We are upgrading zookeeper from 3.4.5
>>> to
>>> > >>> 3.5.6. I
>>> > >>> >> >> have
>>> > >>> >> >> > >> set
>>> > >>> >> >> > >>>> up 3
>>> > >>> >> >> > >>>>>>> node
>>> > >>> >> >> > >>>>>>>>>>> cluster where 2 node are on 3.5.6
>>> version
>>> > >>> and 1
>>> > >>> >> >> node on
>>> > >>> >> >> > >>>> 3.4.5.
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> Everything is running fine and didn't
>>> get
>>> > any
>>> > >>> >> issue
>>> > >>> >> >> on my
>>> > >>> >> >> > >>>>> system.
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> but I found something on apache site
>>> that
>>> > >>> first
>>> > >>> >> we
>>> > >>> >> >> need
>>> > >>> >> >> > >> to
>>> > >>> >> >> > >>>>>> upgrade
>>> > >>> >> >> > >>>>>>>> on
>>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So
>>> is
>>> > it
>>> > >>> >> >> mandatory
>>> > >>> >> >> > >> to
>>> > >>> >> >> > >>> go
>>> > >>> >> >> > >>>>> on
>>> > >>> >> >> > >>>>>>>> 3.4.6
>>> > >>> >> >> > >>>>>>>>>>> first.
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> Upgrading a running ZooKeeper ensemble
>>> to
>>> > >>> 3.5.0
>>> > >>> >> >> should be
>>> > >>> >> >> > >>>> done
>>> > >>> >> >> > >>>>>> only
>>> > >>> >> >> > >>>>>>>>> after
>>> > >>> >> >> > >>>>>>>>>>> upgrading your ensemble to the 3.4.6
>>> > release.
>>> > >>> >> Note
>>> > >>> >> >> that
>>> > >>> >> >> > >>> this
>>> > >>> >> >> > >>>> is
>>> > >>> >> >> > >>>>>>> only
>>> > >>> >> >> > >>>>>>>>>>> necessary for rolling upgrades (if
>>> you're
>>> > >>> fine
>>> > >>> >> with
>>> > >>> >> >> > >>> shutting
>>> > >>> >> >> > >>>>> down
>>> > >>> >> >> > >>>>>>> the
>>> > >>> >> >> > >>>>>>>>>>> system completely, you don't have to go
>>> > >>> through
>>> > >>> >> >> 3.4.6).
>>> > >>> >> >> > >> If
>>> > >>> >> >> > >>>> you
>>> > >>> >> >> > >>>>>>>> attempt
>>> > >>> >> >> > >>>>>>>>> a
>>> > >>> >> >> > >>>>>>>>>>> rolling upgrade without going through
>>> 3.4.6
>>> > >>> (for
>>> > >>> >> >> example
>>> > >>> >> >> > >>> from
>>> > >>> >> >> > >>>>>>> 3.4.5),
>>> > >>> >> >> > >>>>>>>>> you
>>> > >>> >> >> > >>>>>>>>>>> may get the following error:
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO
>>> > >>> >> [localhost/
>>> > >>> >> >> > >>>>>> 127.0.0.1:2784
>>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager$Listener@498] -
>>> Received
>>> > >>> >> >> connection
>>> > >>> >> >> > >>>> request
>>> > >>> >> >> > >>>>> /
>>> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
>>> > >>> >> [localhost/
>>> > >>> >> >> > >>>>>> 127.0.0.1:2784
>>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349] - Invalid
>>> server
>>> > id:
>>> > >>> >> -65536
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> During a rolling upgrade, each server
>>> is
>>> > >>> taken
>>> > >>> >> down
>>> > >>> >> >> in
>>> > >>> >> >> > >> turn
>>> > >>> >> >> > >>>> and
>>> > >>> >> >> > >>>>>>>>> rebooted
>>> > >>> >> >> > >>>>>>>>>>> with the new 3.5.0 binaries. Before
>>> > starting
>>> > >>> the
>>> > >>> >> >> server
>>> > >>> >> >> > >>> with
>>> > >>> >> >> > >>>>>> 3.5.0
>>> > >>> >> >> > >>>>>>>>>>> binaries, we highly recommend updating
>>> the
>>> > >>> >> >> configuration
>>> > >>> >> >> > >>> file
>>> > >>> >> >> > >>>>> so
>>> > >>> >> >> > >>>>>>> that
>>> > >>> >> >> > >>>>>>>>> all
>>> > >>> >> >> > >>>>>>>>>>> server statements "server.x=..."
>>> contain
>>> > >>> client
>>> > >>> >> >> ports
>>> > >>> >> >> > >> (see
>>> > >>> >> >> > >>>> the
>>> > >>> >> >> > >>>>>>>> section
>>> > >>> >> >> > >>>>>>>>>>> Specifying
>>> > >>> >> >> > >>>>>>>>>>> the client port). As explained earlier
>>> you
>>> > >>> may
>>> > >>> >> >> leave the
>>> > >>> >> >> > >>>>>>>> configuration
>>> > >>> >> >> > >>>>>>>>>> in a
>>> > >>> >> >> > >>>>>>>>>>> single file, as well as leave the
>>> > >>> >> >> > >>>> clientPort/clientPortAddress
>>> > >>> >> >> > >>>>>>>>> statements
>>> > >>> >> >> > >>>>>>>>>>> (although if you specify client ports
>>> in
>>> > the
>>> > >>> new
>>> > >>> >> >> format,
>>> > >>> >> >> > >>>> these
>>> > >>> >> >> > >>>>>>>>> statements
>>> > >>> >> >> > >>>>>>>>>>> are now redundant).
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> Could you please let me know about this
>>> > case.
>>> > >>> >> >> Appreciate
>>> > >>> >> >> > >> if
>>> > >>> >> >> > >>>>>> respond
>>> > >>> >> >> > >>>>>>>>> soon.
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>> Thanks,
>>> > >>> >> >> > >>>>>>>>>>> ---------------------
>>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
>>> > >>> >> >> > >>>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>>
>>> > >>> >> >> > >>>>>>>>>
>>> > >>> >> >> > >>>>>>>>
>>> > >>> >> >> > >>>>>>>
>>> > >>> >> >> > >>>>>>
>>> > >>> >> >> > >>>>>
>>> > >>> >> >> > >>>>
>>> > >>> >> >> > >>>
>>> > >>> >> >> > >>
>>> > >>> >> >> >
>>> > >>> >> >> >
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >> ________________________________
>>> > >>> >> >>
>>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>>> > >>> >> >> This e-mail (including any attachments) is strictly
>>> > >>> confidential
>>> > >>> >> and
>>> > >>> >> >> may also contain privileged information. If you are not the
>>> > >>> intended
>>> > >>> >> >> recipient you are not authorised to read, print, save,
>>> process or
>>> > >>> >> disclose
>>> > >>> >> >> this message. If you have received this message by mistake,
>>> > please
>>> > >>> >> inform
>>> > >>> >> >> the sender immediately and destroy this e-mail, its
>>> attachments
>>> > >>> and any
>>> > >>> >> >> copies. Any use, distribution, reproduction or disclosure by
>>> any
>>> > >>> person
>>> > >>> >> >> other than the intended recipient is strictly prohibited and
>>> the
>>> > >>> person
>>> > >>> >> >> responsible may incur in penalties.
>>> > >>> >> >> The use of this e-mail is only for professional purposes;
>>> > >>> there is
>>> > >>> >> no
>>> > >>> >> >> guarantee that the correspondence towards this e-mail will be
>>> > read
>>> > >>> >> only by
>>> > >>> >> >> the recipient, because, under certain circumstances, there
>>> may
>>> > be a
>>> > >>> >> need to
>>> > >>> >> >> access this email by third subjects belonging to the Company.
>>> > >>> >> >>
>>> > >>> >> >>
>>> > >>> >> >> ________________________________
>>> > >>> >> >>
>>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>>> > >>> >> >> This e-mail (including any attachments) is strictly
>>> confidential
>>> > >>> and
>>> > >>> >> may
>>> > >>> >> >> also contain privileged information. If you are not the
>>> intended
>>> > >>> >> recipient
>>> > >>> >> >> you are not authorised to read, print, save, process or
>>> disclose
>>> > >>> this
>>> > >>> >> >> message. If you have received this message by mistake, please
>>> > >>> inform
>>> > >>> >> the
>>> > >>> >> >> sender immediately and destroy this e-mail, its attachments
>>> and
>>> > any
>>> > >>> >> copies.
>>> > >>> >> >> Any use, distribution, reproduction or disclosure by any
>>> person
>>> > >>> other
>>> > >>> >> than
>>> > >>> >> >> the intended recipient is strictly prohibited and the person
>>> > >>> >> responsible
>>> > >>> >> >> may incur in penalties.
>>> > >>> >> >> The use of this e-mail is only for professional purposes;
>>> there
>>> > is
>>> > >>> no
>>> > >>> >> >> guarantee that the correspondence towards this e-mail will be
>>> > read
>>> > >>> >> only by
>>> > >>> >> >> the recipient, because, under certain circumstances, there
>>> may
>>> > be a
>>> > >>> >> need to
>>> > >>> >> >> access this email by third subjects belonging to the Company.
>>> > >>> >> >>
>>> > >>> >> >
>>> > >>> >>
>>> > >>> >
>>> > >>>
>>> > >>
>>> >
>>>
>>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Hi Team,
Server to Server communication is not supported in 3.5.6 version as per
below JIRA issue?
https://issues.apache.org/jira/browse/ZOOKEEPER-2639
Thanks,
---------------------
Kuldeep Singh Budania
On Thu, Jul 2, 2020 at 4:24 PM kuldeep singh <ku...@gmail.com>
wrote:
> Thanks for the reply.
>
> Now my ZKCli cmd is working fine as we use some our customized
> authentication and we resolve the issue.
>
> Now I am going to implement Server to Server communication.
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <
> szalay.beko.mate@gmail.com> wrote:
>
>> I think SSL is working for you already... If you managed to start the
>> zkCli.sh and be able to connect to ZooKeeper on the secure port and issue
>> any kind of command (like: " ls / "), then the wire encryption is working
>> and your server/client communication is secured by ZooKeeper.
>>
>> Why you want to run the following command?
>> addauth ztpasswd zooadmin:<password>
>>
>> Do you also want to configure a superDigest user in ZooKeeper? Please note
>> that this command is independent from SSL. If you need to create a
>> username-password pair for digest authentication then please use the
>> command in the following way:
>> addauth digest zooadmin:yourSuperSecretPassword
>>
>> Kind regards,
>> Mate
>>
>> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <ku...@gmail.com>
>> wrote:
>>
>> > 1. sh zkCli.sh --config /etc/zookeeper -server localhost:2281
>> >
>> > 2. addauth ztpasswd zooadmin:<password>
>> >
>> >
>> > Thanks,
>> > ---------------------
>> > Kuldeep Singh Budania
>> >
>> >
>> >
>> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <kuldeep.singh08@gmail.com
>> >
>> > wrote:
>> >
>> > > Hi Team,
>> > >
>> > > Any update on this?
>> > >
>> > > Thanks,
>> > > ---------------------
>> > > Kuldeep Singh Budania
>> > >
>> > >
>> > >
>> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
>> kuldeep.singh08@gmail.com>
>> > > wrote:
>> > >
>> > >> Sorry this is my bad, there were server setting like below
>> > >>
>> > >> export SERVER_JVMFLAGS="
>> > >>
>> > >>
>> > >>
>> >
>> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > >>
>> > >>
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> > >> -Dzookeeper.ssl.keyStore.password=testpass
>> > >>
>> >
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
>> > >>
>> > >>
>> > >>
>> > >> export CLIENT_JVMFLAGS="
>> > >>
>> > >>
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> > >> -Dzookeeper.client.secure=true
>> > >>
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> > >> -Dzookeeper.ssl.keyStore.password=testpass
>> > >>
>> >
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> > >> -Dzookeeper.ssl.trustStore.password=testpass"
>> > >>
>> > >> I want to have SSL between client to server communication
>> > >>
>> > >> I am already following the same link which you have shared with me
>> but
>> > >> that is not working.
>> > >>
>> > >> Zoo.cfg
>> > >>
>> > >> secureClientPort=2281
>> > >> initLimit=10
>> > >> syncLimit=5
>> > >> dataDir=/var/lib/zookeeper/data
>> > >> tickTime=2000
>> > >> autopurge.snapRetainCount=3
>> > >> autopurge.purgeInterval=1
>> > >> admin.enableServer=false
>> > >> standaloneEnabled=false
>> > >> jute.maxbuffer=2147483648
>> > >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > >> server.1=host1_priv:10288:10388
>> > >> server.2=host2_priv:10288:10388
>> > >> server.3=host3_priv:10288:10388
>> > >>
>> > >>
>> > >> command to connect using zkcli
>> > >>
>> > >> 1. zkcli zoo.cfg localhost:2281
>> > >> 2. addauth ztpasswd usernaem:password
>> > >>
>> > >> after second step we are getting below error
>> > >>
>> > >> WatchedEvent state:AuthFailed type:None path:null
>> > >>
>> > >>
>> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
>> > provider
>> > >> for scheme: ztpasswd has x509 ip digest*
>> > >>
>> > >> Thanks,
>> > >> ---------------------
>> > >> Kuldeep Singh Budania
>> > >>
>> > >>
>> > >>
>> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
>> > >> szalay.beko.mate@gmail.com> wrote:
>> > >>
>> > >>> > No authentication provider for scheme: ztpasswd has x509 ip
>> digest*
>> > >>>
>> > >>> This suggest you have some configuration error... Where did you use
>> the
>> > >>> "ztpasswd" string in your configs / commands?
>> > >>>
>> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
>> > >>> szalay.beko.mate@gmail.com>
>> > >>> wrote:
>> > >>>
>> > >>> > > My ZK server is up and running in secure mode
>> > >>> >
>> > >>> > What is your goal? You want to setup client-server SSL connection?
>> > >>> >
>> > >>> > see:
>> > >>> >
>> > >>>
>> >
>> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
>> > >>> >
>> > >>> > (or you want to have both SSL and SASL enabled?)
>> > >>> >
>> > >>> > Anyway, please remove the following line from the SERVER_JVMFLAGS:
>> > >>> >
>> > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> > >>> > This is a configuration that makes sense only for the ZooKeeper
>> > client,
>> > >>> > not for the server. For the server, use the following:
>> > >>> >
>> > >>> >
>> > >>>
>> >
>> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > >>> >
>> > >>> > If it doesn't solve the issue, then can you please send your
>> zoo.cfg
>> > >>> file?
>> > >>> > Also can you please send the zkCli command you execute? (you need
>> to
>> > >>> > connect to the secure ZooKeeper port, unless portUnification is
>> > >>> enabled)
>> > >>> >
>> > >>> > Kind regards,
>> > >>> > Mate
>> > >>> >
>> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
>> > >>> kuldeep.singh08@gmail.com>
>> > >>> > wrote:
>> > >>> >
>> > >>> >> Hi,
>> > >>> >>
>> > >>> >> we have done below changes in java.env file
>> > >>> >>
>> > >>> >> export SERVER_JVMFLAGS="
>> > >>> >>
>> > >>> >>
>> > >>>
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> > >>> >>
>> > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
>> > >>> >>
>> > >>>
>> >
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
>> > >>> >>
>> > >>> >>
>> > >>> >>
>> > >>> >> export CLIENT_JVMFLAGS="
>> > >>> >>
>> > >>> >>
>> > >>>
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> > >>> >> -Dzookeeper.client.secure=true
>> > >>> >>
>> > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
>> > >>> >>
>> > >>>
>> >
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
>> > >>> >>
>> > >>> >> I have started the ZK server and it is up without any issue.
>> > >>> >>
>> > >>> >> But now when I login to ZkCli then it gives the below error.
>> > >>> >>
>> > >>> >> WatchedEvent state:AuthFailed type:None path:null
>> > >>> >>
>> > >>> >>
>> > >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>> > >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
>> > >>> provider
>> > >>> >> for scheme: ztpasswd has x509 ip digest*
>> > >>> >>
>> > >>> >> Please help me on this issue
>> > >>> >>
>> > >>> >> Thanks,
>> > >>> >> ---------------------
>> > >>> >> Kuldeep Singh Budania
>> > >>> >> Software Architect
>> > >>> >>
>> > >>> >>
>> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
>> > >>> kuldeep.singh08@gmail.com>
>> > >>> >> wrote:
>> > >>> >>
>> > >>> >> > Hi,
>> > >>> >> >
>> > >>> >> > My ZK server is up and running in secure mode, But When I am
>> > >>> trying to
>> > >>> >> > connect to the ZK server using ZKCli, it gives the below error.
>> > >>> >> >
>> > >>> >> > WatchedEvent state:AuthFailed type:None path:null
>> > >>> >> >
>> > >>> >> >
>> > >>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>> > >>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
>> authentication
>> > >>> >> provider
>> > >>> >> > for scheme: ztpasswd has x509 ip digest*
>> > >>> >> >
>> > >>> >> > Can someone please help me on this issue. we are using the
>> 3.5.6
>> > >>> >> version.
>> > >>> >> >
>> > >>> >> > I appreciate if I will get a response as soon as possible, as
>> I am
>> > >>> stuck
>> > >>> >> > at this point.
>> > >>> >> >
>> > >>> >> > Thanks,
>> > >>> >> > ---------------------
>> > >>> >> > Kuldeep Singh Budania
>> > >>> >> > Software Architect
>> > >>> >> >
>> > >>> >> >
>> > >>> >> >
>> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli - Diennea
>> > >>> >> > <en...@diennea.com.invalid> wrote:
>> > >>> >> >
>> > >>> >> >> I mean in zoo.cfg
>> > >>> >> >> Not as a system property
>> > >>> >> >>
>> > >>> >> >> Enrico
>> > >>> >> >>
>> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <
>> > >>> >> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
>> > >>> >> >>
>> > >>> >> >> Hi
>> > >>> >> >> You have to enable Netty on the server side
>> > >>> >> >>
>> > >>> >> >> Something like:
>> > >>> >> >>
>> > >>> >>
>> > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > >>> >> >>
>> > >>> >> >> Hope that helps
>> > >>> >> >> Enrico
>> > >>> >> >>
>> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
>> > >>> >> kuldeep.singh08@gmail.com>
>> > >>> >> >> ha scritto:
>> > >>> >> >>
>> > >>> >> >> Hi,
>> > >>> >> >>
>> > >>> >> >> I got below error while setting SSL properties in
>> > zkEnv.sh
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> ==========================================================================================
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
>> > [main:QuorumPeerConfig@133]
>> > >>> -
>> > >>> >> >> Reading
>> > >>> >> >> configuration from: /etc/zookeeper/zoo.cfg
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
>> > [main:QuorumPeerConfig@385]
>> > >>> -
>> > >>> >> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
>> > [main:QuorumPeerConfig@399]
>> > >>> -
>> > >>> >> >> secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] -
>> > >>> Setting
>> > >>> >> -D
>> > >>> >> >> jdk.tls.rejectClientInitiatedRenegotiation=true to
>> > disable
>> > >>> >> >> client-initiated
>> > >>> >> >> TLS renegotiation
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
>> > >>> [main:DatadirCleanupManager@78]
>> > >>> >> -
>> > >>> >> >> autopurge.snapRetainCount set to 3
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
>> > >>> [main:DatadirCleanupManager@79]
>> > >>> >> -
>> > >>> >> >> autopurge.purgeInterval set to 1
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,898 - INFO [
>> > >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@138] -
>> Purge
>> > >>> task
>> > >>> >> >> started.
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46]
>> -
>> > >>> Log4j
>> > >>> >> >> found with
>> > >>> >> >> jmx enabled.
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
>> > >>> [PurgeTask:FileTxnSnapLog@103]
>> > >>> >> -
>> > >>> >> >> zookeeper.snapshot.trust.empty : false
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,910 - INFO [
>> > >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@144] -
>> Purge
>> > >>> task
>> > >>> >> >> completed.
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
>> [main:QuorumPeerMain@141
>> > ]
>> > >>> -
>> > >>> >> >> Starting quorum
>> > >>> >> >> peer
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
>> > [main:ServerCnxnFactory@135]
>> > >>> -
>> > >>> >> >> Using
>> > >>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as
>> > server
>> > >>> >> >> connection
>> > >>> >> >> factory
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
>> > >>> [main:NIOServerCnxnFactory@673]
>> > >>> >> -
>> > >>> >> >> Configuring NIO connection handler with 10s
>> sessionless
>> > >>> >> >> connection timeout,
>> > >>> >> >> 2 selector thread(s), 16 worker threads, and 64 kB
>> direct
>> > >>> >> buffers.
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
>> > >>> [main:NIOServerCnxnFactory@686
>> > >>> >> ]
>> > >>> >> >> - binding
>> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
>> > [main:ServerCnxnFactory@135]
>> > >>> -
>> > >>> >> >> Using
>> > >>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as
>> > server
>> > >>> >> >> connection
>> > >>> >> >> factory
>> > >>> >> >>
>> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
>> [main:QuorumPeerMain@101
>> > ]
>> > >>> -
>> > >>> >> >> Unexpected
>> > >>> >> >> exception, exiting abnormally
>> > >>> >> >>
>> > >>> >> >> java.lang.UnsupportedOperationException: SSL isn't
>> > >>> supported in
>> > >>> >> >> NIOServerCnxn
>> > >>> >> >>
>> > >>> >> >> at
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
>> > >>> >> >>
>> > >>> >> >> at
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
>> > >>> >> >>
>> > >>> >> >> at
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
>> > >>> >> >>
>> > >>> >> >> at
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >> >> I have set the following properties in
>> SERVER_JVMFLAGS in
>> > >>> >> >> zkEnv.sh file :
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
>> > >>> >> >> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
>> > >>> >> >> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
>> > >>> >> >>
>> > >>> >> >> Thanks,
>> > >>> >> >> ---------------------
>> > >>> >> >> Kuldeep Singh Budania
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <
>> > >>> >> >> jordan@jordanzimmerman.com>
>> > >>> >> >> wrote:
>> > >>> >> >>
>> > >>> >> >> > It's the same as the normal ZooKeeper client:
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> > >>> >> >> > <
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> > >>> >> >> > >
>> > >>> >> >> >
>> > >>> >> >> > -Jordan
>> > >>> >> >> >
>> > >>> >> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep singh <
>> > >>> >> >> kuldeep.singh08@gmail.com>
>> > >>> >> >> > wrote:
>> > >>> >> >> > >
>> > >>> >> >> > > Hi Team,
>> > >>> >> >> > > How we will do secure communication between the
>> > Curator
>> > >>> >> >> framework and
>> > >>> >> >> > > zookeeper 3.5.6 ?
>> > >>> >> >> > > I didn't get any solution right now.
>> > >>> >> >> > > I appreciate it if someone could help me with the
>> > same.
>> > >>> >> >> > >
>> > >>> >> >> > > Thanks,
>> > >>> >> >> > > ---------------------
>> > >>> >> >> > > Kuldeep Singh Budania
>> > >>> >> >> > > Software Architect
>> > >>> >> >> > >
>> > >>> >> >> > >
>> > >>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
>> > >>> >> >> > szalay.beko.mate@gmail.com>
>> > >>> >> >> > > wrote:
>> > >>> >> >> > >
>> > >>> >> >> > >> Hello Kuldeep,
>> > >>> >> >> > >>
>> > >>> >> >> > >> did you download the source from the ZooKeeper
>> > >>> webpage, or
>> > >>> >> >> checked out
>> > >>> >> >> > from
>> > >>> >> >> > >> git?
>> > >>> >> >> > >> Anyway, the following commands should work:
>> > >>> >> >> > >>
>> > >>> >> >> > >> wget
>> > >>> >> >> > >>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
>> > >>> >> >> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
>> > >>> >> >> > >> cd apache-zookeeper-3.5.7
>> > >>> >> >> > >> mvn clean install -DskipTests
>> > >>> >> >> > >>
>> > >>> >> >> > >> I tested it with OpenJDK 8u424 and maven 3.6.0.
>> > >>> >> >> > >>
>> > >>> >> >> > >> Kind regards,
>> > >>> >> >> > >> Mate
>> > >>> >> >> > >>
>> > >>> >> >> > >>
>> > >>> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
>> > >>> >> >> > kuldeep.singh08@gmail.com>
>> > >>> >> >> > >> wrote:
>> > >>> >> >> > >>
>> > >>> >> >> > >>> Hi All,
>> > >>> >> >> > >>>
>> > >>> >> >> > >>> I have download the zookeeper source code and
>> run
>> > >>> the mvn
>> > >>> >> >> command for
>> > >>> >> >> > >>> packaging but get problem on "zookeeper-server"
>> > >>> >> directory.
>> > >>> >> >> > >>>
>> > >>> >> >> > >>> *command :- mvn clean package*
>> > >>> >> >> > >>>
>> > >>> >> >> > >>> [ERROR] Failed to execute goal
>> > >>> >> >> > >>>
>> > >>> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> > >>> >> >> > >>> (default-compile) on project zookeeper: Fatal
>> error
>> > >>> >> >> compiling:
>> > >>> >> >> > >>> java.lang.NullPointerException -> [Help 1]
>> > >>> >> >> > >>>
>> > >>> org.apache.maven.lifecycle.LifecycleExecutionException:
>> > >>> >> >> Failed to
>> > >>> >> >> > execute
>> > >>> >> >> > >>> goal
>> > >>> >> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> > >>> >> >> > >>> (default-compile) on project zookeeper: Fatal
>> error
>> > >>> >> >> compiling
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
>> > >>> >> >> > >>> at
>> > >>> >> >> >
>> > >>> >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
>> > >>> >> >> > >>> at
>> > >>> >> >> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
>> > >>> >> >> > >>> at
>> > >>> >> >> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
>> > >>> >> >> > >>> at
>> > >>> >> >> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
>> > >>> >> >> > >>> at
>> > >>> >> >> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
>> > >>> >> >> > >>> at
>> > >>> >> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> > >>> >> >> > >>> at
>> > >>> >> java.lang.reflect.Method.invoke(Method.java:498)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>> > >>> >> >> > >>> Caused by:
>> > >>> >> org.apache.maven.plugin.MojoExecutionException:
>> > >>> >> >> Fatal error
>> > >>> >> >> > >>> compiling
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>> > >>> >> >> > >>> ... 19 more
>> > >>> >> >> > >>> Caused by:
>> > >>> >> org.codehaus.plexus.compiler.CompilerException:
>> > >>> >> >> > >>> java.lang.NullPointerException
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
>> > >>> >> >> > >>> ... 22 more
>> > >>> >> >> > >>> Caused by: java.lang.RuntimeException:
>> > >>> >> >> java.lang.NullPointerException
>> > >>> >> >> > >>> at
>> > >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:559)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > >>> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
>> > >>> >> >> > >>> ... 24 more
>> > >>> >> >> > >>> Caused by: java.lang.NullPointerException
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
>> > >>> >> >> > >>> at
>> > >>> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
>> > >>> >> >> > >>> at
>> > >>> >> >> com.sun.tools.doclint.Checker.scan(Checker.java:144)
>> > >>> >> >> > >>> at
>> > >>> >> >> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > >>>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > >>>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > >>>
>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> > >>> >> >> > >>> at
>> > >>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>
>> > >>> >> >>
>> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > >>>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > >>>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >>> >> >> > >>> at
>> > >>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >>> >> >> > >>> at
>> > >>> >> >> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > >>>
>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > >>>
>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
>> > >>> >> >> > >>> at
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > >>> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
>> > >>> >> >> > >>> at
>> > >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:523)
>> > >>> >> >> > >>> ... 27 more
>> > >>> >> >> > >>> [ERROR]
>> > >>> >> >> > >>> [ERROR] Re-run Maven using the -X switch to
>> enable
>> > >>> full
>> > >>> >> >> debug logging.
>> > >>> >> >> > >>> [ERROR]
>> > >>> >> >> > >>> [ERROR] For more information about the errors
>> and
>> > >>> >> possible
>> > >>> >> >> solutions,
>> > >>> >> >> > >>> please read the following articles:
>> > >>> >> >> > >>> [ERROR] [Help 1]
>> > >>> >> >> > >>>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>> > >>> >> >> > >>>
>> > >>> >> >> > >>> Can someone help me on this issue?
>> > >>> >> >> > >>>
>> > >>> >> >> > >>> Thanks,
>> > >>> >> >> > >>> ---------------------
>> > >>> >> >> > >>> Kuldeep Singh Budania
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté
>> <
>> > >>> >> >> > >>> szalay.beko.mate@gmail.com>
>> > >>> >> >> > >>> wrote:
>> > >>> >> >> > >>>
>> > >>> >> >> > >>>> these exceptions can mean many things... I
>> think
>> > >>> this
>> > >>> >> can
>> > >>> >> >> be even
>> > >>> >> >> > >> normal
>> > >>> >> >> > >>>> duding rolling restart (as some connections get
>> > >>> broken
>> > >>> >> in
>> > >>> >> >> this case)
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>> However, I saw cases already when exceptions
>> like
>> > >>> these
>> > >>> >> >> killed
>> > >>> >> >> > receiver
>> > >>> >> >> > >>> or
>> > >>> >> >> > >>>> sender threads in QuorumCnxManager / Leader
>> > >>> Election in
>> > >>> >> >> such a way
>> > >>> >> >> > that
>> > >>> >> >> > >>>> they were not able to recover, so the node was
>> > >>> unable to
>> > >>> >> >> connect to
>> > >>> >> >> > any
>> > >>> >> >> > >>>> quorum until restart. I remember seeing this in
>> > 3.4
>> > >>> too.
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>> Do you see these exceptions in the second
>> server
>> > >>> (the
>> > >>> >> one
>> > >>> >> >> which you
>> > >>> >> >> > >> just
>> > >>> >> >> > >>>> upgraded in step 3)?
>> > >>> >> >> > >>>> Is this issue reproducible?
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>> What is the tickTime and initLimit you use?
>> Maybe
>> > >>> the
>> > >>> >> >> server just
>> > >>> >> >> > >> require
>> > >>> >> >> > >>>> more time to sync?
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>> I would need more logs to really see what
>> > happened.
>> > >>> Can
>> > >>> >> >> you create a
>> > >>> >> >> > >> Jira
>> > >>> >> >> > >>>> issue and upload the logs and also the
>> ZooKeeper
>> > >>> >> configs?
>> > >>> >> >> I am happy
>> > >>> >> >> > to
>> > >>> >> >> > >>>> take a closer look.
>> > >>> >> >> > >>>> (if you need to re-run the test to collect the
>> > logs,
>> > >>> >> then
>> > >>> >> >> enabling
>> > >>> >> >> > >> DEBUG
>> > >>> >> >> > >>>> logs would be great. The INFO level logs are
>> > usually
>> > >>> >> >> enough for these
>> > >>> >> >> > >>>> problems, but one can never know...)
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>> Kind regards,
>> > >>> >> >> > >>>> Mate
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
>> > >>> >> >> > >> kuldeep.singh08@gmail.com
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>> wrote:
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>>> Hi Team,
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> I have done some POC on rolling upgrade and
>> found
>> > >>> below
>> > >>> >> >> result.
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> 1. On 1st node upgrade zookeeper . Traffic
>> was
>> > >>> >> running
>> > >>> >> >> fine
>> > >>> >> >> > >> because
>> > >>> >> >> > >>> 2
>> > >>> >> >> > >>>>> nodes are already on old zookeeper.
>> > >>> >> >> > >>>>> 2. On 1st node upgrade our application and
>> > didn’t
>> > >>> >> find
>> > >>> >> >> any issue
>> > >>> >> >> > >>>>> 3. On 2nd node upgrade zookeeper but got
>> below
>> > >>> error
>> > >>> >> >> and zookeeper
>> > >>> >> >> > >>> is
>> > >>> >> >> > >>>>> not taking any requests
>> > >>> >> >> > >>>>> 4.
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> java.io.EOFException
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> at
>> > >>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> at
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
>> > >>> >> >> > >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
>> -
>> > >>> >> >> Interrupting
>> > >>> >> >> > >>> SendWorker
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR
>> [LearnerHandler-/
>> > >>> >> >> 192.168.44.73:33754
>> > >>> >> >> > >>>>> :LearnerHandler@562] - Unexpected exception
>> > >>> causing
>> > >>> >> >> shutdown while
>> > >>> >> >> > >>> sock
>> > >>> >> >> > >>>>> still open
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> java.io.EOFException
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> at
>> > >>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> at
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>
>> > >>> >> >>
>> > >>>
>> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> at
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> at
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> at
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >>
>> > >>>
>> >
>> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
>> > >>> >> >> > >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679]
>> -
>> > >>> >> >> Interrupted while
>> > >>> >> >> > >>>> waiting
>> > >>> >> >> > >>>>> for message on queue
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> Please let me know is this the known issue or
>> > this
>> > >>> is
>> > >>> >> >> different issue
>> > >>> >> >> > >>>> which
>> > >>> >> >> > >>>>> is mention in Apache zookeeper documentation
>> when
>> > >>> >> >> upgrading from
>> > >>> >> >> > >> 3.4.5
>> > >>> >> >> > >>> to
>> > >>> >> >> > >>>>> 3.5.6
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> Thanks,
>> > >>> >> >> > >>>>> ---------------------
>> > >>> >> >> > >>>>> Kuldeep Singh Budania
>> > >>> >> >> > >>>>> Software Architect
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander
>> Shraer
>> > <
>> > >>> >> >> shralex@gmail.com>
>> > >>> >> >> > >>>>> wrote:
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>>> +1 to what Mate said (I wrote the quoted
>> > >>> >> instructions).
>> > >>> >> >> > >>>>>>
>> > >>> >> >> > >>>>>>
>> > >>> >> >> > >>>>>>
>> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő
>> > Máté <
>> > >>> >> >> > >>>>>> szalay.beko.mate@gmail.com>
>> > >>> >> >> > >>>>>> wrote:
>> > >>> >> >> > >>>>>>
>> > >>> >> >> > >>>>>>> Hi Kuldeep,
>> > >>> >> >> > >>>>>>>
>> > >>> >> >> > >>>>>>> I just want to provide you some background
>> info
>> > >>> about
>> > >>> >> >> our
>> > >>> >> >> > >>>>> documentation.
>> > >>> >> >> > >>>>>>> The reason to upgrade to 3.4.6 first is to
>> > avoid
>> > >>> the
>> > >>> >> >> following
>> > >>> >> >> > >>> error:
>> > >>> >> >> > >>>>>>>
>> > >>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
>> > >>> [localhost/
>> > >>> >> >> > >>> 127.0.0.1:2784
>> > >>> >> >> > >>>>>>> :QuorumCnxManager@349] - Invalid server id:
>> > >>> -65536
>> > >>> >> >> > >>>>>>>
>> > >>> >> >> > >>>>>>> This error comes because of the protocol
>> > changes
>> > >>> >> between
>> > >>> >> >> > >> ZooKeeper
>> > >>> >> >> > >>>>> server
>> > >>> >> >> > >>>>>>> nodes during connection initiation for
>> leader
>> > >>> >> election.
>> > >>> >> >> In
>> > >>> >> >> > >>> ZooKeeper
>> > >>> >> >> > >>>>> 3.5
>> > >>> >> >> > >>>>>> a
>> > >>> >> >> > >>>>>>> protocol version was introduced (see
>> > >>> ZOOKEEPER-107)
>> > >>> >> and
>> > >>> >> >> since
>> > >>> >> >> > >> that
>> > >>> >> >> > >>>> time
>> > >>> >> >> > >>>>>> the
>> > >>> >> >> > >>>>>>> fist long value sent in the initial message
>> is
>> > >>> not
>> > >>> >> the
>> > >>> >> >> server ID
>> > >>> >> >> > >>> but
>> > >>> >> >> > >>>>> the
>> > >>> >> >> > >>>>>>> protocol version (-65536). In ZooKeeper
>> 3.4.6
>> > we
>> > >>> made
>> > >>> >> >> the old 3.4
>> > >>> >> >> > >>>>>>> ZooKeepers backward compatible, so they are
>> > able
>> > >>> to
>> > >>> >> >> parse both
>> > >>> >> >> > >> the
>> > >>> >> >> > >>>> old
>> > >>> >> >> > >>>>>> and
>> > >>> >> >> > >>>>>>> the new protocol format (see
>> ZOOKEEPER-1633).
>> > >>> This
>> > >>> >> >> issue happens
>> > >>> >> >> > >>> only
>> > >>> >> >> > >>>>>> when
>> > >>> >> >> > >>>>>>> you need to use old (3.4.0 - 3.4.5) and new
>> > >>> (3.5.0+)
>> > >>> >> >> ZooKeeper
>> > >>> >> >> > >>>> servers
>> > >>> >> >> > >>>>>>> together in the same cluster. During a
>> rolling
>> > >>> >> upgrade,
>> > >>> >> >> this is
>> > >>> >> >> > >>>> usually
>> > >>> >> >> > >>>>>> the
>> > >>> >> >> > >>>>>>> case to have old and new ZooKeepers present
>> > >>> together.
>> > >>> >> >> > >>>>>>>
>> > >>> >> >> > >>>>>>> The fact that you haven't seen any issues
>> might
>> > >>> be
>> > >>> >> >> caused by the
>> > >>> >> >> > >>>> order
>> > >>> >> >> > >>>>> of
>> > >>> >> >> > >>>>>>> the servers. In ZooKeeper the connection
>> > >>> initiation
>> > >>> >> >> between the
>> > >>> >> >> > >>>> servers
>> > >>> >> >> > >>>>>>> during the leader election follows a
>> specific
>> > >>> rule.
>> > >>> >> As
>> > >>> >> >> far as I
>> > >>> >> >> > >>>>> remember
>> > >>> >> >> > >>>>>>> always the server with the larger ID 'wins
>> the
>> > >>> >> >> challenge', so it
>> > >>> >> >> > >> is
>> > >>> >> >> > >>>>>>> possible, that the old server didn't need to
>> > >>> parse
>> > >>> >> any
>> > >>> >> >> initial
>> > >>> >> >> > >>>> message
>> > >>> >> >> > >>>>>> (if
>> > >>> >> >> > >>>>>>> it had the largest ID) and this is why you
>> > >>> haven't
>> > >>> >> seen
>> > >>> >> >> the
>> > >>> >> >> > >> issue.
>> > >>> >> >> > >>>> Also
>> > >>> >> >> > >>>>>>> having 2 nodes up from the 3 nodes cluster
>> > still
>> > >>> >> makes
>> > >>> >> >> the
>> > >>> >> >> > >> cluster
>> > >>> >> >> > >>>> work
>> > >>> >> >> > >>>>>> (so
>> > >>> >> >> > >>>>>>> you should also check if all the servers are
>> > >>> part of
>> > >>> >> >> the quorum).
>> > >>> >> >> > >>>>>>>
>> > >>> >> >> > >>>>>>> I agree with Enrico and Norbert, the safest
>> and
>> > >>> most
>> > >>> >> >> stable way
>> > >>> >> >> > >> is
>> > >>> >> >> > >>>>>> upgrade
>> > >>> >> >> > >>>>>>> first to 3.4.latest, then go to 3.5.latest.
>> > >>> Still, if
>> > >>> >> >> you don't
>> > >>> >> >> > >> see
>> > >>> >> >> > >>>>> that
>> > >>> >> >> > >>>>>>> you would hit this specific issue (e.g. no
>> > >>> "Invalid
>> > >>> >> >> server id" in
>> > >>> >> >> > >>> the
>> > >>> >> >> > >>>>> log
>> > >>> >> >> > >>>>>>> files), and all the three servers can handle
>> > >>> traffic,
>> > >>> >> >> then maybe
>> > >>> >> >> > >>> you
>> > >>> >> >> > >>>>>> don't
>> > >>> >> >> > >>>>>>> need to upgrade first to 3.4.latest, it is
>> your
>> > >>> >> >> decision.
>> > >>> >> >> > >>> Definitely
>> > >>> >> >> > >>>>> you
>> > >>> >> >> > >>>>>>> should test it first, as suggested by the
>> > others.
>> > >>> >> >> > >>>>>>>
>> > >>> >> >> > >>>>>>> Kind regards,
>> > >>> >> >> > >>>>>>> Mate
>> > >>> >> >> > >>>>>>>
>> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert
>> Kalmar
>> > >>> >> >> > >>>>>>> <nk...@cloudera.com.invalid> wrote:
>> > >>> >> >> > >>>>>>>
>> > >>> >> >> > >>>>>>>> Hi,
>> > >>> >> >> > >>>>>>>>
>> > >>> >> >> > >>>>>>>> That guide is to upgrade to 3.5.0, which
>> was
>> > an
>> > >>> >> alpha
>> > >>> >> >> version.
>> > >>> >> >> > >> A
>> > >>> >> >> > >>>> lot
>> > >>> >> >> > >>>>>> has
>> > >>> >> >> > >>>>>>>> changed for the first stable release of
>> 3.5.5
>> > >>> and
>> > >>> >> then
>> > >>> >> >> a few
>> > >>> >> >> > >>> more,
>> > >>> >> >> > >>>>> even
>> > >>> >> >> > >>>>>>>> rolling upgrade issues have been fixed for
>> > >>> 3.5.6.
>> > >>> >> >> > >>>>>>>> This is a more up-to-date guide:
>> > >>> >> >> > >>>>>>>>
>> > >>> >> >> > >>>
>> > >>> >> >>
>> > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
>> > >>> >> >> > >>>>>>>>
>> > >>> >> >> > >>>>>>>> If you have done your testing (with prod
>> > >>> snapshot!),
>> > >>> >> >> then you
>> > >>> >> >> > >> can
>> > >>> >> >> > >>>>> skip
>> > >>> >> >> > >>>>>>> 3.4
>> > >>> >> >> > >>>>>>>> latest upgrade, but keep in mind we do our
>> > >>> >> >> recommendations for
>> > >>> >> >> > >> a
>> > >>> >> >> > >>>>>> reason.
>> > >>> >> >> > >>>>>>>> There were issues reported and/or found
>> during
>> > >>> >> >> testing. Some
>> > >>> >> >> > >> are
>> > >>> >> >> > >>>>> fixed
>> > >>> >> >> > >>>>>>> with
>> > >>> >> >> > >>>>>>>> 3.5.6, some only happens if certain
>> conditions
>> > >>> stand
>> > >>> >> >> > >>> (IOException:
>> > >>> >> >> > >>>> No
>> > >>> >> >> > >>>>>>>> snapshot found - mentioned in the guide,
>> fixed
>> > >>> in
>> > >>> >> >> 3.5.6).
>> > >>> >> >> > >>>>>>>>
>> > >>> >> >> > >>>>>>>> So it is up to you, I would still
>> recommend to
>> > >>> do an
>> > >>> >> >> 3.4
>> > >>> >> >> > >> upgrade
>> > >>> >> >> > >>>>> first,
>> > >>> >> >> > >>>>>>> if
>> > >>> >> >> > >>>>>>>> it's feasible.
>> > >>> >> >> > >>>>>>>>
>> > >>> >> >> > >>>>>>>> Regards,
>> > >>> >> >> > >>>>>>>> Norbert
>> > >>> >> >> > >>>>>>>>
>> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep
>> > singh <
>> > >>> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
>> > >>> >> >> > >>>>>>>> wrote:
>> > >>> >> >> > >>>>>>>>
>> > >>> >> >> > >>>>>>>>> Hi,
>> > >>> >> >> > >>>>>>>>>
>> > >>> >> >> > >>>>>>>>> Current Zookeeper version :- 3.4.5
>> > >>> >> >> > >>>>>>>>> Upgraded version :- 3.5.6
>> > >>> >> >> > >>>>>>>>>
>> > >>> >> >> > >>>>>>>>> We are not going with 3.5.7. Our final
>> > >>> decision is
>> > >>> >> >> zookeeper
>> > >>> >> >> > >>>>> version
>> > >>> >> >> > >>>>>> is
>> > >>> >> >> > >>>>>>>>> 3.5.6
>> > >>> >> >> > >>>>>>>>> as per your reply first we need to move
>> > latest
>> > >>> >> >> version of
>> > >>> >> >> > >>> 3.4.x,
>> > >>> >> >> > >>>>> like
>> > >>> >> >> > >>>>>>>> below
>> > >>> >> >> > >>>>>>>>>
>> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I
>> am
>> > >>> wrong
>> > >>> >> >> here)
>> > >>> >> >> > >>>>>>>>>
>> > >>> >> >> > >>>>>>>>> But if We are not facing any problem that
>> i
>> > >>> have
>> > >>> >> >> shared you
>> > >>> >> >> > >>> that
>> > >>> >> >> > >>>> we
>> > >>> >> >> > >>>>>>> have
>> > >>> >> >> > >>>>>>>>> set up of 3 node cluster where 2 node are
>> on
>> > >>> 3.5.6
>> > >>> >> >> version
>> > >>> >> >> > >> and
>> > >>> >> >> > >>> 1
>> > >>> >> >> > >>>>> node
>> > >>> >> >> > >>>>>>> on
>> > >>> >> >> > >>>>>>>>> 3.4.5, Everything is running fine and
>> didn't
>> > >>> get
>> > >>> >> any
>> > >>> >> >> issue,
>> > >>> >> >> > >> So
>> > >>> >> >> > >>>> what
>> > >>> >> >> > >>>>>>> other
>> > >>> >> >> > >>>>>>>>> problem we can face if we directly move to
>> > >>> 3.5.6
>> > >>> >> >> > >>>>>>>>>
>> > >>> >> >> > >>>>>>>>> Thanks,
>> > >>> >> >> > >>>>>>>>> ---------------------
>> > >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
>> > >>> >> >> > >>>>>>>>> Software Architect
>> > >>> >> >> > >>>>>>>>>
>> > >>> >> >> > >>>>>>>>>
>> > >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico
>> > >>> Olivelli <
>> > >>> >> >> > >>>>> eolivelli@gmail.com
>> > >>> >> >> > >>>>>>>
>> > >>> >> >> > >>>>>>>>> wrote:
>> > >>> >> >> > >>>>>>>>>
>> > >>> >> >> > >>>>>>>>>> Hi
>> > >>> >> >> > >>>>>>>>>> You have to upgrade to latest 3.4.x
>> > Zookeeper
>> > >>> then
>> > >>> >> >> you will
>> > >>> >> >> > >>>>> upgrade
>> > >>> >> >> > >>>>>>> to
>> > >>> >> >> > >>>>>>>>>> 3.5.7.
>> > >>> >> >> > >>>>>>>>>> All should run well without issues
>> > >>> >> >> > >>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>> Enrico
>> > >>> >> >> > >>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
>> > >>> >> >> > >>>>> kuldeep.singh08@gmail.com
>> > >>> >> >> > >>>>>>>
>> > >>> >> >> > >>>>>>> ha
>> > >>> >> >> > >>>>>>>>>> scritto:
>> > >>> >> >> > >>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>>> Hi Team,
>> > >>> >> >> > >>>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to
>> > >>> 3.5.6. I
>> > >>> >> >> have
>> > >>> >> >> > >> set
>> > >>> >> >> > >>>> up 3
>> > >>> >> >> > >>>>>>> node
>> > >>> >> >> > >>>>>>>>>>> cluster where 2 node are on 3.5.6
>> version
>> > >>> and 1
>> > >>> >> >> node on
>> > >>> >> >> > >>>> 3.4.5.
>> > >>> >> >> > >>>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>>> Everything is running fine and didn't
>> get
>> > any
>> > >>> >> issue
>> > >>> >> >> on my
>> > >>> >> >> > >>>>> system.
>> > >>> >> >> > >>>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>>> but I found something on apache site
>> that
>> > >>> first
>> > >>> >> we
>> > >>> >> >> need
>> > >>> >> >> > >> to
>> > >>> >> >> > >>>>>> upgrade
>> > >>> >> >> > >>>>>>>> on
>> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So
>> is
>> > it
>> > >>> >> >> mandatory
>> > >>> >> >> > >> to
>> > >>> >> >> > >>> go
>> > >>> >> >> > >>>>> on
>> > >>> >> >> > >>>>>>>> 3.4.6
>> > >>> >> >> > >>>>>>>>>>> first.
>> > >>> >> >> > >>>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
>> > >>> >> >> > >>>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>>> Upgrading a running ZooKeeper ensemble
>> to
>> > >>> 3.5.0
>> > >>> >> >> should be
>> > >>> >> >> > >>>> done
>> > >>> >> >> > >>>>>> only
>> > >>> >> >> > >>>>>>>>> after
>> > >>> >> >> > >>>>>>>>>>> upgrading your ensemble to the 3.4.6
>> > release.
>> > >>> >> Note
>> > >>> >> >> that
>> > >>> >> >> > >>> this
>> > >>> >> >> > >>>> is
>> > >>> >> >> > >>>>>>> only
>> > >>> >> >> > >>>>>>>>>>> necessary for rolling upgrades (if
>> you're
>> > >>> fine
>> > >>> >> with
>> > >>> >> >> > >>> shutting
>> > >>> >> >> > >>>>> down
>> > >>> >> >> > >>>>>>> the
>> > >>> >> >> > >>>>>>>>>>> system completely, you don't have to go
>> > >>> through
>> > >>> >> >> 3.4.6).
>> > >>> >> >> > >> If
>> > >>> >> >> > >>>> you
>> > >>> >> >> > >>>>>>>> attempt
>> > >>> >> >> > >>>>>>>>> a
>> > >>> >> >> > >>>>>>>>>>> rolling upgrade without going through
>> 3.4.6
>> > >>> (for
>> > >>> >> >> example
>> > >>> >> >> > >>> from
>> > >>> >> >> > >>>>>>> 3.4.5),
>> > >>> >> >> > >>>>>>>>> you
>> > >>> >> >> > >>>>>>>>>>> may get the following error:
>> > >>> >> >> > >>>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO
>> > >>> >> [localhost/
>> > >>> >> >> > >>>>>> 127.0.0.1:2784
>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager$Listener@498] -
>> Received
>> > >>> >> >> connection
>> > >>> >> >> > >>>> request
>> > >>> >> >> > >>>>> /
>> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
>> > >>> >> >> > >>>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
>> > >>> >> [localhost/
>> > >>> >> >> > >>>>>> 127.0.0.1:2784
>> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server
>> > id:
>> > >>> >> -65536
>> > >>> >> >> > >>>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>>> During a rolling upgrade, each server is
>> > >>> taken
>> > >>> >> down
>> > >>> >> >> in
>> > >>> >> >> > >> turn
>> > >>> >> >> > >>>> and
>> > >>> >> >> > >>>>>>>>> rebooted
>> > >>> >> >> > >>>>>>>>>>> with the new 3.5.0 binaries. Before
>> > starting
>> > >>> the
>> > >>> >> >> server
>> > >>> >> >> > >>> with
>> > >>> >> >> > >>>>>> 3.5.0
>> > >>> >> >> > >>>>>>>>>>> binaries, we highly recommend updating
>> the
>> > >>> >> >> configuration
>> > >>> >> >> > >>> file
>> > >>> >> >> > >>>>> so
>> > >>> >> >> > >>>>>>> that
>> > >>> >> >> > >>>>>>>>> all
>> > >>> >> >> > >>>>>>>>>>> server statements "server.x=..." contain
>> > >>> client
>> > >>> >> >> ports
>> > >>> >> >> > >> (see
>> > >>> >> >> > >>>> the
>> > >>> >> >> > >>>>>>>> section
>> > >>> >> >> > >>>>>>>>>>> Specifying
>> > >>> >> >> > >>>>>>>>>>> the client port). As explained earlier
>> you
>> > >>> may
>> > >>> >> >> leave the
>> > >>> >> >> > >>>>>>>> configuration
>> > >>> >> >> > >>>>>>>>>> in a
>> > >>> >> >> > >>>>>>>>>>> single file, as well as leave the
>> > >>> >> >> > >>>> clientPort/clientPortAddress
>> > >>> >> >> > >>>>>>>>> statements
>> > >>> >> >> > >>>>>>>>>>> (although if you specify client ports in
>> > the
>> > >>> new
>> > >>> >> >> format,
>> > >>> >> >> > >>>> these
>> > >>> >> >> > >>>>>>>>> statements
>> > >>> >> >> > >>>>>>>>>>> are now redundant).
>> > >>> >> >> > >>>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>>> Could you please let me know about this
>> > case.
>> > >>> >> >> Appreciate
>> > >>> >> >> > >> if
>> > >>> >> >> > >>>>>> respond
>> > >>> >> >> > >>>>>>>>> soon.
>> > >>> >> >> > >>>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>>> Thanks,
>> > >>> >> >> > >>>>>>>>>>> ---------------------
>> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
>> > >>> >> >> > >>>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>>
>> > >>> >> >> > >>>>>>>>>
>> > >>> >> >> > >>>>>>>>
>> > >>> >> >> > >>>>>>>
>> > >>> >> >> > >>>>>>
>> > >>> >> >> > >>>>>
>> > >>> >> >> > >>>>
>> > >>> >> >> > >>>
>> > >>> >> >> > >>
>> > >>> >> >> >
>> > >>> >> >> >
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >> >> ________________________________
>> > >>> >> >>
>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>> > >>> >> >> This e-mail (including any attachments) is strictly
>> > >>> confidential
>> > >>> >> and
>> > >>> >> >> may also contain privileged information. If you are not the
>> > >>> intended
>> > >>> >> >> recipient you are not authorised to read, print, save,
>> process or
>> > >>> >> disclose
>> > >>> >> >> this message. If you have received this message by mistake,
>> > please
>> > >>> >> inform
>> > >>> >> >> the sender immediately and destroy this e-mail, its
>> attachments
>> > >>> and any
>> > >>> >> >> copies. Any use, distribution, reproduction or disclosure by
>> any
>> > >>> person
>> > >>> >> >> other than the intended recipient is strictly prohibited and
>> the
>> > >>> person
>> > >>> >> >> responsible may incur in penalties.
>> > >>> >> >> The use of this e-mail is only for professional purposes;
>> > >>> there is
>> > >>> >> no
>> > >>> >> >> guarantee that the correspondence towards this e-mail will be
>> > read
>> > >>> >> only by
>> > >>> >> >> the recipient, because, under certain circumstances, there may
>> > be a
>> > >>> >> need to
>> > >>> >> >> access this email by third subjects belonging to the Company.
>> > >>> >> >>
>> > >>> >> >>
>> > >>> >> >> ________________________________
>> > >>> >> >>
>> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>> > >>> >> >> This e-mail (including any attachments) is strictly
>> confidential
>> > >>> and
>> > >>> >> may
>> > >>> >> >> also contain privileged information. If you are not the
>> intended
>> > >>> >> recipient
>> > >>> >> >> you are not authorised to read, print, save, process or
>> disclose
>> > >>> this
>> > >>> >> >> message. If you have received this message by mistake, please
>> > >>> inform
>> > >>> >> the
>> > >>> >> >> sender immediately and destroy this e-mail, its attachments
>> and
>> > any
>> > >>> >> copies.
>> > >>> >> >> Any use, distribution, reproduction or disclosure by any
>> person
>> > >>> other
>> > >>> >> than
>> > >>> >> >> the intended recipient is strictly prohibited and the person
>> > >>> >> responsible
>> > >>> >> >> may incur in penalties.
>> > >>> >> >> The use of this e-mail is only for professional purposes;
>> there
>> > is
>> > >>> no
>> > >>> >> >> guarantee that the correspondence towards this e-mail will be
>> > read
>> > >>> >> only by
>> > >>> >> >> the recipient, because, under certain circumstances, there may
>> > be a
>> > >>> >> need to
>> > >>> >> >> access this email by third subjects belonging to the Company.
>> > >>> >> >>
>> > >>> >> >
>> > >>> >>
>> > >>> >
>> > >>>
>> > >>
>> >
>>
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Thanks for the reply.
Now my ZKCli cmd is working fine as we use some our customized
authentication and we resolve the issue.
Now I am going to implement Server to Server communication.
Thanks,
---------------------
Kuldeep Singh Budania
On Thu, Jul 2, 2020 at 3:53 PM Szalay-Bekő Máté <sz...@gmail.com>
wrote:
> I think SSL is working for you already... If you managed to start the
> zkCli.sh and be able to connect to ZooKeeper on the secure port and issue
> any kind of command (like: " ls / "), then the wire encryption is working
> and your server/client communication is secured by ZooKeeper.
>
> Why you want to run the following command?
> addauth ztpasswd zooadmin:<password>
>
> Do you also want to configure a superDigest user in ZooKeeper? Please note
> that this command is independent from SSL. If you need to create a
> username-password pair for digest authentication then please use the
> command in the following way:
> addauth digest zooadmin:yourSuperSecretPassword
>
> Kind regards,
> Mate
>
> On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <ku...@gmail.com>
> wrote:
>
> > 1. sh zkCli.sh --config /etc/zookeeper -server localhost:2281
> >
> > 2. addauth ztpasswd zooadmin:<password>
> >
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> >
> >
> >
> > On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <ku...@gmail.com>
> > wrote:
> >
> > > Hi Team,
> > >
> > > Any update on this?
> > >
> > > Thanks,
> > > ---------------------
> > > Kuldeep Singh Budania
> > >
> > >
> > >
> > > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <
> kuldeep.singh08@gmail.com>
> > > wrote:
> > >
> > >> Sorry this is my bad, there were server setting like below
> > >>
> > >> export SERVER_JVMFLAGS="
> > >>
> > >>
> > >>
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >>
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >>
> > >>
> > >>
> > >> export CLIENT_JVMFLAGS="
> > >>
> > >>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >> -Dzookeeper.client.secure=true
> > >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >> -Dzookeeper.ssl.keyStore.password=testpass
> > >>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >>
> > >> I want to have SSL between client to server communication
> > >>
> > >> I am already following the same link which you have shared with me but
> > >> that is not working.
> > >>
> > >> Zoo.cfg
> > >>
> > >> secureClientPort=2281
> > >> initLimit=10
> > >> syncLimit=5
> > >> dataDir=/var/lib/zookeeper/data
> > >> tickTime=2000
> > >> autopurge.snapRetainCount=3
> > >> autopurge.purgeInterval=1
> > >> admin.enableServer=false
> > >> standaloneEnabled=false
> > >> jute.maxbuffer=2147483648
> > >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >> server.1=host1_priv:10288:10388
> > >> server.2=host2_priv:10288:10388
> > >> server.3=host3_priv:10288:10388
> > >>
> > >>
> > >> command to connect using zkcli
> > >>
> > >> 1. zkcli zoo.cfg localhost:2281
> > >> 2. addauth ztpasswd usernaem:password
> > >>
> > >> after second step we are getting below error
> > >>
> > >> WatchedEvent state:AuthFailed type:None path:null
> > >>
> > >>
> > >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
> > provider
> > >> for scheme: ztpasswd has x509 ip digest*
> > >>
> > >> Thanks,
> > >> ---------------------
> > >> Kuldeep Singh Budania
> > >>
> > >>
> > >>
> > >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
> > >> szalay.beko.mate@gmail.com> wrote:
> > >>
> > >>> > No authentication provider for scheme: ztpasswd has x509 ip
> digest*
> > >>>
> > >>> This suggest you have some configuration error... Where did you use
> the
> > >>> "ztpasswd" string in your configs / commands?
> > >>>
> > >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
> > >>> szalay.beko.mate@gmail.com>
> > >>> wrote:
> > >>>
> > >>> > > My ZK server is up and running in secure mode
> > >>> >
> > >>> > What is your goal? You want to setup client-server SSL connection?
> > >>> >
> > >>> > see:
> > >>> >
> > >>>
> >
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
> > >>> >
> > >>> > (or you want to have both SSL and SASL enabled?)
> > >>> >
> > >>> > Anyway, please remove the following line from the SERVER_JVMFLAGS:
> > >>> >
> > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >>> > This is a configuration that makes sense only for the ZooKeeper
> > client,
> > >>> > not for the server. For the server, use the following:
> > >>> >
> > >>> >
> > >>>
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >>> >
> > >>> > If it doesn't solve the issue, then can you please send your
> zoo.cfg
> > >>> file?
> > >>> > Also can you please send the zkCli command you execute? (you need
> to
> > >>> > connect to the secure ZooKeeper port, unless portUnification is
> > >>> enabled)
> > >>> >
> > >>> > Kind regards,
> > >>> > Mate
> > >>> >
> > >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
> > >>> kuldeep.singh08@gmail.com>
> > >>> > wrote:
> > >>> >
> > >>> >> Hi,
> > >>> >>
> > >>> >> we have done below changes in java.env file
> > >>> >>
> > >>> >> export SERVER_JVMFLAGS="
> > >>> >>
> > >>> >>
> > >>>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >>> >>
> > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> > >>> >>
> > >>>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >>> >>
> > >>> >>
> > >>> >>
> > >>> >> export CLIENT_JVMFLAGS="
> > >>> >>
> > >>> >>
> > >>>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > >>> >> -Dzookeeper.client.secure=true
> > >>> >>
> > -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> > >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> > >>> >>
> > >>>
> >
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> > >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> > >>> >>
> > >>> >> I have started the ZK server and it is up without any issue.
> > >>> >>
> > >>> >> But now when I login to ZkCli then it gives the below error.
> > >>> >>
> > >>> >> WatchedEvent state:AuthFailed type:None path:null
> > >>> >>
> > >>> >>
> > >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
> > >>> provider
> > >>> >> for scheme: ztpasswd has x509 ip digest*
> > >>> >>
> > >>> >> Please help me on this issue
> > >>> >>
> > >>> >> Thanks,
> > >>> >> ---------------------
> > >>> >> Kuldeep Singh Budania
> > >>> >> Software Architect
> > >>> >>
> > >>> >>
> > >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
> > >>> kuldeep.singh08@gmail.com>
> > >>> >> wrote:
> > >>> >>
> > >>> >> > Hi,
> > >>> >> >
> > >>> >> > My ZK server is up and running in secure mode, But When I am
> > >>> trying to
> > >>> >> > connect to the ZK server using ZKCli, it gives the below error.
> > >>> >> >
> > >>> >> > WatchedEvent state:AuthFailed type:None path:null
> > >>> >> >
> > >>> >> >
> > >>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > >>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No
> authentication
> > >>> >> provider
> > >>> >> > for scheme: ztpasswd has x509 ip digest*
> > >>> >> >
> > >>> >> > Can someone please help me on this issue. we are using the 3.5.6
> > >>> >> version.
> > >>> >> >
> > >>> >> > I appreciate if I will get a response as soon as possible, as I
> am
> > >>> stuck
> > >>> >> > at this point.
> > >>> >> >
> > >>> >> > Thanks,
> > >>> >> > ---------------------
> > >>> >> > Kuldeep Singh Budania
> > >>> >> > Software Architect
> > >>> >> >
> > >>> >> >
> > >>> >> >
> > >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli - Diennea
> > >>> >> > <en...@diennea.com.invalid> wrote:
> > >>> >> >
> > >>> >> >> I mean in zoo.cfg
> > >>> >> >> Not as a system property
> > >>> >> >>
> > >>> >> >> Enrico
> > >>> >> >>
> > >>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <
> > >>> >> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
> > >>> >> >>
> > >>> >> >> Hi
> > >>> >> >> You have to enable Netty on the server side
> > >>> >> >>
> > >>> >> >> Something like:
> > >>> >> >>
> > >>> >>
> > serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >>> >> >>
> > >>> >> >> Hope that helps
> > >>> >> >> Enrico
> > >>> >> >>
> > >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
> > >>> >> kuldeep.singh08@gmail.com>
> > >>> >> >> ha scritto:
> > >>> >> >>
> > >>> >> >> Hi,
> > >>> >> >>
> > >>> >> >> I got below error while setting SSL properties in
> > zkEnv.sh
> > >>> >> >>
> > >>> >> >>
> > >>> >> >>
> > >>> >> >>
> > >>> >> >>
> > >>> >>
> > >>>
> >
> ==========================================================================================
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,864 - INFO
> > [main:QuorumPeerConfig@133]
> > >>> -
> > >>> >> >> Reading
> > >>> >> >> configuration from: /etc/zookeeper/zoo.cfg
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> > [main:QuorumPeerConfig@385]
> > >>> -
> > >>> >> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,874 - INFO
> > [main:QuorumPeerConfig@399]
> > >>> -
> > >>> >> >> secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] -
> > >>> Setting
> > >>> >> -D
> > >>> >> >> jdk.tls.rejectClientInitiatedRenegotiation=true to
> > disable
> > >>> >> >> client-initiated
> > >>> >> >> TLS renegotiation
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> > >>> [main:DatadirCleanupManager@78]
> > >>> >> -
> > >>> >> >> autopurge.snapRetainCount set to 3
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,897 - INFO
> > >>> [main:DatadirCleanupManager@79]
> > >>> >> -
> > >>> >> >> autopurge.purgeInterval set to 1
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,898 - INFO [
> > >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge
> > >>> task
> > >>> >> >> started.
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46]
> -
> > >>> Log4j
> > >>> >> >> found with
> > >>> >> >> jmx enabled.
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,903 - INFO
> > >>> [PurgeTask:FileTxnSnapLog@103]
> > >>> >> -
> > >>> >> >> zookeeper.snapshot.trust.empty : false
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,910 - INFO [
> > >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge
> > >>> task
> > >>> >> >> completed.
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,975 - INFO
> [main:QuorumPeerMain@141
> > ]
> > >>> -
> > >>> >> >> Starting quorum
> > >>> >> >> peer
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,983 - INFO
> > [main:ServerCnxnFactory@135]
> > >>> -
> > >>> >> >> Using
> > >>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as
> > server
> > >>> >> >> connection
> > >>> >> >> factory
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,986 - INFO
> > >>> [main:NIOServerCnxnFactory@673]
> > >>> >> -
> > >>> >> >> Configuring NIO connection handler with 10s sessionless
> > >>> >> >> connection timeout,
> > >>> >> >> 2 selector thread(s), 16 worker threads, and 64 kB
> direct
> > >>> >> buffers.
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,992 - INFO
> > >>> [main:NIOServerCnxnFactory@686
> > >>> >> ]
> > >>> >> >> - binding
> > >>> >> >> to port 0.0.0.0/0.0.0.0:10181
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,994 - INFO
> > [main:ServerCnxnFactory@135]
> > >>> -
> > >>> >> >> Using
> > >>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as
> > server
> > >>> >> >> connection
> > >>> >> >> factory
> > >>> >> >>
> > >>> >> >> 2020-06-24 15:49:35,995 - ERROR
> [main:QuorumPeerMain@101
> > ]
> > >>> -
> > >>> >> >> Unexpected
> > >>> >> >> exception, exiting abnormally
> > >>> >> >>
> > >>> >> >> java.lang.UnsupportedOperationException: SSL isn't
> > >>> supported in
> > >>> >> >> NIOServerCnxn
> > >>> >> >>
> > >>> >> >> at
> > >>> >> >>
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> > >>> >> >>
> > >>> >> >> at
> > >>> >> >>
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> > >>> >> >>
> > >>> >> >> at
> > >>> >> >>
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> > >>> >> >>
> > >>> >> >> at
> > >>> >> >>
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> > >>> >> >>
> > >>> >> >>
> > >>> >> >>
> > >>> >> >>
> > >>> >> >>
> > >>> >> >> I have set the following properties in SERVER_JVMFLAGS
> in
> > >>> >> >> zkEnv.sh file :
> > >>> >> >>
> > >>> >> >>
> > >>> >>
> > >>>
> >
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> > >>> >> >>
> > >>> >> >>
> > >>> >>
> > >>>
> >
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> > >>> >> >> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> > >>> >> >>
> > >>> >> >>
> > >>> >>
> > >>>
> >
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> > >>> >> >> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> > >>> >> >>
> > >>> >> >> Thanks,
> > >>> >> >> ---------------------
> > >>> >> >> Kuldeep Singh Budania
> > >>> >> >>
> > >>> >> >>
> > >>> >> >>
> > >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <
> > >>> >> >> jordan@jordanzimmerman.com>
> > >>> >> >> wrote:
> > >>> >> >>
> > >>> >> >> > It's the same as the normal ZooKeeper client:
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > >>> >> >> > <
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > >>> >> >> > >
> > >>> >> >> >
> > >>> >> >> > -Jordan
> > >>> >> >> >
> > >>> >> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep singh <
> > >>> >> >> kuldeep.singh08@gmail.com>
> > >>> >> >> > wrote:
> > >>> >> >> > >
> > >>> >> >> > > Hi Team,
> > >>> >> >> > > How we will do secure communication between the
> > Curator
> > >>> >> >> framework and
> > >>> >> >> > > zookeeper 3.5.6 ?
> > >>> >> >> > > I didn't get any solution right now.
> > >>> >> >> > > I appreciate it if someone could help me with the
> > same.
> > >>> >> >> > >
> > >>> >> >> > > Thanks,
> > >>> >> >> > > ---------------------
> > >>> >> >> > > Kuldeep Singh Budania
> > >>> >> >> > > Software Architect
> > >>> >> >> > >
> > >>> >> >> > >
> > >>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
> > >>> >> >> > szalay.beko.mate@gmail.com>
> > >>> >> >> > > wrote:
> > >>> >> >> > >
> > >>> >> >> > >> Hello Kuldeep,
> > >>> >> >> > >>
> > >>> >> >> > >> did you download the source from the ZooKeeper
> > >>> webpage, or
> > >>> >> >> checked out
> > >>> >> >> > from
> > >>> >> >> > >> git?
> > >>> >> >> > >> Anyway, the following commands should work:
> > >>> >> >> > >>
> > >>> >> >> > >> wget
> > >>> >> >> > >>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> > >>> >> >> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
> > >>> >> >> > >> cd apache-zookeeper-3.5.7
> > >>> >> >> > >> mvn clean install -DskipTests
> > >>> >> >> > >>
> > >>> >> >> > >> I tested it with OpenJDK 8u424 and maven 3.6.0.
> > >>> >> >> > >>
> > >>> >> >> > >> Kind regards,
> > >>> >> >> > >> Mate
> > >>> >> >> > >>
> > >>> >> >> > >>
> > >>> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
> > >>> >> >> > kuldeep.singh08@gmail.com>
> > >>> >> >> > >> wrote:
> > >>> >> >> > >>
> > >>> >> >> > >>> Hi All,
> > >>> >> >> > >>>
> > >>> >> >> > >>> I have download the zookeeper source code and run
> > >>> the mvn
> > >>> >> >> command for
> > >>> >> >> > >>> packaging but get problem on "zookeeper-server"
> > >>> >> directory.
> > >>> >> >> > >>>
> > >>> >> >> > >>> *command :- mvn clean package*
> > >>> >> >> > >>>
> > >>> >> >> > >>> [ERROR] Failed to execute goal
> > >>> >> >> > >>>
> > >>> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > >>> >> >> > >>> (default-compile) on project zookeeper: Fatal
> error
> > >>> >> >> compiling:
> > >>> >> >> > >>> java.lang.NullPointerException -> [Help 1]
> > >>> >> >> > >>>
> > >>> org.apache.maven.lifecycle.LifecycleExecutionException:
> > >>> >> >> Failed to
> > >>> >> >> > execute
> > >>> >> >> > >>> goal
> > >>> >> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > >>> >> >> > >>> (default-compile) on project zookeeper: Fatal
> error
> > >>> >> >> compiling
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> > >>> >> >> > >>> at
> > >>> >> >> >
> > >>> >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> > >>> >> >> > >>> at
> > >>> >> >> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> > >>> >> >> > >>> at
> > >>> >> >> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> > >>> >> >> > >>> at
> > >>> >> >> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> > >>> >> >> > >>> at
> > >>> >> >> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> > >>> >> >> > >>> at
> > >>> >> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > >>> >> >> > >>> at
> > >>> >> java.lang.reflect.Method.invoke(Method.java:498)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> > >>> >> >> > >>> Caused by:
> > >>> >> org.apache.maven.plugin.MojoExecutionException:
> > >>> >> >> Fatal error
> > >>> >> >> > >>> compiling
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> > >>> >> >> > >>> ... 19 more
> > >>> >> >> > >>> Caused by:
> > >>> >> org.codehaus.plexus.compiler.CompilerException:
> > >>> >> >> > >>> java.lang.NullPointerException
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> > >>> >> >> > >>> ... 22 more
> > >>> >> >> > >>> Caused by: java.lang.RuntimeException:
> > >>> >> >> java.lang.NullPointerException
> > >>> >> >> > >>> at
> > >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:559)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > >>> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> > >>> >> >> > >>> ... 24 more
> > >>> >> >> > >>> Caused by: java.lang.NullPointerException
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> > >>> >> >> > >>> at
> > >>> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> > >>> >> >> > >>> at
> > >>> >> >> com.sun.tools.doclint.Checker.scan(Checker.java:144)
> > >>> >> >> > >>> at
> > >>> >> >> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> > com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > >>>
> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >>> >> >> > >>> at
> > >>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > >>> >> >> > >>> at
> > >>> >> >> > >>
> > >>> >> >>
> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> >> >> > >>> at
> > >>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> > com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> >> >> > >>> at
> > >>> >> >> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > >>>
> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > >>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> > >>> >> >> > >>> at
> > >>> >> >> > >>>
> > >>> >> >>
> > >>> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> > >>> >> >> > >>> at
> > >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:523)
> > >>> >> >> > >>> ... 27 more
> > >>> >> >> > >>> [ERROR]
> > >>> >> >> > >>> [ERROR] Re-run Maven using the -X switch to
> enable
> > >>> full
> > >>> >> >> debug logging.
> > >>> >> >> > >>> [ERROR]
> > >>> >> >> > >>> [ERROR] For more information about the errors and
> > >>> >> possible
> > >>> >> >> solutions,
> > >>> >> >> > >>> please read the following articles:
> > >>> >> >> > >>> [ERROR] [Help 1]
> > >>> >> >> > >>>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > >>> >> >> > >>>
> > >>> >> >> > >>> Can someone help me on this issue?
> > >>> >> >> > >>>
> > >>> >> >> > >>> Thanks,
> > >>> >> >> > >>> ---------------------
> > >>> >> >> > >>> Kuldeep Singh Budania
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>>
> > >>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
> > >>> >> >> > >>> szalay.beko.mate@gmail.com>
> > >>> >> >> > >>> wrote:
> > >>> >> >> > >>>
> > >>> >> >> > >>>> these exceptions can mean many things... I think
> > >>> this
> > >>> >> can
> > >>> >> >> be even
> > >>> >> >> > >> normal
> > >>> >> >> > >>>> duding rolling restart (as some connections get
> > >>> broken
> > >>> >> in
> > >>> >> >> this case)
> > >>> >> >> > >>>>
> > >>> >> >> > >>>> However, I saw cases already when exceptions
> like
> > >>> these
> > >>> >> >> killed
> > >>> >> >> > receiver
> > >>> >> >> > >>> or
> > >>> >> >> > >>>> sender threads in QuorumCnxManager / Leader
> > >>> Election in
> > >>> >> >> such a way
> > >>> >> >> > that
> > >>> >> >> > >>>> they were not able to recover, so the node was
> > >>> unable to
> > >>> >> >> connect to
> > >>> >> >> > any
> > >>> >> >> > >>>> quorum until restart. I remember seeing this in
> > 3.4
> > >>> too.
> > >>> >> >> > >>>>
> > >>> >> >> > >>>> Do you see these exceptions in the second server
> > >>> (the
> > >>> >> one
> > >>> >> >> which you
> > >>> >> >> > >> just
> > >>> >> >> > >>>> upgraded in step 3)?
> > >>> >> >> > >>>> Is this issue reproducible?
> > >>> >> >> > >>>>
> > >>> >> >> > >>>> What is the tickTime and initLimit you use?
> Maybe
> > >>> the
> > >>> >> >> server just
> > >>> >> >> > >> require
> > >>> >> >> > >>>> more time to sync?
> > >>> >> >> > >>>>
> > >>> >> >> > >>>> I would need more logs to really see what
> > happened.
> > >>> Can
> > >>> >> >> you create a
> > >>> >> >> > >> Jira
> > >>> >> >> > >>>> issue and upload the logs and also the ZooKeeper
> > >>> >> configs?
> > >>> >> >> I am happy
> > >>> >> >> > to
> > >>> >> >> > >>>> take a closer look.
> > >>> >> >> > >>>> (if you need to re-run the test to collect the
> > logs,
> > >>> >> then
> > >>> >> >> enabling
> > >>> >> >> > >> DEBUG
> > >>> >> >> > >>>> logs would be great. The INFO level logs are
> > usually
> > >>> >> >> enough for these
> > >>> >> >> > >>>> problems, but one can never know...)
> > >>> >> >> > >>>>
> > >>> >> >> > >>>> Kind regards,
> > >>> >> >> > >>>> Mate
> > >>> >> >> > >>>>
> > >>> >> >> > >>>>
> > >>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
> > >>> >> >> > >> kuldeep.singh08@gmail.com
> > >>> >> >> > >>>>
> > >>> >> >> > >>>> wrote:
> > >>> >> >> > >>>>
> > >>> >> >> > >>>>> Hi Team,
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> I have done some POC on rolling upgrade and
> found
> > >>> below
> > >>> >> >> result.
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> 1. On 1st node upgrade zookeeper . Traffic
> was
> > >>> >> running
> > >>> >> >> fine
> > >>> >> >> > >> because
> > >>> >> >> > >>> 2
> > >>> >> >> > >>>>> nodes are already on old zookeeper.
> > >>> >> >> > >>>>> 2. On 1st node upgrade our application and
> > didn’t
> > >>> >> find
> > >>> >> >> any issue
> > >>> >> >> > >>>>> 3. On 2nd node upgrade zookeeper but got
> below
> > >>> error
> > >>> >> >> and zookeeper
> > >>> >> >> > >>> is
> > >>> >> >> > >>>>> not taking any requests
> > >>> >> >> > >>>>> 4.
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> java.io.EOFException
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> at
> > >>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> at
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
> > >>> >> >> > >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765]
> -
> > >>> >> >> Interrupting
> > >>> >> >> > >>> SendWorker
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR
> [LearnerHandler-/
> > >>> >> >> 192.168.44.73:33754
> > >>> >> >> > >>>>> :LearnerHandler@562] - Unexpected exception
> > >>> causing
> > >>> >> >> shutdown while
> > >>> >> >> > >>> sock
> > >>> >> >> > >>>>> still open
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> java.io.EOFException
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> at
> > >>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> at
> > >>> >> >> > >>>>>
> > >>> >> >> > >>
> > >>> >> >>
> > >>>
> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> at
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> at
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> at
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >>
> > >>> >>
> > >>>
> >
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
> > >>> >> >> > >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679]
> -
> > >>> >> >> Interrupted while
> > >>> >> >> > >>>> waiting
> > >>> >> >> > >>>>> for message on queue
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> Please let me know is this the known issue or
> > this
> > >>> is
> > >>> >> >> different issue
> > >>> >> >> > >>>> which
> > >>> >> >> > >>>>> is mention in Apache zookeeper documentation
> when
> > >>> >> >> upgrading from
> > >>> >> >> > >> 3.4.5
> > >>> >> >> > >>> to
> > >>> >> >> > >>>>> 3.5.6
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> Thanks,
> > >>> >> >> > >>>>> ---------------------
> > >>> >> >> > >>>>> Kuldeep Singh Budania
> > >>> >> >> > >>>>> Software Architect
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander
> Shraer
> > <
> > >>> >> >> shralex@gmail.com>
> > >>> >> >> > >>>>> wrote:
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>>> +1 to what Mate said (I wrote the quoted
> > >>> >> instructions).
> > >>> >> >> > >>>>>>
> > >>> >> >> > >>>>>>
> > >>> >> >> > >>>>>>
> > >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő
> > Máté <
> > >>> >> >> > >>>>>> szalay.beko.mate@gmail.com>
> > >>> >> >> > >>>>>> wrote:
> > >>> >> >> > >>>>>>
> > >>> >> >> > >>>>>>> Hi Kuldeep,
> > >>> >> >> > >>>>>>>
> > >>> >> >> > >>>>>>> I just want to provide you some background
> info
> > >>> about
> > >>> >> >> our
> > >>> >> >> > >>>>> documentation.
> > >>> >> >> > >>>>>>> The reason to upgrade to 3.4.6 first is to
> > avoid
> > >>> the
> > >>> >> >> following
> > >>> >> >> > >>> error:
> > >>> >> >> > >>>>>>>
> > >>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
> > >>> [localhost/
> > >>> >> >> > >>> 127.0.0.1:2784
> > >>> >> >> > >>>>>>> :QuorumCnxManager@349] - Invalid server id:
> > >>> -65536
> > >>> >> >> > >>>>>>>
> > >>> >> >> > >>>>>>> This error comes because of the protocol
> > changes
> > >>> >> between
> > >>> >> >> > >> ZooKeeper
> > >>> >> >> > >>>>> server
> > >>> >> >> > >>>>>>> nodes during connection initiation for leader
> > >>> >> election.
> > >>> >> >> In
> > >>> >> >> > >>> ZooKeeper
> > >>> >> >> > >>>>> 3.5
> > >>> >> >> > >>>>>> a
> > >>> >> >> > >>>>>>> protocol version was introduced (see
> > >>> ZOOKEEPER-107)
> > >>> >> and
> > >>> >> >> since
> > >>> >> >> > >> that
> > >>> >> >> > >>>> time
> > >>> >> >> > >>>>>> the
> > >>> >> >> > >>>>>>> fist long value sent in the initial message
> is
> > >>> not
> > >>> >> the
> > >>> >> >> server ID
> > >>> >> >> > >>> but
> > >>> >> >> > >>>>> the
> > >>> >> >> > >>>>>>> protocol version (-65536). In ZooKeeper 3.4.6
> > we
> > >>> made
> > >>> >> >> the old 3.4
> > >>> >> >> > >>>>>>> ZooKeepers backward compatible, so they are
> > able
> > >>> to
> > >>> >> >> parse both
> > >>> >> >> > >> the
> > >>> >> >> > >>>> old
> > >>> >> >> > >>>>>> and
> > >>> >> >> > >>>>>>> the new protocol format (see ZOOKEEPER-1633).
> > >>> This
> > >>> >> >> issue happens
> > >>> >> >> > >>> only
> > >>> >> >> > >>>>>> when
> > >>> >> >> > >>>>>>> you need to use old (3.4.0 - 3.4.5) and new
> > >>> (3.5.0+)
> > >>> >> >> ZooKeeper
> > >>> >> >> > >>>> servers
> > >>> >> >> > >>>>>>> together in the same cluster. During a
> rolling
> > >>> >> upgrade,
> > >>> >> >> this is
> > >>> >> >> > >>>> usually
> > >>> >> >> > >>>>>> the
> > >>> >> >> > >>>>>>> case to have old and new ZooKeepers present
> > >>> together.
> > >>> >> >> > >>>>>>>
> > >>> >> >> > >>>>>>> The fact that you haven't seen any issues
> might
> > >>> be
> > >>> >> >> caused by the
> > >>> >> >> > >>>> order
> > >>> >> >> > >>>>> of
> > >>> >> >> > >>>>>>> the servers. In ZooKeeper the connection
> > >>> initiation
> > >>> >> >> between the
> > >>> >> >> > >>>> servers
> > >>> >> >> > >>>>>>> during the leader election follows a specific
> > >>> rule.
> > >>> >> As
> > >>> >> >> far as I
> > >>> >> >> > >>>>> remember
> > >>> >> >> > >>>>>>> always the server with the larger ID 'wins
> the
> > >>> >> >> challenge', so it
> > >>> >> >> > >> is
> > >>> >> >> > >>>>>>> possible, that the old server didn't need to
> > >>> parse
> > >>> >> any
> > >>> >> >> initial
> > >>> >> >> > >>>> message
> > >>> >> >> > >>>>>> (if
> > >>> >> >> > >>>>>>> it had the largest ID) and this is why you
> > >>> haven't
> > >>> >> seen
> > >>> >> >> the
> > >>> >> >> > >> issue.
> > >>> >> >> > >>>> Also
> > >>> >> >> > >>>>>>> having 2 nodes up from the 3 nodes cluster
> > still
> > >>> >> makes
> > >>> >> >> the
> > >>> >> >> > >> cluster
> > >>> >> >> > >>>> work
> > >>> >> >> > >>>>>> (so
> > >>> >> >> > >>>>>>> you should also check if all the servers are
> > >>> part of
> > >>> >> >> the quorum).
> > >>> >> >> > >>>>>>>
> > >>> >> >> > >>>>>>> I agree with Enrico and Norbert, the safest
> and
> > >>> most
> > >>> >> >> stable way
> > >>> >> >> > >> is
> > >>> >> >> > >>>>>> upgrade
> > >>> >> >> > >>>>>>> first to 3.4.latest, then go to 3.5.latest.
> > >>> Still, if
> > >>> >> >> you don't
> > >>> >> >> > >> see
> > >>> >> >> > >>>>> that
> > >>> >> >> > >>>>>>> you would hit this specific issue (e.g. no
> > >>> "Invalid
> > >>> >> >> server id" in
> > >>> >> >> > >>> the
> > >>> >> >> > >>>>> log
> > >>> >> >> > >>>>>>> files), and all the three servers can handle
> > >>> traffic,
> > >>> >> >> then maybe
> > >>> >> >> > >>> you
> > >>> >> >> > >>>>>> don't
> > >>> >> >> > >>>>>>> need to upgrade first to 3.4.latest, it is
> your
> > >>> >> >> decision.
> > >>> >> >> > >>> Definitely
> > >>> >> >> > >>>>> you
> > >>> >> >> > >>>>>>> should test it first, as suggested by the
> > others.
> > >>> >> >> > >>>>>>>
> > >>> >> >> > >>>>>>> Kind regards,
> > >>> >> >> > >>>>>>> Mate
> > >>> >> >> > >>>>>>>
> > >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert
> Kalmar
> > >>> >> >> > >>>>>>> <nk...@cloudera.com.invalid> wrote:
> > >>> >> >> > >>>>>>>
> > >>> >> >> > >>>>>>>> Hi,
> > >>> >> >> > >>>>>>>>
> > >>> >> >> > >>>>>>>> That guide is to upgrade to 3.5.0, which was
> > an
> > >>> >> alpha
> > >>> >> >> version.
> > >>> >> >> > >> A
> > >>> >> >> > >>>> lot
> > >>> >> >> > >>>>>> has
> > >>> >> >> > >>>>>>>> changed for the first stable release of
> 3.5.5
> > >>> and
> > >>> >> then
> > >>> >> >> a few
> > >>> >> >> > >>> more,
> > >>> >> >> > >>>>> even
> > >>> >> >> > >>>>>>>> rolling upgrade issues have been fixed for
> > >>> 3.5.6.
> > >>> >> >> > >>>>>>>> This is a more up-to-date guide:
> > >>> >> >> > >>>>>>>>
> > >>> >> >> > >>>
> > >>> >> >>
> > https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> > >>> >> >> > >>>>>>>>
> > >>> >> >> > >>>>>>>> If you have done your testing (with prod
> > >>> snapshot!),
> > >>> >> >> then you
> > >>> >> >> > >> can
> > >>> >> >> > >>>>> skip
> > >>> >> >> > >>>>>>> 3.4
> > >>> >> >> > >>>>>>>> latest upgrade, but keep in mind we do our
> > >>> >> >> recommendations for
> > >>> >> >> > >> a
> > >>> >> >> > >>>>>> reason.
> > >>> >> >> > >>>>>>>> There were issues reported and/or found
> during
> > >>> >> >> testing. Some
> > >>> >> >> > >> are
> > >>> >> >> > >>>>> fixed
> > >>> >> >> > >>>>>>> with
> > >>> >> >> > >>>>>>>> 3.5.6, some only happens if certain
> conditions
> > >>> stand
> > >>> >> >> > >>> (IOException:
> > >>> >> >> > >>>> No
> > >>> >> >> > >>>>>>>> snapshot found - mentioned in the guide,
> fixed
> > >>> in
> > >>> >> >> 3.5.6).
> > >>> >> >> > >>>>>>>>
> > >>> >> >> > >>>>>>>> So it is up to you, I would still recommend
> to
> > >>> do an
> > >>> >> >> 3.4
> > >>> >> >> > >> upgrade
> > >>> >> >> > >>>>> first,
> > >>> >> >> > >>>>>>> if
> > >>> >> >> > >>>>>>>> it's feasible.
> > >>> >> >> > >>>>>>>>
> > >>> >> >> > >>>>>>>> Regards,
> > >>> >> >> > >>>>>>>> Norbert
> > >>> >> >> > >>>>>>>>
> > >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep
> > singh <
> > >>> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
> > >>> >> >> > >>>>>>>> wrote:
> > >>> >> >> > >>>>>>>>
> > >>> >> >> > >>>>>>>>> Hi,
> > >>> >> >> > >>>>>>>>>
> > >>> >> >> > >>>>>>>>> Current Zookeeper version :- 3.4.5
> > >>> >> >> > >>>>>>>>> Upgraded version :- 3.5.6
> > >>> >> >> > >>>>>>>>>
> > >>> >> >> > >>>>>>>>> We are not going with 3.5.7. Our final
> > >>> decision is
> > >>> >> >> zookeeper
> > >>> >> >> > >>>>> version
> > >>> >> >> > >>>>>> is
> > >>> >> >> > >>>>>>>>> 3.5.6
> > >>> >> >> > >>>>>>>>> as per your reply first we need to move
> > latest
> > >>> >> >> version of
> > >>> >> >> > >>> 3.4.x,
> > >>> >> >> > >>>>> like
> > >>> >> >> > >>>>>>>> below
> > >>> >> >> > >>>>>>>>>
> > >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I
> am
> > >>> wrong
> > >>> >> >> here)
> > >>> >> >> > >>>>>>>>>
> > >>> >> >> > >>>>>>>>> But if We are not facing any problem that i
> > >>> have
> > >>> >> >> shared you
> > >>> >> >> > >>> that
> > >>> >> >> > >>>> we
> > >>> >> >> > >>>>>>> have
> > >>> >> >> > >>>>>>>>> set up of 3 node cluster where 2 node are
> on
> > >>> 3.5.6
> > >>> >> >> version
> > >>> >> >> > >> and
> > >>> >> >> > >>> 1
> > >>> >> >> > >>>>> node
> > >>> >> >> > >>>>>>> on
> > >>> >> >> > >>>>>>>>> 3.4.5, Everything is running fine and
> didn't
> > >>> get
> > >>> >> any
> > >>> >> >> issue,
> > >>> >> >> > >> So
> > >>> >> >> > >>>> what
> > >>> >> >> > >>>>>>> other
> > >>> >> >> > >>>>>>>>> problem we can face if we directly move to
> > >>> 3.5.6
> > >>> >> >> > >>>>>>>>>
> > >>> >> >> > >>>>>>>>> Thanks,
> > >>> >> >> > >>>>>>>>> ---------------------
> > >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
> > >>> >> >> > >>>>>>>>> Software Architect
> > >>> >> >> > >>>>>>>>>
> > >>> >> >> > >>>>>>>>>
> > >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico
> > >>> Olivelli <
> > >>> >> >> > >>>>> eolivelli@gmail.com
> > >>> >> >> > >>>>>>>
> > >>> >> >> > >>>>>>>>> wrote:
> > >>> >> >> > >>>>>>>>>
> > >>> >> >> > >>>>>>>>>> Hi
> > >>> >> >> > >>>>>>>>>> You have to upgrade to latest 3.4.x
> > Zookeeper
> > >>> then
> > >>> >> >> you will
> > >>> >> >> > >>>>> upgrade
> > >>> >> >> > >>>>>>> to
> > >>> >> >> > >>>>>>>>>> 3.5.7.
> > >>> >> >> > >>>>>>>>>> All should run well without issues
> > >>> >> >> > >>>>>>>>>>
> > >>> >> >> > >>>>>>>>>>
> > >>> >> >> > >>>>>>>>>> Enrico
> > >>> >> >> > >>>>>>>>>>
> > >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
> > >>> >> >> > >>>>> kuldeep.singh08@gmail.com
> > >>> >> >> > >>>>>>>
> > >>> >> >> > >>>>>>> ha
> > >>> >> >> > >>>>>>>>>> scritto:
> > >>> >> >> > >>>>>>>>>>
> > >>> >> >> > >>>>>>>>>>> Hi Team,
> > >>> >> >> > >>>>>>>>>>>
> > >>> >> >> > >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to
> > >>> 3.5.6. I
> > >>> >> >> have
> > >>> >> >> > >> set
> > >>> >> >> > >>>> up 3
> > >>> >> >> > >>>>>>> node
> > >>> >> >> > >>>>>>>>>>> cluster where 2 node are on 3.5.6 version
> > >>> and 1
> > >>> >> >> node on
> > >>> >> >> > >>>> 3.4.5.
> > >>> >> >> > >>>>>>>>>>>
> > >>> >> >> > >>>>>>>>>>> Everything is running fine and didn't get
> > any
> > >>> >> issue
> > >>> >> >> on my
> > >>> >> >> > >>>>> system.
> > >>> >> >> > >>>>>>>>>>>
> > >>> >> >> > >>>>>>>>>>> but I found something on apache site
> that
> > >>> first
> > >>> >> we
> > >>> >> >> need
> > >>> >> >> > >> to
> > >>> >> >> > >>>>>> upgrade
> > >>> >> >> > >>>>>>>> on
> > >>> >> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is
> > it
> > >>> >> >> mandatory
> > >>> >> >> > >> to
> > >>> >> >> > >>> go
> > >>> >> >> > >>>>> on
> > >>> >> >> > >>>>>>>> 3.4.6
> > >>> >> >> > >>>>>>>>>>> first.
> > >>> >> >> > >>>>>>>>>>>
> > >>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
> > >>> >> >> > >>>>>>>>>>>
> > >>> >> >> > >>>>>>>>>>> Upgrading a running ZooKeeper ensemble to
> > >>> 3.5.0
> > >>> >> >> should be
> > >>> >> >> > >>>> done
> > >>> >> >> > >>>>>> only
> > >>> >> >> > >>>>>>>>> after
> > >>> >> >> > >>>>>>>>>>> upgrading your ensemble to the 3.4.6
> > release.
> > >>> >> Note
> > >>> >> >> that
> > >>> >> >> > >>> this
> > >>> >> >> > >>>> is
> > >>> >> >> > >>>>>>> only
> > >>> >> >> > >>>>>>>>>>> necessary for rolling upgrades (if you're
> > >>> fine
> > >>> >> with
> > >>> >> >> > >>> shutting
> > >>> >> >> > >>>>> down
> > >>> >> >> > >>>>>>> the
> > >>> >> >> > >>>>>>>>>>> system completely, you don't have to go
> > >>> through
> > >>> >> >> 3.4.6).
> > >>> >> >> > >> If
> > >>> >> >> > >>>> you
> > >>> >> >> > >>>>>>>> attempt
> > >>> >> >> > >>>>>>>>> a
> > >>> >> >> > >>>>>>>>>>> rolling upgrade without going through
> 3.4.6
> > >>> (for
> > >>> >> >> example
> > >>> >> >> > >>> from
> > >>> >> >> > >>>>>>> 3.4.5),
> > >>> >> >> > >>>>>>>>> you
> > >>> >> >> > >>>>>>>>>>> may get the following error:
> > >>> >> >> > >>>>>>>>>>>
> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO
> > >>> >> [localhost/
> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager$Listener@498] -
> Received
> > >>> >> >> connection
> > >>> >> >> > >>>> request
> > >>> >> >> > >>>>> /
> > >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
> > >>> >> >> > >>>>>>>>>>>
> > >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
> > >>> >> [localhost/
> > >>> >> >> > >>>>>> 127.0.0.1:2784
> > >>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server
> > id:
> > >>> >> -65536
> > >>> >> >> > >>>>>>>>>>>
> > >>> >> >> > >>>>>>>>>>> During a rolling upgrade, each server is
> > >>> taken
> > >>> >> down
> > >>> >> >> in
> > >>> >> >> > >> turn
> > >>> >> >> > >>>> and
> > >>> >> >> > >>>>>>>>> rebooted
> > >>> >> >> > >>>>>>>>>>> with the new 3.5.0 binaries. Before
> > starting
> > >>> the
> > >>> >> >> server
> > >>> >> >> > >>> with
> > >>> >> >> > >>>>>> 3.5.0
> > >>> >> >> > >>>>>>>>>>> binaries, we highly recommend updating
> the
> > >>> >> >> configuration
> > >>> >> >> > >>> file
> > >>> >> >> > >>>>> so
> > >>> >> >> > >>>>>>> that
> > >>> >> >> > >>>>>>>>> all
> > >>> >> >> > >>>>>>>>>>> server statements "server.x=..." contain
> > >>> client
> > >>> >> >> ports
> > >>> >> >> > >> (see
> > >>> >> >> > >>>> the
> > >>> >> >> > >>>>>>>> section
> > >>> >> >> > >>>>>>>>>>> Specifying
> > >>> >> >> > >>>>>>>>>>> the client port). As explained earlier
> you
> > >>> may
> > >>> >> >> leave the
> > >>> >> >> > >>>>>>>> configuration
> > >>> >> >> > >>>>>>>>>> in a
> > >>> >> >> > >>>>>>>>>>> single file, as well as leave the
> > >>> >> >> > >>>> clientPort/clientPortAddress
> > >>> >> >> > >>>>>>>>> statements
> > >>> >> >> > >>>>>>>>>>> (although if you specify client ports in
> > the
> > >>> new
> > >>> >> >> format,
> > >>> >> >> > >>>> these
> > >>> >> >> > >>>>>>>>> statements
> > >>> >> >> > >>>>>>>>>>> are now redundant).
> > >>> >> >> > >>>>>>>>>>>
> > >>> >> >> > >>>>>>>>>>> Could you please let me know about this
> > case.
> > >>> >> >> Appreciate
> > >>> >> >> > >> if
> > >>> >> >> > >>>>>> respond
> > >>> >> >> > >>>>>>>>> soon.
> > >>> >> >> > >>>>>>>>>>>
> > >>> >> >> > >>>>>>>>>>> Thanks,
> > >>> >> >> > >>>>>>>>>>> ---------------------
> > >>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
> > >>> >> >> > >>>>>>>>>>>
> > >>> >> >> > >>>>>>>>>>
> > >>> >> >> > >>>>>>>>>
> > >>> >> >> > >>>>>>>>
> > >>> >> >> > >>>>>>>
> > >>> >> >> > >>>>>>
> > >>> >> >> > >>>>>
> > >>> >> >> > >>>>
> > >>> >> >> > >>>
> > >>> >> >> > >>
> > >>> >> >> >
> > >>> >> >> >
> > >>> >> >>
> > >>> >> >>
> > >>> >> >> ________________________________
> > >>> >> >>
> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > >>> >> >> This e-mail (including any attachments) is strictly
> > >>> confidential
> > >>> >> and
> > >>> >> >> may also contain privileged information. If you are not the
> > >>> intended
> > >>> >> >> recipient you are not authorised to read, print, save, process
> or
> > >>> >> disclose
> > >>> >> >> this message. If you have received this message by mistake,
> > please
> > >>> >> inform
> > >>> >> >> the sender immediately and destroy this e-mail, its attachments
> > >>> and any
> > >>> >> >> copies. Any use, distribution, reproduction or disclosure by
> any
> > >>> person
> > >>> >> >> other than the intended recipient is strictly prohibited and
> the
> > >>> person
> > >>> >> >> responsible may incur in penalties.
> > >>> >> >> The use of this e-mail is only for professional purposes;
> > >>> there is
> > >>> >> no
> > >>> >> >> guarantee that the correspondence towards this e-mail will be
> > read
> > >>> >> only by
> > >>> >> >> the recipient, because, under certain circumstances, there may
> > be a
> > >>> >> need to
> > >>> >> >> access this email by third subjects belonging to the Company.
> > >>> >> >>
> > >>> >> >>
> > >>> >> >> ________________________________
> > >>> >> >>
> > >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> > >>> >> >> This e-mail (including any attachments) is strictly
> confidential
> > >>> and
> > >>> >> may
> > >>> >> >> also contain privileged information. If you are not the
> intended
> > >>> >> recipient
> > >>> >> >> you are not authorised to read, print, save, process or
> disclose
> > >>> this
> > >>> >> >> message. If you have received this message by mistake, please
> > >>> inform
> > >>> >> the
> > >>> >> >> sender immediately and destroy this e-mail, its attachments and
> > any
> > >>> >> copies.
> > >>> >> >> Any use, distribution, reproduction or disclosure by any person
> > >>> other
> > >>> >> than
> > >>> >> >> the intended recipient is strictly prohibited and the person
> > >>> >> responsible
> > >>> >> >> may incur in penalties.
> > >>> >> >> The use of this e-mail is only for professional purposes; there
> > is
> > >>> no
> > >>> >> >> guarantee that the correspondence towards this e-mail will be
> > read
> > >>> >> only by
> > >>> >> >> the recipient, because, under certain circumstances, there may
> > be a
> > >>> >> need to
> > >>> >> >> access this email by third subjects belonging to the Company.
> > >>> >> >>
> > >>> >> >
> > >>> >>
> > >>> >
> > >>>
> > >>
> >
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by Szalay-Bekő Máté <sz...@gmail.com>.
I think SSL is working for you already... If you managed to start the
zkCli.sh and be able to connect to ZooKeeper on the secure port and issue
any kind of command (like: " ls / "), then the wire encryption is working
and your server/client communication is secured by ZooKeeper.
Why you want to run the following command?
addauth ztpasswd zooadmin:<password>
Do you also want to configure a superDigest user in ZooKeeper? Please note
that this command is independent from SSL. If you need to create a
username-password pair for digest authentication then please use the
command in the following way:
addauth digest zooadmin:yourSuperSecretPassword
Kind regards,
Mate
On Thu, Jul 2, 2020 at 6:59 AM kuldeep singh <ku...@gmail.com>
wrote:
> 1. sh zkCli.sh --config /etc/zookeeper -server localhost:2281
>
> 2. addauth ztpasswd zooadmin:<password>
>
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <ku...@gmail.com>
> wrote:
>
> > Hi Team,
> >
> > Any update on this?
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> >
> >
> >
> > On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <ku...@gmail.com>
> > wrote:
> >
> >> Sorry this is my bad, there were server setting like below
> >>
> >> export SERVER_JVMFLAGS="
> >>
> >>
> >>
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >>
> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >> -Dzookeeper.ssl.keyStore.password=testpass
> >>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >> -Dzookeeper.ssl.trustStore.password=testpass"
> >>
> >>
> >>
> >> export CLIENT_JVMFLAGS="
> >>
> >> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >> -Dzookeeper.client.secure=true
> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >> -Dzookeeper.ssl.keyStore.password=testpass
> >>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >> -Dzookeeper.ssl.trustStore.password=testpass"
> >>
> >> I want to have SSL between client to server communication
> >>
> >> I am already following the same link which you have shared with me but
> >> that is not working.
> >>
> >> Zoo.cfg
> >>
> >> secureClientPort=2281
> >> initLimit=10
> >> syncLimit=5
> >> dataDir=/var/lib/zookeeper/data
> >> tickTime=2000
> >> autopurge.snapRetainCount=3
> >> autopurge.purgeInterval=1
> >> admin.enableServer=false
> >> standaloneEnabled=false
> >> jute.maxbuffer=2147483648
> >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >> server.1=host1_priv:10288:10388
> >> server.2=host2_priv:10288:10388
> >> server.3=host3_priv:10288:10388
> >>
> >>
> >> command to connect using zkcli
> >>
> >> 1. zkcli zoo.cfg localhost:2281
> >> 2. addauth ztpasswd usernaem:password
> >>
> >> after second step we are getting below error
> >>
> >> WatchedEvent state:AuthFailed type:None path:null
> >>
> >>
> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
> provider
> >> for scheme: ztpasswd has x509 ip digest*
> >>
> >> Thanks,
> >> ---------------------
> >> Kuldeep Singh Budania
> >>
> >>
> >>
> >> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
> >> szalay.beko.mate@gmail.com> wrote:
> >>
> >>> > No authentication provider for scheme: ztpasswd has x509 ip digest*
> >>>
> >>> This suggest you have some configuration error... Where did you use the
> >>> "ztpasswd" string in your configs / commands?
> >>>
> >>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
> >>> szalay.beko.mate@gmail.com>
> >>> wrote:
> >>>
> >>> > > My ZK server is up and running in secure mode
> >>> >
> >>> > What is your goal? You want to setup client-server SSL connection?
> >>> >
> >>> > see:
> >>> >
> >>>
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
> >>> >
> >>> > (or you want to have both SSL and SASL enabled?)
> >>> >
> >>> > Anyway, please remove the following line from the SERVER_JVMFLAGS:
> >>> >
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >>> > This is a configuration that makes sense only for the ZooKeeper
> client,
> >>> > not for the server. For the server, use the following:
> >>> >
> >>> >
> >>>
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >>> >
> >>> > If it doesn't solve the issue, then can you please send your zoo.cfg
> >>> file?
> >>> > Also can you please send the zkCli command you execute? (you need to
> >>> > connect to the secure ZooKeeper port, unless portUnification is
> >>> enabled)
> >>> >
> >>> > Kind regards,
> >>> > Mate
> >>> >
> >>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
> >>> kuldeep.singh08@gmail.com>
> >>> > wrote:
> >>> >
> >>> >> Hi,
> >>> >>
> >>> >> we have done below changes in java.env file
> >>> >>
> >>> >> export SERVER_JVMFLAGS="
> >>> >>
> >>> >>
> >>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >>> >>
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> >>> >>
> >>>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> >>> >>
> >>> >>
> >>> >>
> >>> >> export CLIENT_JVMFLAGS="
> >>> >>
> >>> >>
> >>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >>> >> -Dzookeeper.client.secure=true
> >>> >>
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >>> >> -Dzookeeper.ssl.keyStore.password=testpass
> >>> >>
> >>>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >>> >> -Dzookeeper.ssl.trustStore.password=testpass"
> >>> >>
> >>> >> I have started the ZK server and it is up without any issue.
> >>> >>
> >>> >> But now when I login to ZkCli then it gives the below error.
> >>> >>
> >>> >> WatchedEvent state:AuthFailed type:None path:null
> >>> >>
> >>> >>
> >>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> >>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
> >>> provider
> >>> >> for scheme: ztpasswd has x509 ip digest*
> >>> >>
> >>> >> Please help me on this issue
> >>> >>
> >>> >> Thanks,
> >>> >> ---------------------
> >>> >> Kuldeep Singh Budania
> >>> >> Software Architect
> >>> >>
> >>> >>
> >>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
> >>> kuldeep.singh08@gmail.com>
> >>> >> wrote:
> >>> >>
> >>> >> > Hi,
> >>> >> >
> >>> >> > My ZK server is up and running in secure mode, But When I am
> >>> trying to
> >>> >> > connect to the ZK server using ZKCli, it gives the below error.
> >>> >> >
> >>> >> > WatchedEvent state:AuthFailed type:None path:null
> >>> >> >
> >>> >> >
> >>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> >>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
> >>> >> provider
> >>> >> > for scheme: ztpasswd has x509 ip digest*
> >>> >> >
> >>> >> > Can someone please help me on this issue. we are using the 3.5.6
> >>> >> version.
> >>> >> >
> >>> >> > I appreciate if I will get a response as soon as possible, as I am
> >>> stuck
> >>> >> > at this point.
> >>> >> >
> >>> >> > Thanks,
> >>> >> > ---------------------
> >>> >> > Kuldeep Singh Budania
> >>> >> > Software Architect
> >>> >> >
> >>> >> >
> >>> >> >
> >>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli - Diennea
> >>> >> > <en...@diennea.com.invalid> wrote:
> >>> >> >
> >>> >> >> I mean in zoo.cfg
> >>> >> >> Not as a system property
> >>> >> >>
> >>> >> >> Enrico
> >>> >> >>
> >>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <
> >>> >> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
> >>> >> >>
> >>> >> >> Hi
> >>> >> >> You have to enable Netty on the server side
> >>> >> >>
> >>> >> >> Something like:
> >>> >> >>
> >>> >>
> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >>> >> >>
> >>> >> >> Hope that helps
> >>> >> >> Enrico
> >>> >> >>
> >>> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
> >>> >> kuldeep.singh08@gmail.com>
> >>> >> >> ha scritto:
> >>> >> >>
> >>> >> >> Hi,
> >>> >> >>
> >>> >> >> I got below error while setting SSL properties in
> zkEnv.sh
> >>> >> >>
> >>> >> >>
> >>> >> >>
> >>> >> >>
> >>> >> >>
> >>> >>
> >>>
> ==========================================================================================
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,864 - INFO
> [main:QuorumPeerConfig@133]
> >>> -
> >>> >> >> Reading
> >>> >> >> configuration from: /etc/zookeeper/zoo.cfg
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,874 - INFO
> [main:QuorumPeerConfig@385]
> >>> -
> >>> >> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,874 - INFO
> [main:QuorumPeerConfig@399]
> >>> -
> >>> >> >> secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] -
> >>> Setting
> >>> >> -D
> >>> >> >> jdk.tls.rejectClientInitiatedRenegotiation=true to
> disable
> >>> >> >> client-initiated
> >>> >> >> TLS renegotiation
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,897 - INFO
> >>> [main:DatadirCleanupManager@78]
> >>> >> -
> >>> >> >> autopurge.snapRetainCount set to 3
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,897 - INFO
> >>> [main:DatadirCleanupManager@79]
> >>> >> -
> >>> >> >> autopurge.purgeInterval set to 1
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,898 - INFO [
> >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge
> >>> task
> >>> >> >> started.
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] -
> >>> Log4j
> >>> >> >> found with
> >>> >> >> jmx enabled.
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,903 - INFO
> >>> [PurgeTask:FileTxnSnapLog@103]
> >>> >> -
> >>> >> >> zookeeper.snapshot.trust.empty : false
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,910 - INFO [
> >>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge
> >>> task
> >>> >> >> completed.
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141
> ]
> >>> -
> >>> >> >> Starting quorum
> >>> >> >> peer
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,983 - INFO
> [main:ServerCnxnFactory@135]
> >>> -
> >>> >> >> Using
> >>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as
> server
> >>> >> >> connection
> >>> >> >> factory
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,986 - INFO
> >>> [main:NIOServerCnxnFactory@673]
> >>> >> -
> >>> >> >> Configuring NIO connection handler with 10s sessionless
> >>> >> >> connection timeout,
> >>> >> >> 2 selector thread(s), 16 worker threads, and 64 kB direct
> >>> >> buffers.
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,992 - INFO
> >>> [main:NIOServerCnxnFactory@686
> >>> >> ]
> >>> >> >> - binding
> >>> >> >> to port 0.0.0.0/0.0.0.0:10181
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,994 - INFO
> [main:ServerCnxnFactory@135]
> >>> -
> >>> >> >> Using
> >>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as
> server
> >>> >> >> connection
> >>> >> >> factory
> >>> >> >>
> >>> >> >> 2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101
> ]
> >>> -
> >>> >> >> Unexpected
> >>> >> >> exception, exiting abnormally
> >>> >> >>
> >>> >> >> java.lang.UnsupportedOperationException: SSL isn't
> >>> supported in
> >>> >> >> NIOServerCnxn
> >>> >> >>
> >>> >> >> at
> >>> >> >>
> >>> >> >>
> >>> >>
> >>>
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> >>> >> >>
> >>> >> >> at
> >>> >> >>
> >>> >> >>
> >>> >>
> >>>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> >>> >> >>
> >>> >> >> at
> >>> >> >>
> >>> >> >>
> >>> >>
> >>>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> >>> >> >>
> >>> >> >> at
> >>> >> >>
> >>> >> >>
> >>> >>
> >>>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> >>> >> >>
> >>> >> >>
> >>> >> >>
> >>> >> >>
> >>> >> >>
> >>> >> >> I have set the following properties in SERVER_JVMFLAGS in
> >>> >> >> zkEnv.sh file :
> >>> >> >>
> >>> >> >>
> >>> >>
> >>>
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >>> >> >>
> >>> >> >>
> >>> >>
> >>>
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> >>> >> >> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> >>> >> >>
> >>> >> >>
> >>> >>
> >>>
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> >>> >> >> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> >>> >> >>
> >>> >> >> Thanks,
> >>> >> >> ---------------------
> >>> >> >> Kuldeep Singh Budania
> >>> >> >>
> >>> >> >>
> >>> >> >>
> >>> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <
> >>> >> >> jordan@jordanzimmerman.com>
> >>> >> >> wrote:
> >>> >> >>
> >>> >> >> > It's the same as the normal ZooKeeper client:
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >>> >> >> > <
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >>> >> >> > >
> >>> >> >> >
> >>> >> >> > -Jordan
> >>> >> >> >
> >>> >> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep singh <
> >>> >> >> kuldeep.singh08@gmail.com>
> >>> >> >> > wrote:
> >>> >> >> > >
> >>> >> >> > > Hi Team,
> >>> >> >> > > How we will do secure communication between the
> Curator
> >>> >> >> framework and
> >>> >> >> > > zookeeper 3.5.6 ?
> >>> >> >> > > I didn't get any solution right now.
> >>> >> >> > > I appreciate it if someone could help me with the
> same.
> >>> >> >> > >
> >>> >> >> > > Thanks,
> >>> >> >> > > ---------------------
> >>> >> >> > > Kuldeep Singh Budania
> >>> >> >> > > Software Architect
> >>> >> >> > >
> >>> >> >> > >
> >>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
> >>> >> >> > szalay.beko.mate@gmail.com>
> >>> >> >> > > wrote:
> >>> >> >> > >
> >>> >> >> > >> Hello Kuldeep,
> >>> >> >> > >>
> >>> >> >> > >> did you download the source from the ZooKeeper
> >>> webpage, or
> >>> >> >> checked out
> >>> >> >> > from
> >>> >> >> > >> git?
> >>> >> >> > >> Anyway, the following commands should work:
> >>> >> >> > >>
> >>> >> >> > >> wget
> >>> >> >> > >>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> >>> >> >> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
> >>> >> >> > >> cd apache-zookeeper-3.5.7
> >>> >> >> > >> mvn clean install -DskipTests
> >>> >> >> > >>
> >>> >> >> > >> I tested it with OpenJDK 8u424 and maven 3.6.0.
> >>> >> >> > >>
> >>> >> >> > >> Kind regards,
> >>> >> >> > >> Mate
> >>> >> >> > >>
> >>> >> >> > >>
> >>> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
> >>> >> >> > kuldeep.singh08@gmail.com>
> >>> >> >> > >> wrote:
> >>> >> >> > >>
> >>> >> >> > >>> Hi All,
> >>> >> >> > >>>
> >>> >> >> > >>> I have download the zookeeper source code and run
> >>> the mvn
> >>> >> >> command for
> >>> >> >> > >>> packaging but get problem on "zookeeper-server"
> >>> >> directory.
> >>> >> >> > >>>
> >>> >> >> > >>> *command :- mvn clean package*
> >>> >> >> > >>>
> >>> >> >> > >>> [ERROR] Failed to execute goal
> >>> >> >> > >>>
> >>> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >>> >> >> > >>> (default-compile) on project zookeeper: Fatal error
> >>> >> >> compiling:
> >>> >> >> > >>> java.lang.NullPointerException -> [Help 1]
> >>> >> >> > >>>
> >>> org.apache.maven.lifecycle.LifecycleExecutionException:
> >>> >> >> Failed to
> >>> >> >> > execute
> >>> >> >> > >>> goal
> >>> >> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >>> >> >> > >>> (default-compile) on project zookeeper: Fatal error
> >>> >> >> compiling
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> >>> >> >> > >>> at
> >>> >> >> >
> >>> >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> >>> >> >> > >>> at
> >>> >> >> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> >>> >> >> > >>> at
> >>> >> >> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> >>> >> >> > >>> at
> >>> >> >> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> >>> >> >> > >>> at
> >>> >> >> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> >>> >> >> > >>> at
> >>> >> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>> >> >> > >>> at
> >>> >> java.lang.reflect.Method.invoke(Method.java:498)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> >>> >> >> > >>> Caused by:
> >>> >> org.apache.maven.plugin.MojoExecutionException:
> >>> >> >> Fatal error
> >>> >> >> > >>> compiling
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> >>> >> >> > >>> ... 19 more
> >>> >> >> > >>> Caused by:
> >>> >> org.codehaus.plexus.compiler.CompilerException:
> >>> >> >> > >>> java.lang.NullPointerException
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> >>> >> >> > >>> ... 22 more
> >>> >> >> > >>> Caused by: java.lang.RuntimeException:
> >>> >> >> java.lang.NullPointerException
> >>> >> >> > >>> at
> >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:559)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> >>> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> >>> >> >> > >>> ... 24 more
> >>> >> >> > >>> Caused by: java.lang.NullPointerException
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> >>> >> >> > >>> at
> >>> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> >>> >> >> > >>> at
> >>> >> >> com.sun.tools.doclint.Checker.scan(Checker.java:144)
> >>> >> >> > >>> at
> >>> >> >> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> >>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> >> >> > >>> at
> >>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >>> >> >> > >>> at
> >>> >> >> > >>
> >>> >> >> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> >> >> > >>> at
> >>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> >> >> > >>> at
> >>> >> >> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> >>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> >>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> >>> >> >> > >>> at
> >>> >> >> > >>>
> >>> >> >>
> >>> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> >>> >> >> > >>> at
> >>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:523)
> >>> >> >> > >>> ... 27 more
> >>> >> >> > >>> [ERROR]
> >>> >> >> > >>> [ERROR] Re-run Maven using the -X switch to enable
> >>> full
> >>> >> >> debug logging.
> >>> >> >> > >>> [ERROR]
> >>> >> >> > >>> [ERROR] For more information about the errors and
> >>> >> possible
> >>> >> >> solutions,
> >>> >> >> > >>> please read the following articles:
> >>> >> >> > >>> [ERROR] [Help 1]
> >>> >> >> > >>>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> >>> >> >> > >>>
> >>> >> >> > >>> Can someone help me on this issue?
> >>> >> >> > >>>
> >>> >> >> > >>> Thanks,
> >>> >> >> > >>> ---------------------
> >>> >> >> > >>> Kuldeep Singh Budania
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>>
> >>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
> >>> >> >> > >>> szalay.beko.mate@gmail.com>
> >>> >> >> > >>> wrote:
> >>> >> >> > >>>
> >>> >> >> > >>>> these exceptions can mean many things... I think
> >>> this
> >>> >> can
> >>> >> >> be even
> >>> >> >> > >> normal
> >>> >> >> > >>>> duding rolling restart (as some connections get
> >>> broken
> >>> >> in
> >>> >> >> this case)
> >>> >> >> > >>>>
> >>> >> >> > >>>> However, I saw cases already when exceptions like
> >>> these
> >>> >> >> killed
> >>> >> >> > receiver
> >>> >> >> > >>> or
> >>> >> >> > >>>> sender threads in QuorumCnxManager / Leader
> >>> Election in
> >>> >> >> such a way
> >>> >> >> > that
> >>> >> >> > >>>> they were not able to recover, so the node was
> >>> unable to
> >>> >> >> connect to
> >>> >> >> > any
> >>> >> >> > >>>> quorum until restart. I remember seeing this in
> 3.4
> >>> too.
> >>> >> >> > >>>>
> >>> >> >> > >>>> Do you see these exceptions in the second server
> >>> (the
> >>> >> one
> >>> >> >> which you
> >>> >> >> > >> just
> >>> >> >> > >>>> upgraded in step 3)?
> >>> >> >> > >>>> Is this issue reproducible?
> >>> >> >> > >>>>
> >>> >> >> > >>>> What is the tickTime and initLimit you use? Maybe
> >>> the
> >>> >> >> server just
> >>> >> >> > >> require
> >>> >> >> > >>>> more time to sync?
> >>> >> >> > >>>>
> >>> >> >> > >>>> I would need more logs to really see what
> happened.
> >>> Can
> >>> >> >> you create a
> >>> >> >> > >> Jira
> >>> >> >> > >>>> issue and upload the logs and also the ZooKeeper
> >>> >> configs?
> >>> >> >> I am happy
> >>> >> >> > to
> >>> >> >> > >>>> take a closer look.
> >>> >> >> > >>>> (if you need to re-run the test to collect the
> logs,
> >>> >> then
> >>> >> >> enabling
> >>> >> >> > >> DEBUG
> >>> >> >> > >>>> logs would be great. The INFO level logs are
> usually
> >>> >> >> enough for these
> >>> >> >> > >>>> problems, but one can never know...)
> >>> >> >> > >>>>
> >>> >> >> > >>>> Kind regards,
> >>> >> >> > >>>> Mate
> >>> >> >> > >>>>
> >>> >> >> > >>>>
> >>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
> >>> >> >> > >> kuldeep.singh08@gmail.com
> >>> >> >> > >>>>
> >>> >> >> > >>>> wrote:
> >>> >> >> > >>>>
> >>> >> >> > >>>>> Hi Team,
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> I have done some POC on rolling upgrade and found
> >>> below
> >>> >> >> result.
> >>> >> >> > >>>>>
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> 1. On 1st node upgrade zookeeper . Traffic was
> >>> >> running
> >>> >> >> fine
> >>> >> >> > >> because
> >>> >> >> > >>> 2
> >>> >> >> > >>>>> nodes are already on old zookeeper.
> >>> >> >> > >>>>> 2. On 1st node upgrade our application and
> didn’t
> >>> >> find
> >>> >> >> any issue
> >>> >> >> > >>>>> 3. On 2nd node upgrade zookeeper but got below
> >>> error
> >>> >> >> and zookeeper
> >>> >> >> > >>> is
> >>> >> >> > >>>>> not taking any requests
> >>> >> >> > >>>>> 4.
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> java.io.EOFException
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> at
> >>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> at
> >>> >> >> > >>>>>
> >>> >> >> > >>>>>
> >>> >> >> > >>>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
> >>> >> >> > >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765] -
> >>> >> >> Interrupting
> >>> >> >> > >>> SendWorker
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/
> >>> >> >> 192.168.44.73:33754
> >>> >> >> > >>>>> :LearnerHandler@562] - Unexpected exception
> >>> causing
> >>> >> >> shutdown while
> >>> >> >> > >>> sock
> >>> >> >> > >>>>> still open
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> java.io.EOFException
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> at
> >>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> at
> >>> >> >> > >>>>>
> >>> >> >> > >>
> >>> >> >>
> >>> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> at
> >>> >> >> > >>>>>
> >>> >> >> > >>>>>
> >>> >> >> > >>>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> at
> >>> >> >> > >>>>>
> >>> >> >> > >>>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> at
> >>> >> >> > >>>>>
> >>> >> >> > >>>>>
> >>> >> >> > >>>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >>
> >>> >>
> >>>
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
> >>> >> >> > >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679] -
> >>> >> >> Interrupted while
> >>> >> >> > >>>> waiting
> >>> >> >> > >>>>> for message on queue
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> Please let me know is this the known issue or
> this
> >>> is
> >>> >> >> different issue
> >>> >> >> > >>>> which
> >>> >> >> > >>>>> is mention in Apache zookeeper documentation when
> >>> >> >> upgrading from
> >>> >> >> > >> 3.4.5
> >>> >> >> > >>> to
> >>> >> >> > >>>>> 3.5.6
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> Thanks,
> >>> >> >> > >>>>> ---------------------
> >>> >> >> > >>>>> Kuldeep Singh Budania
> >>> >> >> > >>>>> Software Architect
> >>> >> >> > >>>>>
> >>> >> >> > >>>>>
> >>> >> >> > >>>>>
> >>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer
> <
> >>> >> >> shralex@gmail.com>
> >>> >> >> > >>>>> wrote:
> >>> >> >> > >>>>>
> >>> >> >> > >>>>>> +1 to what Mate said (I wrote the quoted
> >>> >> instructions).
> >>> >> >> > >>>>>>
> >>> >> >> > >>>>>>
> >>> >> >> > >>>>>>
> >>> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő
> Máté <
> >>> >> >> > >>>>>> szalay.beko.mate@gmail.com>
> >>> >> >> > >>>>>> wrote:
> >>> >> >> > >>>>>>
> >>> >> >> > >>>>>>> Hi Kuldeep,
> >>> >> >> > >>>>>>>
> >>> >> >> > >>>>>>> I just want to provide you some background info
> >>> about
> >>> >> >> our
> >>> >> >> > >>>>> documentation.
> >>> >> >> > >>>>>>> The reason to upgrade to 3.4.6 first is to
> avoid
> >>> the
> >>> >> >> following
> >>> >> >> > >>> error:
> >>> >> >> > >>>>>>>
> >>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
> >>> [localhost/
> >>> >> >> > >>> 127.0.0.1:2784
> >>> >> >> > >>>>>>> :QuorumCnxManager@349] - Invalid server id:
> >>> -65536
> >>> >> >> > >>>>>>>
> >>> >> >> > >>>>>>> This error comes because of the protocol
> changes
> >>> >> between
> >>> >> >> > >> ZooKeeper
> >>> >> >> > >>>>> server
> >>> >> >> > >>>>>>> nodes during connection initiation for leader
> >>> >> election.
> >>> >> >> In
> >>> >> >> > >>> ZooKeeper
> >>> >> >> > >>>>> 3.5
> >>> >> >> > >>>>>> a
> >>> >> >> > >>>>>>> protocol version was introduced (see
> >>> ZOOKEEPER-107)
> >>> >> and
> >>> >> >> since
> >>> >> >> > >> that
> >>> >> >> > >>>> time
> >>> >> >> > >>>>>> the
> >>> >> >> > >>>>>>> fist long value sent in the initial message is
> >>> not
> >>> >> the
> >>> >> >> server ID
> >>> >> >> > >>> but
> >>> >> >> > >>>>> the
> >>> >> >> > >>>>>>> protocol version (-65536). In ZooKeeper 3.4.6
> we
> >>> made
> >>> >> >> the old 3.4
> >>> >> >> > >>>>>>> ZooKeepers backward compatible, so they are
> able
> >>> to
> >>> >> >> parse both
> >>> >> >> > >> the
> >>> >> >> > >>>> old
> >>> >> >> > >>>>>> and
> >>> >> >> > >>>>>>> the new protocol format (see ZOOKEEPER-1633).
> >>> This
> >>> >> >> issue happens
> >>> >> >> > >>> only
> >>> >> >> > >>>>>> when
> >>> >> >> > >>>>>>> you need to use old (3.4.0 - 3.4.5) and new
> >>> (3.5.0+)
> >>> >> >> ZooKeeper
> >>> >> >> > >>>> servers
> >>> >> >> > >>>>>>> together in the same cluster. During a rolling
> >>> >> upgrade,
> >>> >> >> this is
> >>> >> >> > >>>> usually
> >>> >> >> > >>>>>> the
> >>> >> >> > >>>>>>> case to have old and new ZooKeepers present
> >>> together.
> >>> >> >> > >>>>>>>
> >>> >> >> > >>>>>>> The fact that you haven't seen any issues might
> >>> be
> >>> >> >> caused by the
> >>> >> >> > >>>> order
> >>> >> >> > >>>>> of
> >>> >> >> > >>>>>>> the servers. In ZooKeeper the connection
> >>> initiation
> >>> >> >> between the
> >>> >> >> > >>>> servers
> >>> >> >> > >>>>>>> during the leader election follows a specific
> >>> rule.
> >>> >> As
> >>> >> >> far as I
> >>> >> >> > >>>>> remember
> >>> >> >> > >>>>>>> always the server with the larger ID 'wins the
> >>> >> >> challenge', so it
> >>> >> >> > >> is
> >>> >> >> > >>>>>>> possible, that the old server didn't need to
> >>> parse
> >>> >> any
> >>> >> >> initial
> >>> >> >> > >>>> message
> >>> >> >> > >>>>>> (if
> >>> >> >> > >>>>>>> it had the largest ID) and this is why you
> >>> haven't
> >>> >> seen
> >>> >> >> the
> >>> >> >> > >> issue.
> >>> >> >> > >>>> Also
> >>> >> >> > >>>>>>> having 2 nodes up from the 3 nodes cluster
> still
> >>> >> makes
> >>> >> >> the
> >>> >> >> > >> cluster
> >>> >> >> > >>>> work
> >>> >> >> > >>>>>> (so
> >>> >> >> > >>>>>>> you should also check if all the servers are
> >>> part of
> >>> >> >> the quorum).
> >>> >> >> > >>>>>>>
> >>> >> >> > >>>>>>> I agree with Enrico and Norbert, the safest and
> >>> most
> >>> >> >> stable way
> >>> >> >> > >> is
> >>> >> >> > >>>>>> upgrade
> >>> >> >> > >>>>>>> first to 3.4.latest, then go to 3.5.latest.
> >>> Still, if
> >>> >> >> you don't
> >>> >> >> > >> see
> >>> >> >> > >>>>> that
> >>> >> >> > >>>>>>> you would hit this specific issue (e.g. no
> >>> "Invalid
> >>> >> >> server id" in
> >>> >> >> > >>> the
> >>> >> >> > >>>>> log
> >>> >> >> > >>>>>>> files), and all the three servers can handle
> >>> traffic,
> >>> >> >> then maybe
> >>> >> >> > >>> you
> >>> >> >> > >>>>>> don't
> >>> >> >> > >>>>>>> need to upgrade first to 3.4.latest, it is your
> >>> >> >> decision.
> >>> >> >> > >>> Definitely
> >>> >> >> > >>>>> you
> >>> >> >> > >>>>>>> should test it first, as suggested by the
> others.
> >>> >> >> > >>>>>>>
> >>> >> >> > >>>>>>> Kind regards,
> >>> >> >> > >>>>>>> Mate
> >>> >> >> > >>>>>>>
> >>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
> >>> >> >> > >>>>>>> <nk...@cloudera.com.invalid> wrote:
> >>> >> >> > >>>>>>>
> >>> >> >> > >>>>>>>> Hi,
> >>> >> >> > >>>>>>>>
> >>> >> >> > >>>>>>>> That guide is to upgrade to 3.5.0, which was
> an
> >>> >> alpha
> >>> >> >> version.
> >>> >> >> > >> A
> >>> >> >> > >>>> lot
> >>> >> >> > >>>>>> has
> >>> >> >> > >>>>>>>> changed for the first stable release of 3.5.5
> >>> and
> >>> >> then
> >>> >> >> a few
> >>> >> >> > >>> more,
> >>> >> >> > >>>>> even
> >>> >> >> > >>>>>>>> rolling upgrade issues have been fixed for
> >>> 3.5.6.
> >>> >> >> > >>>>>>>> This is a more up-to-date guide:
> >>> >> >> > >>>>>>>>
> >>> >> >> > >>>
> >>> >> >>
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> >>> >> >> > >>>>>>>>
> >>> >> >> > >>>>>>>> If you have done your testing (with prod
> >>> snapshot!),
> >>> >> >> then you
> >>> >> >> > >> can
> >>> >> >> > >>>>> skip
> >>> >> >> > >>>>>>> 3.4
> >>> >> >> > >>>>>>>> latest upgrade, but keep in mind we do our
> >>> >> >> recommendations for
> >>> >> >> > >> a
> >>> >> >> > >>>>>> reason.
> >>> >> >> > >>>>>>>> There were issues reported and/or found during
> >>> >> >> testing. Some
> >>> >> >> > >> are
> >>> >> >> > >>>>> fixed
> >>> >> >> > >>>>>>> with
> >>> >> >> > >>>>>>>> 3.5.6, some only happens if certain conditions
> >>> stand
> >>> >> >> > >>> (IOException:
> >>> >> >> > >>>> No
> >>> >> >> > >>>>>>>> snapshot found - mentioned in the guide, fixed
> >>> in
> >>> >> >> 3.5.6).
> >>> >> >> > >>>>>>>>
> >>> >> >> > >>>>>>>> So it is up to you, I would still recommend to
> >>> do an
> >>> >> >> 3.4
> >>> >> >> > >> upgrade
> >>> >> >> > >>>>> first,
> >>> >> >> > >>>>>>> if
> >>> >> >> > >>>>>>>> it's feasible.
> >>> >> >> > >>>>>>>>
> >>> >> >> > >>>>>>>> Regards,
> >>> >> >> > >>>>>>>> Norbert
> >>> >> >> > >>>>>>>>
> >>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep
> singh <
> >>> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
> >>> >> >> > >>>>>>>> wrote:
> >>> >> >> > >>>>>>>>
> >>> >> >> > >>>>>>>>> Hi,
> >>> >> >> > >>>>>>>>>
> >>> >> >> > >>>>>>>>> Current Zookeeper version :- 3.4.5
> >>> >> >> > >>>>>>>>> Upgraded version :- 3.5.6
> >>> >> >> > >>>>>>>>>
> >>> >> >> > >>>>>>>>> We are not going with 3.5.7. Our final
> >>> decision is
> >>> >> >> zookeeper
> >>> >> >> > >>>>> version
> >>> >> >> > >>>>>> is
> >>> >> >> > >>>>>>>>> 3.5.6
> >>> >> >> > >>>>>>>>> as per your reply first we need to move
> latest
> >>> >> >> version of
> >>> >> >> > >>> 3.4.x,
> >>> >> >> > >>>>> like
> >>> >> >> > >>>>>>>> below
> >>> >> >> > >>>>>>>>>
> >>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am
> >>> wrong
> >>> >> >> here)
> >>> >> >> > >>>>>>>>>
> >>> >> >> > >>>>>>>>> But if We are not facing any problem that i
> >>> have
> >>> >> >> shared you
> >>> >> >> > >>> that
> >>> >> >> > >>>> we
> >>> >> >> > >>>>>>> have
> >>> >> >> > >>>>>>>>> set up of 3 node cluster where 2 node are on
> >>> 3.5.6
> >>> >> >> version
> >>> >> >> > >> and
> >>> >> >> > >>> 1
> >>> >> >> > >>>>> node
> >>> >> >> > >>>>>>> on
> >>> >> >> > >>>>>>>>> 3.4.5, Everything is running fine and didn't
> >>> get
> >>> >> any
> >>> >> >> issue,
> >>> >> >> > >> So
> >>> >> >> > >>>> what
> >>> >> >> > >>>>>>> other
> >>> >> >> > >>>>>>>>> problem we can face if we directly move to
> >>> 3.5.6
> >>> >> >> > >>>>>>>>>
> >>> >> >> > >>>>>>>>> Thanks,
> >>> >> >> > >>>>>>>>> ---------------------
> >>> >> >> > >>>>>>>>> Kuldeep Singh Budania
> >>> >> >> > >>>>>>>>> Software Architect
> >>> >> >> > >>>>>>>>>
> >>> >> >> > >>>>>>>>>
> >>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico
> >>> Olivelli <
> >>> >> >> > >>>>> eolivelli@gmail.com
> >>> >> >> > >>>>>>>
> >>> >> >> > >>>>>>>>> wrote:
> >>> >> >> > >>>>>>>>>
> >>> >> >> > >>>>>>>>>> Hi
> >>> >> >> > >>>>>>>>>> You have to upgrade to latest 3.4.x
> Zookeeper
> >>> then
> >>> >> >> you will
> >>> >> >> > >>>>> upgrade
> >>> >> >> > >>>>>>> to
> >>> >> >> > >>>>>>>>>> 3.5.7.
> >>> >> >> > >>>>>>>>>> All should run well without issues
> >>> >> >> > >>>>>>>>>>
> >>> >> >> > >>>>>>>>>>
> >>> >> >> > >>>>>>>>>> Enrico
> >>> >> >> > >>>>>>>>>>
> >>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
> >>> >> >> > >>>>> kuldeep.singh08@gmail.com
> >>> >> >> > >>>>>>>
> >>> >> >> > >>>>>>> ha
> >>> >> >> > >>>>>>>>>> scritto:
> >>> >> >> > >>>>>>>>>>
> >>> >> >> > >>>>>>>>>>> Hi Team,
> >>> >> >> > >>>>>>>>>>>
> >>> >> >> > >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to
> >>> 3.5.6. I
> >>> >> >> have
> >>> >> >> > >> set
> >>> >> >> > >>>> up 3
> >>> >> >> > >>>>>>> node
> >>> >> >> > >>>>>>>>>>> cluster where 2 node are on 3.5.6 version
> >>> and 1
> >>> >> >> node on
> >>> >> >> > >>>> 3.4.5.
> >>> >> >> > >>>>>>>>>>>
> >>> >> >> > >>>>>>>>>>> Everything is running fine and didn't get
> any
> >>> >> issue
> >>> >> >> on my
> >>> >> >> > >>>>> system.
> >>> >> >> > >>>>>>>>>>>
> >>> >> >> > >>>>>>>>>>> but I found something on apache site that
> >>> first
> >>> >> we
> >>> >> >> need
> >>> >> >> > >> to
> >>> >> >> > >>>>>> upgrade
> >>> >> >> > >>>>>>>> on
> >>> >> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is
> it
> >>> >> >> mandatory
> >>> >> >> > >> to
> >>> >> >> > >>> go
> >>> >> >> > >>>>> on
> >>> >> >> > >>>>>>>> 3.4.6
> >>> >> >> > >>>>>>>>>>> first.
> >>> >> >> > >>>>>>>>>>>
> >>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
> >>> >> >> > >>>>>>>>>>>
> >>> >> >> > >>>>>>>>>>> Upgrading a running ZooKeeper ensemble to
> >>> 3.5.0
> >>> >> >> should be
> >>> >> >> > >>>> done
> >>> >> >> > >>>>>> only
> >>> >> >> > >>>>>>>>> after
> >>> >> >> > >>>>>>>>>>> upgrading your ensemble to the 3.4.6
> release.
> >>> >> Note
> >>> >> >> that
> >>> >> >> > >>> this
> >>> >> >> > >>>> is
> >>> >> >> > >>>>>>> only
> >>> >> >> > >>>>>>>>>>> necessary for rolling upgrades (if you're
> >>> fine
> >>> >> with
> >>> >> >> > >>> shutting
> >>> >> >> > >>>>> down
> >>> >> >> > >>>>>>> the
> >>> >> >> > >>>>>>>>>>> system completely, you don't have to go
> >>> through
> >>> >> >> 3.4.6).
> >>> >> >> > >> If
> >>> >> >> > >>>> you
> >>> >> >> > >>>>>>>> attempt
> >>> >> >> > >>>>>>>>> a
> >>> >> >> > >>>>>>>>>>> rolling upgrade without going through 3.4.6
> >>> (for
> >>> >> >> example
> >>> >> >> > >>> from
> >>> >> >> > >>>>>>> 3.4.5),
> >>> >> >> > >>>>>>>>> you
> >>> >> >> > >>>>>>>>>>> may get the following error:
> >>> >> >> > >>>>>>>>>>>
> >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO
> >>> >> [localhost/
> >>> >> >> > >>>>>> 127.0.0.1:2784
> >>> >> >> > >>>>>>>>>>> :QuorumCnxManager$Listener@498] - Received
> >>> >> >> connection
> >>> >> >> > >>>> request
> >>> >> >> > >>>>> /
> >>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
> >>> >> >> > >>>>>>>>>>>
> >>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
> >>> >> [localhost/
> >>> >> >> > >>>>>> 127.0.0.1:2784
> >>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server
> id:
> >>> >> -65536
> >>> >> >> > >>>>>>>>>>>
> >>> >> >> > >>>>>>>>>>> During a rolling upgrade, each server is
> >>> taken
> >>> >> down
> >>> >> >> in
> >>> >> >> > >> turn
> >>> >> >> > >>>> and
> >>> >> >> > >>>>>>>>> rebooted
> >>> >> >> > >>>>>>>>>>> with the new 3.5.0 binaries. Before
> starting
> >>> the
> >>> >> >> server
> >>> >> >> > >>> with
> >>> >> >> > >>>>>> 3.5.0
> >>> >> >> > >>>>>>>>>>> binaries, we highly recommend updating the
> >>> >> >> configuration
> >>> >> >> > >>> file
> >>> >> >> > >>>>> so
> >>> >> >> > >>>>>>> that
> >>> >> >> > >>>>>>>>> all
> >>> >> >> > >>>>>>>>>>> server statements "server.x=..." contain
> >>> client
> >>> >> >> ports
> >>> >> >> > >> (see
> >>> >> >> > >>>> the
> >>> >> >> > >>>>>>>> section
> >>> >> >> > >>>>>>>>>>> Specifying
> >>> >> >> > >>>>>>>>>>> the client port). As explained earlier you
> >>> may
> >>> >> >> leave the
> >>> >> >> > >>>>>>>> configuration
> >>> >> >> > >>>>>>>>>> in a
> >>> >> >> > >>>>>>>>>>> single file, as well as leave the
> >>> >> >> > >>>> clientPort/clientPortAddress
> >>> >> >> > >>>>>>>>> statements
> >>> >> >> > >>>>>>>>>>> (although if you specify client ports in
> the
> >>> new
> >>> >> >> format,
> >>> >> >> > >>>> these
> >>> >> >> > >>>>>>>>> statements
> >>> >> >> > >>>>>>>>>>> are now redundant).
> >>> >> >> > >>>>>>>>>>>
> >>> >> >> > >>>>>>>>>>> Could you please let me know about this
> case.
> >>> >> >> Appreciate
> >>> >> >> > >> if
> >>> >> >> > >>>>>> respond
> >>> >> >> > >>>>>>>>> soon.
> >>> >> >> > >>>>>>>>>>>
> >>> >> >> > >>>>>>>>>>> Thanks,
> >>> >> >> > >>>>>>>>>>> ---------------------
> >>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
> >>> >> >> > >>>>>>>>>>>
> >>> >> >> > >>>>>>>>>>
> >>> >> >> > >>>>>>>>>
> >>> >> >> > >>>>>>>>
> >>> >> >> > >>>>>>>
> >>> >> >> > >>>>>>
> >>> >> >> > >>>>>
> >>> >> >> > >>>>
> >>> >> >> > >>>
> >>> >> >> > >>
> >>> >> >> >
> >>> >> >> >
> >>> >> >>
> >>> >> >>
> >>> >> >> ________________________________
> >>> >> >>
> >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> >>> >> >> This e-mail (including any attachments) is strictly
> >>> confidential
> >>> >> and
> >>> >> >> may also contain privileged information. If you are not the
> >>> intended
> >>> >> >> recipient you are not authorised to read, print, save, process or
> >>> >> disclose
> >>> >> >> this message. If you have received this message by mistake,
> please
> >>> >> inform
> >>> >> >> the sender immediately and destroy this e-mail, its attachments
> >>> and any
> >>> >> >> copies. Any use, distribution, reproduction or disclosure by any
> >>> person
> >>> >> >> other than the intended recipient is strictly prohibited and the
> >>> person
> >>> >> >> responsible may incur in penalties.
> >>> >> >> The use of this e-mail is only for professional purposes;
> >>> there is
> >>> >> no
> >>> >> >> guarantee that the correspondence towards this e-mail will be
> read
> >>> >> only by
> >>> >> >> the recipient, because, under certain circumstances, there may
> be a
> >>> >> need to
> >>> >> >> access this email by third subjects belonging to the Company.
> >>> >> >>
> >>> >> >>
> >>> >> >> ________________________________
> >>> >> >>
> >>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> >>> >> >> This e-mail (including any attachments) is strictly confidential
> >>> and
> >>> >> may
> >>> >> >> also contain privileged information. If you are not the intended
> >>> >> recipient
> >>> >> >> you are not authorised to read, print, save, process or disclose
> >>> this
> >>> >> >> message. If you have received this message by mistake, please
> >>> inform
> >>> >> the
> >>> >> >> sender immediately and destroy this e-mail, its attachments and
> any
> >>> >> copies.
> >>> >> >> Any use, distribution, reproduction or disclosure by any person
> >>> other
> >>> >> than
> >>> >> >> the intended recipient is strictly prohibited and the person
> >>> >> responsible
> >>> >> >> may incur in penalties.
> >>> >> >> The use of this e-mail is only for professional purposes; there
> is
> >>> no
> >>> >> >> guarantee that the correspondence towards this e-mail will be
> read
> >>> >> only by
> >>> >> >> the recipient, because, under certain circumstances, there may
> be a
> >>> >> need to
> >>> >> >> access this email by third subjects belonging to the Company.
> >>> >> >>
> >>> >> >
> >>> >>
> >>> >
> >>>
> >>
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
1. sh zkCli.sh --config /etc/zookeeper -server localhost:2281
2. addauth ztpasswd zooadmin:<password>
Thanks,
---------------------
Kuldeep Singh Budania
On Thu, Jul 2, 2020 at 9:56 AM kuldeep singh <ku...@gmail.com>
wrote:
> Hi Team,
>
> Any update on this?
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <ku...@gmail.com>
> wrote:
>
>> Sorry this is my bad, there were server setting like below
>>
>> export SERVER_JVMFLAGS="
>>
>>
>> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> -Dzookeeper.ssl.keyStore.password=testpass
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> -Dzookeeper.ssl.trustStore.password=testpass"
>>
>>
>>
>> export CLIENT_JVMFLAGS="
>>
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> -Dzookeeper.client.secure=true
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> -Dzookeeper.ssl.keyStore.password=testpass
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> -Dzookeeper.ssl.trustStore.password=testpass"
>>
>> I want to have SSL between client to server communication
>>
>> I am already following the same link which you have shared with me but
>> that is not working.
>>
>> Zoo.cfg
>>
>> secureClientPort=2281
>> initLimit=10
>> syncLimit=5
>> dataDir=/var/lib/zookeeper/data
>> tickTime=2000
>> autopurge.snapRetainCount=3
>> autopurge.purgeInterval=1
>> admin.enableServer=false
>> standaloneEnabled=false
>> jute.maxbuffer=2147483648
>> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> server.1=host1_priv:10288:10388
>> server.2=host2_priv:10288:10388
>> server.3=host3_priv:10288:10388
>>
>>
>> command to connect using zkcli
>>
>> 1. zkcli zoo.cfg localhost:2281
>> 2. addauth ztpasswd usernaem:password
>>
>> after second step we are getting below error
>>
>> WatchedEvent state:AuthFailed type:None path:null
>>
>>
>> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication provider
>> for scheme: ztpasswd has x509 ip digest*
>>
>> Thanks,
>> ---------------------
>> Kuldeep Singh Budania
>>
>>
>>
>> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
>> szalay.beko.mate@gmail.com> wrote:
>>
>>> > No authentication provider for scheme: ztpasswd has x509 ip digest*
>>>
>>> This suggest you have some configuration error... Where did you use the
>>> "ztpasswd" string in your configs / commands?
>>>
>>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
>>> szalay.beko.mate@gmail.com>
>>> wrote:
>>>
>>> > > My ZK server is up and running in secure mode
>>> >
>>> > What is your goal? You want to setup client-server SSL connection?
>>> >
>>> > see:
>>> >
>>> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
>>> >
>>> > (or you want to have both SSL and SASL enabled?)
>>> >
>>> > Anyway, please remove the following line from the SERVER_JVMFLAGS:
>>> > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>>> > This is a configuration that makes sense only for the ZooKeeper client,
>>> > not for the server. For the server, use the following:
>>> >
>>> >
>>> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>> >
>>> > If it doesn't solve the issue, then can you please send your zoo.cfg
>>> file?
>>> > Also can you please send the zkCli command you execute? (you need to
>>> > connect to the secure ZooKeeper port, unless portUnification is
>>> enabled)
>>> >
>>> > Kind regards,
>>> > Mate
>>> >
>>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <
>>> kuldeep.singh08@gmail.com>
>>> > wrote:
>>> >
>>> >> Hi,
>>> >>
>>> >> we have done below changes in java.env file
>>> >>
>>> >> export SERVER_JVMFLAGS="
>>> >>
>>> >>
>>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>>> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>>> >> -Dzookeeper.ssl.keyStore.password=testpass
>>> >>
>>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>>> >> -Dzookeeper.ssl.trustStore.password=testpass"
>>> >>
>>> >>
>>> >>
>>> >> export CLIENT_JVMFLAGS="
>>> >>
>>> >>
>>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>>> >> -Dzookeeper.client.secure=true
>>> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>>> >> -Dzookeeper.ssl.keyStore.password=testpass
>>> >>
>>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>>> >> -Dzookeeper.ssl.trustStore.password=testpass"
>>> >>
>>> >> I have started the ZK server and it is up without any issue.
>>> >>
>>> >> But now when I login to ZkCli then it gives the below error.
>>> >>
>>> >> WatchedEvent state:AuthFailed type:None path:null
>>> >>
>>> >>
>>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
>>> provider
>>> >> for scheme: ztpasswd has x509 ip digest*
>>> >>
>>> >> Please help me on this issue
>>> >>
>>> >> Thanks,
>>> >> ---------------------
>>> >> Kuldeep Singh Budania
>>> >> Software Architect
>>> >>
>>> >>
>>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
>>> kuldeep.singh08@gmail.com>
>>> >> wrote:
>>> >>
>>> >> > Hi,
>>> >> >
>>> >> > My ZK server is up and running in secure mode, But When I am
>>> trying to
>>> >> > connect to the ZK server using ZKCli, it gives the below error.
>>> >> >
>>> >> > WatchedEvent state:AuthFailed type:None path:null
>>> >> >
>>> >> >
>>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
>>> >> provider
>>> >> > for scheme: ztpasswd has x509 ip digest*
>>> >> >
>>> >> > Can someone please help me on this issue. we are using the 3.5.6
>>> >> version.
>>> >> >
>>> >> > I appreciate if I will get a response as soon as possible, as I am
>>> stuck
>>> >> > at this point.
>>> >> >
>>> >> > Thanks,
>>> >> > ---------------------
>>> >> > Kuldeep Singh Budania
>>> >> > Software Architect
>>> >> >
>>> >> >
>>> >> >
>>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli - Diennea
>>> >> > <en...@diennea.com.invalid> wrote:
>>> >> >
>>> >> >> I mean in zoo.cfg
>>> >> >> Not as a system property
>>> >> >>
>>> >> >> Enrico
>>> >> >>
>>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <
>>> >> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
>>> >> >>
>>> >> >> Hi
>>> >> >> You have to enable Netty on the server side
>>> >> >>
>>> >> >> Something like:
>>> >> >>
>>> >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>> >> >>
>>> >> >> Hope that helps
>>> >> >> Enrico
>>> >> >>
>>> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
>>> >> kuldeep.singh08@gmail.com>
>>> >> >> ha scritto:
>>> >> >>
>>> >> >> Hi,
>>> >> >>
>>> >> >> I got below error while setting SSL properties in zkEnv.sh
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >>
>>> >>
>>> ==========================================================================================
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,864 - INFO [main:QuorumPeerConfig@133]
>>> -
>>> >> >> Reading
>>> >> >> configuration from: /etc/zookeeper/zoo.cfg
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@385]
>>> -
>>> >> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@399]
>>> -
>>> >> >> secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] -
>>> Setting
>>> >> -D
>>> >> >> jdk.tls.rejectClientInitiatedRenegotiation=true to disable
>>> >> >> client-initiated
>>> >> >> TLS renegotiation
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,897 - INFO
>>> [main:DatadirCleanupManager@78]
>>> >> -
>>> >> >> autopurge.snapRetainCount set to 3
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,897 - INFO
>>> [main:DatadirCleanupManager@79]
>>> >> -
>>> >> >> autopurge.purgeInterval set to 1
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,898 - INFO [
>>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge
>>> task
>>> >> >> started.
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] -
>>> Log4j
>>> >> >> found with
>>> >> >> jmx enabled.
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,903 - INFO
>>> [PurgeTask:FileTxnSnapLog@103]
>>> >> -
>>> >> >> zookeeper.snapshot.trust.empty : false
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,910 - INFO [
>>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge
>>> task
>>> >> >> completed.
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141]
>>> -
>>> >> >> Starting quorum
>>> >> >> peer
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,983 - INFO [main:ServerCnxnFactory@135]
>>> -
>>> >> >> Using
>>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as server
>>> >> >> connection
>>> >> >> factory
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,986 - INFO
>>> [main:NIOServerCnxnFactory@673]
>>> >> -
>>> >> >> Configuring NIO connection handler with 10s sessionless
>>> >> >> connection timeout,
>>> >> >> 2 selector thread(s), 16 worker threads, and 64 kB direct
>>> >> buffers.
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,992 - INFO
>>> [main:NIOServerCnxnFactory@686
>>> >> ]
>>> >> >> - binding
>>> >> >> to port 0.0.0.0/0.0.0.0:10181
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,994 - INFO [main:ServerCnxnFactory@135]
>>> -
>>> >> >> Using
>>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as server
>>> >> >> connection
>>> >> >> factory
>>> >> >>
>>> >> >> 2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101]
>>> -
>>> >> >> Unexpected
>>> >> >> exception, exiting abnormally
>>> >> >>
>>> >> >> java.lang.UnsupportedOperationException: SSL isn't
>>> supported in
>>> >> >> NIOServerCnxn
>>> >> >>
>>> >> >> at
>>> >> >>
>>> >> >>
>>> >>
>>> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
>>> >> >>
>>> >> >> at
>>> >> >>
>>> >> >>
>>> >>
>>> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
>>> >> >>
>>> >> >> at
>>> >> >>
>>> >> >>
>>> >>
>>> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
>>> >> >>
>>> >> >> at
>>> >> >>
>>> >> >>
>>> >>
>>> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> I have set the following properties in SERVER_JVMFLAGS in
>>> >> >> zkEnv.sh file :
>>> >> >>
>>> >> >>
>>> >>
>>> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>> >> >>
>>> >> >>
>>> >>
>>> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
>>> >> >> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
>>> >> >>
>>> >> >>
>>> >>
>>> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
>>> >> >> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
>>> >> >>
>>> >> >> Thanks,
>>> >> >> ---------------------
>>> >> >> Kuldeep Singh Budania
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <
>>> >> >> jordan@jordanzimmerman.com>
>>> >> >> wrote:
>>> >> >>
>>> >> >> > It's the same as the normal ZooKeeper client:
>>> >> >> >
>>> >> >>
>>> >>
>>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>>> >> >> > <
>>> >> >> >
>>> >> >>
>>> >>
>>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>>> >> >> > >
>>> >> >> >
>>> >> >> > -Jordan
>>> >> >> >
>>> >> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep singh <
>>> >> >> kuldeep.singh08@gmail.com>
>>> >> >> > wrote:
>>> >> >> > >
>>> >> >> > > Hi Team,
>>> >> >> > > How we will do secure communication between the Curator
>>> >> >> framework and
>>> >> >> > > zookeeper 3.5.6 ?
>>> >> >> > > I didn't get any solution right now.
>>> >> >> > > I appreciate it if someone could help me with the same.
>>> >> >> > >
>>> >> >> > > Thanks,
>>> >> >> > > ---------------------
>>> >> >> > > Kuldeep Singh Budania
>>> >> >> > > Software Architect
>>> >> >> > >
>>> >> >> > >
>>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
>>> >> >> > szalay.beko.mate@gmail.com>
>>> >> >> > > wrote:
>>> >> >> > >
>>> >> >> > >> Hello Kuldeep,
>>> >> >> > >>
>>> >> >> > >> did you download the source from the ZooKeeper
>>> webpage, or
>>> >> >> checked out
>>> >> >> > from
>>> >> >> > >> git?
>>> >> >> > >> Anyway, the following commands should work:
>>> >> >> > >>
>>> >> >> > >> wget
>>> >> >> > >>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
>>> >> >> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
>>> >> >> > >> cd apache-zookeeper-3.5.7
>>> >> >> > >> mvn clean install -DskipTests
>>> >> >> > >>
>>> >> >> > >> I tested it with OpenJDK 8u424 and maven 3.6.0.
>>> >> >> > >>
>>> >> >> > >> Kind regards,
>>> >> >> > >> Mate
>>> >> >> > >>
>>> >> >> > >>
>>> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
>>> >> >> > kuldeep.singh08@gmail.com>
>>> >> >> > >> wrote:
>>> >> >> > >>
>>> >> >> > >>> Hi All,
>>> >> >> > >>>
>>> >> >> > >>> I have download the zookeeper source code and run
>>> the mvn
>>> >> >> command for
>>> >> >> > >>> packaging but get problem on "zookeeper-server"
>>> >> directory.
>>> >> >> > >>>
>>> >> >> > >>> *command :- mvn clean package*
>>> >> >> > >>>
>>> >> >> > >>> [ERROR] Failed to execute goal
>>> >> >> > >>>
>>> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>>> >> >> > >>> (default-compile) on project zookeeper: Fatal error
>>> >> >> compiling:
>>> >> >> > >>> java.lang.NullPointerException -> [Help 1]
>>> >> >> > >>>
>>> org.apache.maven.lifecycle.LifecycleExecutionException:
>>> >> >> Failed to
>>> >> >> > execute
>>> >> >> > >>> goal
>>> >> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>>> >> >> > >>> (default-compile) on project zookeeper: Fatal error
>>> >> >> compiling
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
>>> >> >> > >>> at
>>> >> >> >
>>> >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
>>> >> >> > >>> at
>>> >> >> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
>>> >> >> > >>> at
>>> >> >> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
>>> >> >> > >>> at
>>> >> >> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
>>> >> >> > >>> at
>>> >> >> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
>>> >> >> > >>> at
>>> >> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> >> >> > >>> at
>>> >> java.lang.reflect.Method.invoke(Method.java:498)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>>> >> >> > >>> Caused by:
>>> >> org.apache.maven.plugin.MojoExecutionException:
>>> >> >> Fatal error
>>> >> >> > >>> compiling
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>>> >> >> > >>> ... 19 more
>>> >> >> > >>> Caused by:
>>> >> org.codehaus.plexus.compiler.CompilerException:
>>> >> >> > >>> java.lang.NullPointerException
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
>>> >> >> > >>> ... 22 more
>>> >> >> > >>> Caused by: java.lang.RuntimeException:
>>> >> >> java.lang.NullPointerException
>>> >> >> > >>> at
>>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:559)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >>
>>> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
>>> >> >> > >>> ... 24 more
>>> >> >> > >>> Caused by: java.lang.NullPointerException
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
>>> >> >> > >>> at
>>> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
>>> >> >> > >>> at
>>> >> >> com.sun.tools.doclint.Checker.scan(Checker.java:144)
>>> >> >> > >>> at
>>> >> >> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> >
>>> >> >>
>>> >>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> >
>>> >> >>
>>> >>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >>
>>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>>> >> >> > >>> at
>>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>>> >> >> > >>> at
>>> >> >> > >>
>>> >> >> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> >> >> > >>> at
>>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> >
>>> >> >>
>>> >>
>>> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> >> >> > >>> at
>>> >> >> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >>
>>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >>
>>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
>>> >> >> > >>> at
>>> >> >> > >>>
>>> >> >>
>>> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
>>> >> >> > >>> at
>>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:523)
>>> >> >> > >>> ... 27 more
>>> >> >> > >>> [ERROR]
>>> >> >> > >>> [ERROR] Re-run Maven using the -X switch to enable
>>> full
>>> >> >> debug logging.
>>> >> >> > >>> [ERROR]
>>> >> >> > >>> [ERROR] For more information about the errors and
>>> >> possible
>>> >> >> solutions,
>>> >> >> > >>> please read the following articles:
>>> >> >> > >>> [ERROR] [Help 1]
>>> >> >> > >>>
>>> >> >> >
>>> >> >>
>>> >>
>>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>>> >> >> > >>>
>>> >> >> > >>> Can someone help me on this issue?
>>> >> >> > >>>
>>> >> >> > >>> Thanks,
>>> >> >> > >>> ---------------------
>>> >> >> > >>> Kuldeep Singh Budania
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>>
>>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
>>> >> >> > >>> szalay.beko.mate@gmail.com>
>>> >> >> > >>> wrote:
>>> >> >> > >>>
>>> >> >> > >>>> these exceptions can mean many things... I think
>>> this
>>> >> can
>>> >> >> be even
>>> >> >> > >> normal
>>> >> >> > >>>> duding rolling restart (as some connections get
>>> broken
>>> >> in
>>> >> >> this case)
>>> >> >> > >>>>
>>> >> >> > >>>> However, I saw cases already when exceptions like
>>> these
>>> >> >> killed
>>> >> >> > receiver
>>> >> >> > >>> or
>>> >> >> > >>>> sender threads in QuorumCnxManager / Leader
>>> Election in
>>> >> >> such a way
>>> >> >> > that
>>> >> >> > >>>> they were not able to recover, so the node was
>>> unable to
>>> >> >> connect to
>>> >> >> > any
>>> >> >> > >>>> quorum until restart. I remember seeing this in 3.4
>>> too.
>>> >> >> > >>>>
>>> >> >> > >>>> Do you see these exceptions in the second server
>>> (the
>>> >> one
>>> >> >> which you
>>> >> >> > >> just
>>> >> >> > >>>> upgraded in step 3)?
>>> >> >> > >>>> Is this issue reproducible?
>>> >> >> > >>>>
>>> >> >> > >>>> What is the tickTime and initLimit you use? Maybe
>>> the
>>> >> >> server just
>>> >> >> > >> require
>>> >> >> > >>>> more time to sync?
>>> >> >> > >>>>
>>> >> >> > >>>> I would need more logs to really see what happened.
>>> Can
>>> >> >> you create a
>>> >> >> > >> Jira
>>> >> >> > >>>> issue and upload the logs and also the ZooKeeper
>>> >> configs?
>>> >> >> I am happy
>>> >> >> > to
>>> >> >> > >>>> take a closer look.
>>> >> >> > >>>> (if you need to re-run the test to collect the logs,
>>> >> then
>>> >> >> enabling
>>> >> >> > >> DEBUG
>>> >> >> > >>>> logs would be great. The INFO level logs are usually
>>> >> >> enough for these
>>> >> >> > >>>> problems, but one can never know...)
>>> >> >> > >>>>
>>> >> >> > >>>> Kind regards,
>>> >> >> > >>>> Mate
>>> >> >> > >>>>
>>> >> >> > >>>>
>>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
>>> >> >> > >> kuldeep.singh08@gmail.com
>>> >> >> > >>>>
>>> >> >> > >>>> wrote:
>>> >> >> > >>>>
>>> >> >> > >>>>> Hi Team,
>>> >> >> > >>>>>
>>> >> >> > >>>>> I have done some POC on rolling upgrade and found
>>> below
>>> >> >> result.
>>> >> >> > >>>>>
>>> >> >> > >>>>>
>>> >> >> > >>>>> 1. On 1st node upgrade zookeeper . Traffic was
>>> >> running
>>> >> >> fine
>>> >> >> > >> because
>>> >> >> > >>> 2
>>> >> >> > >>>>> nodes are already on old zookeeper.
>>> >> >> > >>>>> 2. On 1st node upgrade our application and didn’t
>>> >> find
>>> >> >> any issue
>>> >> >> > >>>>> 3. On 2nd node upgrade zookeeper but got below
>>> error
>>> >> >> and zookeeper
>>> >> >> > >>> is
>>> >> >> > >>>>> not taking any requests
>>> >> >> > >>>>> 4.
>>> >> >> > >>>>>
>>> >> >> > >>>>> java.io.EOFException
>>> >> >> > >>>>>
>>> >> >> > >>>>> at
>>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
>>> >> >> > >>>>>
>>> >> >> > >>>>> at
>>> >> >> > >>>>>
>>> >> >> > >>>>>
>>> >> >> > >>>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
>>> >> >> > >>>>>
>>> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
>>> >> >> > >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765] -
>>> >> >> Interrupting
>>> >> >> > >>> SendWorker
>>> >> >> > >>>>>
>>> >> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/
>>> >> >> 192.168.44.73:33754
>>> >> >> > >>>>> :LearnerHandler@562] - Unexpected exception
>>> causing
>>> >> >> shutdown while
>>> >> >> > >>> sock
>>> >> >> > >>>>> still open
>>> >> >> > >>>>>
>>> >> >> > >>>>> java.io.EOFException
>>> >> >> > >>>>>
>>> >> >> > >>>>> at
>>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
>>> >> >> > >>>>>
>>> >> >> > >>>>> at
>>> >> >> > >>>>>
>>> >> >> > >>
>>> >> >>
>>> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
>>> >> >> > >>>>>
>>> >> >> > >>>>> at
>>> >> >> > >>>>>
>>> >> >> > >>>>>
>>> >> >> > >>>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
>>> >> >> > >>>>>
>>> >> >> > >>>>> at
>>> >> >> > >>>>>
>>> >> >> > >>>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
>>> >> >> > >>>>>
>>> >> >> > >>>>> at
>>> >> >> > >>>>>
>>> >> >> > >>>>>
>>> >> >> > >>>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >>
>>> >>
>>> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
>>> >> >> > >>>>>
>>> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
>>> >> >> > >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679] -
>>> >> >> Interrupted while
>>> >> >> > >>>> waiting
>>> >> >> > >>>>> for message on queue
>>> >> >> > >>>>>
>>> >> >> > >>>>> Please let me know is this the known issue or this
>>> is
>>> >> >> different issue
>>> >> >> > >>>> which
>>> >> >> > >>>>> is mention in Apache zookeeper documentation when
>>> >> >> upgrading from
>>> >> >> > >> 3.4.5
>>> >> >> > >>> to
>>> >> >> > >>>>> 3.5.6
>>> >> >> > >>>>>
>>> >> >> > >>>>> Thanks,
>>> >> >> > >>>>> ---------------------
>>> >> >> > >>>>> Kuldeep Singh Budania
>>> >> >> > >>>>> Software Architect
>>> >> >> > >>>>>
>>> >> >> > >>>>>
>>> >> >> > >>>>>
>>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer <
>>> >> >> shralex@gmail.com>
>>> >> >> > >>>>> wrote:
>>> >> >> > >>>>>
>>> >> >> > >>>>>> +1 to what Mate said (I wrote the quoted
>>> >> instructions).
>>> >> >> > >>>>>>
>>> >> >> > >>>>>>
>>> >> >> > >>>>>>
>>> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő Máté <
>>> >> >> > >>>>>> szalay.beko.mate@gmail.com>
>>> >> >> > >>>>>> wrote:
>>> >> >> > >>>>>>
>>> >> >> > >>>>>>> Hi Kuldeep,
>>> >> >> > >>>>>>>
>>> >> >> > >>>>>>> I just want to provide you some background info
>>> about
>>> >> >> our
>>> >> >> > >>>>> documentation.
>>> >> >> > >>>>>>> The reason to upgrade to 3.4.6 first is to avoid
>>> the
>>> >> >> following
>>> >> >> > >>> error:
>>> >> >> > >>>>>>>
>>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
>>> [localhost/
>>> >> >> > >>> 127.0.0.1:2784
>>> >> >> > >>>>>>> :QuorumCnxManager@349] - Invalid server id:
>>> -65536
>>> >> >> > >>>>>>>
>>> >> >> > >>>>>>> This error comes because of the protocol changes
>>> >> between
>>> >> >> > >> ZooKeeper
>>> >> >> > >>>>> server
>>> >> >> > >>>>>>> nodes during connection initiation for leader
>>> >> election.
>>> >> >> In
>>> >> >> > >>> ZooKeeper
>>> >> >> > >>>>> 3.5
>>> >> >> > >>>>>> a
>>> >> >> > >>>>>>> protocol version was introduced (see
>>> ZOOKEEPER-107)
>>> >> and
>>> >> >> since
>>> >> >> > >> that
>>> >> >> > >>>> time
>>> >> >> > >>>>>> the
>>> >> >> > >>>>>>> fist long value sent in the initial message is
>>> not
>>> >> the
>>> >> >> server ID
>>> >> >> > >>> but
>>> >> >> > >>>>> the
>>> >> >> > >>>>>>> protocol version (-65536). In ZooKeeper 3.4.6 we
>>> made
>>> >> >> the old 3.4
>>> >> >> > >>>>>>> ZooKeepers backward compatible, so they are able
>>> to
>>> >> >> parse both
>>> >> >> > >> the
>>> >> >> > >>>> old
>>> >> >> > >>>>>> and
>>> >> >> > >>>>>>> the new protocol format (see ZOOKEEPER-1633).
>>> This
>>> >> >> issue happens
>>> >> >> > >>> only
>>> >> >> > >>>>>> when
>>> >> >> > >>>>>>> you need to use old (3.4.0 - 3.4.5) and new
>>> (3.5.0+)
>>> >> >> ZooKeeper
>>> >> >> > >>>> servers
>>> >> >> > >>>>>>> together in the same cluster. During a rolling
>>> >> upgrade,
>>> >> >> this is
>>> >> >> > >>>> usually
>>> >> >> > >>>>>> the
>>> >> >> > >>>>>>> case to have old and new ZooKeepers present
>>> together.
>>> >> >> > >>>>>>>
>>> >> >> > >>>>>>> The fact that you haven't seen any issues might
>>> be
>>> >> >> caused by the
>>> >> >> > >>>> order
>>> >> >> > >>>>> of
>>> >> >> > >>>>>>> the servers. In ZooKeeper the connection
>>> initiation
>>> >> >> between the
>>> >> >> > >>>> servers
>>> >> >> > >>>>>>> during the leader election follows a specific
>>> rule.
>>> >> As
>>> >> >> far as I
>>> >> >> > >>>>> remember
>>> >> >> > >>>>>>> always the server with the larger ID 'wins the
>>> >> >> challenge', so it
>>> >> >> > >> is
>>> >> >> > >>>>>>> possible, that the old server didn't need to
>>> parse
>>> >> any
>>> >> >> initial
>>> >> >> > >>>> message
>>> >> >> > >>>>>> (if
>>> >> >> > >>>>>>> it had the largest ID) and this is why you
>>> haven't
>>> >> seen
>>> >> >> the
>>> >> >> > >> issue.
>>> >> >> > >>>> Also
>>> >> >> > >>>>>>> having 2 nodes up from the 3 nodes cluster still
>>> >> makes
>>> >> >> the
>>> >> >> > >> cluster
>>> >> >> > >>>> work
>>> >> >> > >>>>>> (so
>>> >> >> > >>>>>>> you should also check if all the servers are
>>> part of
>>> >> >> the quorum).
>>> >> >> > >>>>>>>
>>> >> >> > >>>>>>> I agree with Enrico and Norbert, the safest and
>>> most
>>> >> >> stable way
>>> >> >> > >> is
>>> >> >> > >>>>>> upgrade
>>> >> >> > >>>>>>> first to 3.4.latest, then go to 3.5.latest.
>>> Still, if
>>> >> >> you don't
>>> >> >> > >> see
>>> >> >> > >>>>> that
>>> >> >> > >>>>>>> you would hit this specific issue (e.g. no
>>> "Invalid
>>> >> >> server id" in
>>> >> >> > >>> the
>>> >> >> > >>>>> log
>>> >> >> > >>>>>>> files), and all the three servers can handle
>>> traffic,
>>> >> >> then maybe
>>> >> >> > >>> you
>>> >> >> > >>>>>> don't
>>> >> >> > >>>>>>> need to upgrade first to 3.4.latest, it is your
>>> >> >> decision.
>>> >> >> > >>> Definitely
>>> >> >> > >>>>> you
>>> >> >> > >>>>>>> should test it first, as suggested by the others.
>>> >> >> > >>>>>>>
>>> >> >> > >>>>>>> Kind regards,
>>> >> >> > >>>>>>> Mate
>>> >> >> > >>>>>>>
>>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
>>> >> >> > >>>>>>> <nk...@cloudera.com.invalid> wrote:
>>> >> >> > >>>>>>>
>>> >> >> > >>>>>>>> Hi,
>>> >> >> > >>>>>>>>
>>> >> >> > >>>>>>>> That guide is to upgrade to 3.5.0, which was an
>>> >> alpha
>>> >> >> version.
>>> >> >> > >> A
>>> >> >> > >>>> lot
>>> >> >> > >>>>>> has
>>> >> >> > >>>>>>>> changed for the first stable release of 3.5.5
>>> and
>>> >> then
>>> >> >> a few
>>> >> >> > >>> more,
>>> >> >> > >>>>> even
>>> >> >> > >>>>>>>> rolling upgrade issues have been fixed for
>>> 3.5.6.
>>> >> >> > >>>>>>>> This is a more up-to-date guide:
>>> >> >> > >>>>>>>>
>>> >> >> > >>>
>>> >> >> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
>>> >> >> > >>>>>>>>
>>> >> >> > >>>>>>>> If you have done your testing (with prod
>>> snapshot!),
>>> >> >> then you
>>> >> >> > >> can
>>> >> >> > >>>>> skip
>>> >> >> > >>>>>>> 3.4
>>> >> >> > >>>>>>>> latest upgrade, but keep in mind we do our
>>> >> >> recommendations for
>>> >> >> > >> a
>>> >> >> > >>>>>> reason.
>>> >> >> > >>>>>>>> There were issues reported and/or found during
>>> >> >> testing. Some
>>> >> >> > >> are
>>> >> >> > >>>>> fixed
>>> >> >> > >>>>>>> with
>>> >> >> > >>>>>>>> 3.5.6, some only happens if certain conditions
>>> stand
>>> >> >> > >>> (IOException:
>>> >> >> > >>>> No
>>> >> >> > >>>>>>>> snapshot found - mentioned in the guide, fixed
>>> in
>>> >> >> 3.5.6).
>>> >> >> > >>>>>>>>
>>> >> >> > >>>>>>>> So it is up to you, I would still recommend to
>>> do an
>>> >> >> 3.4
>>> >> >> > >> upgrade
>>> >> >> > >>>>> first,
>>> >> >> > >>>>>>> if
>>> >> >> > >>>>>>>> it's feasible.
>>> >> >> > >>>>>>>>
>>> >> >> > >>>>>>>> Regards,
>>> >> >> > >>>>>>>> Norbert
>>> >> >> > >>>>>>>>
>>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep singh <
>>> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
>>> >> >> > >>>>>>>> wrote:
>>> >> >> > >>>>>>>>
>>> >> >> > >>>>>>>>> Hi,
>>> >> >> > >>>>>>>>>
>>> >> >> > >>>>>>>>> Current Zookeeper version :- 3.4.5
>>> >> >> > >>>>>>>>> Upgraded version :- 3.5.6
>>> >> >> > >>>>>>>>>
>>> >> >> > >>>>>>>>> We are not going with 3.5.7. Our final
>>> decision is
>>> >> >> zookeeper
>>> >> >> > >>>>> version
>>> >> >> > >>>>>> is
>>> >> >> > >>>>>>>>> 3.5.6
>>> >> >> > >>>>>>>>> as per your reply first we need to move latest
>>> >> >> version of
>>> >> >> > >>> 3.4.x,
>>> >> >> > >>>>> like
>>> >> >> > >>>>>>>> below
>>> >> >> > >>>>>>>>>
>>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am
>>> wrong
>>> >> >> here)
>>> >> >> > >>>>>>>>>
>>> >> >> > >>>>>>>>> But if We are not facing any problem that i
>>> have
>>> >> >> shared you
>>> >> >> > >>> that
>>> >> >> > >>>> we
>>> >> >> > >>>>>>> have
>>> >> >> > >>>>>>>>> set up of 3 node cluster where 2 node are on
>>> 3.5.6
>>> >> >> version
>>> >> >> > >> and
>>> >> >> > >>> 1
>>> >> >> > >>>>> node
>>> >> >> > >>>>>>> on
>>> >> >> > >>>>>>>>> 3.4.5, Everything is running fine and didn't
>>> get
>>> >> any
>>> >> >> issue,
>>> >> >> > >> So
>>> >> >> > >>>> what
>>> >> >> > >>>>>>> other
>>> >> >> > >>>>>>>>> problem we can face if we directly move to
>>> 3.5.6
>>> >> >> > >>>>>>>>>
>>> >> >> > >>>>>>>>> Thanks,
>>> >> >> > >>>>>>>>> ---------------------
>>> >> >> > >>>>>>>>> Kuldeep Singh Budania
>>> >> >> > >>>>>>>>> Software Architect
>>> >> >> > >>>>>>>>>
>>> >> >> > >>>>>>>>>
>>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico
>>> Olivelli <
>>> >> >> > >>>>> eolivelli@gmail.com
>>> >> >> > >>>>>>>
>>> >> >> > >>>>>>>>> wrote:
>>> >> >> > >>>>>>>>>
>>> >> >> > >>>>>>>>>> Hi
>>> >> >> > >>>>>>>>>> You have to upgrade to latest 3.4.x Zookeeper
>>> then
>>> >> >> you will
>>> >> >> > >>>>> upgrade
>>> >> >> > >>>>>>> to
>>> >> >> > >>>>>>>>>> 3.5.7.
>>> >> >> > >>>>>>>>>> All should run well without issues
>>> >> >> > >>>>>>>>>>
>>> >> >> > >>>>>>>>>>
>>> >> >> > >>>>>>>>>> Enrico
>>> >> >> > >>>>>>>>>>
>>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
>>> >> >> > >>>>> kuldeep.singh08@gmail.com
>>> >> >> > >>>>>>>
>>> >> >> > >>>>>>> ha
>>> >> >> > >>>>>>>>>> scritto:
>>> >> >> > >>>>>>>>>>
>>> >> >> > >>>>>>>>>>> Hi Team,
>>> >> >> > >>>>>>>>>>>
>>> >> >> > >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to
>>> 3.5.6. I
>>> >> >> have
>>> >> >> > >> set
>>> >> >> > >>>> up 3
>>> >> >> > >>>>>>> node
>>> >> >> > >>>>>>>>>>> cluster where 2 node are on 3.5.6 version
>>> and 1
>>> >> >> node on
>>> >> >> > >>>> 3.4.5.
>>> >> >> > >>>>>>>>>>>
>>> >> >> > >>>>>>>>>>> Everything is running fine and didn't get any
>>> >> issue
>>> >> >> on my
>>> >> >> > >>>>> system.
>>> >> >> > >>>>>>>>>>>
>>> >> >> > >>>>>>>>>>> but I found something on apache site that
>>> first
>>> >> we
>>> >> >> need
>>> >> >> > >> to
>>> >> >> > >>>>>> upgrade
>>> >> >> > >>>>>>>> on
>>> >> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is it
>>> >> >> mandatory
>>> >> >> > >> to
>>> >> >> > >>> go
>>> >> >> > >>>>> on
>>> >> >> > >>>>>>>> 3.4.6
>>> >> >> > >>>>>>>>>>> first.
>>> >> >> > >>>>>>>>>>>
>>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
>>> >> >> > >>>>>>>>>>>
>>> >> >> > >>>>>>>>>>> Upgrading a running ZooKeeper ensemble to
>>> 3.5.0
>>> >> >> should be
>>> >> >> > >>>> done
>>> >> >> > >>>>>> only
>>> >> >> > >>>>>>>>> after
>>> >> >> > >>>>>>>>>>> upgrading your ensemble to the 3.4.6 release.
>>> >> Note
>>> >> >> that
>>> >> >> > >>> this
>>> >> >> > >>>> is
>>> >> >> > >>>>>>> only
>>> >> >> > >>>>>>>>>>> necessary for rolling upgrades (if you're
>>> fine
>>> >> with
>>> >> >> > >>> shutting
>>> >> >> > >>>>> down
>>> >> >> > >>>>>>> the
>>> >> >> > >>>>>>>>>>> system completely, you don't have to go
>>> through
>>> >> >> 3.4.6).
>>> >> >> > >> If
>>> >> >> > >>>> you
>>> >> >> > >>>>>>>> attempt
>>> >> >> > >>>>>>>>> a
>>> >> >> > >>>>>>>>>>> rolling upgrade without going through 3.4.6
>>> (for
>>> >> >> example
>>> >> >> > >>> from
>>> >> >> > >>>>>>> 3.4.5),
>>> >> >> > >>>>>>>>> you
>>> >> >> > >>>>>>>>>>> may get the following error:
>>> >> >> > >>>>>>>>>>>
>>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO
>>> >> [localhost/
>>> >> >> > >>>>>> 127.0.0.1:2784
>>> >> >> > >>>>>>>>>>> :QuorumCnxManager$Listener@498] - Received
>>> >> >> connection
>>> >> >> > >>>> request
>>> >> >> > >>>>> /
>>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
>>> >> >> > >>>>>>>>>>>
>>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
>>> >> [localhost/
>>> >> >> > >>>>>> 127.0.0.1:2784
>>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server id:
>>> >> -65536
>>> >> >> > >>>>>>>>>>>
>>> >> >> > >>>>>>>>>>> During a rolling upgrade, each server is
>>> taken
>>> >> down
>>> >> >> in
>>> >> >> > >> turn
>>> >> >> > >>>> and
>>> >> >> > >>>>>>>>> rebooted
>>> >> >> > >>>>>>>>>>> with the new 3.5.0 binaries. Before starting
>>> the
>>> >> >> server
>>> >> >> > >>> with
>>> >> >> > >>>>>> 3.5.0
>>> >> >> > >>>>>>>>>>> binaries, we highly recommend updating the
>>> >> >> configuration
>>> >> >> > >>> file
>>> >> >> > >>>>> so
>>> >> >> > >>>>>>> that
>>> >> >> > >>>>>>>>> all
>>> >> >> > >>>>>>>>>>> server statements "server.x=..." contain
>>> client
>>> >> >> ports
>>> >> >> > >> (see
>>> >> >> > >>>> the
>>> >> >> > >>>>>>>> section
>>> >> >> > >>>>>>>>>>> Specifying
>>> >> >> > >>>>>>>>>>> the client port). As explained earlier you
>>> may
>>> >> >> leave the
>>> >> >> > >>>>>>>> configuration
>>> >> >> > >>>>>>>>>> in a
>>> >> >> > >>>>>>>>>>> single file, as well as leave the
>>> >> >> > >>>> clientPort/clientPortAddress
>>> >> >> > >>>>>>>>> statements
>>> >> >> > >>>>>>>>>>> (although if you specify client ports in the
>>> new
>>> >> >> format,
>>> >> >> > >>>> these
>>> >> >> > >>>>>>>>> statements
>>> >> >> > >>>>>>>>>>> are now redundant).
>>> >> >> > >>>>>>>>>>>
>>> >> >> > >>>>>>>>>>> Could you please let me know about this case.
>>> >> >> Appreciate
>>> >> >> > >> if
>>> >> >> > >>>>>> respond
>>> >> >> > >>>>>>>>> soon.
>>> >> >> > >>>>>>>>>>>
>>> >> >> > >>>>>>>>>>> Thanks,
>>> >> >> > >>>>>>>>>>> ---------------------
>>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
>>> >> >> > >>>>>>>>>>>
>>> >> >> > >>>>>>>>>>
>>> >> >> > >>>>>>>>>
>>> >> >> > >>>>>>>>
>>> >> >> > >>>>>>>
>>> >> >> > >>>>>>
>>> >> >> > >>>>>
>>> >> >> > >>>>
>>> >> >> > >>>
>>> >> >> > >>
>>> >> >> >
>>> >> >> >
>>> >> >>
>>> >> >>
>>> >> >> ________________________________
>>> >> >>
>>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>>> >> >> This e-mail (including any attachments) is strictly
>>> confidential
>>> >> and
>>> >> >> may also contain privileged information. If you are not the
>>> intended
>>> >> >> recipient you are not authorised to read, print, save, process or
>>> >> disclose
>>> >> >> this message. If you have received this message by mistake, please
>>> >> inform
>>> >> >> the sender immediately and destroy this e-mail, its attachments
>>> and any
>>> >> >> copies. Any use, distribution, reproduction or disclosure by any
>>> person
>>> >> >> other than the intended recipient is strictly prohibited and the
>>> person
>>> >> >> responsible may incur in penalties.
>>> >> >> The use of this e-mail is only for professional purposes;
>>> there is
>>> >> no
>>> >> >> guarantee that the correspondence towards this e-mail will be read
>>> >> only by
>>> >> >> the recipient, because, under certain circumstances, there may be a
>>> >> need to
>>> >> >> access this email by third subjects belonging to the Company.
>>> >> >>
>>> >> >>
>>> >> >> ________________________________
>>> >> >>
>>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>>> >> >> This e-mail (including any attachments) is strictly confidential
>>> and
>>> >> may
>>> >> >> also contain privileged information. If you are not the intended
>>> >> recipient
>>> >> >> you are not authorised to read, print, save, process or disclose
>>> this
>>> >> >> message. If you have received this message by mistake, please
>>> inform
>>> >> the
>>> >> >> sender immediately and destroy this e-mail, its attachments and any
>>> >> copies.
>>> >> >> Any use, distribution, reproduction or disclosure by any person
>>> other
>>> >> than
>>> >> >> the intended recipient is strictly prohibited and the person
>>> >> responsible
>>> >> >> may incur in penalties.
>>> >> >> The use of this e-mail is only for professional purposes; there is
>>> no
>>> >> >> guarantee that the correspondence towards this e-mail will be read
>>> >> only by
>>> >> >> the recipient, because, under certain circumstances, there may be a
>>> >> need to
>>> >> >> access this email by third subjects belonging to the Company.
>>> >> >>
>>> >> >
>>> >>
>>> >
>>>
>>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Hi Team,
Any update on this?
Thanks,
---------------------
Kuldeep Singh Budania
On Wed, Jul 1, 2020 at 6:43 PM kuldeep singh <ku...@gmail.com>
wrote:
> Sorry this is my bad, there were server setting like below
>
> export SERVER_JVMFLAGS="
>
>
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> -Dzookeeper.ssl.keyStore.password=testpass
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> -Dzookeeper.ssl.trustStore.password=testpass"
>
>
>
> export CLIENT_JVMFLAGS="
>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> -Dzookeeper.client.secure=true
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> -Dzookeeper.ssl.keyStore.password=testpass
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> -Dzookeeper.ssl.trustStore.password=testpass"
>
> I want to have SSL between client to server communication
>
> I am already following the same link which you have shared with me but
> that is not working.
>
> Zoo.cfg
>
> secureClientPort=2281
> initLimit=10
> syncLimit=5
> dataDir=/var/lib/zookeeper/data
> tickTime=2000
> autopurge.snapRetainCount=3
> autopurge.purgeInterval=1
> admin.enableServer=false
> standaloneEnabled=false
> jute.maxbuffer=2147483648
> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> server.1=host1_priv:10288:10388
> server.2=host2_priv:10288:10388
> server.3=host3_priv:10288:10388
>
>
> command to connect using zkcli
>
> 1. zkcli zoo.cfg localhost:2281
> 2. addauth ztpasswd usernaem:password
>
> after second step we are getting below error
>
> WatchedEvent state:AuthFailed type:None path:null
>
>
> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication provider
> for scheme: ztpasswd has x509 ip digest*
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <
> szalay.beko.mate@gmail.com> wrote:
>
>> > No authentication provider for scheme: ztpasswd has x509 ip digest*
>>
>> This suggest you have some configuration error... Where did you use the
>> "ztpasswd" string in your configs / commands?
>>
>> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
>> szalay.beko.mate@gmail.com>
>> wrote:
>>
>> > > My ZK server is up and running in secure mode
>> >
>> > What is your goal? You want to setup client-server SSL connection?
>> >
>> > see:
>> >
>> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
>> >
>> > (or you want to have both SSL and SASL enabled?)
>> >
>> > Anyway, please remove the following line from the SERVER_JVMFLAGS:
>> > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> > This is a configuration that makes sense only for the ZooKeeper client,
>> > not for the server. For the server, use the following:
>> >
>> >
>> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> >
>> > If it doesn't solve the issue, then can you please send your zoo.cfg
>> file?
>> > Also can you please send the zkCli command you execute? (you need to
>> > connect to the secure ZooKeeper port, unless portUnification is enabled)
>> >
>> > Kind regards,
>> > Mate
>> >
>> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <kuldeep.singh08@gmail.com
>> >
>> > wrote:
>> >
>> >> Hi,
>> >>
>> >> we have done below changes in java.env file
>> >>
>> >> export SERVER_JVMFLAGS="
>> >>
>> >> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> >> -Dzookeeper.ssl.keyStore.password=testpass
>> >>
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> >> -Dzookeeper.ssl.trustStore.password=testpass"
>> >>
>> >>
>> >>
>> >> export CLIENT_JVMFLAGS="
>> >>
>> >> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> >> -Dzookeeper.client.secure=true
>> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> >> -Dzookeeper.ssl.keyStore.password=testpass
>> >>
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> >> -Dzookeeper.ssl.trustStore.password=testpass"
>> >>
>> >> I have started the ZK server and it is up without any issue.
>> >>
>> >> But now when I login to ZkCli then it gives the below error.
>> >>
>> >> WatchedEvent state:AuthFailed type:None path:null
>> >>
>> >>
>> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
>> provider
>> >> for scheme: ztpasswd has x509 ip digest*
>> >>
>> >> Please help me on this issue
>> >>
>> >> Thanks,
>> >> ---------------------
>> >> Kuldeep Singh Budania
>> >> Software Architect
>> >>
>> >>
>> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
>> kuldeep.singh08@gmail.com>
>> >> wrote:
>> >>
>> >> > Hi,
>> >> >
>> >> > My ZK server is up and running in secure mode, But When I am trying
>> to
>> >> > connect to the ZK server using ZKCli, it gives the below error.
>> >> >
>> >> > WatchedEvent state:AuthFailed type:None path:null
>> >> >
>> >> >
>> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
>> >> provider
>> >> > for scheme: ztpasswd has x509 ip digest*
>> >> >
>> >> > Can someone please help me on this issue. we are using the 3.5.6
>> >> version.
>> >> >
>> >> > I appreciate if I will get a response as soon as possible, as I am
>> stuck
>> >> > at this point.
>> >> >
>> >> > Thanks,
>> >> > ---------------------
>> >> > Kuldeep Singh Budania
>> >> > Software Architect
>> >> >
>> >> >
>> >> >
>> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli - Diennea
>> >> > <en...@diennea.com.invalid> wrote:
>> >> >
>> >> >> I mean in zoo.cfg
>> >> >> Not as a system property
>> >> >>
>> >> >> Enrico
>> >> >>
>> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <
>> >> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
>> >> >>
>> >> >> Hi
>> >> >> You have to enable Netty on the server side
>> >> >>
>> >> >> Something like:
>> >> >>
>> >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> >> >>
>> >> >> Hope that helps
>> >> >> Enrico
>> >> >>
>> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
>> >> kuldeep.singh08@gmail.com>
>> >> >> ha scritto:
>> >> >>
>> >> >> Hi,
>> >> >>
>> >> >> I got below error while setting SSL properties in zkEnv.sh
>> >> >>
>> >> >>
>> >> >>
>> >> >>
>> >> >>
>> >>
>> ==========================================================================================
>> >> >>
>> >> >> 2020-06-24 15:49:35,864 - INFO [main:QuorumPeerConfig@133]
>> -
>> >> >> Reading
>> >> >> configuration from: /etc/zookeeper/zoo.cfg
>> >> >>
>> >> >> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@385]
>> -
>> >> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
>> >> >>
>> >> >> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@399]
>> -
>> >> >> secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
>> >> >>
>> >> >> 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] -
>> Setting
>> >> -D
>> >> >> jdk.tls.rejectClientInitiatedRenegotiation=true to disable
>> >> >> client-initiated
>> >> >> TLS renegotiation
>> >> >>
>> >> >> 2020-06-24 15:49:35,897 - INFO
>> [main:DatadirCleanupManager@78]
>> >> -
>> >> >> autopurge.snapRetainCount set to 3
>> >> >>
>> >> >> 2020-06-24 15:49:35,897 - INFO
>> [main:DatadirCleanupManager@79]
>> >> -
>> >> >> autopurge.purgeInterval set to 1
>> >> >>
>> >> >> 2020-06-24 15:49:35,898 - INFO [
>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge task
>> >> >> started.
>> >> >>
>> >> >> 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] -
>> Log4j
>> >> >> found with
>> >> >> jmx enabled.
>> >> >>
>> >> >> 2020-06-24 15:49:35,903 - INFO
>> [PurgeTask:FileTxnSnapLog@103]
>> >> -
>> >> >> zookeeper.snapshot.trust.empty : false
>> >> >>
>> >> >> 2020-06-24 15:49:35,910 - INFO [
>> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge task
>> >> >> completed.
>> >> >>
>> >> >> 2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141] -
>> >> >> Starting quorum
>> >> >> peer
>> >> >>
>> >> >> 2020-06-24 15:49:35,983 - INFO [main:ServerCnxnFactory@135]
>> -
>> >> >> Using
>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as server
>> >> >> connection
>> >> >> factory
>> >> >>
>> >> >> 2020-06-24 15:49:35,986 - INFO
>> [main:NIOServerCnxnFactory@673]
>> >> -
>> >> >> Configuring NIO connection handler with 10s sessionless
>> >> >> connection timeout,
>> >> >> 2 selector thread(s), 16 worker threads, and 64 kB direct
>> >> buffers.
>> >> >>
>> >> >> 2020-06-24 15:49:35,992 - INFO
>> [main:NIOServerCnxnFactory@686
>> >> ]
>> >> >> - binding
>> >> >> to port 0.0.0.0/0.0.0.0:10181
>> >> >>
>> >> >> 2020-06-24 15:49:35,994 - INFO [main:ServerCnxnFactory@135]
>> -
>> >> >> Using
>> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as server
>> >> >> connection
>> >> >> factory
>> >> >>
>> >> >> 2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101] -
>> >> >> Unexpected
>> >> >> exception, exiting abnormally
>> >> >>
>> >> >> java.lang.UnsupportedOperationException: SSL isn't
>> supported in
>> >> >> NIOServerCnxn
>> >> >>
>> >> >> at
>> >> >>
>> >> >>
>> >>
>> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
>> >> >>
>> >> >> at
>> >> >>
>> >> >>
>> >>
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
>> >> >>
>> >> >> at
>> >> >>
>> >> >>
>> >>
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
>> >> >>
>> >> >> at
>> >> >>
>> >> >>
>> >>
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
>> >> >>
>> >> >>
>> >> >>
>> >> >>
>> >> >>
>> >> >> I have set the following properties in SERVER_JVMFLAGS in
>> >> >> zkEnv.sh file :
>> >> >>
>> >> >>
>> >>
>> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> >> >>
>> >> >>
>> >>
>> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
>> >> >> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
>> >> >>
>> >> >>
>> >>
>> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
>> >> >> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
>> >> >>
>> >> >> Thanks,
>> >> >> ---------------------
>> >> >> Kuldeep Singh Budania
>> >> >>
>> >> >>
>> >> >>
>> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <
>> >> >> jordan@jordanzimmerman.com>
>> >> >> wrote:
>> >> >>
>> >> >> > It's the same as the normal ZooKeeper client:
>> >> >> >
>> >> >>
>> >>
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> >> >> > <
>> >> >> >
>> >> >>
>> >>
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> >> >> > >
>> >> >> >
>> >> >> > -Jordan
>> >> >> >
>> >> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep singh <
>> >> >> kuldeep.singh08@gmail.com>
>> >> >> > wrote:
>> >> >> > >
>> >> >> > > Hi Team,
>> >> >> > > How we will do secure communication between the Curator
>> >> >> framework and
>> >> >> > > zookeeper 3.5.6 ?
>> >> >> > > I didn't get any solution right now.
>> >> >> > > I appreciate it if someone could help me with the same.
>> >> >> > >
>> >> >> > > Thanks,
>> >> >> > > ---------------------
>> >> >> > > Kuldeep Singh Budania
>> >> >> > > Software Architect
>> >> >> > >
>> >> >> > >
>> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
>> >> >> > szalay.beko.mate@gmail.com>
>> >> >> > > wrote:
>> >> >> > >
>> >> >> > >> Hello Kuldeep,
>> >> >> > >>
>> >> >> > >> did you download the source from the ZooKeeper
>> webpage, or
>> >> >> checked out
>> >> >> > from
>> >> >> > >> git?
>> >> >> > >> Anyway, the following commands should work:
>> >> >> > >>
>> >> >> > >> wget
>> >> >> > >>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
>> >> >> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
>> >> >> > >> cd apache-zookeeper-3.5.7
>> >> >> > >> mvn clean install -DskipTests
>> >> >> > >>
>> >> >> > >> I tested it with OpenJDK 8u424 and maven 3.6.0.
>> >> >> > >>
>> >> >> > >> Kind regards,
>> >> >> > >> Mate
>> >> >> > >>
>> >> >> > >>
>> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
>> >> >> > kuldeep.singh08@gmail.com>
>> >> >> > >> wrote:
>> >> >> > >>
>> >> >> > >>> Hi All,
>> >> >> > >>>
>> >> >> > >>> I have download the zookeeper source code and run the
>> mvn
>> >> >> command for
>> >> >> > >>> packaging but get problem on "zookeeper-server"
>> >> directory.
>> >> >> > >>>
>> >> >> > >>> *command :- mvn clean package*
>> >> >> > >>>
>> >> >> > >>> [ERROR] Failed to execute goal
>> >> >> > >>>
>> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> >> >> > >>> (default-compile) on project zookeeper: Fatal error
>> >> >> compiling:
>> >> >> > >>> java.lang.NullPointerException -> [Help 1]
>> >> >> > >>>
>> org.apache.maven.lifecycle.LifecycleExecutionException:
>> >> >> Failed to
>> >> >> > execute
>> >> >> > >>> goal
>> >> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> >> >> > >>> (default-compile) on project zookeeper: Fatal error
>> >> >> compiling
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
>> >> >> > >>> at
>> >> >> >
>> >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
>> >> >> > >>> at
>> >> >> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
>> >> >> > >>> at
>> >> >> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
>> >> >> > >>> at
>> >> >> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
>> >> >> > >>> at
>> >> >> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
>> >> >> > >>> at
>> >> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >> >> > >>> at
>> >> java.lang.reflect.Method.invoke(Method.java:498)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> >
>> >> >>
>> >>
>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>> >> >> > >>> Caused by:
>> >> org.apache.maven.plugin.MojoExecutionException:
>> >> >> Fatal error
>> >> >> > >>> compiling
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>> >> >> > >>> ... 19 more
>> >> >> > >>> Caused by:
>> >> org.codehaus.plexus.compiler.CompilerException:
>> >> >> > >>> java.lang.NullPointerException
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
>> >> >> > >>> ... 22 more
>> >> >> > >>> Caused by: java.lang.RuntimeException:
>> >> >> java.lang.NullPointerException
>> >> >> > >>> at
>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:559)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
>> >> >> > >>> ... 24 more
>> >> >> > >>> Caused by: java.lang.NullPointerException
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
>> >> >> > >>> at
>> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
>> >> >> > >>> at
>> >> >> com.sun.tools.doclint.Checker.scan(Checker.java:144)
>> >> >> > >>> at
>> >> >> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> >
>> >> >>
>> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> >
>> >> >>
>> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >>
>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> >> >> > >>> at
>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> >> >> > >>> at
>> >> >> > >>
>> >> >> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >> >> > >>> at
>> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> >
>> >> >>
>> >>
>> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >> >> > >>> at
>> >> >> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >>
>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >>
>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
>> >> >> > >>> at
>> >> >> > >>>
>> >> >> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
>> >> >> > >>> at
>> >> >> com.sun.tools.javac.main.Main.compile(Main.java:523)
>> >> >> > >>> ... 27 more
>> >> >> > >>> [ERROR]
>> >> >> > >>> [ERROR] Re-run Maven using the -X switch to enable
>> full
>> >> >> debug logging.
>> >> >> > >>> [ERROR]
>> >> >> > >>> [ERROR] For more information about the errors and
>> >> possible
>> >> >> solutions,
>> >> >> > >>> please read the following articles:
>> >> >> > >>> [ERROR] [Help 1]
>> >> >> > >>>
>> >> >> >
>> >> >>
>> >>
>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>> >> >> > >>>
>> >> >> > >>> Can someone help me on this issue?
>> >> >> > >>>
>> >> >> > >>> Thanks,
>> >> >> > >>> ---------------------
>> >> >> > >>> Kuldeep Singh Budania
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>>
>> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
>> >> >> > >>> szalay.beko.mate@gmail.com>
>> >> >> > >>> wrote:
>> >> >> > >>>
>> >> >> > >>>> these exceptions can mean many things... I think this
>> >> can
>> >> >> be even
>> >> >> > >> normal
>> >> >> > >>>> duding rolling restart (as some connections get
>> broken
>> >> in
>> >> >> this case)
>> >> >> > >>>>
>> >> >> > >>>> However, I saw cases already when exceptions like
>> these
>> >> >> killed
>> >> >> > receiver
>> >> >> > >>> or
>> >> >> > >>>> sender threads in QuorumCnxManager / Leader Election
>> in
>> >> >> such a way
>> >> >> > that
>> >> >> > >>>> they were not able to recover, so the node was
>> unable to
>> >> >> connect to
>> >> >> > any
>> >> >> > >>>> quorum until restart. I remember seeing this in 3.4
>> too.
>> >> >> > >>>>
>> >> >> > >>>> Do you see these exceptions in the second server (the
>> >> one
>> >> >> which you
>> >> >> > >> just
>> >> >> > >>>> upgraded in step 3)?
>> >> >> > >>>> Is this issue reproducible?
>> >> >> > >>>>
>> >> >> > >>>> What is the tickTime and initLimit you use? Maybe the
>> >> >> server just
>> >> >> > >> require
>> >> >> > >>>> more time to sync?
>> >> >> > >>>>
>> >> >> > >>>> I would need more logs to really see what happened.
>> Can
>> >> >> you create a
>> >> >> > >> Jira
>> >> >> > >>>> issue and upload the logs and also the ZooKeeper
>> >> configs?
>> >> >> I am happy
>> >> >> > to
>> >> >> > >>>> take a closer look.
>> >> >> > >>>> (if you need to re-run the test to collect the logs,
>> >> then
>> >> >> enabling
>> >> >> > >> DEBUG
>> >> >> > >>>> logs would be great. The INFO level logs are usually
>> >> >> enough for these
>> >> >> > >>>> problems, but one can never know...)
>> >> >> > >>>>
>> >> >> > >>>> Kind regards,
>> >> >> > >>>> Mate
>> >> >> > >>>>
>> >> >> > >>>>
>> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
>> >> >> > >> kuldeep.singh08@gmail.com
>> >> >> > >>>>
>> >> >> > >>>> wrote:
>> >> >> > >>>>
>> >> >> > >>>>> Hi Team,
>> >> >> > >>>>>
>> >> >> > >>>>> I have done some POC on rolling upgrade and found
>> below
>> >> >> result.
>> >> >> > >>>>>
>> >> >> > >>>>>
>> >> >> > >>>>> 1. On 1st node upgrade zookeeper . Traffic was
>> >> running
>> >> >> fine
>> >> >> > >> because
>> >> >> > >>> 2
>> >> >> > >>>>> nodes are already on old zookeeper.
>> >> >> > >>>>> 2. On 1st node upgrade our application and didn’t
>> >> find
>> >> >> any issue
>> >> >> > >>>>> 3. On 2nd node upgrade zookeeper but got below
>> error
>> >> >> and zookeeper
>> >> >> > >>> is
>> >> >> > >>>>> not taking any requests
>> >> >> > >>>>> 4.
>> >> >> > >>>>>
>> >> >> > >>>>> java.io.EOFException
>> >> >> > >>>>>
>> >> >> > >>>>> at
>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
>> >> >> > >>>>>
>> >> >> > >>>>> at
>> >> >> > >>>>>
>> >> >> > >>>>>
>> >> >> > >>>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
>> >> >> > >>>>>
>> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
>> >> >> > >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765] -
>> >> >> Interrupting
>> >> >> > >>> SendWorker
>> >> >> > >>>>>
>> >> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/
>> >> >> 192.168.44.73:33754
>> >> >> > >>>>> :LearnerHandler@562] - Unexpected exception causing
>> >> >> shutdown while
>> >> >> > >>> sock
>> >> >> > >>>>> still open
>> >> >> > >>>>>
>> >> >> > >>>>> java.io.EOFException
>> >> >> > >>>>>
>> >> >> > >>>>> at
>> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
>> >> >> > >>>>>
>> >> >> > >>>>> at
>> >> >> > >>>>>
>> >> >> > >>
>> >> >>
>> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
>> >> >> > >>>>>
>> >> >> > >>>>> at
>> >> >> > >>>>>
>> >> >> > >>>>>
>> >> >> > >>>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
>> >> >> > >>>>>
>> >> >> > >>>>> at
>> >> >> > >>>>>
>> >> >> > >>>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
>> >> >> > >>>>>
>> >> >> > >>>>> at
>> >> >> > >>>>>
>> >> >> > >>>>>
>> >> >> > >>>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >>
>> >>
>> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
>> >> >> > >>>>>
>> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
>> >> >> > >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679] -
>> >> >> Interrupted while
>> >> >> > >>>> waiting
>> >> >> > >>>>> for message on queue
>> >> >> > >>>>>
>> >> >> > >>>>> Please let me know is this the known issue or this
>> is
>> >> >> different issue
>> >> >> > >>>> which
>> >> >> > >>>>> is mention in Apache zookeeper documentation when
>> >> >> upgrading from
>> >> >> > >> 3.4.5
>> >> >> > >>> to
>> >> >> > >>>>> 3.5.6
>> >> >> > >>>>>
>> >> >> > >>>>> Thanks,
>> >> >> > >>>>> ---------------------
>> >> >> > >>>>> Kuldeep Singh Budania
>> >> >> > >>>>> Software Architect
>> >> >> > >>>>>
>> >> >> > >>>>>
>> >> >> > >>>>>
>> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer <
>> >> >> shralex@gmail.com>
>> >> >> > >>>>> wrote:
>> >> >> > >>>>>
>> >> >> > >>>>>> +1 to what Mate said (I wrote the quoted
>> >> instructions).
>> >> >> > >>>>>>
>> >> >> > >>>>>>
>> >> >> > >>>>>>
>> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő Máté <
>> >> >> > >>>>>> szalay.beko.mate@gmail.com>
>> >> >> > >>>>>> wrote:
>> >> >> > >>>>>>
>> >> >> > >>>>>>> Hi Kuldeep,
>> >> >> > >>>>>>>
>> >> >> > >>>>>>> I just want to provide you some background info
>> about
>> >> >> our
>> >> >> > >>>>> documentation.
>> >> >> > >>>>>>> The reason to upgrade to 3.4.6 first is to avoid
>> the
>> >> >> following
>> >> >> > >>> error:
>> >> >> > >>>>>>>
>> >> >> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
>> [localhost/
>> >> >> > >>> 127.0.0.1:2784
>> >> >> > >>>>>>> :QuorumCnxManager@349] - Invalid server id:
>> -65536
>> >> >> > >>>>>>>
>> >> >> > >>>>>>> This error comes because of the protocol changes
>> >> between
>> >> >> > >> ZooKeeper
>> >> >> > >>>>> server
>> >> >> > >>>>>>> nodes during connection initiation for leader
>> >> election.
>> >> >> In
>> >> >> > >>> ZooKeeper
>> >> >> > >>>>> 3.5
>> >> >> > >>>>>> a
>> >> >> > >>>>>>> protocol version was introduced (see
>> ZOOKEEPER-107)
>> >> and
>> >> >> since
>> >> >> > >> that
>> >> >> > >>>> time
>> >> >> > >>>>>> the
>> >> >> > >>>>>>> fist long value sent in the initial message is not
>> >> the
>> >> >> server ID
>> >> >> > >>> but
>> >> >> > >>>>> the
>> >> >> > >>>>>>> protocol version (-65536). In ZooKeeper 3.4.6 we
>> made
>> >> >> the old 3.4
>> >> >> > >>>>>>> ZooKeepers backward compatible, so they are able
>> to
>> >> >> parse both
>> >> >> > >> the
>> >> >> > >>>> old
>> >> >> > >>>>>> and
>> >> >> > >>>>>>> the new protocol format (see ZOOKEEPER-1633). This
>> >> >> issue happens
>> >> >> > >>> only
>> >> >> > >>>>>> when
>> >> >> > >>>>>>> you need to use old (3.4.0 - 3.4.5) and new
>> (3.5.0+)
>> >> >> ZooKeeper
>> >> >> > >>>> servers
>> >> >> > >>>>>>> together in the same cluster. During a rolling
>> >> upgrade,
>> >> >> this is
>> >> >> > >>>> usually
>> >> >> > >>>>>> the
>> >> >> > >>>>>>> case to have old and new ZooKeepers present
>> together.
>> >> >> > >>>>>>>
>> >> >> > >>>>>>> The fact that you haven't seen any issues might be
>> >> >> caused by the
>> >> >> > >>>> order
>> >> >> > >>>>> of
>> >> >> > >>>>>>> the servers. In ZooKeeper the connection
>> initiation
>> >> >> between the
>> >> >> > >>>> servers
>> >> >> > >>>>>>> during the leader election follows a specific
>> rule.
>> >> As
>> >> >> far as I
>> >> >> > >>>>> remember
>> >> >> > >>>>>>> always the server with the larger ID 'wins the
>> >> >> challenge', so it
>> >> >> > >> is
>> >> >> > >>>>>>> possible, that the old server didn't need to parse
>> >> any
>> >> >> initial
>> >> >> > >>>> message
>> >> >> > >>>>>> (if
>> >> >> > >>>>>>> it had the largest ID) and this is why you haven't
>> >> seen
>> >> >> the
>> >> >> > >> issue.
>> >> >> > >>>> Also
>> >> >> > >>>>>>> having 2 nodes up from the 3 nodes cluster still
>> >> makes
>> >> >> the
>> >> >> > >> cluster
>> >> >> > >>>> work
>> >> >> > >>>>>> (so
>> >> >> > >>>>>>> you should also check if all the servers are part
>> of
>> >> >> the quorum).
>> >> >> > >>>>>>>
>> >> >> > >>>>>>> I agree with Enrico and Norbert, the safest and
>> most
>> >> >> stable way
>> >> >> > >> is
>> >> >> > >>>>>> upgrade
>> >> >> > >>>>>>> first to 3.4.latest, then go to 3.5.latest.
>> Still, if
>> >> >> you don't
>> >> >> > >> see
>> >> >> > >>>>> that
>> >> >> > >>>>>>> you would hit this specific issue (e.g. no
>> "Invalid
>> >> >> server id" in
>> >> >> > >>> the
>> >> >> > >>>>> log
>> >> >> > >>>>>>> files), and all the three servers can handle
>> traffic,
>> >> >> then maybe
>> >> >> > >>> you
>> >> >> > >>>>>> don't
>> >> >> > >>>>>>> need to upgrade first to 3.4.latest, it is your
>> >> >> decision.
>> >> >> > >>> Definitely
>> >> >> > >>>>> you
>> >> >> > >>>>>>> should test it first, as suggested by the others.
>> >> >> > >>>>>>>
>> >> >> > >>>>>>> Kind regards,
>> >> >> > >>>>>>> Mate
>> >> >> > >>>>>>>
>> >> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
>> >> >> > >>>>>>> <nk...@cloudera.com.invalid> wrote:
>> >> >> > >>>>>>>
>> >> >> > >>>>>>>> Hi,
>> >> >> > >>>>>>>>
>> >> >> > >>>>>>>> That guide is to upgrade to 3.5.0, which was an
>> >> alpha
>> >> >> version.
>> >> >> > >> A
>> >> >> > >>>> lot
>> >> >> > >>>>>> has
>> >> >> > >>>>>>>> changed for the first stable release of 3.5.5 and
>> >> then
>> >> >> a few
>> >> >> > >>> more,
>> >> >> > >>>>> even
>> >> >> > >>>>>>>> rolling upgrade issues have been fixed for 3.5.6.
>> >> >> > >>>>>>>> This is a more up-to-date guide:
>> >> >> > >>>>>>>>
>> >> >> > >>>
>> >> >> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
>> >> >> > >>>>>>>>
>> >> >> > >>>>>>>> If you have done your testing (with prod
>> snapshot!),
>> >> >> then you
>> >> >> > >> can
>> >> >> > >>>>> skip
>> >> >> > >>>>>>> 3.4
>> >> >> > >>>>>>>> latest upgrade, but keep in mind we do our
>> >> >> recommendations for
>> >> >> > >> a
>> >> >> > >>>>>> reason.
>> >> >> > >>>>>>>> There were issues reported and/or found during
>> >> >> testing. Some
>> >> >> > >> are
>> >> >> > >>>>> fixed
>> >> >> > >>>>>>> with
>> >> >> > >>>>>>>> 3.5.6, some only happens if certain conditions
>> stand
>> >> >> > >>> (IOException:
>> >> >> > >>>> No
>> >> >> > >>>>>>>> snapshot found - mentioned in the guide, fixed in
>> >> >> 3.5.6).
>> >> >> > >>>>>>>>
>> >> >> > >>>>>>>> So it is up to you, I would still recommend to
>> do an
>> >> >> 3.4
>> >> >> > >> upgrade
>> >> >> > >>>>> first,
>> >> >> > >>>>>>> if
>> >> >> > >>>>>>>> it's feasible.
>> >> >> > >>>>>>>>
>> >> >> > >>>>>>>> Regards,
>> >> >> > >>>>>>>> Norbert
>> >> >> > >>>>>>>>
>> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep singh <
>> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
>> >> >> > >>>>>>>> wrote:
>> >> >> > >>>>>>>>
>> >> >> > >>>>>>>>> Hi,
>> >> >> > >>>>>>>>>
>> >> >> > >>>>>>>>> Current Zookeeper version :- 3.4.5
>> >> >> > >>>>>>>>> Upgraded version :- 3.5.6
>> >> >> > >>>>>>>>>
>> >> >> > >>>>>>>>> We are not going with 3.5.7. Our final decision
>> is
>> >> >> zookeeper
>> >> >> > >>>>> version
>> >> >> > >>>>>> is
>> >> >> > >>>>>>>>> 3.5.6
>> >> >> > >>>>>>>>> as per your reply first we need to move latest
>> >> >> version of
>> >> >> > >>> 3.4.x,
>> >> >> > >>>>> like
>> >> >> > >>>>>>>> below
>> >> >> > >>>>>>>>>
>> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am
>> wrong
>> >> >> here)
>> >> >> > >>>>>>>>>
>> >> >> > >>>>>>>>> But if We are not facing any problem that i have
>> >> >> shared you
>> >> >> > >>> that
>> >> >> > >>>> we
>> >> >> > >>>>>>> have
>> >> >> > >>>>>>>>> set up of 3 node cluster where 2 node are on
>> 3.5.6
>> >> >> version
>> >> >> > >> and
>> >> >> > >>> 1
>> >> >> > >>>>> node
>> >> >> > >>>>>>> on
>> >> >> > >>>>>>>>> 3.4.5, Everything is running fine and didn't get
>> >> any
>> >> >> issue,
>> >> >> > >> So
>> >> >> > >>>> what
>> >> >> > >>>>>>> other
>> >> >> > >>>>>>>>> problem we can face if we directly move to 3.5.6
>> >> >> > >>>>>>>>>
>> >> >> > >>>>>>>>> Thanks,
>> >> >> > >>>>>>>>> ---------------------
>> >> >> > >>>>>>>>> Kuldeep Singh Budania
>> >> >> > >>>>>>>>> Software Architect
>> >> >> > >>>>>>>>>
>> >> >> > >>>>>>>>>
>> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico Olivelli
>> <
>> >> >> > >>>>> eolivelli@gmail.com
>> >> >> > >>>>>>>
>> >> >> > >>>>>>>>> wrote:
>> >> >> > >>>>>>>>>
>> >> >> > >>>>>>>>>> Hi
>> >> >> > >>>>>>>>>> You have to upgrade to latest 3.4.x Zookeeper
>> then
>> >> >> you will
>> >> >> > >>>>> upgrade
>> >> >> > >>>>>>> to
>> >> >> > >>>>>>>>>> 3.5.7.
>> >> >> > >>>>>>>>>> All should run well without issues
>> >> >> > >>>>>>>>>>
>> >> >> > >>>>>>>>>>
>> >> >> > >>>>>>>>>> Enrico
>> >> >> > >>>>>>>>>>
>> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
>> >> >> > >>>>> kuldeep.singh08@gmail.com
>> >> >> > >>>>>>>
>> >> >> > >>>>>>> ha
>> >> >> > >>>>>>>>>> scritto:
>> >> >> > >>>>>>>>>>
>> >> >> > >>>>>>>>>>> Hi Team,
>> >> >> > >>>>>>>>>>>
>> >> >> > >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to
>> 3.5.6. I
>> >> >> have
>> >> >> > >> set
>> >> >> > >>>> up 3
>> >> >> > >>>>>>> node
>> >> >> > >>>>>>>>>>> cluster where 2 node are on 3.5.6 version and
>> 1
>> >> >> node on
>> >> >> > >>>> 3.4.5.
>> >> >> > >>>>>>>>>>>
>> >> >> > >>>>>>>>>>> Everything is running fine and didn't get any
>> >> issue
>> >> >> on my
>> >> >> > >>>>> system.
>> >> >> > >>>>>>>>>>>
>> >> >> > >>>>>>>>>>> but I found something on apache site that
>> first
>> >> we
>> >> >> need
>> >> >> > >> to
>> >> >> > >>>>>> upgrade
>> >> >> > >>>>>>>> on
>> >> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is it
>> >> >> mandatory
>> >> >> > >> to
>> >> >> > >>> go
>> >> >> > >>>>> on
>> >> >> > >>>>>>>> 3.4.6
>> >> >> > >>>>>>>>>>> first.
>> >> >> > >>>>>>>>>>>
>> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
>> >> >> > >>>>>>>>>>>
>> >> >> > >>>>>>>>>>> Upgrading a running ZooKeeper ensemble to
>> 3.5.0
>> >> >> should be
>> >> >> > >>>> done
>> >> >> > >>>>>> only
>> >> >> > >>>>>>>>> after
>> >> >> > >>>>>>>>>>> upgrading your ensemble to the 3.4.6 release.
>> >> Note
>> >> >> that
>> >> >> > >>> this
>> >> >> > >>>> is
>> >> >> > >>>>>>> only
>> >> >> > >>>>>>>>>>> necessary for rolling upgrades (if you're fine
>> >> with
>> >> >> > >>> shutting
>> >> >> > >>>>> down
>> >> >> > >>>>>>> the
>> >> >> > >>>>>>>>>>> system completely, you don't have to go
>> through
>> >> >> 3.4.6).
>> >> >> > >> If
>> >> >> > >>>> you
>> >> >> > >>>>>>>> attempt
>> >> >> > >>>>>>>>> a
>> >> >> > >>>>>>>>>>> rolling upgrade without going through 3.4.6
>> (for
>> >> >> example
>> >> >> > >>> from
>> >> >> > >>>>>>> 3.4.5),
>> >> >> > >>>>>>>>> you
>> >> >> > >>>>>>>>>>> may get the following error:
>> >> >> > >>>>>>>>>>>
>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO
>> >> [localhost/
>> >> >> > >>>>>> 127.0.0.1:2784
>> >> >> > >>>>>>>>>>> :QuorumCnxManager$Listener@498] - Received
>> >> >> connection
>> >> >> > >>>> request
>> >> >> > >>>>> /
>> >> >> > >>>>>>>>>>> 127.0.0.1:60876
>> >> >> > >>>>>>>>>>>
>> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
>> >> [localhost/
>> >> >> > >>>>>> 127.0.0.1:2784
>> >> >> > >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server id:
>> >> -65536
>> >> >> > >>>>>>>>>>>
>> >> >> > >>>>>>>>>>> During a rolling upgrade, each server is taken
>> >> down
>> >> >> in
>> >> >> > >> turn
>> >> >> > >>>> and
>> >> >> > >>>>>>>>> rebooted
>> >> >> > >>>>>>>>>>> with the new 3.5.0 binaries. Before starting
>> the
>> >> >> server
>> >> >> > >>> with
>> >> >> > >>>>>> 3.5.0
>> >> >> > >>>>>>>>>>> binaries, we highly recommend updating the
>> >> >> configuration
>> >> >> > >>> file
>> >> >> > >>>>> so
>> >> >> > >>>>>>> that
>> >> >> > >>>>>>>>> all
>> >> >> > >>>>>>>>>>> server statements "server.x=..." contain
>> client
>> >> >> ports
>> >> >> > >> (see
>> >> >> > >>>> the
>> >> >> > >>>>>>>> section
>> >> >> > >>>>>>>>>>> Specifying
>> >> >> > >>>>>>>>>>> the client port). As explained earlier you may
>> >> >> leave the
>> >> >> > >>>>>>>> configuration
>> >> >> > >>>>>>>>>> in a
>> >> >> > >>>>>>>>>>> single file, as well as leave the
>> >> >> > >>>> clientPort/clientPortAddress
>> >> >> > >>>>>>>>> statements
>> >> >> > >>>>>>>>>>> (although if you specify client ports in the
>> new
>> >> >> format,
>> >> >> > >>>> these
>> >> >> > >>>>>>>>> statements
>> >> >> > >>>>>>>>>>> are now redundant).
>> >> >> > >>>>>>>>>>>
>> >> >> > >>>>>>>>>>> Could you please let me know about this case.
>> >> >> Appreciate
>> >> >> > >> if
>> >> >> > >>>>>> respond
>> >> >> > >>>>>>>>> soon.
>> >> >> > >>>>>>>>>>>
>> >> >> > >>>>>>>>>>> Thanks,
>> >> >> > >>>>>>>>>>> ---------------------
>> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
>> >> >> > >>>>>>>>>>>
>> >> >> > >>>>>>>>>>
>> >> >> > >>>>>>>>>
>> >> >> > >>>>>>>>
>> >> >> > >>>>>>>
>> >> >> > >>>>>>
>> >> >> > >>>>>
>> >> >> > >>>>
>> >> >> > >>>
>> >> >> > >>
>> >> >> >
>> >> >> >
>> >> >>
>> >> >>
>> >> >> ________________________________
>> >> >>
>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>> >> >> This e-mail (including any attachments) is strictly confidential
>> >> and
>> >> >> may also contain privileged information. If you are not the intended
>> >> >> recipient you are not authorised to read, print, save, process or
>> >> disclose
>> >> >> this message. If you have received this message by mistake, please
>> >> inform
>> >> >> the sender immediately and destroy this e-mail, its attachments and
>> any
>> >> >> copies. Any use, distribution, reproduction or disclosure by any
>> person
>> >> >> other than the intended recipient is strictly prohibited and the
>> person
>> >> >> responsible may incur in penalties.
>> >> >> The use of this e-mail is only for professional purposes; there
>> is
>> >> no
>> >> >> guarantee that the correspondence towards this e-mail will be read
>> >> only by
>> >> >> the recipient, because, under certain circumstances, there may be a
>> >> need to
>> >> >> access this email by third subjects belonging to the Company.
>> >> >>
>> >> >>
>> >> >> ________________________________
>> >> >>
>> >> >> CONFIDENTIALITY & PRIVACY NOTICE
>> >> >> This e-mail (including any attachments) is strictly confidential and
>> >> may
>> >> >> also contain privileged information. If you are not the intended
>> >> recipient
>> >> >> you are not authorised to read, print, save, process or disclose
>> this
>> >> >> message. If you have received this message by mistake, please inform
>> >> the
>> >> >> sender immediately and destroy this e-mail, its attachments and any
>> >> copies.
>> >> >> Any use, distribution, reproduction or disclosure by any person
>> other
>> >> than
>> >> >> the intended recipient is strictly prohibited and the person
>> >> responsible
>> >> >> may incur in penalties.
>> >> >> The use of this e-mail is only for professional purposes; there is
>> no
>> >> >> guarantee that the correspondence towards this e-mail will be read
>> >> only by
>> >> >> the recipient, because, under certain circumstances, there may be a
>> >> need to
>> >> >> access this email by third subjects belonging to the Company.
>> >> >>
>> >> >
>> >>
>> >
>>
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Sorry this is my bad, there were server setting like below
export SERVER_JVMFLAGS="
-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
-Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
-Dzookeeper.ssl.keyStore.password=testpass
-Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
-Dzookeeper.ssl.trustStore.password=testpass"
export CLIENT_JVMFLAGS="
-Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
-Dzookeeper.client.secure=true
-Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
-Dzookeeper.ssl.keyStore.password=testpass
-Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
-Dzookeeper.ssl.trustStore.password=testpass"
I want to have SSL between client to server communication
I am already following the same link which you have shared with me but that
is not working.
Zoo.cfg
secureClientPort=2281
initLimit=10
syncLimit=5
dataDir=/var/lib/zookeeper/data
tickTime=2000
autopurge.snapRetainCount=3
autopurge.purgeInterval=1
admin.enableServer=false
standaloneEnabled=false
jute.maxbuffer=2147483648
serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
server.1=host1_priv:10288:10388
server.2=host2_priv:10288:10388
server.3=host3_priv:10288:10388
command to connect using zkcli
1. zkcli zoo.cfg localhost:2281
2. addauth ztpasswd usernaem:password
after second step we are getting below error
WatchedEvent state:AuthFailed type:None path:null
Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
[nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication provider
for scheme: ztpasswd has x509 ip digest*
Thanks,
---------------------
Kuldeep Singh Budania
On Wed, Jul 1, 2020 at 6:25 PM Szalay-Bekő Máté <sz...@gmail.com>
wrote:
> > No authentication provider for scheme: ztpasswd has x509 ip digest*
>
> This suggest you have some configuration error... Where did you use the
> "ztpasswd" string in your configs / commands?
>
> On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <
> szalay.beko.mate@gmail.com>
> wrote:
>
> > > My ZK server is up and running in secure mode
> >
> > What is your goal? You want to setup client-server SSL connection?
> >
> > see:
> >
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
> >
> > (or you want to have both SSL and SASL enabled?)
> >
> > Anyway, please remove the following line from the SERVER_JVMFLAGS:
> > -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> > This is a configuration that makes sense only for the ZooKeeper client,
> > not for the server. For the server, use the following:
> >
> >
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >
> > If it doesn't solve the issue, then can you please send your zoo.cfg
> file?
> > Also can you please send the zkCli command you execute? (you need to
> > connect to the secure ZooKeeper port, unless portUnification is enabled)
> >
> > Kind regards,
> > Mate
> >
> > On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <ku...@gmail.com>
> > wrote:
> >
> >> Hi,
> >>
> >> we have done below changes in java.env file
> >>
> >> export SERVER_JVMFLAGS="
> >>
> >> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >> -Dzookeeper.ssl.keyStore.password=testpass
> >>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >> -Dzookeeper.ssl.trustStore.password=testpass"
> >>
> >>
> >>
> >> export CLIENT_JVMFLAGS="
> >>
> >> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> >> -Dzookeeper.client.secure=true
> >> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> >> -Dzookeeper.ssl.keyStore.password=testpass
> >>
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> >> -Dzookeeper.ssl.trustStore.password=testpass"
> >>
> >> I have started the ZK server and it is up without any issue.
> >>
> >> But now when I login to ZkCli then it gives the below error.
> >>
> >> WatchedEvent state:AuthFailed type:None path:null
> >>
> >>
> >> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> >> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
> provider
> >> for scheme: ztpasswd has x509 ip digest*
> >>
> >> Please help me on this issue
> >>
> >> Thanks,
> >> ---------------------
> >> Kuldeep Singh Budania
> >> Software Architect
> >>
> >>
> >> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <
> kuldeep.singh08@gmail.com>
> >> wrote:
> >>
> >> > Hi,
> >> >
> >> > My ZK server is up and running in secure mode, But When I am trying
> to
> >> > connect to the ZK server using ZKCli, it gives the below error.
> >> >
> >> > WatchedEvent state:AuthFailed type:None path:null
> >> >
> >> >
> >> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> >> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
> >> provider
> >> > for scheme: ztpasswd has x509 ip digest*
> >> >
> >> > Can someone please help me on this issue. we are using the 3.5.6
> >> version.
> >> >
> >> > I appreciate if I will get a response as soon as possible, as I am
> stuck
> >> > at this point.
> >> >
> >> > Thanks,
> >> > ---------------------
> >> > Kuldeep Singh Budania
> >> > Software Architect
> >> >
> >> >
> >> >
> >> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli - Diennea
> >> > <en...@diennea.com.invalid> wrote:
> >> >
> >> >> I mean in zoo.cfg
> >> >> Not as a system property
> >> >>
> >> >> Enrico
> >> >>
> >> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <
> >> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
> >> >>
> >> >> Hi
> >> >> You have to enable Netty on the server side
> >> >>
> >> >> Something like:
> >> >>
> >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >> >>
> >> >> Hope that helps
> >> >> Enrico
> >> >>
> >> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
> >> kuldeep.singh08@gmail.com>
> >> >> ha scritto:
> >> >>
> >> >> Hi,
> >> >>
> >> >> I got below error while setting SSL properties in zkEnv.sh
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >>
> ==========================================================================================
> >> >>
> >> >> 2020-06-24 15:49:35,864 - INFO [main:QuorumPeerConfig@133]
> -
> >> >> Reading
> >> >> configuration from: /etc/zookeeper/zoo.cfg
> >> >>
> >> >> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@385]
> -
> >> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
> >> >>
> >> >> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@399]
> -
> >> >> secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
> >> >>
> >> >> 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] - Setting
> >> -D
> >> >> jdk.tls.rejectClientInitiatedRenegotiation=true to disable
> >> >> client-initiated
> >> >> TLS renegotiation
> >> >>
> >> >> 2020-06-24 15:49:35,897 - INFO
> [main:DatadirCleanupManager@78]
> >> -
> >> >> autopurge.snapRetainCount set to 3
> >> >>
> >> >> 2020-06-24 15:49:35,897 - INFO
> [main:DatadirCleanupManager@79]
> >> -
> >> >> autopurge.purgeInterval set to 1
> >> >>
> >> >> 2020-06-24 15:49:35,898 - INFO [
> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge task
> >> >> started.
> >> >>
> >> >> 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] -
> Log4j
> >> >> found with
> >> >> jmx enabled.
> >> >>
> >> >> 2020-06-24 15:49:35,903 - INFO [PurgeTask:FileTxnSnapLog@103
> ]
> >> -
> >> >> zookeeper.snapshot.trust.empty : false
> >> >>
> >> >> 2020-06-24 15:49:35,910 - INFO [
> >> >> PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge task
> >> >> completed.
> >> >>
> >> >> 2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141] -
> >> >> Starting quorum
> >> >> peer
> >> >>
> >> >> 2020-06-24 15:49:35,983 - INFO [main:ServerCnxnFactory@135]
> -
> >> >> Using
> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as server
> >> >> connection
> >> >> factory
> >> >>
> >> >> 2020-06-24 15:49:35,986 - INFO
> [main:NIOServerCnxnFactory@673]
> >> -
> >> >> Configuring NIO connection handler with 10s sessionless
> >> >> connection timeout,
> >> >> 2 selector thread(s), 16 worker threads, and 64 kB direct
> >> buffers.
> >> >>
> >> >> 2020-06-24 15:49:35,992 - INFO
> [main:NIOServerCnxnFactory@686
> >> ]
> >> >> - binding
> >> >> to port 0.0.0.0/0.0.0.0:10181
> >> >>
> >> >> 2020-06-24 15:49:35,994 - INFO [main:ServerCnxnFactory@135]
> -
> >> >> Using
> >> >> org.apache.zookeeper.server.NIOServerCnxnFactory as server
> >> >> connection
> >> >> factory
> >> >>
> >> >> 2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101] -
> >> >> Unexpected
> >> >> exception, exiting abnormally
> >> >>
> >> >> java.lang.UnsupportedOperationException: SSL isn't supported
> in
> >> >> NIOServerCnxn
> >> >>
> >> >> at
> >> >>
> >> >>
> >>
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> >> >>
> >> >> at
> >> >>
> >> >>
> >>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> >> >>
> >> >> at
> >> >>
> >> >>
> >>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> >> >>
> >> >> at
> >> >>
> >> >>
> >>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> I have set the following properties in SERVER_JVMFLAGS in
> >> >> zkEnv.sh file :
> >> >>
> >> >>
> >>
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >> >>
> >> >>
> >>
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> >> >> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> >> >>
> >> >>
> >>
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> >> >> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> >> >>
> >> >> Thanks,
> >> >> ---------------------
> >> >> Kuldeep Singh Budania
> >> >>
> >> >>
> >> >>
> >> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <
> >> >> jordan@jordanzimmerman.com>
> >> >> wrote:
> >> >>
> >> >> > It's the same as the normal ZooKeeper client:
> >> >> >
> >> >>
> >>
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >> >> > <
> >> >> >
> >> >>
> >>
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >> >> > >
> >> >> >
> >> >> > -Jordan
> >> >> >
> >> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep singh <
> >> >> kuldeep.singh08@gmail.com>
> >> >> > wrote:
> >> >> > >
> >> >> > > Hi Team,
> >> >> > > How we will do secure communication between the Curator
> >> >> framework and
> >> >> > > zookeeper 3.5.6 ?
> >> >> > > I didn't get any solution right now.
> >> >> > > I appreciate it if someone could help me with the same.
> >> >> > >
> >> >> > > Thanks,
> >> >> > > ---------------------
> >> >> > > Kuldeep Singh Budania
> >> >> > > Software Architect
> >> >> > >
> >> >> > >
> >> >> > > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
> >> >> > szalay.beko.mate@gmail.com>
> >> >> > > wrote:
> >> >> > >
> >> >> > >> Hello Kuldeep,
> >> >> > >>
> >> >> > >> did you download the source from the ZooKeeper webpage,
> or
> >> >> checked out
> >> >> > from
> >> >> > >> git?
> >> >> > >> Anyway, the following commands should work:
> >> >> > >>
> >> >> > >> wget
> >> >> > >>
> >> >> > >>
> >> >> >
> >> >>
> >>
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> >> >> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
> >> >> > >> cd apache-zookeeper-3.5.7
> >> >> > >> mvn clean install -DskipTests
> >> >> > >>
> >> >> > >> I tested it with OpenJDK 8u424 and maven 3.6.0.
> >> >> > >>
> >> >> > >> Kind regards,
> >> >> > >> Mate
> >> >> > >>
> >> >> > >>
> >> >> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
> >> >> > kuldeep.singh08@gmail.com>
> >> >> > >> wrote:
> >> >> > >>
> >> >> > >>> Hi All,
> >> >> > >>>
> >> >> > >>> I have download the zookeeper source code and run the
> mvn
> >> >> command for
> >> >> > >>> packaging but get problem on "zookeeper-server"
> >> directory.
> >> >> > >>>
> >> >> > >>> *command :- mvn clean package*
> >> >> > >>>
> >> >> > >>> [ERROR] Failed to execute goal
> >> >> > >>>
> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >> >> > >>> (default-compile) on project zookeeper: Fatal error
> >> >> compiling:
> >> >> > >>> java.lang.NullPointerException -> [Help 1]
> >> >> > >>> org.apache.maven.lifecycle.LifecycleExecutionException:
> >> >> Failed to
> >> >> > execute
> >> >> > >>> goal
> >> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >> >> > >>> (default-compile) on project zookeeper: Fatal error
> >> >> compiling
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> >> >> > >>> at
> >> >> >
> >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> >> >> > >>> at
> >> >> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> >> >> > >>> at
> >> >> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> >> >> > >>> at
> >> >> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> >> >> > >>> at
> >> >> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> >> >> > >>> at
> >> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >> >> > >>> at
> >> java.lang.reflect.Method.invoke(Method.java:498)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> >> >> > >>> at
> >> >> > >>>
> >> >> >
> >> >>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> >> >> > >>> Caused by:
> >> org.apache.maven.plugin.MojoExecutionException:
> >> >> Fatal error
> >> >> > >>> compiling
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> >> >> > >>> ... 19 more
> >> >> > >>> Caused by:
> >> org.codehaus.plexus.compiler.CompilerException:
> >> >> > >>> java.lang.NullPointerException
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> >> >> > >>> ... 22 more
> >> >> > >>> Caused by: java.lang.RuntimeException:
> >> >> java.lang.NullPointerException
> >> >> > >>> at
> >> >> com.sun.tools.javac.main.Main.compile(Main.java:559)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> >> >> > >>> ... 24 more
> >> >> > >>> Caused by: java.lang.NullPointerException
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> >> >> > >>> at
> >> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> >> >> > >>> at
> >> >> com.sun.tools.doclint.Checker.scan(Checker.java:144)
> >> >> > >>> at
> >> >> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> >> >> > >>> at
> >> >> > >>>
> >> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> >> >> > >>> at
> >> >> > >>>
> >> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> >> >> > >>> at
> >> >> > >>>
> >> >> >
> >> >>
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> >> >> > >>> at
> >> >> > >>>
> >> >> >
> >> >>
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> >> >> > >>> at
> >> >> > >>>
> >> >>
> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >> >> > >>> at
> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >> >> > >>> at
> >> >> > >>
> >> >> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> >> >> > >>> at
> >> >> > >>>
> >> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> >> >> > >>> at
> >> >> > >>>
> >> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> >> > >>> at
> >> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> >> >> > >>> at
> >> >> > >>>
> >> >> >
> >> >>
> >>
> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> >> > >>> at
> >> >> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> >> >> > >>> at
> >> >> > >>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> >> >> > >>> at
> >> >> > >>>
> >> >>
> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> >> >> > >>> at
> >> >> > >>>
> >> >> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> >> >> > >>> at
> >> >> com.sun.tools.javac.main.Main.compile(Main.java:523)
> >> >> > >>> ... 27 more
> >> >> > >>> [ERROR]
> >> >> > >>> [ERROR] Re-run Maven using the -X switch to enable full
> >> >> debug logging.
> >> >> > >>> [ERROR]
> >> >> > >>> [ERROR] For more information about the errors and
> >> possible
> >> >> solutions,
> >> >> > >>> please read the following articles:
> >> >> > >>> [ERROR] [Help 1]
> >> >> > >>>
> >> >> >
> >> >>
> >> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> >> >> > >>>
> >> >> > >>> Can someone help me on this issue?
> >> >> > >>>
> >> >> > >>> Thanks,
> >> >> > >>> ---------------------
> >> >> > >>> Kuldeep Singh Budania
> >> >> > >>>
> >> >> > >>>
> >> >> > >>>
> >> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
> >> >> > >>> szalay.beko.mate@gmail.com>
> >> >> > >>> wrote:
> >> >> > >>>
> >> >> > >>>> these exceptions can mean many things... I think this
> >> can
> >> >> be even
> >> >> > >> normal
> >> >> > >>>> duding rolling restart (as some connections get broken
> >> in
> >> >> this case)
> >> >> > >>>>
> >> >> > >>>> However, I saw cases already when exceptions like
> these
> >> >> killed
> >> >> > receiver
> >> >> > >>> or
> >> >> > >>>> sender threads in QuorumCnxManager / Leader Election
> in
> >> >> such a way
> >> >> > that
> >> >> > >>>> they were not able to recover, so the node was unable
> to
> >> >> connect to
> >> >> > any
> >> >> > >>>> quorum until restart. I remember seeing this in 3.4
> too.
> >> >> > >>>>
> >> >> > >>>> Do you see these exceptions in the second server (the
> >> one
> >> >> which you
> >> >> > >> just
> >> >> > >>>> upgraded in step 3)?
> >> >> > >>>> Is this issue reproducible?
> >> >> > >>>>
> >> >> > >>>> What is the tickTime and initLimit you use? Maybe the
> >> >> server just
> >> >> > >> require
> >> >> > >>>> more time to sync?
> >> >> > >>>>
> >> >> > >>>> I would need more logs to really see what happened.
> Can
> >> >> you create a
> >> >> > >> Jira
> >> >> > >>>> issue and upload the logs and also the ZooKeeper
> >> configs?
> >> >> I am happy
> >> >> > to
> >> >> > >>>> take a closer look.
> >> >> > >>>> (if you need to re-run the test to collect the logs,
> >> then
> >> >> enabling
> >> >> > >> DEBUG
> >> >> > >>>> logs would be great. The INFO level logs are usually
> >> >> enough for these
> >> >> > >>>> problems, but one can never know...)
> >> >> > >>>>
> >> >> > >>>> Kind regards,
> >> >> > >>>> Mate
> >> >> > >>>>
> >> >> > >>>>
> >> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
> >> >> > >> kuldeep.singh08@gmail.com
> >> >> > >>>>
> >> >> > >>>> wrote:
> >> >> > >>>>
> >> >> > >>>>> Hi Team,
> >> >> > >>>>>
> >> >> > >>>>> I have done some POC on rolling upgrade and found
> below
> >> >> result.
> >> >> > >>>>>
> >> >> > >>>>>
> >> >> > >>>>> 1. On 1st node upgrade zookeeper . Traffic was
> >> running
> >> >> fine
> >> >> > >> because
> >> >> > >>> 2
> >> >> > >>>>> nodes are already on old zookeeper.
> >> >> > >>>>> 2. On 1st node upgrade our application and didn’t
> >> find
> >> >> any issue
> >> >> > >>>>> 3. On 2nd node upgrade zookeeper but got below
> error
> >> >> and zookeeper
> >> >> > >>> is
> >> >> > >>>>> not taking any requests
> >> >> > >>>>> 4.
> >> >> > >>>>>
> >> >> > >>>>> java.io.EOFException
> >> >> > >>>>>
> >> >> > >>>>> at
> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
> >> >> > >>>>>
> >> >> > >>>>> at
> >> >> > >>>>>
> >> >> > >>>>>
> >> >> > >>>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> >> >> > >>>>>
> >> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
> >> >> > >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765] -
> >> >> Interrupting
> >> >> > >>> SendWorker
> >> >> > >>>>>
> >> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/
> >> >> 192.168.44.73:33754
> >> >> > >>>>> :LearnerHandler@562] - Unexpected exception causing
> >> >> shutdown while
> >> >> > >>> sock
> >> >> > >>>>> still open
> >> >> > >>>>>
> >> >> > >>>>> java.io.EOFException
> >> >> > >>>>>
> >> >> > >>>>> at
> >> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
> >> >> > >>>>>
> >> >> > >>>>> at
> >> >> > >>>>>
> >> >> > >>
> >> >>
> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> >> >> > >>>>>
> >> >> > >>>>> at
> >> >> > >>>>>
> >> >> > >>>>>
> >> >> > >>>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> >> >> > >>>>>
> >> >> > >>>>> at
> >> >> > >>>>>
> >> >> > >>>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> >> >> > >>>>>
> >> >> > >>>>> at
> >> >> > >>>>>
> >> >> > >>>>>
> >> >> > >>>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >>
> >>
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> >> >> > >>>>>
> >> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
> >> >> > >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679] -
> >> >> Interrupted while
> >> >> > >>>> waiting
> >> >> > >>>>> for message on queue
> >> >> > >>>>>
> >> >> > >>>>> Please let me know is this the known issue or this is
> >> >> different issue
> >> >> > >>>> which
> >> >> > >>>>> is mention in Apache zookeeper documentation when
> >> >> upgrading from
> >> >> > >> 3.4.5
> >> >> > >>> to
> >> >> > >>>>> 3.5.6
> >> >> > >>>>>
> >> >> > >>>>> Thanks,
> >> >> > >>>>> ---------------------
> >> >> > >>>>> Kuldeep Singh Budania
> >> >> > >>>>> Software Architect
> >> >> > >>>>>
> >> >> > >>>>>
> >> >> > >>>>>
> >> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer <
> >> >> shralex@gmail.com>
> >> >> > >>>>> wrote:
> >> >> > >>>>>
> >> >> > >>>>>> +1 to what Mate said (I wrote the quoted
> >> instructions).
> >> >> > >>>>>>
> >> >> > >>>>>>
> >> >> > >>>>>>
> >> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő Máté <
> >> >> > >>>>>> szalay.beko.mate@gmail.com>
> >> >> > >>>>>> wrote:
> >> >> > >>>>>>
> >> >> > >>>>>>> Hi Kuldeep,
> >> >> > >>>>>>>
> >> >> > >>>>>>> I just want to provide you some background info
> about
> >> >> our
> >> >> > >>>>> documentation.
> >> >> > >>>>>>> The reason to upgrade to 3.4.6 first is to avoid
> the
> >> >> following
> >> >> > >>> error:
> >> >> > >>>>>>>
> >> >> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
> [localhost/
> >> >> > >>> 127.0.0.1:2784
> >> >> > >>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
> >> >> > >>>>>>>
> >> >> > >>>>>>> This error comes because of the protocol changes
> >> between
> >> >> > >> ZooKeeper
> >> >> > >>>>> server
> >> >> > >>>>>>> nodes during connection initiation for leader
> >> election.
> >> >> In
> >> >> > >>> ZooKeeper
> >> >> > >>>>> 3.5
> >> >> > >>>>>> a
> >> >> > >>>>>>> protocol version was introduced (see ZOOKEEPER-107)
> >> and
> >> >> since
> >> >> > >> that
> >> >> > >>>> time
> >> >> > >>>>>> the
> >> >> > >>>>>>> fist long value sent in the initial message is not
> >> the
> >> >> server ID
> >> >> > >>> but
> >> >> > >>>>> the
> >> >> > >>>>>>> protocol version (-65536). In ZooKeeper 3.4.6 we
> made
> >> >> the old 3.4
> >> >> > >>>>>>> ZooKeepers backward compatible, so they are able to
> >> >> parse both
> >> >> > >> the
> >> >> > >>>> old
> >> >> > >>>>>> and
> >> >> > >>>>>>> the new protocol format (see ZOOKEEPER-1633). This
> >> >> issue happens
> >> >> > >>> only
> >> >> > >>>>>> when
> >> >> > >>>>>>> you need to use old (3.4.0 - 3.4.5) and new
> (3.5.0+)
> >> >> ZooKeeper
> >> >> > >>>> servers
> >> >> > >>>>>>> together in the same cluster. During a rolling
> >> upgrade,
> >> >> this is
> >> >> > >>>> usually
> >> >> > >>>>>> the
> >> >> > >>>>>>> case to have old and new ZooKeepers present
> together.
> >> >> > >>>>>>>
> >> >> > >>>>>>> The fact that you haven't seen any issues might be
> >> >> caused by the
> >> >> > >>>> order
> >> >> > >>>>> of
> >> >> > >>>>>>> the servers. In ZooKeeper the connection initiation
> >> >> between the
> >> >> > >>>> servers
> >> >> > >>>>>>> during the leader election follows a specific rule.
> >> As
> >> >> far as I
> >> >> > >>>>> remember
> >> >> > >>>>>>> always the server with the larger ID 'wins the
> >> >> challenge', so it
> >> >> > >> is
> >> >> > >>>>>>> possible, that the old server didn't need to parse
> >> any
> >> >> initial
> >> >> > >>>> message
> >> >> > >>>>>> (if
> >> >> > >>>>>>> it had the largest ID) and this is why you haven't
> >> seen
> >> >> the
> >> >> > >> issue.
> >> >> > >>>> Also
> >> >> > >>>>>>> having 2 nodes up from the 3 nodes cluster still
> >> makes
> >> >> the
> >> >> > >> cluster
> >> >> > >>>> work
> >> >> > >>>>>> (so
> >> >> > >>>>>>> you should also check if all the servers are part
> of
> >> >> the quorum).
> >> >> > >>>>>>>
> >> >> > >>>>>>> I agree with Enrico and Norbert, the safest and
> most
> >> >> stable way
> >> >> > >> is
> >> >> > >>>>>> upgrade
> >> >> > >>>>>>> first to 3.4.latest, then go to 3.5.latest. Still,
> if
> >> >> you don't
> >> >> > >> see
> >> >> > >>>>> that
> >> >> > >>>>>>> you would hit this specific issue (e.g. no "Invalid
> >> >> server id" in
> >> >> > >>> the
> >> >> > >>>>> log
> >> >> > >>>>>>> files), and all the three servers can handle
> traffic,
> >> >> then maybe
> >> >> > >>> you
> >> >> > >>>>>> don't
> >> >> > >>>>>>> need to upgrade first to 3.4.latest, it is your
> >> >> decision.
> >> >> > >>> Definitely
> >> >> > >>>>> you
> >> >> > >>>>>>> should test it first, as suggested by the others.
> >> >> > >>>>>>>
> >> >> > >>>>>>> Kind regards,
> >> >> > >>>>>>> Mate
> >> >> > >>>>>>>
> >> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
> >> >> > >>>>>>> <nk...@cloudera.com.invalid> wrote:
> >> >> > >>>>>>>
> >> >> > >>>>>>>> Hi,
> >> >> > >>>>>>>>
> >> >> > >>>>>>>> That guide is to upgrade to 3.5.0, which was an
> >> alpha
> >> >> version.
> >> >> > >> A
> >> >> > >>>> lot
> >> >> > >>>>>> has
> >> >> > >>>>>>>> changed for the first stable release of 3.5.5 and
> >> then
> >> >> a few
> >> >> > >>> more,
> >> >> > >>>>> even
> >> >> > >>>>>>>> rolling upgrade issues have been fixed for 3.5.6.
> >> >> > >>>>>>>> This is a more up-to-date guide:
> >> >> > >>>>>>>>
> >> >> > >>>
> >> >> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> >> >> > >>>>>>>>
> >> >> > >>>>>>>> If you have done your testing (with prod
> snapshot!),
> >> >> then you
> >> >> > >> can
> >> >> > >>>>> skip
> >> >> > >>>>>>> 3.4
> >> >> > >>>>>>>> latest upgrade, but keep in mind we do our
> >> >> recommendations for
> >> >> > >> a
> >> >> > >>>>>> reason.
> >> >> > >>>>>>>> There were issues reported and/or found during
> >> >> testing. Some
> >> >> > >> are
> >> >> > >>>>> fixed
> >> >> > >>>>>>> with
> >> >> > >>>>>>>> 3.5.6, some only happens if certain conditions
> stand
> >> >> > >>> (IOException:
> >> >> > >>>> No
> >> >> > >>>>>>>> snapshot found - mentioned in the guide, fixed in
> >> >> 3.5.6).
> >> >> > >>>>>>>>
> >> >> > >>>>>>>> So it is up to you, I would still recommend to do
> an
> >> >> 3.4
> >> >> > >> upgrade
> >> >> > >>>>> first,
> >> >> > >>>>>>> if
> >> >> > >>>>>>>> it's feasible.
> >> >> > >>>>>>>>
> >> >> > >>>>>>>> Regards,
> >> >> > >>>>>>>> Norbert
> >> >> > >>>>>>>>
> >> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep singh <
> >> >> > >>>>>>> kuldeep.singh08@gmail.com>
> >> >> > >>>>>>>> wrote:
> >> >> > >>>>>>>>
> >> >> > >>>>>>>>> Hi,
> >> >> > >>>>>>>>>
> >> >> > >>>>>>>>> Current Zookeeper version :- 3.4.5
> >> >> > >>>>>>>>> Upgraded version :- 3.5.6
> >> >> > >>>>>>>>>
> >> >> > >>>>>>>>> We are not going with 3.5.7. Our final decision
> is
> >> >> zookeeper
> >> >> > >>>>> version
> >> >> > >>>>>> is
> >> >> > >>>>>>>>> 3.5.6
> >> >> > >>>>>>>>> as per your reply first we need to move latest
> >> >> version of
> >> >> > >>> 3.4.x,
> >> >> > >>>>> like
> >> >> > >>>>>>>> below
> >> >> > >>>>>>>>>
> >> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am
> wrong
> >> >> here)
> >> >> > >>>>>>>>>
> >> >> > >>>>>>>>> But if We are not facing any problem that i have
> >> >> shared you
> >> >> > >>> that
> >> >> > >>>> we
> >> >> > >>>>>>> have
> >> >> > >>>>>>>>> set up of 3 node cluster where 2 node are on
> 3.5.6
> >> >> version
> >> >> > >> and
> >> >> > >>> 1
> >> >> > >>>>> node
> >> >> > >>>>>>> on
> >> >> > >>>>>>>>> 3.4.5, Everything is running fine and didn't get
> >> any
> >> >> issue,
> >> >> > >> So
> >> >> > >>>> what
> >> >> > >>>>>>> other
> >> >> > >>>>>>>>> problem we can face if we directly move to 3.5.6
> >> >> > >>>>>>>>>
> >> >> > >>>>>>>>> Thanks,
> >> >> > >>>>>>>>> ---------------------
> >> >> > >>>>>>>>> Kuldeep Singh Budania
> >> >> > >>>>>>>>> Software Architect
> >> >> > >>>>>>>>>
> >> >> > >>>>>>>>>
> >> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico Olivelli <
> >> >> > >>>>> eolivelli@gmail.com
> >> >> > >>>>>>>
> >> >> > >>>>>>>>> wrote:
> >> >> > >>>>>>>>>
> >> >> > >>>>>>>>>> Hi
> >> >> > >>>>>>>>>> You have to upgrade to latest 3.4.x Zookeeper
> then
> >> >> you will
> >> >> > >>>>> upgrade
> >> >> > >>>>>>> to
> >> >> > >>>>>>>>>> 3.5.7.
> >> >> > >>>>>>>>>> All should run well without issues
> >> >> > >>>>>>>>>>
> >> >> > >>>>>>>>>>
> >> >> > >>>>>>>>>> Enrico
> >> >> > >>>>>>>>>>
> >> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
> >> >> > >>>>> kuldeep.singh08@gmail.com
> >> >> > >>>>>>>
> >> >> > >>>>>>> ha
> >> >> > >>>>>>>>>> scritto:
> >> >> > >>>>>>>>>>
> >> >> > >>>>>>>>>>> Hi Team,
> >> >> > >>>>>>>>>>>
> >> >> > >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to
> 3.5.6. I
> >> >> have
> >> >> > >> set
> >> >> > >>>> up 3
> >> >> > >>>>>>> node
> >> >> > >>>>>>>>>>> cluster where 2 node are on 3.5.6 version and 1
> >> >> node on
> >> >> > >>>> 3.4.5.
> >> >> > >>>>>>>>>>>
> >> >> > >>>>>>>>>>> Everything is running fine and didn't get any
> >> issue
> >> >> on my
> >> >> > >>>>> system.
> >> >> > >>>>>>>>>>>
> >> >> > >>>>>>>>>>> but I found something on apache site that
> first
> >> we
> >> >> need
> >> >> > >> to
> >> >> > >>>>>> upgrade
> >> >> > >>>>>>>> on
> >> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is it
> >> >> mandatory
> >> >> > >> to
> >> >> > >>> go
> >> >> > >>>>> on
> >> >> > >>>>>>>> 3.4.6
> >> >> > >>>>>>>>>>> first.
> >> >> > >>>>>>>>>>>
> >> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
> >> >> > >>>>>>>>>>>
> >> >> > >>>>>>>>>>> Upgrading a running ZooKeeper ensemble to 3.5.0
> >> >> should be
> >> >> > >>>> done
> >> >> > >>>>>> only
> >> >> > >>>>>>>>> after
> >> >> > >>>>>>>>>>> upgrading your ensemble to the 3.4.6 release.
> >> Note
> >> >> that
> >> >> > >>> this
> >> >> > >>>> is
> >> >> > >>>>>>> only
> >> >> > >>>>>>>>>>> necessary for rolling upgrades (if you're fine
> >> with
> >> >> > >>> shutting
> >> >> > >>>>> down
> >> >> > >>>>>>> the
> >> >> > >>>>>>>>>>> system completely, you don't have to go through
> >> >> 3.4.6).
> >> >> > >> If
> >> >> > >>>> you
> >> >> > >>>>>>>> attempt
> >> >> > >>>>>>>>> a
> >> >> > >>>>>>>>>>> rolling upgrade without going through 3.4.6
> (for
> >> >> example
> >> >> > >>> from
> >> >> > >>>>>>> 3.4.5),
> >> >> > >>>>>>>>> you
> >> >> > >>>>>>>>>>> may get the following error:
> >> >> > >>>>>>>>>>>
> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO
> >> [localhost/
> >> >> > >>>>>> 127.0.0.1:2784
> >> >> > >>>>>>>>>>> :QuorumCnxManager$Listener@498] - Received
> >> >> connection
> >> >> > >>>> request
> >> >> > >>>>> /
> >> >> > >>>>>>>>>>> 127.0.0.1:60876
> >> >> > >>>>>>>>>>>
> >> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
> >> [localhost/
> >> >> > >>>>>> 127.0.0.1:2784
> >> >> > >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server id:
> >> -65536
> >> >> > >>>>>>>>>>>
> >> >> > >>>>>>>>>>> During a rolling upgrade, each server is taken
> >> down
> >> >> in
> >> >> > >> turn
> >> >> > >>>> and
> >> >> > >>>>>>>>> rebooted
> >> >> > >>>>>>>>>>> with the new 3.5.0 binaries. Before starting
> the
> >> >> server
> >> >> > >>> with
> >> >> > >>>>>> 3.5.0
> >> >> > >>>>>>>>>>> binaries, we highly recommend updating the
> >> >> configuration
> >> >> > >>> file
> >> >> > >>>>> so
> >> >> > >>>>>>> that
> >> >> > >>>>>>>>> all
> >> >> > >>>>>>>>>>> server statements "server.x=..." contain client
> >> >> ports
> >> >> > >> (see
> >> >> > >>>> the
> >> >> > >>>>>>>> section
> >> >> > >>>>>>>>>>> Specifying
> >> >> > >>>>>>>>>>> the client port). As explained earlier you may
> >> >> leave the
> >> >> > >>>>>>>> configuration
> >> >> > >>>>>>>>>> in a
> >> >> > >>>>>>>>>>> single file, as well as leave the
> >> >> > >>>> clientPort/clientPortAddress
> >> >> > >>>>>>>>> statements
> >> >> > >>>>>>>>>>> (although if you specify client ports in the
> new
> >> >> format,
> >> >> > >>>> these
> >> >> > >>>>>>>>> statements
> >> >> > >>>>>>>>>>> are now redundant).
> >> >> > >>>>>>>>>>>
> >> >> > >>>>>>>>>>> Could you please let me know about this case.
> >> >> Appreciate
> >> >> > >> if
> >> >> > >>>>>> respond
> >> >> > >>>>>>>>> soon.
> >> >> > >>>>>>>>>>>
> >> >> > >>>>>>>>>>> Thanks,
> >> >> > >>>>>>>>>>> ---------------------
> >> >> > >>>>>>>>>>> Kuldeep Singh Budania
> >> >> > >>>>>>>>>>>
> >> >> > >>>>>>>>>>
> >> >> > >>>>>>>>>
> >> >> > >>>>>>>>
> >> >> > >>>>>>>
> >> >> > >>>>>>
> >> >> > >>>>>
> >> >> > >>>>
> >> >> > >>>
> >> >> > >>
> >> >> >
> >> >> >
> >> >>
> >> >>
> >> >> ________________________________
> >> >>
> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> >> >> This e-mail (including any attachments) is strictly confidential
> >> and
> >> >> may also contain privileged information. If you are not the intended
> >> >> recipient you are not authorised to read, print, save, process or
> >> disclose
> >> >> this message. If you have received this message by mistake, please
> >> inform
> >> >> the sender immediately and destroy this e-mail, its attachments and
> any
> >> >> copies. Any use, distribution, reproduction or disclosure by any
> person
> >> >> other than the intended recipient is strictly prohibited and the
> person
> >> >> responsible may incur in penalties.
> >> >> The use of this e-mail is only for professional purposes; there
> is
> >> no
> >> >> guarantee that the correspondence towards this e-mail will be read
> >> only by
> >> >> the recipient, because, under certain circumstances, there may be a
> >> need to
> >> >> access this email by third subjects belonging to the Company.
> >> >>
> >> >>
> >> >> ________________________________
> >> >>
> >> >> CONFIDENTIALITY & PRIVACY NOTICE
> >> >> This e-mail (including any attachments) is strictly confidential and
> >> may
> >> >> also contain privileged information. If you are not the intended
> >> recipient
> >> >> you are not authorised to read, print, save, process or disclose this
> >> >> message. If you have received this message by mistake, please inform
> >> the
> >> >> sender immediately and destroy this e-mail, its attachments and any
> >> copies.
> >> >> Any use, distribution, reproduction or disclosure by any person other
> >> than
> >> >> the intended recipient is strictly prohibited and the person
> >> responsible
> >> >> may incur in penalties.
> >> >> The use of this e-mail is only for professional purposes; there is no
> >> >> guarantee that the correspondence towards this e-mail will be read
> >> only by
> >> >> the recipient, because, under certain circumstances, there may be a
> >> need to
> >> >> access this email by third subjects belonging to the Company.
> >> >>
> >> >
> >>
> >
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by Szalay-Bekő Máté <sz...@gmail.com>.
> No authentication provider for scheme: ztpasswd has x509 ip digest*
This suggest you have some configuration error... Where did you use the
"ztpasswd" string in your configs / commands?
On Wed, Jul 1, 2020 at 2:53 PM Szalay-Bekő Máté <sz...@gmail.com>
wrote:
> > My ZK server is up and running in secure mode
>
> What is your goal? You want to setup client-server SSL connection?
>
> see:
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
>
> (or you want to have both SSL and SASL enabled?)
>
> Anyway, please remove the following line from the SERVER_JVMFLAGS:
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> This is a configuration that makes sense only for the ZooKeeper client,
> not for the server. For the server, use the following:
>
> -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>
> If it doesn't solve the issue, then can you please send your zoo.cfg file?
> Also can you please send the zkCli command you execute? (you need to
> connect to the secure ZooKeeper port, unless portUnification is enabled)
>
> Kind regards,
> Mate
>
> On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <ku...@gmail.com>
> wrote:
>
>> Hi,
>>
>> we have done below changes in java.env file
>>
>> export SERVER_JVMFLAGS="
>>
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> -Dzookeeper.ssl.keyStore.password=testpass
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> -Dzookeeper.ssl.trustStore.password=testpass"
>>
>>
>>
>> export CLIENT_JVMFLAGS="
>>
>> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
>> -Dzookeeper.client.secure=true
>> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
>> -Dzookeeper.ssl.keyStore.password=testpass
>> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
>> -Dzookeeper.ssl.trustStore.password=testpass"
>>
>> I have started the ZK server and it is up without any issue.
>>
>> But now when I login to ZkCli then it gives the below error.
>>
>> WatchedEvent state:AuthFailed type:None path:null
>>
>>
>> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication provider
>> for scheme: ztpasswd has x509 ip digest*
>>
>> Please help me on this issue
>>
>> Thanks,
>> ---------------------
>> Kuldeep Singh Budania
>> Software Architect
>>
>>
>> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <ku...@gmail.com>
>> wrote:
>>
>> > Hi,
>> >
>> > My ZK server is up and running in secure mode, But When I am trying to
>> > connect to the ZK server using ZKCli, it gives the below error.
>> >
>> > WatchedEvent state:AuthFailed type:None path:null
>> >
>> >
>> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
>> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
>> provider
>> > for scheme: ztpasswd has x509 ip digest*
>> >
>> > Can someone please help me on this issue. we are using the 3.5.6
>> version.
>> >
>> > I appreciate if I will get a response as soon as possible, as I am stuck
>> > at this point.
>> >
>> > Thanks,
>> > ---------------------
>> > Kuldeep Singh Budania
>> > Software Architect
>> >
>> >
>> >
>> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli - Diennea
>> > <en...@diennea.com.invalid> wrote:
>> >
>> >> I mean in zoo.cfg
>> >> Not as a system property
>> >>
>> >> Enrico
>> >>
>> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <
>> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
>> >>
>> >> Hi
>> >> You have to enable Netty on the server side
>> >>
>> >> Something like:
>> >>
>> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> >>
>> >> Hope that helps
>> >> Enrico
>> >>
>> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
>> kuldeep.singh08@gmail.com>
>> >> ha scritto:
>> >>
>> >> Hi,
>> >>
>> >> I got below error while setting SSL properties in zkEnv.sh
>> >>
>> >>
>> >>
>> >>
>> >>
>> ==========================================================================================
>> >>
>> >> 2020-06-24 15:49:35,864 - INFO [main:QuorumPeerConfig@133] -
>> >> Reading
>> >> configuration from: /etc/zookeeper/zoo.cfg
>> >>
>> >> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@385] -
>> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
>> >>
>> >> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@399] -
>> >> secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
>> >>
>> >> 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] - Setting
>> -D
>> >> jdk.tls.rejectClientInitiatedRenegotiation=true to disable
>> >> client-initiated
>> >> TLS renegotiation
>> >>
>> >> 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@78]
>> -
>> >> autopurge.snapRetainCount set to 3
>> >>
>> >> 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@79]
>> -
>> >> autopurge.purgeInterval set to 1
>> >>
>> >> 2020-06-24 15:49:35,898 - INFO [
>> >> PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge task
>> >> started.
>> >>
>> >> 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] - Log4j
>> >> found with
>> >> jmx enabled.
>> >>
>> >> 2020-06-24 15:49:35,903 - INFO [PurgeTask:FileTxnSnapLog@103]
>> -
>> >> zookeeper.snapshot.trust.empty : false
>> >>
>> >> 2020-06-24 15:49:35,910 - INFO [
>> >> PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge task
>> >> completed.
>> >>
>> >> 2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141] -
>> >> Starting quorum
>> >> peer
>> >>
>> >> 2020-06-24 15:49:35,983 - INFO [main:ServerCnxnFactory@135] -
>> >> Using
>> >> org.apache.zookeeper.server.NIOServerCnxnFactory as server
>> >> connection
>> >> factory
>> >>
>> >> 2020-06-24 15:49:35,986 - INFO [main:NIOServerCnxnFactory@673]
>> -
>> >> Configuring NIO connection handler with 10s sessionless
>> >> connection timeout,
>> >> 2 selector thread(s), 16 worker threads, and 64 kB direct
>> buffers.
>> >>
>> >> 2020-06-24 15:49:35,992 - INFO [main:NIOServerCnxnFactory@686
>> ]
>> >> - binding
>> >> to port 0.0.0.0/0.0.0.0:10181
>> >>
>> >> 2020-06-24 15:49:35,994 - INFO [main:ServerCnxnFactory@135] -
>> >> Using
>> >> org.apache.zookeeper.server.NIOServerCnxnFactory as server
>> >> connection
>> >> factory
>> >>
>> >> 2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101] -
>> >> Unexpected
>> >> exception, exiting abnormally
>> >>
>> >> java.lang.UnsupportedOperationException: SSL isn't supported in
>> >> NIOServerCnxn
>> >>
>> >> at
>> >>
>> >>
>> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
>> >>
>> >> at
>> >>
>> >>
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
>> >>
>> >> at
>> >>
>> >>
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
>> >>
>> >> at
>> >>
>> >>
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> I have set the following properties in SERVER_JVMFLAGS in
>> >> zkEnv.sh file :
>> >>
>> >>
>> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>> >>
>> >>
>> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
>> >> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
>> >>
>> >>
>> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
>> >> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
>> >>
>> >> Thanks,
>> >> ---------------------
>> >> Kuldeep Singh Budania
>> >>
>> >>
>> >>
>> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <
>> >> jordan@jordanzimmerman.com>
>> >> wrote:
>> >>
>> >> > It's the same as the normal ZooKeeper client:
>> >> >
>> >>
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> >> > <
>> >> >
>> >>
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> >> > >
>> >> >
>> >> > -Jordan
>> >> >
>> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep singh <
>> >> kuldeep.singh08@gmail.com>
>> >> > wrote:
>> >> > >
>> >> > > Hi Team,
>> >> > > How we will do secure communication between the Curator
>> >> framework and
>> >> > > zookeeper 3.5.6 ?
>> >> > > I didn't get any solution right now.
>> >> > > I appreciate it if someone could help me with the same.
>> >> > >
>> >> > > Thanks,
>> >> > > ---------------------
>> >> > > Kuldeep Singh Budania
>> >> > > Software Architect
>> >> > >
>> >> > >
>> >> > > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
>> >> > szalay.beko.mate@gmail.com>
>> >> > > wrote:
>> >> > >
>> >> > >> Hello Kuldeep,
>> >> > >>
>> >> > >> did you download the source from the ZooKeeper webpage, or
>> >> checked out
>> >> > from
>> >> > >> git?
>> >> > >> Anyway, the following commands should work:
>> >> > >>
>> >> > >> wget
>> >> > >>
>> >> > >>
>> >> >
>> >>
>> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
>> >> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
>> >> > >> cd apache-zookeeper-3.5.7
>> >> > >> mvn clean install -DskipTests
>> >> > >>
>> >> > >> I tested it with OpenJDK 8u424 and maven 3.6.0.
>> >> > >>
>> >> > >> Kind regards,
>> >> > >> Mate
>> >> > >>
>> >> > >>
>> >> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
>> >> > kuldeep.singh08@gmail.com>
>> >> > >> wrote:
>> >> > >>
>> >> > >>> Hi All,
>> >> > >>>
>> >> > >>> I have download the zookeeper source code and run the mvn
>> >> command for
>> >> > >>> packaging but get problem on "zookeeper-server"
>> directory.
>> >> > >>>
>> >> > >>> *command :- mvn clean package*
>> >> > >>>
>> >> > >>> [ERROR] Failed to execute goal
>> >> > >>>
>> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> >> > >>> (default-compile) on project zookeeper: Fatal error
>> >> compiling:
>> >> > >>> java.lang.NullPointerException -> [Help 1]
>> >> > >>> org.apache.maven.lifecycle.LifecycleExecutionException:
>> >> Failed to
>> >> > execute
>> >> > >>> goal
>> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> >> > >>> (default-compile) on project zookeeper: Fatal error
>> >> compiling
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
>> >> > >>> at
>> >> >
>> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
>> >> > >>> at
>> >> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
>> >> > >>> at
>> >> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
>> >> > >>> at
>> >> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
>> >> > >>> at
>> >> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
>> >> > >>> at
>> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >> > >>> at
>> java.lang.reflect.Method.invoke(Method.java:498)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>> >> > >>> at
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>> >> > >>> at
>> >> > >>>
>> >> >
>> >>
>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>> >> > >>> Caused by:
>> org.apache.maven.plugin.MojoExecutionException:
>> >> Fatal error
>> >> > >>> compiling
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>> >> > >>> ... 19 more
>> >> > >>> Caused by:
>> org.codehaus.plexus.compiler.CompilerException:
>> >> > >>> java.lang.NullPointerException
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
>> >> > >>> ... 22 more
>> >> > >>> Caused by: java.lang.RuntimeException:
>> >> java.lang.NullPointerException
>> >> > >>> at
>> >> com.sun.tools.javac.main.Main.compile(Main.java:559)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
>> >> > >>> ... 24 more
>> >> > >>> Caused by: java.lang.NullPointerException
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
>> >> > >>> at
>> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
>> >> > >>> at
>> >> com.sun.tools.doclint.Checker.scan(Checker.java:144)
>> >> > >>> at
>> >> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
>> >> > >>> at
>> >> > >>>
>> >> >
>> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
>> >> > >>> at
>> >> > >>>
>> >> >
>> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> >> > >>> at
>> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> >> > >>> at
>> >> > >>
>> >> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >> > >>> at
>> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> >> > >>> at
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
>> >> > >>> at
>> >> > >>>
>> >> >
>> >>
>> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> >> > >>> at
>> >> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
>> >> > >>> at
>> >> > >>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
>> >> > >>> at
>> >> > >>>
>> >> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
>> >> > >>> at
>> >> com.sun.tools.javac.main.Main.compile(Main.java:523)
>> >> > >>> ... 27 more
>> >> > >>> [ERROR]
>> >> > >>> [ERROR] Re-run Maven using the -X switch to enable full
>> >> debug logging.
>> >> > >>> [ERROR]
>> >> > >>> [ERROR] For more information about the errors and
>> possible
>> >> solutions,
>> >> > >>> please read the following articles:
>> >> > >>> [ERROR] [Help 1]
>> >> > >>>
>> >> >
>> >>
>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>> >> > >>>
>> >> > >>> Can someone help me on this issue?
>> >> > >>>
>> >> > >>> Thanks,
>> >> > >>> ---------------------
>> >> > >>> Kuldeep Singh Budania
>> >> > >>>
>> >> > >>>
>> >> > >>>
>> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
>> >> > >>> szalay.beko.mate@gmail.com>
>> >> > >>> wrote:
>> >> > >>>
>> >> > >>>> these exceptions can mean many things... I think this
>> can
>> >> be even
>> >> > >> normal
>> >> > >>>> duding rolling restart (as some connections get broken
>> in
>> >> this case)
>> >> > >>>>
>> >> > >>>> However, I saw cases already when exceptions like these
>> >> killed
>> >> > receiver
>> >> > >>> or
>> >> > >>>> sender threads in QuorumCnxManager / Leader Election in
>> >> such a way
>> >> > that
>> >> > >>>> they were not able to recover, so the node was unable to
>> >> connect to
>> >> > any
>> >> > >>>> quorum until restart. I remember seeing this in 3.4 too.
>> >> > >>>>
>> >> > >>>> Do you see these exceptions in the second server (the
>> one
>> >> which you
>> >> > >> just
>> >> > >>>> upgraded in step 3)?
>> >> > >>>> Is this issue reproducible?
>> >> > >>>>
>> >> > >>>> What is the tickTime and initLimit you use? Maybe the
>> >> server just
>> >> > >> require
>> >> > >>>> more time to sync?
>> >> > >>>>
>> >> > >>>> I would need more logs to really see what happened. Can
>> >> you create a
>> >> > >> Jira
>> >> > >>>> issue and upload the logs and also the ZooKeeper
>> configs?
>> >> I am happy
>> >> > to
>> >> > >>>> take a closer look.
>> >> > >>>> (if you need to re-run the test to collect the logs,
>> then
>> >> enabling
>> >> > >> DEBUG
>> >> > >>>> logs would be great. The INFO level logs are usually
>> >> enough for these
>> >> > >>>> problems, but one can never know...)
>> >> > >>>>
>> >> > >>>> Kind regards,
>> >> > >>>> Mate
>> >> > >>>>
>> >> > >>>>
>> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
>> >> > >> kuldeep.singh08@gmail.com
>> >> > >>>>
>> >> > >>>> wrote:
>> >> > >>>>
>> >> > >>>>> Hi Team,
>> >> > >>>>>
>> >> > >>>>> I have done some POC on rolling upgrade and found below
>> >> result.
>> >> > >>>>>
>> >> > >>>>>
>> >> > >>>>> 1. On 1st node upgrade zookeeper . Traffic was
>> running
>> >> fine
>> >> > >> because
>> >> > >>> 2
>> >> > >>>>> nodes are already on old zookeeper.
>> >> > >>>>> 2. On 1st node upgrade our application and didn’t
>> find
>> >> any issue
>> >> > >>>>> 3. On 2nd node upgrade zookeeper but got below error
>> >> and zookeeper
>> >> > >>> is
>> >> > >>>>> not taking any requests
>> >> > >>>>> 4.
>> >> > >>>>>
>> >> > >>>>> java.io.EOFException
>> >> > >>>>>
>> >> > >>>>> at
>> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
>> >> > >>>>>
>> >> > >>>>> at
>> >> > >>>>>
>> >> > >>>>>
>> >> > >>>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
>> >> > >>>>>
>> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
>> >> > >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765] -
>> >> Interrupting
>> >> > >>> SendWorker
>> >> > >>>>>
>> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/
>> >> 192.168.44.73:33754
>> >> > >>>>> :LearnerHandler@562] - Unexpected exception causing
>> >> shutdown while
>> >> > >>> sock
>> >> > >>>>> still open
>> >> > >>>>>
>> >> > >>>>> java.io.EOFException
>> >> > >>>>>
>> >> > >>>>> at
>> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
>> >> > >>>>>
>> >> > >>>>> at
>> >> > >>>>>
>> >> > >>
>> >> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
>> >> > >>>>>
>> >> > >>>>> at
>> >> > >>>>>
>> >> > >>>>>
>> >> > >>>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
>> >> > >>>>>
>> >> > >>>>> at
>> >> > >>>>>
>> >> > >>>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
>> >> > >>>>>
>> >> > >>>>> at
>> >> > >>>>>
>> >> > >>>>>
>> >> > >>>>
>> >> > >>>
>> >> > >>
>> >> >
>> >>
>> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
>> >> > >>>>>
>> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
>> >> > >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679] -
>> >> Interrupted while
>> >> > >>>> waiting
>> >> > >>>>> for message on queue
>> >> > >>>>>
>> >> > >>>>> Please let me know is this the known issue or this is
>> >> different issue
>> >> > >>>> which
>> >> > >>>>> is mention in Apache zookeeper documentation when
>> >> upgrading from
>> >> > >> 3.4.5
>> >> > >>> to
>> >> > >>>>> 3.5.6
>> >> > >>>>>
>> >> > >>>>> Thanks,
>> >> > >>>>> ---------------------
>> >> > >>>>> Kuldeep Singh Budania
>> >> > >>>>> Software Architect
>> >> > >>>>>
>> >> > >>>>>
>> >> > >>>>>
>> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer <
>> >> shralex@gmail.com>
>> >> > >>>>> wrote:
>> >> > >>>>>
>> >> > >>>>>> +1 to what Mate said (I wrote the quoted
>> instructions).
>> >> > >>>>>>
>> >> > >>>>>>
>> >> > >>>>>>
>> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő Máté <
>> >> > >>>>>> szalay.beko.mate@gmail.com>
>> >> > >>>>>> wrote:
>> >> > >>>>>>
>> >> > >>>>>>> Hi Kuldeep,
>> >> > >>>>>>>
>> >> > >>>>>>> I just want to provide you some background info about
>> >> our
>> >> > >>>>> documentation.
>> >> > >>>>>>> The reason to upgrade to 3.4.6 first is to avoid the
>> >> following
>> >> > >>> error:
>> >> > >>>>>>>
>> >> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
>> >> > >>> 127.0.0.1:2784
>> >> > >>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
>> >> > >>>>>>>
>> >> > >>>>>>> This error comes because of the protocol changes
>> between
>> >> > >> ZooKeeper
>> >> > >>>>> server
>> >> > >>>>>>> nodes during connection initiation for leader
>> election.
>> >> In
>> >> > >>> ZooKeeper
>> >> > >>>>> 3.5
>> >> > >>>>>> a
>> >> > >>>>>>> protocol version was introduced (see ZOOKEEPER-107)
>> and
>> >> since
>> >> > >> that
>> >> > >>>> time
>> >> > >>>>>> the
>> >> > >>>>>>> fist long value sent in the initial message is not
>> the
>> >> server ID
>> >> > >>> but
>> >> > >>>>> the
>> >> > >>>>>>> protocol version (-65536). In ZooKeeper 3.4.6 we made
>> >> the old 3.4
>> >> > >>>>>>> ZooKeepers backward compatible, so they are able to
>> >> parse both
>> >> > >> the
>> >> > >>>> old
>> >> > >>>>>> and
>> >> > >>>>>>> the new protocol format (see ZOOKEEPER-1633). This
>> >> issue happens
>> >> > >>> only
>> >> > >>>>>> when
>> >> > >>>>>>> you need to use old (3.4.0 - 3.4.5) and new (3.5.0+)
>> >> ZooKeeper
>> >> > >>>> servers
>> >> > >>>>>>> together in the same cluster. During a rolling
>> upgrade,
>> >> this is
>> >> > >>>> usually
>> >> > >>>>>> the
>> >> > >>>>>>> case to have old and new ZooKeepers present together.
>> >> > >>>>>>>
>> >> > >>>>>>> The fact that you haven't seen any issues might be
>> >> caused by the
>> >> > >>>> order
>> >> > >>>>> of
>> >> > >>>>>>> the servers. In ZooKeeper the connection initiation
>> >> between the
>> >> > >>>> servers
>> >> > >>>>>>> during the leader election follows a specific rule.
>> As
>> >> far as I
>> >> > >>>>> remember
>> >> > >>>>>>> always the server with the larger ID 'wins the
>> >> challenge', so it
>> >> > >> is
>> >> > >>>>>>> possible, that the old server didn't need to parse
>> any
>> >> initial
>> >> > >>>> message
>> >> > >>>>>> (if
>> >> > >>>>>>> it had the largest ID) and this is why you haven't
>> seen
>> >> the
>> >> > >> issue.
>> >> > >>>> Also
>> >> > >>>>>>> having 2 nodes up from the 3 nodes cluster still
>> makes
>> >> the
>> >> > >> cluster
>> >> > >>>> work
>> >> > >>>>>> (so
>> >> > >>>>>>> you should also check if all the servers are part of
>> >> the quorum).
>> >> > >>>>>>>
>> >> > >>>>>>> I agree with Enrico and Norbert, the safest and most
>> >> stable way
>> >> > >> is
>> >> > >>>>>> upgrade
>> >> > >>>>>>> first to 3.4.latest, then go to 3.5.latest. Still, if
>> >> you don't
>> >> > >> see
>> >> > >>>>> that
>> >> > >>>>>>> you would hit this specific issue (e.g. no "Invalid
>> >> server id" in
>> >> > >>> the
>> >> > >>>>> log
>> >> > >>>>>>> files), and all the three servers can handle traffic,
>> >> then maybe
>> >> > >>> you
>> >> > >>>>>> don't
>> >> > >>>>>>> need to upgrade first to 3.4.latest, it is your
>> >> decision.
>> >> > >>> Definitely
>> >> > >>>>> you
>> >> > >>>>>>> should test it first, as suggested by the others.
>> >> > >>>>>>>
>> >> > >>>>>>> Kind regards,
>> >> > >>>>>>> Mate
>> >> > >>>>>>>
>> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
>> >> > >>>>>>> <nk...@cloudera.com.invalid> wrote:
>> >> > >>>>>>>
>> >> > >>>>>>>> Hi,
>> >> > >>>>>>>>
>> >> > >>>>>>>> That guide is to upgrade to 3.5.0, which was an
>> alpha
>> >> version.
>> >> > >> A
>> >> > >>>> lot
>> >> > >>>>>> has
>> >> > >>>>>>>> changed for the first stable release of 3.5.5 and
>> then
>> >> a few
>> >> > >>> more,
>> >> > >>>>> even
>> >> > >>>>>>>> rolling upgrade issues have been fixed for 3.5.6.
>> >> > >>>>>>>> This is a more up-to-date guide:
>> >> > >>>>>>>>
>> >> > >>>
>> >> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
>> >> > >>>>>>>>
>> >> > >>>>>>>> If you have done your testing (with prod snapshot!),
>> >> then you
>> >> > >> can
>> >> > >>>>> skip
>> >> > >>>>>>> 3.4
>> >> > >>>>>>>> latest upgrade, but keep in mind we do our
>> >> recommendations for
>> >> > >> a
>> >> > >>>>>> reason.
>> >> > >>>>>>>> There were issues reported and/or found during
>> >> testing. Some
>> >> > >> are
>> >> > >>>>> fixed
>> >> > >>>>>>> with
>> >> > >>>>>>>> 3.5.6, some only happens if certain conditions stand
>> >> > >>> (IOException:
>> >> > >>>> No
>> >> > >>>>>>>> snapshot found - mentioned in the guide, fixed in
>> >> 3.5.6).
>> >> > >>>>>>>>
>> >> > >>>>>>>> So it is up to you, I would still recommend to do an
>> >> 3.4
>> >> > >> upgrade
>> >> > >>>>> first,
>> >> > >>>>>>> if
>> >> > >>>>>>>> it's feasible.
>> >> > >>>>>>>>
>> >> > >>>>>>>> Regards,
>> >> > >>>>>>>> Norbert
>> >> > >>>>>>>>
>> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep singh <
>> >> > >>>>>>> kuldeep.singh08@gmail.com>
>> >> > >>>>>>>> wrote:
>> >> > >>>>>>>>
>> >> > >>>>>>>>> Hi,
>> >> > >>>>>>>>>
>> >> > >>>>>>>>> Current Zookeeper version :- 3.4.5
>> >> > >>>>>>>>> Upgraded version :- 3.5.6
>> >> > >>>>>>>>>
>> >> > >>>>>>>>> We are not going with 3.5.7. Our final decision is
>> >> zookeeper
>> >> > >>>>> version
>> >> > >>>>>> is
>> >> > >>>>>>>>> 3.5.6
>> >> > >>>>>>>>> as per your reply first we need to move latest
>> >> version of
>> >> > >>> 3.4.x,
>> >> > >>>>> like
>> >> > >>>>>>>> below
>> >> > >>>>>>>>>
>> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am wrong
>> >> here)
>> >> > >>>>>>>>>
>> >> > >>>>>>>>> But if We are not facing any problem that i have
>> >> shared you
>> >> > >>> that
>> >> > >>>> we
>> >> > >>>>>>> have
>> >> > >>>>>>>>> set up of 3 node cluster where 2 node are on 3.5.6
>> >> version
>> >> > >> and
>> >> > >>> 1
>> >> > >>>>> node
>> >> > >>>>>>> on
>> >> > >>>>>>>>> 3.4.5, Everything is running fine and didn't get
>> any
>> >> issue,
>> >> > >> So
>> >> > >>>> what
>> >> > >>>>>>> other
>> >> > >>>>>>>>> problem we can face if we directly move to 3.5.6
>> >> > >>>>>>>>>
>> >> > >>>>>>>>> Thanks,
>> >> > >>>>>>>>> ---------------------
>> >> > >>>>>>>>> Kuldeep Singh Budania
>> >> > >>>>>>>>> Software Architect
>> >> > >>>>>>>>>
>> >> > >>>>>>>>>
>> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico Olivelli <
>> >> > >>>>> eolivelli@gmail.com
>> >> > >>>>>>>
>> >> > >>>>>>>>> wrote:
>> >> > >>>>>>>>>
>> >> > >>>>>>>>>> Hi
>> >> > >>>>>>>>>> You have to upgrade to latest 3.4.x Zookeeper then
>> >> you will
>> >> > >>>>> upgrade
>> >> > >>>>>>> to
>> >> > >>>>>>>>>> 3.5.7.
>> >> > >>>>>>>>>> All should run well without issues
>> >> > >>>>>>>>>>
>> >> > >>>>>>>>>>
>> >> > >>>>>>>>>> Enrico
>> >> > >>>>>>>>>>
>> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
>> >> > >>>>> kuldeep.singh08@gmail.com
>> >> > >>>>>>>
>> >> > >>>>>>> ha
>> >> > >>>>>>>>>> scritto:
>> >> > >>>>>>>>>>
>> >> > >>>>>>>>>>> Hi Team,
>> >> > >>>>>>>>>>>
>> >> > >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to 3.5.6. I
>> >> have
>> >> > >> set
>> >> > >>>> up 3
>> >> > >>>>>>> node
>> >> > >>>>>>>>>>> cluster where 2 node are on 3.5.6 version and 1
>> >> node on
>> >> > >>>> 3.4.5.
>> >> > >>>>>>>>>>>
>> >> > >>>>>>>>>>> Everything is running fine and didn't get any
>> issue
>> >> on my
>> >> > >>>>> system.
>> >> > >>>>>>>>>>>
>> >> > >>>>>>>>>>> but I found something on apache site that first
>> we
>> >> need
>> >> > >> to
>> >> > >>>>>> upgrade
>> >> > >>>>>>>> on
>> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is it
>> >> mandatory
>> >> > >> to
>> >> > >>> go
>> >> > >>>>> on
>> >> > >>>>>>>> 3.4.6
>> >> > >>>>>>>>>>> first.
>> >> > >>>>>>>>>>>
>> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
>> >> > >>>>>>>>>>>
>> >> > >>>>>>>>>>> Upgrading a running ZooKeeper ensemble to 3.5.0
>> >> should be
>> >> > >>>> done
>> >> > >>>>>> only
>> >> > >>>>>>>>> after
>> >> > >>>>>>>>>>> upgrading your ensemble to the 3.4.6 release.
>> Note
>> >> that
>> >> > >>> this
>> >> > >>>> is
>> >> > >>>>>>> only
>> >> > >>>>>>>>>>> necessary for rolling upgrades (if you're fine
>> with
>> >> > >>> shutting
>> >> > >>>>> down
>> >> > >>>>>>> the
>> >> > >>>>>>>>>>> system completely, you don't have to go through
>> >> 3.4.6).
>> >> > >> If
>> >> > >>>> you
>> >> > >>>>>>>> attempt
>> >> > >>>>>>>>> a
>> >> > >>>>>>>>>>> rolling upgrade without going through 3.4.6 (for
>> >> example
>> >> > >>> from
>> >> > >>>>>>> 3.4.5),
>> >> > >>>>>>>>> you
>> >> > >>>>>>>>>>> may get the following error:
>> >> > >>>>>>>>>>>
>> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO
>> [localhost/
>> >> > >>>>>> 127.0.0.1:2784
>> >> > >>>>>>>>>>> :QuorumCnxManager$Listener@498] - Received
>> >> connection
>> >> > >>>> request
>> >> > >>>>> /
>> >> > >>>>>>>>>>> 127.0.0.1:60876
>> >> > >>>>>>>>>>>
>> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
>> [localhost/
>> >> > >>>>>> 127.0.0.1:2784
>> >> > >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server id:
>> -65536
>> >> > >>>>>>>>>>>
>> >> > >>>>>>>>>>> During a rolling upgrade, each server is taken
>> down
>> >> in
>> >> > >> turn
>> >> > >>>> and
>> >> > >>>>>>>>> rebooted
>> >> > >>>>>>>>>>> with the new 3.5.0 binaries. Before starting the
>> >> server
>> >> > >>> with
>> >> > >>>>>> 3.5.0
>> >> > >>>>>>>>>>> binaries, we highly recommend updating the
>> >> configuration
>> >> > >>> file
>> >> > >>>>> so
>> >> > >>>>>>> that
>> >> > >>>>>>>>> all
>> >> > >>>>>>>>>>> server statements "server.x=..." contain client
>> >> ports
>> >> > >> (see
>> >> > >>>> the
>> >> > >>>>>>>> section
>> >> > >>>>>>>>>>> Specifying
>> >> > >>>>>>>>>>> the client port). As explained earlier you may
>> >> leave the
>> >> > >>>>>>>> configuration
>> >> > >>>>>>>>>> in a
>> >> > >>>>>>>>>>> single file, as well as leave the
>> >> > >>>> clientPort/clientPortAddress
>> >> > >>>>>>>>> statements
>> >> > >>>>>>>>>>> (although if you specify client ports in the new
>> >> format,
>> >> > >>>> these
>> >> > >>>>>>>>> statements
>> >> > >>>>>>>>>>> are now redundant).
>> >> > >>>>>>>>>>>
>> >> > >>>>>>>>>>> Could you please let me know about this case.
>> >> Appreciate
>> >> > >> if
>> >> > >>>>>> respond
>> >> > >>>>>>>>> soon.
>> >> > >>>>>>>>>>>
>> >> > >>>>>>>>>>> Thanks,
>> >> > >>>>>>>>>>> ---------------------
>> >> > >>>>>>>>>>> Kuldeep Singh Budania
>> >> > >>>>>>>>>>>
>> >> > >>>>>>>>>>
>> >> > >>>>>>>>>
>> >> > >>>>>>>>
>> >> > >>>>>>>
>> >> > >>>>>>
>> >> > >>>>>
>> >> > >>>>
>> >> > >>>
>> >> > >>
>> >> >
>> >> >
>> >>
>> >>
>> >> ________________________________
>> >>
>> >> CONFIDENTIALITY & PRIVACY NOTICE
>> >> This e-mail (including any attachments) is strictly confidential
>> and
>> >> may also contain privileged information. If you are not the intended
>> >> recipient you are not authorised to read, print, save, process or
>> disclose
>> >> this message. If you have received this message by mistake, please
>> inform
>> >> the sender immediately and destroy this e-mail, its attachments and any
>> >> copies. Any use, distribution, reproduction or disclosure by any person
>> >> other than the intended recipient is strictly prohibited and the person
>> >> responsible may incur in penalties.
>> >> The use of this e-mail is only for professional purposes; there is
>> no
>> >> guarantee that the correspondence towards this e-mail will be read
>> only by
>> >> the recipient, because, under certain circumstances, there may be a
>> need to
>> >> access this email by third subjects belonging to the Company.
>> >>
>> >>
>> >> ________________________________
>> >>
>> >> CONFIDENTIALITY & PRIVACY NOTICE
>> >> This e-mail (including any attachments) is strictly confidential and
>> may
>> >> also contain privileged information. If you are not the intended
>> recipient
>> >> you are not authorised to read, print, save, process or disclose this
>> >> message. If you have received this message by mistake, please inform
>> the
>> >> sender immediately and destroy this e-mail, its attachments and any
>> copies.
>> >> Any use, distribution, reproduction or disclosure by any person other
>> than
>> >> the intended recipient is strictly prohibited and the person
>> responsible
>> >> may incur in penalties.
>> >> The use of this e-mail is only for professional purposes; there is no
>> >> guarantee that the correspondence towards this e-mail will be read
>> only by
>> >> the recipient, because, under certain circumstances, there may be a
>> need to
>> >> access this email by third subjects belonging to the Company.
>> >>
>> >
>>
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by Szalay-Bekő Máté <sz...@gmail.com>.
> My ZK server is up and running in secure mode
What is your goal? You want to setup client-server SSL connection?
see:
https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide
(or you want to have both SSL and SASL enabled?)
Anyway, please remove the following line from the SERVER_JVMFLAGS:
-Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
This is a configuration that makes sense only for the ZooKeeper client, not
for the server. For the server, use the following:
-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
If it doesn't solve the issue, then can you please send your zoo.cfg file?
Also can you please send the zkCli command you execute? (you need to
connect to the secure ZooKeeper port, unless portUnification is enabled)
Kind regards,
Mate
On Wed, Jul 1, 2020 at 9:48 AM kuldeep singh <ku...@gmail.com>
wrote:
> Hi,
>
> we have done below changes in java.env file
>
> export SERVER_JVMFLAGS="
>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> -Dzookeeper.ssl.keyStore.password=testpass
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> -Dzookeeper.ssl.trustStore.password=testpass"
>
>
>
> export CLIENT_JVMFLAGS="
>
> -Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
> -Dzookeeper.client.secure=true
> -Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
> -Dzookeeper.ssl.keyStore.password=testpass
> -Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
> -Dzookeeper.ssl.trustStore.password=testpass"
>
> I have started the ZK server and it is up without any issue.
>
> But now when I login to ZkCli then it gives the below error.
>
> WatchedEvent state:AuthFailed type:None path:null
>
>
> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication provider
> for scheme: ztpasswd has x509 ip digest*
>
> Please help me on this issue
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
> Software Architect
>
>
> On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <ku...@gmail.com>
> wrote:
>
> > Hi,
> >
> > My ZK server is up and running in secure mode, But When I am trying to
> > connect to the ZK server using ZKCli, it gives the below error.
> >
> > WatchedEvent state:AuthFailed type:None path:null
> >
> >
> > Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> > [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication
> provider
> > for scheme: ztpasswd has x509 ip digest*
> >
> > Can someone please help me on this issue. we are using the 3.5.6 version.
> >
> > I appreciate if I will get a response as soon as possible, as I am stuck
> > at this point.
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> > Software Architect
> >
> >
> >
> > On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli - Diennea
> > <en...@diennea.com.invalid> wrote:
> >
> >> I mean in zoo.cfg
> >> Not as a system property
> >>
> >> Enrico
> >>
> >> Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <
> >> enrico.olivelli@diennea.com.INVALID> ha scritto:
> >>
> >> Hi
> >> You have to enable Netty on the server side
> >>
> >> Something like:
> >> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >>
> >> Hope that helps
> >> Enrico
> >>
> >> Il giorno 24/06/20, 19:17 "kuldeep singh" <
> kuldeep.singh08@gmail.com>
> >> ha scritto:
> >>
> >> Hi,
> >>
> >> I got below error while setting SSL properties in zkEnv.sh
> >>
> >>
> >>
> >>
> >>
> ==========================================================================================
> >>
> >> 2020-06-24 15:49:35,864 - INFO [main:QuorumPeerConfig@133] -
> >> Reading
> >> configuration from: /etc/zookeeper/zoo.cfg
> >>
> >> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@385] -
> >> clientPortAddress is 0.0.0.0/0.0.0.0:10181
> >>
> >> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@399] -
> >> secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
> >>
> >> 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] - Setting -D
> >> jdk.tls.rejectClientInitiatedRenegotiation=true to disable
> >> client-initiated
> >> TLS renegotiation
> >>
> >> 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@78]
> -
> >> autopurge.snapRetainCount set to 3
> >>
> >> 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@79]
> -
> >> autopurge.purgeInterval set to 1
> >>
> >> 2020-06-24 15:49:35,898 - INFO [
> >> PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge task
> >> started.
> >>
> >> 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] - Log4j
> >> found with
> >> jmx enabled.
> >>
> >> 2020-06-24 15:49:35,903 - INFO [PurgeTask:FileTxnSnapLog@103]
> -
> >> zookeeper.snapshot.trust.empty : false
> >>
> >> 2020-06-24 15:49:35,910 - INFO [
> >> PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge task
> >> completed.
> >>
> >> 2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141] -
> >> Starting quorum
> >> peer
> >>
> >> 2020-06-24 15:49:35,983 - INFO [main:ServerCnxnFactory@135] -
> >> Using
> >> org.apache.zookeeper.server.NIOServerCnxnFactory as server
> >> connection
> >> factory
> >>
> >> 2020-06-24 15:49:35,986 - INFO [main:NIOServerCnxnFactory@673]
> -
> >> Configuring NIO connection handler with 10s sessionless
> >> connection timeout,
> >> 2 selector thread(s), 16 worker threads, and 64 kB direct
> buffers.
> >>
> >> 2020-06-24 15:49:35,992 - INFO [main:NIOServerCnxnFactory@686]
> >> - binding
> >> to port 0.0.0.0/0.0.0.0:10181
> >>
> >> 2020-06-24 15:49:35,994 - INFO [main:ServerCnxnFactory@135] -
> >> Using
> >> org.apache.zookeeper.server.NIOServerCnxnFactory as server
> >> connection
> >> factory
> >>
> >> 2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101] -
> >> Unexpected
> >> exception, exiting abnormally
> >>
> >> java.lang.UnsupportedOperationException: SSL isn't supported in
> >> NIOServerCnxn
> >>
> >> at
> >>
> >>
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
> >>
> >> at
> >>
> >>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
> >>
> >> at
> >>
> >>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
> >>
> >> at
> >>
> >>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
> >>
> >>
> >>
> >>
> >>
> >> I have set the following properties in SERVER_JVMFLAGS in
> >> zkEnv.sh file :
> >>
> >>
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
> >>
> >>
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> >> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
> >>
> >>
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> >> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
> >>
> >> Thanks,
> >> ---------------------
> >> Kuldeep Singh Budania
> >>
> >>
> >>
> >> On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <
> >> jordan@jordanzimmerman.com>
> >> wrote:
> >>
> >> > It's the same as the normal ZooKeeper client:
> >> >
> >>
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >> > <
> >> >
> >>
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >> > >
> >> >
> >> > -Jordan
> >> >
> >> > > On Jun 22, 2020, at 5:50 AM, kuldeep singh <
> >> kuldeep.singh08@gmail.com>
> >> > wrote:
> >> > >
> >> > > Hi Team,
> >> > > How we will do secure communication between the Curator
> >> framework and
> >> > > zookeeper 3.5.6 ?
> >> > > I didn't get any solution right now.
> >> > > I appreciate it if someone could help me with the same.
> >> > >
> >> > > Thanks,
> >> > > ---------------------
> >> > > Kuldeep Singh Budania
> >> > > Software Architect
> >> > >
> >> > >
> >> > > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
> >> > szalay.beko.mate@gmail.com>
> >> > > wrote:
> >> > >
> >> > >> Hello Kuldeep,
> >> > >>
> >> > >> did you download the source from the ZooKeeper webpage, or
> >> checked out
> >> > from
> >> > >> git?
> >> > >> Anyway, the following commands should work:
> >> > >>
> >> > >> wget
> >> > >>
> >> > >>
> >> >
> >>
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> >> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
> >> > >> cd apache-zookeeper-3.5.7
> >> > >> mvn clean install -DskipTests
> >> > >>
> >> > >> I tested it with OpenJDK 8u424 and maven 3.6.0.
> >> > >>
> >> > >> Kind regards,
> >> > >> Mate
> >> > >>
> >> > >>
> >> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
> >> > kuldeep.singh08@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >>> Hi All,
> >> > >>>
> >> > >>> I have download the zookeeper source code and run the mvn
> >> command for
> >> > >>> packaging but get problem on "zookeeper-server" directory.
> >> > >>>
> >> > >>> *command :- mvn clean package*
> >> > >>>
> >> > >>> [ERROR] Failed to execute goal
> >> > >>>
> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >> > >>> (default-compile) on project zookeeper: Fatal error
> >> compiling:
> >> > >>> java.lang.NullPointerException -> [Help 1]
> >> > >>> org.apache.maven.lifecycle.LifecycleExecutionException:
> >> Failed to
> >> > execute
> >> > >>> goal
> >> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >> > >>> (default-compile) on project zookeeper: Fatal error
> >> compiling
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> >> > >>> at
> >> > org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> >> > >>> at
> >> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> >> > >>> at
> >> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> >> > >>> at
> >> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> >> > >>> at
> >> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> >> > >>> at
> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >> > >>> at java.lang.reflect.Method.invoke(Method.java:498)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> >> > >>> at
> >> > >>>
> >> > >>
> >> >
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> >> > >>> at
> >> > >>>
> >> >
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> >> > >>> Caused by: org.apache.maven.plugin.MojoExecutionException:
> >> Fatal error
> >> > >>> compiling
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> >> > >>> ... 19 more
> >> > >>> Caused by: org.codehaus.plexus.compiler.CompilerException:
> >> > >>> java.lang.NullPointerException
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> >> > >>> ... 22 more
> >> > >>> Caused by: java.lang.RuntimeException:
> >> java.lang.NullPointerException
> >> > >>> at
> >> com.sun.tools.javac.main.Main.compile(Main.java:559)
> >> > >>> at
> >> > >>>
> >> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> >> > >>> at
> >> > >>>
> >> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> >> > >>> ... 24 more
> >> > >>> Caused by: java.lang.NullPointerException
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> >> > >>> at
> com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> >> > >>> at
> >> com.sun.tools.doclint.Checker.scan(Checker.java:144)
> >> > >>> at
> >> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> >> > >>> at
> >> > >>>
> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> >> > >>> at
> >> > >>>
> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >> > >>> at
> >> > >>>
> >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >> > >>> at
> >> > >>>
> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > >>> at
> >> > >>>
> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >> > >>> at
> >> > >>>
> >> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> >> > >>> at
> >> > >>>
> >> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> >> > >>> at
> >> > >>>
> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > >>> at
> >> > >>>
> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >> > >>> at
> >> > >>>
> >> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> >> > >>> at
> >> > >>>
> >> >
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> >> > >>> at
> >> > >>>
> >> >
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> >> > >>> at
> >> > >>>
> >> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> >> > >>> at
> >> > >>>
> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > >>> at
> >> > >>>
> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >> > >>> at
> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >> > >>> at
> >> > >>>
> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >> > >>> at
> >> > >>
> >> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> >> > >>> at
> >> > >>>
> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> >> > >>> at
> >> > >>>
> >> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >> > >>> at
> >> > >>>
> >> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >> > >>> at
> >> > >>>
> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > >>> at
> >> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >> > >>> at
> >> > >>>
> >> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >> > >>> at
> >> > >>>
> >> > >>
> >> >
> >>
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> >> > >>> at
> >> > >>>
> >> >
> >>
> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> >> > >>> at
> >> > >>>
> >> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >> > >>> at
> >> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> >> > >>> at
> >> > >>>
> >> > >>>
> >> > >>
> >> >
> >>
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> >> > >>> at
> >> > >>>
> >> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> >> > >>> at
> >> > >>>
> >> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> >> > >>> at
> >> > >>>
> >> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> >> > >>> at
> >> com.sun.tools.javac.main.Main.compile(Main.java:523)
> >> > >>> ... 27 more
> >> > >>> [ERROR]
> >> > >>> [ERROR] Re-run Maven using the -X switch to enable full
> >> debug logging.
> >> > >>> [ERROR]
> >> > >>> [ERROR] For more information about the errors and possible
> >> solutions,
> >> > >>> please read the following articles:
> >> > >>> [ERROR] [Help 1]
> >> > >>>
> >> >
> >> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> >> > >>>
> >> > >>> Can someone help me on this issue?
> >> > >>>
> >> > >>> Thanks,
> >> > >>> ---------------------
> >> > >>> Kuldeep Singh Budania
> >> > >>>
> >> > >>>
> >> > >>>
> >> > >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
> >> > >>> szalay.beko.mate@gmail.com>
> >> > >>> wrote:
> >> > >>>
> >> > >>>> these exceptions can mean many things... I think this can
> >> be even
> >> > >> normal
> >> > >>>> duding rolling restart (as some connections get broken in
> >> this case)
> >> > >>>>
> >> > >>>> However, I saw cases already when exceptions like these
> >> killed
> >> > receiver
> >> > >>> or
> >> > >>>> sender threads in QuorumCnxManager / Leader Election in
> >> such a way
> >> > that
> >> > >>>> they were not able to recover, so the node was unable to
> >> connect to
> >> > any
> >> > >>>> quorum until restart. I remember seeing this in 3.4 too.
> >> > >>>>
> >> > >>>> Do you see these exceptions in the second server (the one
> >> which you
> >> > >> just
> >> > >>>> upgraded in step 3)?
> >> > >>>> Is this issue reproducible?
> >> > >>>>
> >> > >>>> What is the tickTime and initLimit you use? Maybe the
> >> server just
> >> > >> require
> >> > >>>> more time to sync?
> >> > >>>>
> >> > >>>> I would need more logs to really see what happened. Can
> >> you create a
> >> > >> Jira
> >> > >>>> issue and upload the logs and also the ZooKeeper configs?
> >> I am happy
> >> > to
> >> > >>>> take a closer look.
> >> > >>>> (if you need to re-run the test to collect the logs, then
> >> enabling
> >> > >> DEBUG
> >> > >>>> logs would be great. The INFO level logs are usually
> >> enough for these
> >> > >>>> problems, but one can never know...)
> >> > >>>>
> >> > >>>> Kind regards,
> >> > >>>> Mate
> >> > >>>>
> >> > >>>>
> >> > >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
> >> > >> kuldeep.singh08@gmail.com
> >> > >>>>
> >> > >>>> wrote:
> >> > >>>>
> >> > >>>>> Hi Team,
> >> > >>>>>
> >> > >>>>> I have done some POC on rolling upgrade and found below
> >> result.
> >> > >>>>>
> >> > >>>>>
> >> > >>>>> 1. On 1st node upgrade zookeeper . Traffic was running
> >> fine
> >> > >> because
> >> > >>> 2
> >> > >>>>> nodes are already on old zookeeper.
> >> > >>>>> 2. On 1st node upgrade our application and didn’t find
> >> any issue
> >> > >>>>> 3. On 2nd node upgrade zookeeper but got below error
> >> and zookeeper
> >> > >>> is
> >> > >>>>> not taking any requests
> >> > >>>>> 4.
> >> > >>>>>
> >> > >>>>> java.io.EOFException
> >> > >>>>>
> >> > >>>>> at
> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
> >> > >>>>>
> >> > >>>>> at
> >> > >>>>>
> >> > >>>>>
> >> > >>>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> >> > >>>>>
> >> > >>>>> 2020-03-30 14:19:55,587 - WARN
> >> > >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765] -
> >> Interrupting
> >> > >>> SendWorker
> >> > >>>>>
> >> > >>>>> 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/
> >> 192.168.44.73:33754
> >> > >>>>> :LearnerHandler@562] - Unexpected exception causing
> >> shutdown while
> >> > >>> sock
> >> > >>>>> still open
> >> > >>>>>
> >> > >>>>> java.io.EOFException
> >> > >>>>>
> >> > >>>>> at
> >> java.io.DataInputStream.readInt(DataInputStream.java:392)
> >> > >>>>>
> >> > >>>>> at
> >> > >>>>>
> >> > >>
> >> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> >> > >>>>>
> >> > >>>>> at
> >> > >>>>>
> >> > >>>>>
> >> > >>>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> >> > >>>>>
> >> > >>>>> at
> >> > >>>>>
> >> > >>>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> >> > >>>>>
> >> > >>>>> at
> >> > >>>>>
> >> > >>>>>
> >> > >>>>
> >> > >>>
> >> > >>
> >> >
> >>
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> >> > >>>>>
> >> > >>>>> 2020-03-30 14:19:55,588 - WARN
> >> > >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679] -
> >> Interrupted while
> >> > >>>> waiting
> >> > >>>>> for message on queue
> >> > >>>>>
> >> > >>>>> Please let me know is this the known issue or this is
> >> different issue
> >> > >>>> which
> >> > >>>>> is mention in Apache zookeeper documentation when
> >> upgrading from
> >> > >> 3.4.5
> >> > >>> to
> >> > >>>>> 3.5.6
> >> > >>>>>
> >> > >>>>> Thanks,
> >> > >>>>> ---------------------
> >> > >>>>> Kuldeep Singh Budania
> >> > >>>>> Software Architect
> >> > >>>>>
> >> > >>>>>
> >> > >>>>>
> >> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer <
> >> shralex@gmail.com>
> >> > >>>>> wrote:
> >> > >>>>>
> >> > >>>>>> +1 to what Mate said (I wrote the quoted instructions).
> >> > >>>>>>
> >> > >>>>>>
> >> > >>>>>>
> >> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő Máté <
> >> > >>>>>> szalay.beko.mate@gmail.com>
> >> > >>>>>> wrote:
> >> > >>>>>>
> >> > >>>>>>> Hi Kuldeep,
> >> > >>>>>>>
> >> > >>>>>>> I just want to provide you some background info about
> >> our
> >> > >>>>> documentation.
> >> > >>>>>>> The reason to upgrade to 3.4.6 first is to avoid the
> >> following
> >> > >>> error:
> >> > >>>>>>>
> >> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
> >> > >>> 127.0.0.1:2784
> >> > >>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
> >> > >>>>>>>
> >> > >>>>>>> This error comes because of the protocol changes
> between
> >> > >> ZooKeeper
> >> > >>>>> server
> >> > >>>>>>> nodes during connection initiation for leader
> election.
> >> In
> >> > >>> ZooKeeper
> >> > >>>>> 3.5
> >> > >>>>>> a
> >> > >>>>>>> protocol version was introduced (see ZOOKEEPER-107)
> and
> >> since
> >> > >> that
> >> > >>>> time
> >> > >>>>>> the
> >> > >>>>>>> fist long value sent in the initial message is not the
> >> server ID
> >> > >>> but
> >> > >>>>> the
> >> > >>>>>>> protocol version (-65536). In ZooKeeper 3.4.6 we made
> >> the old 3.4
> >> > >>>>>>> ZooKeepers backward compatible, so they are able to
> >> parse both
> >> > >> the
> >> > >>>> old
> >> > >>>>>> and
> >> > >>>>>>> the new protocol format (see ZOOKEEPER-1633). This
> >> issue happens
> >> > >>> only
> >> > >>>>>> when
> >> > >>>>>>> you need to use old (3.4.0 - 3.4.5) and new (3.5.0+)
> >> ZooKeeper
> >> > >>>> servers
> >> > >>>>>>> together in the same cluster. During a rolling
> upgrade,
> >> this is
> >> > >>>> usually
> >> > >>>>>> the
> >> > >>>>>>> case to have old and new ZooKeepers present together.
> >> > >>>>>>>
> >> > >>>>>>> The fact that you haven't seen any issues might be
> >> caused by the
> >> > >>>> order
> >> > >>>>> of
> >> > >>>>>>> the servers. In ZooKeeper the connection initiation
> >> between the
> >> > >>>> servers
> >> > >>>>>>> during the leader election follows a specific rule. As
> >> far as I
> >> > >>>>> remember
> >> > >>>>>>> always the server with the larger ID 'wins the
> >> challenge', so it
> >> > >> is
> >> > >>>>>>> possible, that the old server didn't need to parse any
> >> initial
> >> > >>>> message
> >> > >>>>>> (if
> >> > >>>>>>> it had the largest ID) and this is why you haven't
> seen
> >> the
> >> > >> issue.
> >> > >>>> Also
> >> > >>>>>>> having 2 nodes up from the 3 nodes cluster still makes
> >> the
> >> > >> cluster
> >> > >>>> work
> >> > >>>>>> (so
> >> > >>>>>>> you should also check if all the servers are part of
> >> the quorum).
> >> > >>>>>>>
> >> > >>>>>>> I agree with Enrico and Norbert, the safest and most
> >> stable way
> >> > >> is
> >> > >>>>>> upgrade
> >> > >>>>>>> first to 3.4.latest, then go to 3.5.latest. Still, if
> >> you don't
> >> > >> see
> >> > >>>>> that
> >> > >>>>>>> you would hit this specific issue (e.g. no "Invalid
> >> server id" in
> >> > >>> the
> >> > >>>>> log
> >> > >>>>>>> files), and all the three servers can handle traffic,
> >> then maybe
> >> > >>> you
> >> > >>>>>> don't
> >> > >>>>>>> need to upgrade first to 3.4.latest, it is your
> >> decision.
> >> > >>> Definitely
> >> > >>>>> you
> >> > >>>>>>> should test it first, as suggested by the others.
> >> > >>>>>>>
> >> > >>>>>>> Kind regards,
> >> > >>>>>>> Mate
> >> > >>>>>>>
> >> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
> >> > >>>>>>> <nk...@cloudera.com.invalid> wrote:
> >> > >>>>>>>
> >> > >>>>>>>> Hi,
> >> > >>>>>>>>
> >> > >>>>>>>> That guide is to upgrade to 3.5.0, which was an alpha
> >> version.
> >> > >> A
> >> > >>>> lot
> >> > >>>>>> has
> >> > >>>>>>>> changed for the first stable release of 3.5.5 and
> then
> >> a few
> >> > >>> more,
> >> > >>>>> even
> >> > >>>>>>>> rolling upgrade issues have been fixed for 3.5.6.
> >> > >>>>>>>> This is a more up-to-date guide:
> >> > >>>>>>>>
> >> > >>>
> >> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> >> > >>>>>>>>
> >> > >>>>>>>> If you have done your testing (with prod snapshot!),
> >> then you
> >> > >> can
> >> > >>>>> skip
> >> > >>>>>>> 3.4
> >> > >>>>>>>> latest upgrade, but keep in mind we do our
> >> recommendations for
> >> > >> a
> >> > >>>>>> reason.
> >> > >>>>>>>> There were issues reported and/or found during
> >> testing. Some
> >> > >> are
> >> > >>>>> fixed
> >> > >>>>>>> with
> >> > >>>>>>>> 3.5.6, some only happens if certain conditions stand
> >> > >>> (IOException:
> >> > >>>> No
> >> > >>>>>>>> snapshot found - mentioned in the guide, fixed in
> >> 3.5.6).
> >> > >>>>>>>>
> >> > >>>>>>>> So it is up to you, I would still recommend to do an
> >> 3.4
> >> > >> upgrade
> >> > >>>>> first,
> >> > >>>>>>> if
> >> > >>>>>>>> it's feasible.
> >> > >>>>>>>>
> >> > >>>>>>>> Regards,
> >> > >>>>>>>> Norbert
> >> > >>>>>>>>
> >> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep singh <
> >> > >>>>>>> kuldeep.singh08@gmail.com>
> >> > >>>>>>>> wrote:
> >> > >>>>>>>>
> >> > >>>>>>>>> Hi,
> >> > >>>>>>>>>
> >> > >>>>>>>>> Current Zookeeper version :- 3.4.5
> >> > >>>>>>>>> Upgraded version :- 3.5.6
> >> > >>>>>>>>>
> >> > >>>>>>>>> We are not going with 3.5.7. Our final decision is
> >> zookeeper
> >> > >>>>> version
> >> > >>>>>> is
> >> > >>>>>>>>> 3.5.6
> >> > >>>>>>>>> as per your reply first we need to move latest
> >> version of
> >> > >>> 3.4.x,
> >> > >>>>> like
> >> > >>>>>>>> below
> >> > >>>>>>>>>
> >> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am wrong
> >> here)
> >> > >>>>>>>>>
> >> > >>>>>>>>> But if We are not facing any problem that i have
> >> shared you
> >> > >>> that
> >> > >>>> we
> >> > >>>>>>> have
> >> > >>>>>>>>> set up of 3 node cluster where 2 node are on 3.5.6
> >> version
> >> > >> and
> >> > >>> 1
> >> > >>>>> node
> >> > >>>>>>> on
> >> > >>>>>>>>> 3.4.5, Everything is running fine and didn't get any
> >> issue,
> >> > >> So
> >> > >>>> what
> >> > >>>>>>> other
> >> > >>>>>>>>> problem we can face if we directly move to 3.5.6
> >> > >>>>>>>>>
> >> > >>>>>>>>> Thanks,
> >> > >>>>>>>>> ---------------------
> >> > >>>>>>>>> Kuldeep Singh Budania
> >> > >>>>>>>>> Software Architect
> >> > >>>>>>>>>
> >> > >>>>>>>>>
> >> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico Olivelli <
> >> > >>>>> eolivelli@gmail.com
> >> > >>>>>>>
> >> > >>>>>>>>> wrote:
> >> > >>>>>>>>>
> >> > >>>>>>>>>> Hi
> >> > >>>>>>>>>> You have to upgrade to latest 3.4.x Zookeeper then
> >> you will
> >> > >>>>> upgrade
> >> > >>>>>>> to
> >> > >>>>>>>>>> 3.5.7.
> >> > >>>>>>>>>> All should run well without issues
> >> > >>>>>>>>>>
> >> > >>>>>>>>>>
> >> > >>>>>>>>>> Enrico
> >> > >>>>>>>>>>
> >> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
> >> > >>>>> kuldeep.singh08@gmail.com
> >> > >>>>>>>
> >> > >>>>>>> ha
> >> > >>>>>>>>>> scritto:
> >> > >>>>>>>>>>
> >> > >>>>>>>>>>> Hi Team,
> >> > >>>>>>>>>>>
> >> > >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to 3.5.6. I
> >> have
> >> > >> set
> >> > >>>> up 3
> >> > >>>>>>> node
> >> > >>>>>>>>>>> cluster where 2 node are on 3.5.6 version and 1
> >> node on
> >> > >>>> 3.4.5.
> >> > >>>>>>>>>>>
> >> > >>>>>>>>>>> Everything is running fine and didn't get any
> issue
> >> on my
> >> > >>>>> system.
> >> > >>>>>>>>>>>
> >> > >>>>>>>>>>> but I found something on apache site that first
> we
> >> need
> >> > >> to
> >> > >>>>>> upgrade
> >> > >>>>>>>> on
> >> > >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is it
> >> mandatory
> >> > >> to
> >> > >>> go
> >> > >>>>> on
> >> > >>>>>>>> 3.4.6
> >> > >>>>>>>>>>> first.
> >> > >>>>>>>>>>>
> >> > >>>>>>>>>>> *Upgrading to 3.5.0*
> >> > >>>>>>>>>>>
> >> > >>>>>>>>>>> Upgrading a running ZooKeeper ensemble to 3.5.0
> >> should be
> >> > >>>> done
> >> > >>>>>> only
> >> > >>>>>>>>> after
> >> > >>>>>>>>>>> upgrading your ensemble to the 3.4.6 release. Note
> >> that
> >> > >>> this
> >> > >>>> is
> >> > >>>>>>> only
> >> > >>>>>>>>>>> necessary for rolling upgrades (if you're fine
> with
> >> > >>> shutting
> >> > >>>>> down
> >> > >>>>>>> the
> >> > >>>>>>>>>>> system completely, you don't have to go through
> >> 3.4.6).
> >> > >> If
> >> > >>>> you
> >> > >>>>>>>> attempt
> >> > >>>>>>>>> a
> >> > >>>>>>>>>>> rolling upgrade without going through 3.4.6 (for
> >> example
> >> > >>> from
> >> > >>>>>>> 3.4.5),
> >> > >>>>>>>>> you
> >> > >>>>>>>>>>> may get the following error:
> >> > >>>>>>>>>>>
> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO
> [localhost/
> >> > >>>>>> 127.0.0.1:2784
> >> > >>>>>>>>>>> :QuorumCnxManager$Listener@498] - Received
> >> connection
> >> > >>>> request
> >> > >>>>> /
> >> > >>>>>>>>>>> 127.0.0.1:60876
> >> > >>>>>>>>>>>
> >> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN
> [localhost/
> >> > >>>>>> 127.0.0.1:2784
> >> > >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server id:
> -65536
> >> > >>>>>>>>>>>
> >> > >>>>>>>>>>> During a rolling upgrade, each server is taken
> down
> >> in
> >> > >> turn
> >> > >>>> and
> >> > >>>>>>>>> rebooted
> >> > >>>>>>>>>>> with the new 3.5.0 binaries. Before starting the
> >> server
> >> > >>> with
> >> > >>>>>> 3.5.0
> >> > >>>>>>>>>>> binaries, we highly recommend updating the
> >> configuration
> >> > >>> file
> >> > >>>>> so
> >> > >>>>>>> that
> >> > >>>>>>>>> all
> >> > >>>>>>>>>>> server statements "server.x=..." contain client
> >> ports
> >> > >> (see
> >> > >>>> the
> >> > >>>>>>>> section
> >> > >>>>>>>>>>> Specifying
> >> > >>>>>>>>>>> the client port). As explained earlier you may
> >> leave the
> >> > >>>>>>>> configuration
> >> > >>>>>>>>>> in a
> >> > >>>>>>>>>>> single file, as well as leave the
> >> > >>>> clientPort/clientPortAddress
> >> > >>>>>>>>> statements
> >> > >>>>>>>>>>> (although if you specify client ports in the new
> >> format,
> >> > >>>> these
> >> > >>>>>>>>> statements
> >> > >>>>>>>>>>> are now redundant).
> >> > >>>>>>>>>>>
> >> > >>>>>>>>>>> Could you please let me know about this case.
> >> Appreciate
> >> > >> if
> >> > >>>>>> respond
> >> > >>>>>>>>> soon.
> >> > >>>>>>>>>>>
> >> > >>>>>>>>>>> Thanks,
> >> > >>>>>>>>>>> ---------------------
> >> > >>>>>>>>>>> Kuldeep Singh Budania
> >> > >>>>>>>>>>>
> >> > >>>>>>>>>>
> >> > >>>>>>>>>
> >> > >>>>>>>>
> >> > >>>>>>>
> >> > >>>>>>
> >> > >>>>>
> >> > >>>>
> >> > >>>
> >> > >>
> >> >
> >> >
> >>
> >>
> >> ________________________________
> >>
> >> CONFIDENTIALITY & PRIVACY NOTICE
> >> This e-mail (including any attachments) is strictly confidential and
> >> may also contain privileged information. If you are not the intended
> >> recipient you are not authorised to read, print, save, process or
> disclose
> >> this message. If you have received this message by mistake, please
> inform
> >> the sender immediately and destroy this e-mail, its attachments and any
> >> copies. Any use, distribution, reproduction or disclosure by any person
> >> other than the intended recipient is strictly prohibited and the person
> >> responsible may incur in penalties.
> >> The use of this e-mail is only for professional purposes; there is
> no
> >> guarantee that the correspondence towards this e-mail will be read only
> by
> >> the recipient, because, under certain circumstances, there may be a
> need to
> >> access this email by third subjects belonging to the Company.
> >>
> >>
> >> ________________________________
> >>
> >> CONFIDENTIALITY & PRIVACY NOTICE
> >> This e-mail (including any attachments) is strictly confidential and may
> >> also contain privileged information. If you are not the intended
> recipient
> >> you are not authorised to read, print, save, process or disclose this
> >> message. If you have received this message by mistake, please inform the
> >> sender immediately and destroy this e-mail, its attachments and any
> copies.
> >> Any use, distribution, reproduction or disclosure by any person other
> than
> >> the intended recipient is strictly prohibited and the person responsible
> >> may incur in penalties.
> >> The use of this e-mail is only for professional purposes; there is no
> >> guarantee that the correspondence towards this e-mail will be read only
> by
> >> the recipient, because, under certain circumstances, there may be a
> need to
> >> access this email by third subjects belonging to the Company.
> >>
> >
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Hi,
we have done below changes in java.env file
export SERVER_JVMFLAGS="
-Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
-Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
-Dzookeeper.ssl.keyStore.password=testpass
-Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
-Dzookeeper.ssl.trustStore.password=testpass"
export CLIENT_JVMFLAGS="
-Dzookeeper.clientCnxnSocket=org.apache.zookeeper.ClientCnxnSocketNetty
-Dzookeeper.client.secure=true
-Dzookeeper.ssl.keyStore.location=/root/zookeeper/ssl/testKeyStore.jks
-Dzookeeper.ssl.keyStore.password=testpass
-Dzookeeper.ssl.trustStore.location=/root/zookeeper/ssl/testTrustStore.jks
-Dzookeeper.ssl.trustStore.password=testpass"
I have started the ZK server and it is up without any issue.
But now when I login to ZkCli then it gives the below error.
WatchedEvent state:AuthFailed type:None path:null
Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
[nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication provider
for scheme: ztpasswd has x509 ip digest*
Please help me on this issue
Thanks,
---------------------
Kuldeep Singh Budania
Software Architect
On Wed, Jul 1, 2020 at 12:05 PM kuldeep singh <ku...@gmail.com>
wrote:
> Hi,
>
> My ZK server is up and running in secure mode, But When I am trying to
> connect to the ZK server using ZKCli, it gives the below error.
>
> WatchedEvent state:AuthFailed type:None path:null
>
>
> Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
> [nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication provider
> for scheme: ztpasswd has x509 ip digest*
>
> Can someone please help me on this issue. we are using the 3.5.6 version.
>
> I appreciate if I will get a response as soon as possible, as I am stuck
> at this point.
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
> Software Architect
>
>
>
> On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli - Diennea
> <en...@diennea.com.invalid> wrote:
>
>> I mean in zoo.cfg
>> Not as a system property
>>
>> Enrico
>>
>> Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <
>> enrico.olivelli@diennea.com.INVALID> ha scritto:
>>
>> Hi
>> You have to enable Netty on the server side
>>
>> Something like:
>> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>
>> Hope that helps
>> Enrico
>>
>> Il giorno 24/06/20, 19:17 "kuldeep singh" <ku...@gmail.com>
>> ha scritto:
>>
>> Hi,
>>
>> I got below error while setting SSL properties in zkEnv.sh
>>
>>
>>
>>
>> ==========================================================================================
>>
>> 2020-06-24 15:49:35,864 - INFO [main:QuorumPeerConfig@133] -
>> Reading
>> configuration from: /etc/zookeeper/zoo.cfg
>>
>> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@385] -
>> clientPortAddress is 0.0.0.0/0.0.0.0:10181
>>
>> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@399] -
>> secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
>>
>> 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] - Setting -D
>> jdk.tls.rejectClientInitiatedRenegotiation=true to disable
>> client-initiated
>> TLS renegotiation
>>
>> 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@78] -
>> autopurge.snapRetainCount set to 3
>>
>> 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@79] -
>> autopurge.purgeInterval set to 1
>>
>> 2020-06-24 15:49:35,898 - INFO [
>> PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge task
>> started.
>>
>> 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] - Log4j
>> found with
>> jmx enabled.
>>
>> 2020-06-24 15:49:35,903 - INFO [PurgeTask:FileTxnSnapLog@103] -
>> zookeeper.snapshot.trust.empty : false
>>
>> 2020-06-24 15:49:35,910 - INFO [
>> PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge task
>> completed.
>>
>> 2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141] -
>> Starting quorum
>> peer
>>
>> 2020-06-24 15:49:35,983 - INFO [main:ServerCnxnFactory@135] -
>> Using
>> org.apache.zookeeper.server.NIOServerCnxnFactory as server
>> connection
>> factory
>>
>> 2020-06-24 15:49:35,986 - INFO [main:NIOServerCnxnFactory@673] -
>> Configuring NIO connection handler with 10s sessionless
>> connection timeout,
>> 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
>>
>> 2020-06-24 15:49:35,992 - INFO [main:NIOServerCnxnFactory@686]
>> - binding
>> to port 0.0.0.0/0.0.0.0:10181
>>
>> 2020-06-24 15:49:35,994 - INFO [main:ServerCnxnFactory@135] -
>> Using
>> org.apache.zookeeper.server.NIOServerCnxnFactory as server
>> connection
>> factory
>>
>> 2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101] -
>> Unexpected
>> exception, exiting abnormally
>>
>> java.lang.UnsupportedOperationException: SSL isn't supported in
>> NIOServerCnxn
>>
>> at
>>
>> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
>>
>> at
>>
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
>>
>> at
>>
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
>>
>> at
>>
>> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
>>
>>
>>
>>
>>
>> I have set the following properties in SERVER_JVMFLAGS in
>> zkEnv.sh file :
>>
>> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>>
>> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
>> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
>>
>> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
>> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
>>
>> Thanks,
>> ---------------------
>> Kuldeep Singh Budania
>>
>>
>>
>> On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <
>> jordan@jordanzimmerman.com>
>> wrote:
>>
>> > It's the same as the normal ZooKeeper client:
>> >
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> > <
>> >
>> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
>> > >
>> >
>> > -Jordan
>> >
>> > > On Jun 22, 2020, at 5:50 AM, kuldeep singh <
>> kuldeep.singh08@gmail.com>
>> > wrote:
>> > >
>> > > Hi Team,
>> > > How we will do secure communication between the Curator
>> framework and
>> > > zookeeper 3.5.6 ?
>> > > I didn't get any solution right now.
>> > > I appreciate it if someone could help me with the same.
>> > >
>> > > Thanks,
>> > > ---------------------
>> > > Kuldeep Singh Budania
>> > > Software Architect
>> > >
>> > >
>> > > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
>> > szalay.beko.mate@gmail.com>
>> > > wrote:
>> > >
>> > >> Hello Kuldeep,
>> > >>
>> > >> did you download the source from the ZooKeeper webpage, or
>> checked out
>> > from
>> > >> git?
>> > >> Anyway, the following commands should work:
>> > >>
>> > >> wget
>> > >>
>> > >>
>> >
>> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
>> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
>> > >> cd apache-zookeeper-3.5.7
>> > >> mvn clean install -DskipTests
>> > >>
>> > >> I tested it with OpenJDK 8u424 and maven 3.6.0.
>> > >>
>> > >> Kind regards,
>> > >> Mate
>> > >>
>> > >>
>> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
>> > kuldeep.singh08@gmail.com>
>> > >> wrote:
>> > >>
>> > >>> Hi All,
>> > >>>
>> > >>> I have download the zookeeper source code and run the mvn
>> command for
>> > >>> packaging but get problem on "zookeeper-server" directory.
>> > >>>
>> > >>> *command :- mvn clean package*
>> > >>>
>> > >>> [ERROR] Failed to execute goal
>> > >>> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> > >>> (default-compile) on project zookeeper: Fatal error
>> compiling:
>> > >>> java.lang.NullPointerException -> [Help 1]
>> > >>> org.apache.maven.lifecycle.LifecycleExecutionException:
>> Failed to
>> > execute
>> > >>> goal
>> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>> > >>> (default-compile) on project zookeeper: Fatal error
>> compiling
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
>> > >>> at
>> > org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
>> > >>> at
>> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
>> > >>> at
>> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
>> > >>> at
>> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
>> > >>> at
>> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
>> > >>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> > >>> at java.lang.reflect.Method.invoke(Method.java:498)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>> > >>> at
>> > >>>
>> > >>
>> >
>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>> > >>> at
>> > >>>
>> >
>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>> > >>> Caused by: org.apache.maven.plugin.MojoExecutionException:
>> Fatal error
>> > >>> compiling
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>> > >>> ... 19 more
>> > >>> Caused by: org.codehaus.plexus.compiler.CompilerException:
>> > >>> java.lang.NullPointerException
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
>> > >>> ... 22 more
>> > >>> Caused by: java.lang.RuntimeException:
>> java.lang.NullPointerException
>> > >>> at
>> com.sun.tools.javac.main.Main.compile(Main.java:559)
>> > >>> at
>> > >>>
>> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
>> > >>> at
>> > >>>
>> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
>> > >>> ... 24 more
>> > >>> Caused by: java.lang.NullPointerException
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
>> > >>> at com.sun.tools.doclint.Env.setCurrent(Env.java:155)
>> > >>> at
>> com.sun.tools.doclint.Checker.scan(Checker.java:144)
>> > >>> at
>> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
>> > >>> at
>> > >>>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
>> > >>> at
>> > >>>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> > >>> at
>> > >>>
>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> > >>> at
>> > >>>
>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >>> at
>> > >>>
>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> > >>> at
>> > >>>
>> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
>> > >>> at
>> > >>>
>> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
>> > >>> at
>> > >>>
>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >>> at
>> > >>>
>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> > >>> at
>> > >>>
>> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
>> > >>> at
>> > >>>
>> >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
>> > >>> at
>> > >>>
>> >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
>> > >>> at
>> > >>>
>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
>> > >>> at
>> > >>>
>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >>> at
>> > >>>
>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>> > >>> at
>> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> > >>> at
>> > >>>
>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> > >>> at
>> > >>
>> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
>> > >>> at
>> > >>>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
>> > >>> at
>> > >>>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>> > >>> at
>> > >>>
>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>> > >>> at
>> > >>>
>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >>> at
>> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>> > >>> at
>> > >>>
>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>> > >>> at
>> > >>>
>> > >>
>> >
>> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
>> > >>> at
>> > >>>
>> >
>> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
>> > >>> at
>> > >>>
>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>> > >>> at
>> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
>> > >>> at
>> > >>>
>> > >>>
>> > >>
>> >
>> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
>> > >>> at
>> > >>>
>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
>> > >>> at
>> > >>>
>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
>> > >>> at
>> > >>>
>> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
>> > >>> at
>> com.sun.tools.javac.main.Main.compile(Main.java:523)
>> > >>> ... 27 more
>> > >>> [ERROR]
>> > >>> [ERROR] Re-run Maven using the -X switch to enable full
>> debug logging.
>> > >>> [ERROR]
>> > >>> [ERROR] For more information about the errors and possible
>> solutions,
>> > >>> please read the following articles:
>> > >>> [ERROR] [Help 1]
>> > >>>
>> >
>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>> > >>>
>> > >>> Can someone help me on this issue?
>> > >>>
>> > >>> Thanks,
>> > >>> ---------------------
>> > >>> Kuldeep Singh Budania
>> > >>>
>> > >>>
>> > >>>
>> > >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
>> > >>> szalay.beko.mate@gmail.com>
>> > >>> wrote:
>> > >>>
>> > >>>> these exceptions can mean many things... I think this can
>> be even
>> > >> normal
>> > >>>> duding rolling restart (as some connections get broken in
>> this case)
>> > >>>>
>> > >>>> However, I saw cases already when exceptions like these
>> killed
>> > receiver
>> > >>> or
>> > >>>> sender threads in QuorumCnxManager / Leader Election in
>> such a way
>> > that
>> > >>>> they were not able to recover, so the node was unable to
>> connect to
>> > any
>> > >>>> quorum until restart. I remember seeing this in 3.4 too.
>> > >>>>
>> > >>>> Do you see these exceptions in the second server (the one
>> which you
>> > >> just
>> > >>>> upgraded in step 3)?
>> > >>>> Is this issue reproducible?
>> > >>>>
>> > >>>> What is the tickTime and initLimit you use? Maybe the
>> server just
>> > >> require
>> > >>>> more time to sync?
>> > >>>>
>> > >>>> I would need more logs to really see what happened. Can
>> you create a
>> > >> Jira
>> > >>>> issue and upload the logs and also the ZooKeeper configs?
>> I am happy
>> > to
>> > >>>> take a closer look.
>> > >>>> (if you need to re-run the test to collect the logs, then
>> enabling
>> > >> DEBUG
>> > >>>> logs would be great. The INFO level logs are usually
>> enough for these
>> > >>>> problems, but one can never know...)
>> > >>>>
>> > >>>> Kind regards,
>> > >>>> Mate
>> > >>>>
>> > >>>>
>> > >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
>> > >> kuldeep.singh08@gmail.com
>> > >>>>
>> > >>>> wrote:
>> > >>>>
>> > >>>>> Hi Team,
>> > >>>>>
>> > >>>>> I have done some POC on rolling upgrade and found below
>> result.
>> > >>>>>
>> > >>>>>
>> > >>>>> 1. On 1st node upgrade zookeeper . Traffic was running
>> fine
>> > >> because
>> > >>> 2
>> > >>>>> nodes are already on old zookeeper.
>> > >>>>> 2. On 1st node upgrade our application and didn’t find
>> any issue
>> > >>>>> 3. On 2nd node upgrade zookeeper but got below error
>> and zookeeper
>> > >>> is
>> > >>>>> not taking any requests
>> > >>>>> 4.
>> > >>>>>
>> > >>>>> java.io.EOFException
>> > >>>>>
>> > >>>>> at
>> java.io.DataInputStream.readInt(DataInputStream.java:392)
>> > >>>>>
>> > >>>>> at
>> > >>>>>
>> > >>>>>
>> > >>>>
>> > >>>
>> > >>
>> >
>> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
>> > >>>>>
>> > >>>>> 2020-03-30 14:19:55,587 - WARN
>> > >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765] -
>> Interrupting
>> > >>> SendWorker
>> > >>>>>
>> > >>>>> 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/
>> 192.168.44.73:33754
>> > >>>>> :LearnerHandler@562] - Unexpected exception causing
>> shutdown while
>> > >>> sock
>> > >>>>> still open
>> > >>>>>
>> > >>>>> java.io.EOFException
>> > >>>>>
>> > >>>>> at
>> java.io.DataInputStream.readInt(DataInputStream.java:392)
>> > >>>>>
>> > >>>>> at
>> > >>>>>
>> > >>
>> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
>> > >>>>>
>> > >>>>> at
>> > >>>>>
>> > >>>>>
>> > >>>>
>> > >>>
>> > >>
>> >
>> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
>> > >>>>>
>> > >>>>> at
>> > >>>>>
>> > >>>>
>> > >>>
>> > >>
>> >
>> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
>> > >>>>>
>> > >>>>> at
>> > >>>>>
>> > >>>>>
>> > >>>>
>> > >>>
>> > >>
>> >
>> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
>> > >>>>>
>> > >>>>> 2020-03-30 14:19:55,588 - WARN
>> > >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679] -
>> Interrupted while
>> > >>>> waiting
>> > >>>>> for message on queue
>> > >>>>>
>> > >>>>> Please let me know is this the known issue or this is
>> different issue
>> > >>>> which
>> > >>>>> is mention in Apache zookeeper documentation when
>> upgrading from
>> > >> 3.4.5
>> > >>> to
>> > >>>>> 3.5.6
>> > >>>>>
>> > >>>>> Thanks,
>> > >>>>> ---------------------
>> > >>>>> Kuldeep Singh Budania
>> > >>>>> Software Architect
>> > >>>>>
>> > >>>>>
>> > >>>>>
>> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer <
>> shralex@gmail.com>
>> > >>>>> wrote:
>> > >>>>>
>> > >>>>>> +1 to what Mate said (I wrote the quoted instructions).
>> > >>>>>>
>> > >>>>>>
>> > >>>>>>
>> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő Máté <
>> > >>>>>> szalay.beko.mate@gmail.com>
>> > >>>>>> wrote:
>> > >>>>>>
>> > >>>>>>> Hi Kuldeep,
>> > >>>>>>>
>> > >>>>>>> I just want to provide you some background info about
>> our
>> > >>>>> documentation.
>> > >>>>>>> The reason to upgrade to 3.4.6 first is to avoid the
>> following
>> > >>> error:
>> > >>>>>>>
>> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
>> > >>> 127.0.0.1:2784
>> > >>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
>> > >>>>>>>
>> > >>>>>>> This error comes because of the protocol changes between
>> > >> ZooKeeper
>> > >>>>> server
>> > >>>>>>> nodes during connection initiation for leader election.
>> In
>> > >>> ZooKeeper
>> > >>>>> 3.5
>> > >>>>>> a
>> > >>>>>>> protocol version was introduced (see ZOOKEEPER-107) and
>> since
>> > >> that
>> > >>>> time
>> > >>>>>> the
>> > >>>>>>> fist long value sent in the initial message is not the
>> server ID
>> > >>> but
>> > >>>>> the
>> > >>>>>>> protocol version (-65536). In ZooKeeper 3.4.6 we made
>> the old 3.4
>> > >>>>>>> ZooKeepers backward compatible, so they are able to
>> parse both
>> > >> the
>> > >>>> old
>> > >>>>>> and
>> > >>>>>>> the new protocol format (see ZOOKEEPER-1633). This
>> issue happens
>> > >>> only
>> > >>>>>> when
>> > >>>>>>> you need to use old (3.4.0 - 3.4.5) and new (3.5.0+)
>> ZooKeeper
>> > >>>> servers
>> > >>>>>>> together in the same cluster. During a rolling upgrade,
>> this is
>> > >>>> usually
>> > >>>>>> the
>> > >>>>>>> case to have old and new ZooKeepers present together.
>> > >>>>>>>
>> > >>>>>>> The fact that you haven't seen any issues might be
>> caused by the
>> > >>>> order
>> > >>>>> of
>> > >>>>>>> the servers. In ZooKeeper the connection initiation
>> between the
>> > >>>> servers
>> > >>>>>>> during the leader election follows a specific rule. As
>> far as I
>> > >>>>> remember
>> > >>>>>>> always the server with the larger ID 'wins the
>> challenge', so it
>> > >> is
>> > >>>>>>> possible, that the old server didn't need to parse any
>> initial
>> > >>>> message
>> > >>>>>> (if
>> > >>>>>>> it had the largest ID) and this is why you haven't seen
>> the
>> > >> issue.
>> > >>>> Also
>> > >>>>>>> having 2 nodes up from the 3 nodes cluster still makes
>> the
>> > >> cluster
>> > >>>> work
>> > >>>>>> (so
>> > >>>>>>> you should also check if all the servers are part of
>> the quorum).
>> > >>>>>>>
>> > >>>>>>> I agree with Enrico and Norbert, the safest and most
>> stable way
>> > >> is
>> > >>>>>> upgrade
>> > >>>>>>> first to 3.4.latest, then go to 3.5.latest. Still, if
>> you don't
>> > >> see
>> > >>>>> that
>> > >>>>>>> you would hit this specific issue (e.g. no "Invalid
>> server id" in
>> > >>> the
>> > >>>>> log
>> > >>>>>>> files), and all the three servers can handle traffic,
>> then maybe
>> > >>> you
>> > >>>>>> don't
>> > >>>>>>> need to upgrade first to 3.4.latest, it is your
>> decision.
>> > >>> Definitely
>> > >>>>> you
>> > >>>>>>> should test it first, as suggested by the others.
>> > >>>>>>>
>> > >>>>>>> Kind regards,
>> > >>>>>>> Mate
>> > >>>>>>>
>> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
>> > >>>>>>> <nk...@cloudera.com.invalid> wrote:
>> > >>>>>>>
>> > >>>>>>>> Hi,
>> > >>>>>>>>
>> > >>>>>>>> That guide is to upgrade to 3.5.0, which was an alpha
>> version.
>> > >> A
>> > >>>> lot
>> > >>>>>> has
>> > >>>>>>>> changed for the first stable release of 3.5.5 and then
>> a few
>> > >>> more,
>> > >>>>> even
>> > >>>>>>>> rolling upgrade issues have been fixed for 3.5.6.
>> > >>>>>>>> This is a more up-to-date guide:
>> > >>>>>>>>
>> > >>>
>> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
>> > >>>>>>>>
>> > >>>>>>>> If you have done your testing (with prod snapshot!),
>> then you
>> > >> can
>> > >>>>> skip
>> > >>>>>>> 3.4
>> > >>>>>>>> latest upgrade, but keep in mind we do our
>> recommendations for
>> > >> a
>> > >>>>>> reason.
>> > >>>>>>>> There were issues reported and/or found during
>> testing. Some
>> > >> are
>> > >>>>> fixed
>> > >>>>>>> with
>> > >>>>>>>> 3.5.6, some only happens if certain conditions stand
>> > >>> (IOException:
>> > >>>> No
>> > >>>>>>>> snapshot found - mentioned in the guide, fixed in
>> 3.5.6).
>> > >>>>>>>>
>> > >>>>>>>> So it is up to you, I would still recommend to do an
>> 3.4
>> > >> upgrade
>> > >>>>> first,
>> > >>>>>>> if
>> > >>>>>>>> it's feasible.
>> > >>>>>>>>
>> > >>>>>>>> Regards,
>> > >>>>>>>> Norbert
>> > >>>>>>>>
>> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep singh <
>> > >>>>>>> kuldeep.singh08@gmail.com>
>> > >>>>>>>> wrote:
>> > >>>>>>>>
>> > >>>>>>>>> Hi,
>> > >>>>>>>>>
>> > >>>>>>>>> Current Zookeeper version :- 3.4.5
>> > >>>>>>>>> Upgraded version :- 3.5.6
>> > >>>>>>>>>
>> > >>>>>>>>> We are not going with 3.5.7. Our final decision is
>> zookeeper
>> > >>>>> version
>> > >>>>>> is
>> > >>>>>>>>> 3.5.6
>> > >>>>>>>>> as per your reply first we need to move latest
>> version of
>> > >>> 3.4.x,
>> > >>>>> like
>> > >>>>>>>> below
>> > >>>>>>>>>
>> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am wrong
>> here)
>> > >>>>>>>>>
>> > >>>>>>>>> But if We are not facing any problem that i have
>> shared you
>> > >>> that
>> > >>>> we
>> > >>>>>>> have
>> > >>>>>>>>> set up of 3 node cluster where 2 node are on 3.5.6
>> version
>> > >> and
>> > >>> 1
>> > >>>>> node
>> > >>>>>>> on
>> > >>>>>>>>> 3.4.5, Everything is running fine and didn't get any
>> issue,
>> > >> So
>> > >>>> what
>> > >>>>>>> other
>> > >>>>>>>>> problem we can face if we directly move to 3.5.6
>> > >>>>>>>>>
>> > >>>>>>>>> Thanks,
>> > >>>>>>>>> ---------------------
>> > >>>>>>>>> Kuldeep Singh Budania
>> > >>>>>>>>> Software Architect
>> > >>>>>>>>>
>> > >>>>>>>>>
>> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico Olivelli <
>> > >>>>> eolivelli@gmail.com
>> > >>>>>>>
>> > >>>>>>>>> wrote:
>> > >>>>>>>>>
>> > >>>>>>>>>> Hi
>> > >>>>>>>>>> You have to upgrade to latest 3.4.x Zookeeper then
>> you will
>> > >>>>> upgrade
>> > >>>>>>> to
>> > >>>>>>>>>> 3.5.7.
>> > >>>>>>>>>> All should run well without issues
>> > >>>>>>>>>>
>> > >>>>>>>>>>
>> > >>>>>>>>>> Enrico
>> > >>>>>>>>>>
>> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
>> > >>>>> kuldeep.singh08@gmail.com
>> > >>>>>>>
>> > >>>>>>> ha
>> > >>>>>>>>>> scritto:
>> > >>>>>>>>>>
>> > >>>>>>>>>>> Hi Team,
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to 3.5.6. I
>> have
>> > >> set
>> > >>>> up 3
>> > >>>>>>> node
>> > >>>>>>>>>>> cluster where 2 node are on 3.5.6 version and 1
>> node on
>> > >>>> 3.4.5.
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> Everything is running fine and didn't get any issue
>> on my
>> > >>>>> system.
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> but I found something on apache site that first we
>> need
>> > >> to
>> > >>>>>> upgrade
>> > >>>>>>>> on
>> > >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is it
>> mandatory
>> > >> to
>> > >>> go
>> > >>>>> on
>> > >>>>>>>> 3.4.6
>> > >>>>>>>>>>> first.
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> *Upgrading to 3.5.0*
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> Upgrading a running ZooKeeper ensemble to 3.5.0
>> should be
>> > >>>> done
>> > >>>>>> only
>> > >>>>>>>>> after
>> > >>>>>>>>>>> upgrading your ensemble to the 3.4.6 release. Note
>> that
>> > >>> this
>> > >>>> is
>> > >>>>>>> only
>> > >>>>>>>>>>> necessary for rolling upgrades (if you're fine with
>> > >>> shutting
>> > >>>>> down
>> > >>>>>>> the
>> > >>>>>>>>>>> system completely, you don't have to go through
>> 3.4.6).
>> > >> If
>> > >>>> you
>> > >>>>>>>> attempt
>> > >>>>>>>>> a
>> > >>>>>>>>>>> rolling upgrade without going through 3.4.6 (for
>> example
>> > >>> from
>> > >>>>>>> 3.4.5),
>> > >>>>>>>>> you
>> > >>>>>>>>>>> may get the following error:
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO [localhost/
>> > >>>>>> 127.0.0.1:2784
>> > >>>>>>>>>>> :QuorumCnxManager$Listener@498] - Received
>> connection
>> > >>>> request
>> > >>>>> /
>> > >>>>>>>>>>> 127.0.0.1:60876
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
>> > >>>>>> 127.0.0.1:2784
>> > >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> During a rolling upgrade, each server is taken down
>> in
>> > >> turn
>> > >>>> and
>> > >>>>>>>>> rebooted
>> > >>>>>>>>>>> with the new 3.5.0 binaries. Before starting the
>> server
>> > >>> with
>> > >>>>>> 3.5.0
>> > >>>>>>>>>>> binaries, we highly recommend updating the
>> configuration
>> > >>> file
>> > >>>>> so
>> > >>>>>>> that
>> > >>>>>>>>> all
>> > >>>>>>>>>>> server statements "server.x=..." contain client
>> ports
>> > >> (see
>> > >>>> the
>> > >>>>>>>> section
>> > >>>>>>>>>>> Specifying
>> > >>>>>>>>>>> the client port). As explained earlier you may
>> leave the
>> > >>>>>>>> configuration
>> > >>>>>>>>>> in a
>> > >>>>>>>>>>> single file, as well as leave the
>> > >>>> clientPort/clientPortAddress
>> > >>>>>>>>> statements
>> > >>>>>>>>>>> (although if you specify client ports in the new
>> format,
>> > >>>> these
>> > >>>>>>>>> statements
>> > >>>>>>>>>>> are now redundant).
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> Could you please let me know about this case.
>> Appreciate
>> > >> if
>> > >>>>>> respond
>> > >>>>>>>>> soon.
>> > >>>>>>>>>>>
>> > >>>>>>>>>>> Thanks,
>> > >>>>>>>>>>> ---------------------
>> > >>>>>>>>>>> Kuldeep Singh Budania
>> > >>>>>>>>>>>
>> > >>>>>>>>>>
>> > >>>>>>>>>
>> > >>>>>>>>
>> > >>>>>>>
>> > >>>>>>
>> > >>>>>
>> > >>>>
>> > >>>
>> > >>
>> >
>> >
>>
>>
>> ________________________________
>>
>> CONFIDENTIALITY & PRIVACY NOTICE
>> This e-mail (including any attachments) is strictly confidential and
>> may also contain privileged information. If you are not the intended
>> recipient you are not authorised to read, print, save, process or disclose
>> this message. If you have received this message by mistake, please inform
>> the sender immediately and destroy this e-mail, its attachments and any
>> copies. Any use, distribution, reproduction or disclosure by any person
>> other than the intended recipient is strictly prohibited and the person
>> responsible may incur in penalties.
>> The use of this e-mail is only for professional purposes; there is no
>> guarantee that the correspondence towards this e-mail will be read only by
>> the recipient, because, under certain circumstances, there may be a need to
>> access this email by third subjects belonging to the Company.
>>
>>
>> ________________________________
>>
>> CONFIDENTIALITY & PRIVACY NOTICE
>> This e-mail (including any attachments) is strictly confidential and may
>> also contain privileged information. If you are not the intended recipient
>> you are not authorised to read, print, save, process or disclose this
>> message. If you have received this message by mistake, please inform the
>> sender immediately and destroy this e-mail, its attachments and any copies.
>> Any use, distribution, reproduction or disclosure by any person other than
>> the intended recipient is strictly prohibited and the person responsible
>> may incur in penalties.
>> The use of this e-mail is only for professional purposes; there is no
>> guarantee that the correspondence towards this e-mail will be read only by
>> the recipient, because, under certain circumstances, there may be a need to
>> access this email by third subjects belonging to the Company.
>>
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Hi,
My ZK server is up and running in secure mode, But When I am trying to
connect to the ZK server using ZKCli, it gives the below error.
WatchedEvent state:AuthFailed type:None path:null
Zookeeper logs :- *2020-07-01 07:38:09,342 - WARN
[nioEventLoopGroup-4-2:ZooKeeperServer@1119] - No authentication provider
for scheme: ztpasswd has x509 ip digest*
Can someone please help me on this issue. we are using the 3.5.6 version.
I appreciate if I will get a response as soon as possible, as I am stuck at
this point.
Thanks,
---------------------
Kuldeep Singh Budania
Software Architect
On Thu, Jun 25, 2020 at 11:54 AM Enrico Olivelli - Diennea
<en...@diennea.com.invalid> wrote:
> I mean in zoo.cfg
> Not as a system property
>
> Enrico
>
> Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <
> enrico.olivelli@diennea.com.INVALID> ha scritto:
>
> Hi
> You have to enable Netty on the server side
>
> Something like:
> serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>
> Hope that helps
> Enrico
>
> Il giorno 24/06/20, 19:17 "kuldeep singh" <ku...@gmail.com>
> ha scritto:
>
> Hi,
>
> I got below error while setting SSL properties in zkEnv.sh
>
>
>
>
> ==========================================================================================
>
> 2020-06-24 15:49:35,864 - INFO [main:QuorumPeerConfig@133] -
> Reading
> configuration from: /etc/zookeeper/zoo.cfg
>
> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@385] -
> clientPortAddress is 0.0.0.0/0.0.0.0:10181
>
> 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@399] -
> secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
>
> 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] - Setting -D
> jdk.tls.rejectClientInitiatedRenegotiation=true to disable
> client-initiated
> TLS renegotiation
>
> 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@78] -
> autopurge.snapRetainCount set to 3
>
> 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@79] -
> autopurge.purgeInterval set to 1
>
> 2020-06-24 15:49:35,898 - INFO [
> PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge task
> started.
>
> 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] - Log4j
> found with
> jmx enabled.
>
> 2020-06-24 15:49:35,903 - INFO [PurgeTask:FileTxnSnapLog@103] -
> zookeeper.snapshot.trust.empty : false
>
> 2020-06-24 15:49:35,910 - INFO [
> PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge task
> completed.
>
> 2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141] -
> Starting quorum
> peer
>
> 2020-06-24 15:49:35,983 - INFO [main:ServerCnxnFactory@135] -
> Using
> org.apache.zookeeper.server.NIOServerCnxnFactory as server
> connection
> factory
>
> 2020-06-24 15:49:35,986 - INFO [main:NIOServerCnxnFactory@673] -
> Configuring NIO connection handler with 10s sessionless connection
> timeout,
> 2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
>
> 2020-06-24 15:49:35,992 - INFO [main:NIOServerCnxnFactory@686] -
> binding
> to port 0.0.0.0/0.0.0.0:10181
>
> 2020-06-24 15:49:35,994 - INFO [main:ServerCnxnFactory@135] -
> Using
> org.apache.zookeeper.server.NIOServerCnxnFactory as server
> connection
> factory
>
> 2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101] -
> Unexpected
> exception, exiting abnormally
>
> java.lang.UnsupportedOperationException: SSL isn't supported in
> NIOServerCnxn
>
> at
>
> org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
>
> at
>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
>
> at
>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
>
> at
>
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
>
>
>
>
>
> I have set the following properties in SERVER_JVMFLAGS in zkEnv.sh
> file :
>
> "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
>
> -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
> -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
>
> -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
> -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
>
>
>
> On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <
> jordan@jordanzimmerman.com>
> wrote:
>
> > It's the same as the normal ZooKeeper client:
> >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > <
> >
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> > >
> >
> > -Jordan
> >
> > > On Jun 22, 2020, at 5:50 AM, kuldeep singh <
> kuldeep.singh08@gmail.com>
> > wrote:
> > >
> > > Hi Team,
> > > How we will do secure communication between the Curator
> framework and
> > > zookeeper 3.5.6 ?
> > > I didn't get any solution right now.
> > > I appreciate it if someone could help me with the same.
> > >
> > > Thanks,
> > > ---------------------
> > > Kuldeep Singh Budania
> > > Software Architect
> > >
> > >
> > > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
> > szalay.beko.mate@gmail.com>
> > > wrote:
> > >
> > >> Hello Kuldeep,
> > >>
> > >> did you download the source from the ZooKeeper webpage, or
> checked out
> > from
> > >> git?
> > >> Anyway, the following commands should work:
> > >>
> > >> wget
> > >>
> > >>
> >
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
> > >> cd apache-zookeeper-3.5.7
> > >> mvn clean install -DskipTests
> > >>
> > >> I tested it with OpenJDK 8u424 and maven 3.6.0.
> > >>
> > >> Kind regards,
> > >> Mate
> > >>
> > >>
> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
> > kuldeep.singh08@gmail.com>
> > >> wrote:
> > >>
> > >>> Hi All,
> > >>>
> > >>> I have download the zookeeper source code and run the mvn
> command for
> > >>> packaging but get problem on "zookeeper-server" directory.
> > >>>
> > >>> *command :- mvn clean package*
> > >>>
> > >>> [ERROR] Failed to execute goal
> > >>> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > >>> (default-compile) on project zookeeper: Fatal error
> compiling:
> > >>> java.lang.NullPointerException -> [Help 1]
> > >>> org.apache.maven.lifecycle.LifecycleExecutionException:
> Failed to
> > execute
> > >>> goal
> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> > >>> (default-compile) on project zookeeper: Fatal error compiling
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> > >>> at
> > org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> > >>> at
> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> > >>> at
> org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> > >>> at
> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> > >>> at
> org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> > >>> at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > >>> at java.lang.reflect.Method.invoke(Method.java:498)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> > >>> at
> > >>>
> > >>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> > >>> at
> > >>>
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> > >>> Caused by: org.apache.maven.plugin.MojoExecutionException:
> Fatal error
> > >>> compiling
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> > >>> ... 19 more
> > >>> Caused by: org.codehaus.plexus.compiler.CompilerException:
> > >>> java.lang.NullPointerException
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> > >>> ... 22 more
> > >>> Caused by: java.lang.RuntimeException:
> java.lang.NullPointerException
> > >>> at
> com.sun.tools.javac.main.Main.compile(Main.java:559)
> > >>> at
> > >>>
> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> > >>> at
> > >>>
> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> > >>> ... 24 more
> > >>> Caused by: java.lang.NullPointerException
> > >>> at
> > >>>
> > >>>
> > >>
> >
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> > >>> at com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> > >>> at
> com.sun.tools.doclint.Checker.scan(Checker.java:144)
> > >>> at
> com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> > >>> at
> > >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> > >>> at
> > >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > >>> at
> > >>>
> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > >>> at
> > >>>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> at
> > >>>
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >>> at
> > >>>
> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> > >>> at
> > >>>
> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> > >>> at
> > >>>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> at
> > >>>
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >>> at
> > >>>
> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> > >>> at
> > >>>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> > >>> at
> > >>>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> > >>> at
> > >>>
> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> > >>> at
> > >>>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> at
> > >>>
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> > >>> at
> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > >>> at
> > >>>
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > >>> at
> > >>
> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> > >>> at
> > >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> > >>> at
> > >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> > >>> at
> > >>>
> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> > >>> at
> > >>>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> at
> com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> > >>> at
> > >>>
> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> > >>> at
> > >>>
> > >>
> >
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> > >>> at
> > >>>
> >
> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> > >>> at
> > >>>
> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> > >>> at
> com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> > >>> at
> > >>>
> > >>>
> > >>
> >
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> > >>> at
> > >>>
> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> > >>> at
> > >>>
> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> > >>> at
> > >>>
> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> > >>> at
> com.sun.tools.javac.main.Main.compile(Main.java:523)
> > >>> ... 27 more
> > >>> [ERROR]
> > >>> [ERROR] Re-run Maven using the -X switch to enable full
> debug logging.
> > >>> [ERROR]
> > >>> [ERROR] For more information about the errors and possible
> solutions,
> > >>> please read the following articles:
> > >>> [ERROR] [Help 1]
> > >>>
> >
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > >>>
> > >>> Can someone help me on this issue?
> > >>>
> > >>> Thanks,
> > >>> ---------------------
> > >>> Kuldeep Singh Budania
> > >>>
> > >>>
> > >>>
> > >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
> > >>> szalay.beko.mate@gmail.com>
> > >>> wrote:
> > >>>
> > >>>> these exceptions can mean many things... I think this can
> be even
> > >> normal
> > >>>> duding rolling restart (as some connections get broken in
> this case)
> > >>>>
> > >>>> However, I saw cases already when exceptions like these
> killed
> > receiver
> > >>> or
> > >>>> sender threads in QuorumCnxManager / Leader Election in
> such a way
> > that
> > >>>> they were not able to recover, so the node was unable to
> connect to
> > any
> > >>>> quorum until restart. I remember seeing this in 3.4 too.
> > >>>>
> > >>>> Do you see these exceptions in the second server (the one
> which you
> > >> just
> > >>>> upgraded in step 3)?
> > >>>> Is this issue reproducible?
> > >>>>
> > >>>> What is the tickTime and initLimit you use? Maybe the
> server just
> > >> require
> > >>>> more time to sync?
> > >>>>
> > >>>> I would need more logs to really see what happened. Can you
> create a
> > >> Jira
> > >>>> issue and upload the logs and also the ZooKeeper configs? I
> am happy
> > to
> > >>>> take a closer look.
> > >>>> (if you need to re-run the test to collect the logs, then
> enabling
> > >> DEBUG
> > >>>> logs would be great. The INFO level logs are usually enough
> for these
> > >>>> problems, but one can never know...)
> > >>>>
> > >>>> Kind regards,
> > >>>> Mate
> > >>>>
> > >>>>
> > >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
> > >> kuldeep.singh08@gmail.com
> > >>>>
> > >>>> wrote:
> > >>>>
> > >>>>> Hi Team,
> > >>>>>
> > >>>>> I have done some POC on rolling upgrade and found below
> result.
> > >>>>>
> > >>>>>
> > >>>>> 1. On 1st node upgrade zookeeper . Traffic was running
> fine
> > >> because
> > >>> 2
> > >>>>> nodes are already on old zookeeper.
> > >>>>> 2. On 1st node upgrade our application and didn’t find
> any issue
> > >>>>> 3. On 2nd node upgrade zookeeper but got below error and
> zookeeper
> > >>> is
> > >>>>> not taking any requests
> > >>>>> 4.
> > >>>>>
> > >>>>> java.io.EOFException
> > >>>>>
> > >>>>> at
> java.io.DataInputStream.readInt(DataInputStream.java:392)
> > >>>>>
> > >>>>> at
> > >>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> > >>>>>
> > >>>>> 2020-03-30 14:19:55,587 - WARN
> > >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765] -
> Interrupting
> > >>> SendWorker
> > >>>>>
> > >>>>> 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/
> 192.168.44.73:33754
> > >>>>> :LearnerHandler@562] - Unexpected exception causing
> shutdown while
> > >>> sock
> > >>>>> still open
> > >>>>>
> > >>>>> java.io.EOFException
> > >>>>>
> > >>>>> at
> java.io.DataInputStream.readInt(DataInputStream.java:392)
> > >>>>>
> > >>>>> at
> > >>>>>
> > >>
> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> > >>>>>
> > >>>>> at
> > >>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>
> >
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> > >>>>>
> > >>>>> at
> > >>>>>
> > >>>>
> > >>>
> > >>
> >
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> > >>>>>
> > >>>>> at
> > >>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>
> >
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> > >>>>>
> > >>>>> 2020-03-30 14:19:55,588 - WARN
> > >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679] -
> Interrupted while
> > >>>> waiting
> > >>>>> for message on queue
> > >>>>>
> > >>>>> Please let me know is this the known issue or this is
> different issue
> > >>>> which
> > >>>>> is mention in Apache zookeeper documentation when
> upgrading from
> > >> 3.4.5
> > >>> to
> > >>>>> 3.5.6
> > >>>>>
> > >>>>> Thanks,
> > >>>>> ---------------------
> > >>>>> Kuldeep Singh Budania
> > >>>>> Software Architect
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer <
> shralex@gmail.com>
> > >>>>> wrote:
> > >>>>>
> > >>>>>> +1 to what Mate said (I wrote the quoted instructions).
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő Máté <
> > >>>>>> szalay.beko.mate@gmail.com>
> > >>>>>> wrote:
> > >>>>>>
> > >>>>>>> Hi Kuldeep,
> > >>>>>>>
> > >>>>>>> I just want to provide you some background info about our
> > >>>>> documentation.
> > >>>>>>> The reason to upgrade to 3.4.6 first is to avoid the
> following
> > >>> error:
> > >>>>>>>
> > >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
> > >>> 127.0.0.1:2784
> > >>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
> > >>>>>>>
> > >>>>>>> This error comes because of the protocol changes between
> > >> ZooKeeper
> > >>>>> server
> > >>>>>>> nodes during connection initiation for leader election.
> In
> > >>> ZooKeeper
> > >>>>> 3.5
> > >>>>>> a
> > >>>>>>> protocol version was introduced (see ZOOKEEPER-107) and
> since
> > >> that
> > >>>> time
> > >>>>>> the
> > >>>>>>> fist long value sent in the initial message is not the
> server ID
> > >>> but
> > >>>>> the
> > >>>>>>> protocol version (-65536). In ZooKeeper 3.4.6 we made
> the old 3.4
> > >>>>>>> ZooKeepers backward compatible, so they are able to
> parse both
> > >> the
> > >>>> old
> > >>>>>> and
> > >>>>>>> the new protocol format (see ZOOKEEPER-1633). This issue
> happens
> > >>> only
> > >>>>>> when
> > >>>>>>> you need to use old (3.4.0 - 3.4.5) and new (3.5.0+)
> ZooKeeper
> > >>>> servers
> > >>>>>>> together in the same cluster. During a rolling upgrade,
> this is
> > >>>> usually
> > >>>>>> the
> > >>>>>>> case to have old and new ZooKeepers present together.
> > >>>>>>>
> > >>>>>>> The fact that you haven't seen any issues might be
> caused by the
> > >>>> order
> > >>>>> of
> > >>>>>>> the servers. In ZooKeeper the connection initiation
> between the
> > >>>> servers
> > >>>>>>> during the leader election follows a specific rule. As
> far as I
> > >>>>> remember
> > >>>>>>> always the server with the larger ID 'wins the
> challenge', so it
> > >> is
> > >>>>>>> possible, that the old server didn't need to parse any
> initial
> > >>>> message
> > >>>>>> (if
> > >>>>>>> it had the largest ID) and this is why you haven't seen
> the
> > >> issue.
> > >>>> Also
> > >>>>>>> having 2 nodes up from the 3 nodes cluster still makes
> the
> > >> cluster
> > >>>> work
> > >>>>>> (so
> > >>>>>>> you should also check if all the servers are part of the
> quorum).
> > >>>>>>>
> > >>>>>>> I agree with Enrico and Norbert, the safest and most
> stable way
> > >> is
> > >>>>>> upgrade
> > >>>>>>> first to 3.4.latest, then go to 3.5.latest. Still, if
> you don't
> > >> see
> > >>>>> that
> > >>>>>>> you would hit this specific issue (e.g. no "Invalid
> server id" in
> > >>> the
> > >>>>> log
> > >>>>>>> files), and all the three servers can handle traffic,
> then maybe
> > >>> you
> > >>>>>> don't
> > >>>>>>> need to upgrade first to 3.4.latest, it is your decision.
> > >>> Definitely
> > >>>>> you
> > >>>>>>> should test it first, as suggested by the others.
> > >>>>>>>
> > >>>>>>> Kind regards,
> > >>>>>>> Mate
> > >>>>>>>
> > >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
> > >>>>>>> <nk...@cloudera.com.invalid> wrote:
> > >>>>>>>
> > >>>>>>>> Hi,
> > >>>>>>>>
> > >>>>>>>> That guide is to upgrade to 3.5.0, which was an alpha
> version.
> > >> A
> > >>>> lot
> > >>>>>> has
> > >>>>>>>> changed for the first stable release of 3.5.5 and then
> a few
> > >>> more,
> > >>>>> even
> > >>>>>>>> rolling upgrade issues have been fixed for 3.5.6.
> > >>>>>>>> This is a more up-to-date guide:
> > >>>>>>>>
> > >>>
> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> > >>>>>>>>
> > >>>>>>>> If you have done your testing (with prod snapshot!),
> then you
> > >> can
> > >>>>> skip
> > >>>>>>> 3.4
> > >>>>>>>> latest upgrade, but keep in mind we do our
> recommendations for
> > >> a
> > >>>>>> reason.
> > >>>>>>>> There were issues reported and/or found during testing.
> Some
> > >> are
> > >>>>> fixed
> > >>>>>>> with
> > >>>>>>>> 3.5.6, some only happens if certain conditions stand
> > >>> (IOException:
> > >>>> No
> > >>>>>>>> snapshot found - mentioned in the guide, fixed in
> 3.5.6).
> > >>>>>>>>
> > >>>>>>>> So it is up to you, I would still recommend to do an 3.4
> > >> upgrade
> > >>>>> first,
> > >>>>>>> if
> > >>>>>>>> it's feasible.
> > >>>>>>>>
> > >>>>>>>> Regards,
> > >>>>>>>> Norbert
> > >>>>>>>>
> > >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep singh <
> > >>>>>>> kuldeep.singh08@gmail.com>
> > >>>>>>>> wrote:
> > >>>>>>>>
> > >>>>>>>>> Hi,
> > >>>>>>>>>
> > >>>>>>>>> Current Zookeeper version :- 3.4.5
> > >>>>>>>>> Upgraded version :- 3.5.6
> > >>>>>>>>>
> > >>>>>>>>> We are not going with 3.5.7. Our final decision is
> zookeeper
> > >>>>> version
> > >>>>>> is
> > >>>>>>>>> 3.5.6
> > >>>>>>>>> as per your reply first we need to move latest version
> of
> > >>> 3.4.x,
> > >>>>> like
> > >>>>>>>> below
> > >>>>>>>>>
> > >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am wrong
> here)
> > >>>>>>>>>
> > >>>>>>>>> But if We are not facing any problem that i have
> shared you
> > >>> that
> > >>>> we
> > >>>>>>> have
> > >>>>>>>>> set up of 3 node cluster where 2 node are on 3.5.6
> version
> > >> and
> > >>> 1
> > >>>>> node
> > >>>>>>> on
> > >>>>>>>>> 3.4.5, Everything is running fine and didn't get any
> issue,
> > >> So
> > >>>> what
> > >>>>>>> other
> > >>>>>>>>> problem we can face if we directly move to 3.5.6
> > >>>>>>>>>
> > >>>>>>>>> Thanks,
> > >>>>>>>>> ---------------------
> > >>>>>>>>> Kuldeep Singh Budania
> > >>>>>>>>> Software Architect
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico Olivelli <
> > >>>>> eolivelli@gmail.com
> > >>>>>>>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> Hi
> > >>>>>>>>>> You have to upgrade to latest 3.4.x Zookeeper then
> you will
> > >>>>> upgrade
> > >>>>>>> to
> > >>>>>>>>>> 3.5.7.
> > >>>>>>>>>> All should run well without issues
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> Enrico
> > >>>>>>>>>>
> > >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
> > >>>>> kuldeep.singh08@gmail.com
> > >>>>>>>
> > >>>>>>> ha
> > >>>>>>>>>> scritto:
> > >>>>>>>>>>
> > >>>>>>>>>>> Hi Team,
> > >>>>>>>>>>>
> > >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to 3.5.6. I
> have
> > >> set
> > >>>> up 3
> > >>>>>>> node
> > >>>>>>>>>>> cluster where 2 node are on 3.5.6 version and 1 node
> on
> > >>>> 3.4.5.
> > >>>>>>>>>>>
> > >>>>>>>>>>> Everything is running fine and didn't get any issue
> on my
> > >>>>> system.
> > >>>>>>>>>>>
> > >>>>>>>>>>> but I found something on apache site that first we
> need
> > >> to
> > >>>>>> upgrade
> > >>>>>>>> on
> > >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is it
> mandatory
> > >> to
> > >>> go
> > >>>>> on
> > >>>>>>>> 3.4.6
> > >>>>>>>>>>> first.
> > >>>>>>>>>>>
> > >>>>>>>>>>> *Upgrading to 3.5.0*
> > >>>>>>>>>>>
> > >>>>>>>>>>> Upgrading a running ZooKeeper ensemble to 3.5.0
> should be
> > >>>> done
> > >>>>>> only
> > >>>>>>>>> after
> > >>>>>>>>>>> upgrading your ensemble to the 3.4.6 release. Note
> that
> > >>> this
> > >>>> is
> > >>>>>>> only
> > >>>>>>>>>>> necessary for rolling upgrades (if you're fine with
> > >>> shutting
> > >>>>> down
> > >>>>>>> the
> > >>>>>>>>>>> system completely, you don't have to go through
> 3.4.6).
> > >> If
> > >>>> you
> > >>>>>>>> attempt
> > >>>>>>>>> a
> > >>>>>>>>>>> rolling upgrade without going through 3.4.6 (for
> example
> > >>> from
> > >>>>>>> 3.4.5),
> > >>>>>>>>> you
> > >>>>>>>>>>> may get the following error:
> > >>>>>>>>>>>
> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO [localhost/
> > >>>>>> 127.0.0.1:2784
> > >>>>>>>>>>> :QuorumCnxManager$Listener@498] - Received
> connection
> > >>>> request
> > >>>>> /
> > >>>>>>>>>>> 127.0.0.1:60876
> > >>>>>>>>>>>
> > >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
> > >>>>>> 127.0.0.1:2784
> > >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
> > >>>>>>>>>>>
> > >>>>>>>>>>> During a rolling upgrade, each server is taken down
> in
> > >> turn
> > >>>> and
> > >>>>>>>>> rebooted
> > >>>>>>>>>>> with the new 3.5.0 binaries. Before starting the
> server
> > >>> with
> > >>>>>> 3.5.0
> > >>>>>>>>>>> binaries, we highly recommend updating the
> configuration
> > >>> file
> > >>>>> so
> > >>>>>>> that
> > >>>>>>>>> all
> > >>>>>>>>>>> server statements "server.x=..." contain client ports
> > >> (see
> > >>>> the
> > >>>>>>>> section
> > >>>>>>>>>>> Specifying
> > >>>>>>>>>>> the client port). As explained earlier you may leave
> the
> > >>>>>>>> configuration
> > >>>>>>>>>> in a
> > >>>>>>>>>>> single file, as well as leave the
> > >>>> clientPort/clientPortAddress
> > >>>>>>>>> statements
> > >>>>>>>>>>> (although if you specify client ports in the new
> format,
> > >>>> these
> > >>>>>>>>> statements
> > >>>>>>>>>>> are now redundant).
> > >>>>>>>>>>>
> > >>>>>>>>>>> Could you please let me know about this case.
> Appreciate
> > >> if
> > >>>>>> respond
> > >>>>>>>>> soon.
> > >>>>>>>>>>>
> > >>>>>>>>>>> Thanks,
> > >>>>>>>>>>> ---------------------
> > >>>>>>>>>>> Kuldeep Singh Budania
> > >>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>
> > >>>>>>>
> > >>>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>
> >
> >
>
>
> ________________________________
>
> CONFIDENTIALITY & PRIVACY NOTICE
> This e-mail (including any attachments) is strictly confidential and
> may also contain privileged information. If you are not the intended
> recipient you are not authorised to read, print, save, process or disclose
> this message. If you have received this message by mistake, please inform
> the sender immediately and destroy this e-mail, its attachments and any
> copies. Any use, distribution, reproduction or disclosure by any person
> other than the intended recipient is strictly prohibited and the person
> responsible may incur in penalties.
> The use of this e-mail is only for professional purposes; there is no
> guarantee that the correspondence towards this e-mail will be read only by
> the recipient, because, under certain circumstances, there may be a need to
> access this email by third subjects belonging to the Company.
>
>
> ________________________________
>
> CONFIDENTIALITY & PRIVACY NOTICE
> This e-mail (including any attachments) is strictly confidential and may
> also contain privileged information. If you are not the intended recipient
> you are not authorised to read, print, save, process or disclose this
> message. If you have received this message by mistake, please inform the
> sender immediately and destroy this e-mail, its attachments and any copies.
> Any use, distribution, reproduction or disclosure by any person other than
> the intended recipient is strictly prohibited and the person responsible
> may incur in penalties.
> The use of this e-mail is only for professional purposes; there is no
> guarantee that the correspondence towards this e-mail will be read only by
> the recipient, because, under certain circumstances, there may be a need to
> access this email by third subjects belonging to the Company.
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by Enrico Olivelli - Diennea <en...@diennea.com.INVALID>.
I mean in zoo.cfg
Not as a system property
Enrico
Il giorno 25/06/20, 08:19 "Enrico Olivelli - Diennea" <en...@diennea.com.INVALID> ha scritto:
Hi
You have to enable Netty on the server side
Something like:
serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
Hope that helps
Enrico
Il giorno 24/06/20, 19:17 "kuldeep singh" <ku...@gmail.com> ha scritto:
Hi,
I got below error while setting SSL properties in zkEnv.sh
==========================================================================================
2020-06-24 15:49:35,864 - INFO [main:QuorumPeerConfig@133] - Reading
configuration from: /etc/zookeeper/zoo.cfg
2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@385] -
clientPortAddress is 0.0.0.0/0.0.0.0:10181
2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@399] -
secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
2020-06-24 15:49:35,878 - INFO [main:X509Util@79] - Setting -D
jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated
TLS renegotiation
2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@78] -
autopurge.snapRetainCount set to 3
2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@79] -
autopurge.purgeInterval set to 1
2020-06-24 15:49:35,898 - INFO [
PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge task started.
2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] - Log4j found with
jmx enabled.
2020-06-24 15:49:35,903 - INFO [PurgeTask:FileTxnSnapLog@103] -
zookeeper.snapshot.trust.empty : false
2020-06-24 15:49:35,910 - INFO [
PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge task completed.
2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141] - Starting quorum
peer
2020-06-24 15:49:35,983 - INFO [main:ServerCnxnFactory@135] - Using
org.apache.zookeeper.server.NIOServerCnxnFactory as server connection
factory
2020-06-24 15:49:35,986 - INFO [main:NIOServerCnxnFactory@673] -
Configuring NIO connection handler with 10s sessionless connection timeout,
2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
2020-06-24 15:49:35,992 - INFO [main:NIOServerCnxnFactory@686] - binding
to port 0.0.0.0/0.0.0.0:10181
2020-06-24 15:49:35,994 - INFO [main:ServerCnxnFactory@135] - Using
org.apache.zookeeper.server.NIOServerCnxnFactory as server connection
factory
2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101] - Unexpected
exception, exiting abnormally
java.lang.UnsupportedOperationException: SSL isn't supported in
NIOServerCnxn
at
org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
at
org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
at
org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
at
org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
I have set the following properties in SERVER_JVMFLAGS in zkEnv.sh file :
"-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
-Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
-Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
-Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
-Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
Thanks,
---------------------
Kuldeep Singh Budania
On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <jo...@jordanzimmerman.com>
wrote:
> It's the same as the normal ZooKeeper client:
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> <
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >
>
> -Jordan
>
> > On Jun 22, 2020, at 5:50 AM, kuldeep singh <ku...@gmail.com>
> wrote:
> >
> > Hi Team,
> > How we will do secure communication between the Curator framework and
> > zookeeper 3.5.6 ?
> > I didn't get any solution right now.
> > I appreciate it if someone could help me with the same.
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> > Software Architect
> >
> >
> > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
> szalay.beko.mate@gmail.com>
> > wrote:
> >
> >> Hello Kuldeep,
> >>
> >> did you download the source from the ZooKeeper webpage, or checked out
> from
> >> git?
> >> Anyway, the following commands should work:
> >>
> >> wget
> >>
> >>
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
> >> cd apache-zookeeper-3.5.7
> >> mvn clean install -DskipTests
> >>
> >> I tested it with OpenJDK 8u424 and maven 3.6.0.
> >>
> >> Kind regards,
> >> Mate
> >>
> >>
> >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
> kuldeep.singh08@gmail.com>
> >> wrote:
> >>
> >>> Hi All,
> >>>
> >>> I have download the zookeeper source code and run the mvn command for
> >>> packaging but get problem on "zookeeper-server" directory.
> >>>
> >>> *command :- mvn clean package*
> >>>
> >>> [ERROR] Failed to execute goal
> >>> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >>> (default-compile) on project zookeeper: Fatal error compiling:
> >>> java.lang.NullPointerException -> [Help 1]
> >>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
> execute
> >>> goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >>> (default-compile) on project zookeeper: Fatal error compiling
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> >>> at
> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> >>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> >>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> >>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> >>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >>> at
> >>>
> >>>
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >>> at
> >>>
> >>>
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>> at java.lang.reflect.Method.invoke(Method.java:498)
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> >>> at
> >>>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> >>> at
> >>>
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> >>> Caused by: org.apache.maven.plugin.MojoExecutionException: Fatal error
> >>> compiling
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> >>> ... 19 more
> >>> Caused by: org.codehaus.plexus.compiler.CompilerException:
> >>> java.lang.NullPointerException
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> >>> ... 22 more
> >>> Caused by: java.lang.RuntimeException: java.lang.NullPointerException
> >>> at com.sun.tools.javac.main.Main.compile(Main.java:559)
> >>> at
> >>> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> >>> at
> >>> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> >>> ... 24 more
> >>> Caused by: java.lang.NullPointerException
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> >>> at com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> >>> at com.sun.tools.doclint.Checker.scan(Checker.java:144)
> >>> at com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> >>> at
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> >>> at
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >>> at
> >>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> at
> >>> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> >>> at
> >>> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> at
> >>> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> >>> at
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> >>> at
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> >>> at
> >>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> at com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >>> at
> >> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> >>> at
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> >>> at
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >>> at
> >>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >>> at
> >>>
> >>
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> >>> at
> >>>
> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> >>> at
> >>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> >>> at
> >>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> >>> at
> >>> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> >>> at com.sun.tools.javac.main.Main.compile(Main.java:523)
> >>> ... 27 more
> >>> [ERROR]
> >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> >>> [ERROR]
> >>> [ERROR] For more information about the errors and possible solutions,
> >>> please read the following articles:
> >>> [ERROR] [Help 1]
> >>>
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> >>>
> >>> Can someone help me on this issue?
> >>>
> >>> Thanks,
> >>> ---------------------
> >>> Kuldeep Singh Budania
> >>>
> >>>
> >>>
> >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
> >>> szalay.beko.mate@gmail.com>
> >>> wrote:
> >>>
> >>>> these exceptions can mean many things... I think this can be even
> >> normal
> >>>> duding rolling restart (as some connections get broken in this case)
> >>>>
> >>>> However, I saw cases already when exceptions like these killed
> receiver
> >>> or
> >>>> sender threads in QuorumCnxManager / Leader Election in such a way
> that
> >>>> they were not able to recover, so the node was unable to connect to
> any
> >>>> quorum until restart. I remember seeing this in 3.4 too.
> >>>>
> >>>> Do you see these exceptions in the second server (the one which you
> >> just
> >>>> upgraded in step 3)?
> >>>> Is this issue reproducible?
> >>>>
> >>>> What is the tickTime and initLimit you use? Maybe the server just
> >> require
> >>>> more time to sync?
> >>>>
> >>>> I would need more logs to really see what happened. Can you create a
> >> Jira
> >>>> issue and upload the logs and also the ZooKeeper configs? I am happy
> to
> >>>> take a closer look.
> >>>> (if you need to re-run the test to collect the logs, then enabling
> >> DEBUG
> >>>> logs would be great. The INFO level logs are usually enough for these
> >>>> problems, but one can never know...)
> >>>>
> >>>> Kind regards,
> >>>> Mate
> >>>>
> >>>>
> >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
> >> kuldeep.singh08@gmail.com
> >>>>
> >>>> wrote:
> >>>>
> >>>>> Hi Team,
> >>>>>
> >>>>> I have done some POC on rolling upgrade and found below result.
> >>>>>
> >>>>>
> >>>>> 1. On 1st node upgrade zookeeper . Traffic was running fine
> >> because
> >>> 2
> >>>>> nodes are already on old zookeeper.
> >>>>> 2. On 1st node upgrade our application and didn’t find any issue
> >>>>> 3. On 2nd node upgrade zookeeper but got below error and zookeeper
> >>> is
> >>>>> not taking any requests
> >>>>> 4.
> >>>>>
> >>>>> java.io.EOFException
> >>>>>
> >>>>> at java.io.DataInputStream.readInt(DataInputStream.java:392)
> >>>>>
> >>>>> at
> >>>>>
> >>>>>
> >>>>
> >>>
> >>
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> >>>>>
> >>>>> 2020-03-30 14:19:55,587 - WARN
> >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765] - Interrupting
> >>> SendWorker
> >>>>>
> >>>>> 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/192.168.44.73:33754
> >>>>> :LearnerHandler@562] - Unexpected exception causing shutdown while
> >>> sock
> >>>>> still open
> >>>>>
> >>>>> java.io.EOFException
> >>>>>
> >>>>> at java.io.DataInputStream.readInt(DataInputStream.java:392)
> >>>>>
> >>>>> at
> >>>>>
> >> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> >>>>>
> >>>>> at
> >>>>>
> >>>>>
> >>>>
> >>>
> >>
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> >>>>>
> >>>>> at
> >>>>>
> >>>>
> >>>
> >>
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> >>>>>
> >>>>> at
> >>>>>
> >>>>>
> >>>>
> >>>
> >>
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> >>>>>
> >>>>> 2020-03-30 14:19:55,588 - WARN
> >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679] - Interrupted while
> >>>> waiting
> >>>>> for message on queue
> >>>>>
> >>>>> Please let me know is this the known issue or this is different issue
> >>>> which
> >>>>> is mention in Apache zookeeper documentation when upgrading from
> >> 3.4.5
> >>> to
> >>>>> 3.5.6
> >>>>>
> >>>>> Thanks,
> >>>>> ---------------------
> >>>>> Kuldeep Singh Budania
> >>>>> Software Architect
> >>>>>
> >>>>>
> >>>>>
> >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer <sh...@gmail.com>
> >>>>> wrote:
> >>>>>
> >>>>>> +1 to what Mate said (I wrote the quoted instructions).
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő Máté <
> >>>>>> szalay.beko.mate@gmail.com>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> Hi Kuldeep,
> >>>>>>>
> >>>>>>> I just want to provide you some background info about our
> >>>>> documentation.
> >>>>>>> The reason to upgrade to 3.4.6 first is to avoid the following
> >>> error:
> >>>>>>>
> >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
> >>> 127.0.0.1:2784
> >>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
> >>>>>>>
> >>>>>>> This error comes because of the protocol changes between
> >> ZooKeeper
> >>>>> server
> >>>>>>> nodes during connection initiation for leader election. In
> >>> ZooKeeper
> >>>>> 3.5
> >>>>>> a
> >>>>>>> protocol version was introduced (see ZOOKEEPER-107) and since
> >> that
> >>>> time
> >>>>>> the
> >>>>>>> fist long value sent in the initial message is not the server ID
> >>> but
> >>>>> the
> >>>>>>> protocol version (-65536). In ZooKeeper 3.4.6 we made the old 3.4
> >>>>>>> ZooKeepers backward compatible, so they are able to parse both
> >> the
> >>>> old
> >>>>>> and
> >>>>>>> the new protocol format (see ZOOKEEPER-1633). This issue happens
> >>> only
> >>>>>> when
> >>>>>>> you need to use old (3.4.0 - 3.4.5) and new (3.5.0+) ZooKeeper
> >>>> servers
> >>>>>>> together in the same cluster. During a rolling upgrade, this is
> >>>> usually
> >>>>>> the
> >>>>>>> case to have old and new ZooKeepers present together.
> >>>>>>>
> >>>>>>> The fact that you haven't seen any issues might be caused by the
> >>>> order
> >>>>> of
> >>>>>>> the servers. In ZooKeeper the connection initiation between the
> >>>> servers
> >>>>>>> during the leader election follows a specific rule. As far as I
> >>>>> remember
> >>>>>>> always the server with the larger ID 'wins the challenge', so it
> >> is
> >>>>>>> possible, that the old server didn't need to parse any initial
> >>>> message
> >>>>>> (if
> >>>>>>> it had the largest ID) and this is why you haven't seen the
> >> issue.
> >>>> Also
> >>>>>>> having 2 nodes up from the 3 nodes cluster still makes the
> >> cluster
> >>>> work
> >>>>>> (so
> >>>>>>> you should also check if all the servers are part of the quorum).
> >>>>>>>
> >>>>>>> I agree with Enrico and Norbert, the safest and most stable way
> >> is
> >>>>>> upgrade
> >>>>>>> first to 3.4.latest, then go to 3.5.latest. Still, if you don't
> >> see
> >>>>> that
> >>>>>>> you would hit this specific issue (e.g. no "Invalid server id" in
> >>> the
> >>>>> log
> >>>>>>> files), and all the three servers can handle traffic, then maybe
> >>> you
> >>>>>> don't
> >>>>>>> need to upgrade first to 3.4.latest, it is your decision.
> >>> Definitely
> >>>>> you
> >>>>>>> should test it first, as suggested by the others.
> >>>>>>>
> >>>>>>> Kind regards,
> >>>>>>> Mate
> >>>>>>>
> >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
> >>>>>>> <nk...@cloudera.com.invalid> wrote:
> >>>>>>>
> >>>>>>>> Hi,
> >>>>>>>>
> >>>>>>>> That guide is to upgrade to 3.5.0, which was an alpha version.
> >> A
> >>>> lot
> >>>>>> has
> >>>>>>>> changed for the first stable release of 3.5.5 and then a few
> >>> more,
> >>>>> even
> >>>>>>>> rolling upgrade issues have been fixed for 3.5.6.
> >>>>>>>> This is a more up-to-date guide:
> >>>>>>>>
> >>> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> >>>>>>>>
> >>>>>>>> If you have done your testing (with prod snapshot!), then you
> >> can
> >>>>> skip
> >>>>>>> 3.4
> >>>>>>>> latest upgrade, but keep in mind we do our recommendations for
> >> a
> >>>>>> reason.
> >>>>>>>> There were issues reported and/or found during testing. Some
> >> are
> >>>>> fixed
> >>>>>>> with
> >>>>>>>> 3.5.6, some only happens if certain conditions stand
> >>> (IOException:
> >>>> No
> >>>>>>>> snapshot found - mentioned in the guide, fixed in 3.5.6).
> >>>>>>>>
> >>>>>>>> So it is up to you, I would still recommend to do an 3.4
> >> upgrade
> >>>>> first,
> >>>>>>> if
> >>>>>>>> it's feasible.
> >>>>>>>>
> >>>>>>>> Regards,
> >>>>>>>> Norbert
> >>>>>>>>
> >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep singh <
> >>>>>>> kuldeep.singh08@gmail.com>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Hi,
> >>>>>>>>>
> >>>>>>>>> Current Zookeeper version :- 3.4.5
> >>>>>>>>> Upgraded version :- 3.5.6
> >>>>>>>>>
> >>>>>>>>> We are not going with 3.5.7. Our final decision is zookeeper
> >>>>> version
> >>>>>> is
> >>>>>>>>> 3.5.6
> >>>>>>>>> as per your reply first we need to move latest version of
> >>> 3.4.x,
> >>>>> like
> >>>>>>>> below
> >>>>>>>>>
> >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am wrong here)
> >>>>>>>>>
> >>>>>>>>> But if We are not facing any problem that i have shared you
> >>> that
> >>>> we
> >>>>>>> have
> >>>>>>>>> set up of 3 node cluster where 2 node are on 3.5.6 version
> >> and
> >>> 1
> >>>>> node
> >>>>>>> on
> >>>>>>>>> 3.4.5, Everything is running fine and didn't get any issue,
> >> So
> >>>> what
> >>>>>>> other
> >>>>>>>>> problem we can face if we directly move to 3.5.6
> >>>>>>>>>
> >>>>>>>>> Thanks,
> >>>>>>>>> ---------------------
> >>>>>>>>> Kuldeep Singh Budania
> >>>>>>>>> Software Architect
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico Olivelli <
> >>>>> eolivelli@gmail.com
> >>>>>>>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi
> >>>>>>>>>> You have to upgrade to latest 3.4.x Zookeeper then you will
> >>>>> upgrade
> >>>>>>> to
> >>>>>>>>>> 3.5.7.
> >>>>>>>>>> All should run well without issues
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Enrico
> >>>>>>>>>>
> >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
> >>>>> kuldeep.singh08@gmail.com
> >>>>>>>
> >>>>>>> ha
> >>>>>>>>>> scritto:
> >>>>>>>>>>
> >>>>>>>>>>> Hi Team,
> >>>>>>>>>>>
> >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to 3.5.6. I have
> >> set
> >>>> up 3
> >>>>>>> node
> >>>>>>>>>>> cluster where 2 node are on 3.5.6 version and 1 node on
> >>>> 3.4.5.
> >>>>>>>>>>>
> >>>>>>>>>>> Everything is running fine and didn't get any issue on my
> >>>>> system.
> >>>>>>>>>>>
> >>>>>>>>>>> but I found something on apache site that first we need
> >> to
> >>>>>> upgrade
> >>>>>>>> on
> >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is it mandatory
> >> to
> >>> go
> >>>>> on
> >>>>>>>> 3.4.6
> >>>>>>>>>>> first.
> >>>>>>>>>>>
> >>>>>>>>>>> *Upgrading to 3.5.0*
> >>>>>>>>>>>
> >>>>>>>>>>> Upgrading a running ZooKeeper ensemble to 3.5.0 should be
> >>>> done
> >>>>>> only
> >>>>>>>>> after
> >>>>>>>>>>> upgrading your ensemble to the 3.4.6 release. Note that
> >>> this
> >>>> is
> >>>>>>> only
> >>>>>>>>>>> necessary for rolling upgrades (if you're fine with
> >>> shutting
> >>>>> down
> >>>>>>> the
> >>>>>>>>>>> system completely, you don't have to go through 3.4.6).
> >> If
> >>>> you
> >>>>>>>> attempt
> >>>>>>>>> a
> >>>>>>>>>>> rolling upgrade without going through 3.4.6 (for example
> >>> from
> >>>>>>> 3.4.5),
> >>>>>>>>> you
> >>>>>>>>>>> may get the following error:
> >>>>>>>>>>>
> >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO [localhost/
> >>>>>> 127.0.0.1:2784
> >>>>>>>>>>> :QuorumCnxManager$Listener@498] - Received connection
> >>>> request
> >>>>> /
> >>>>>>>>>>> 127.0.0.1:60876
> >>>>>>>>>>>
> >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
> >>>>>> 127.0.0.1:2784
> >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
> >>>>>>>>>>>
> >>>>>>>>>>> During a rolling upgrade, each server is taken down in
> >> turn
> >>>> and
> >>>>>>>>> rebooted
> >>>>>>>>>>> with the new 3.5.0 binaries. Before starting the server
> >>> with
> >>>>>> 3.5.0
> >>>>>>>>>>> binaries, we highly recommend updating the configuration
> >>> file
> >>>>> so
> >>>>>>> that
> >>>>>>>>> all
> >>>>>>>>>>> server statements "server.x=..." contain client ports
> >> (see
> >>>> the
> >>>>>>>> section
> >>>>>>>>>>> Specifying
> >>>>>>>>>>> the client port). As explained earlier you may leave the
> >>>>>>>> configuration
> >>>>>>>>>> in a
> >>>>>>>>>>> single file, as well as leave the
> >>>> clientPort/clientPortAddress
> >>>>>>>>> statements
> >>>>>>>>>>> (although if you specify client ports in the new format,
> >>>> these
> >>>>>>>>> statements
> >>>>>>>>>>> are now redundant).
> >>>>>>>>>>>
> >>>>>>>>>>> Could you please let me know about this case. Appreciate
> >> if
> >>>>>> respond
> >>>>>>>>> soon.
> >>>>>>>>>>>
> >>>>>>>>>>> Thanks,
> >>>>>>>>>>> ---------------------
> >>>>>>>>>>> Kuldeep Singh Budania
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>
>
>
________________________________
CONFIDENTIALITY & PRIVACY NOTICE
This e-mail (including any attachments) is strictly confidential and may also contain privileged information. If you are not the intended recipient you are not authorised to read, print, save, process or disclose this message. If you have received this message by mistake, please inform the sender immediately and destroy this e-mail, its attachments and any copies. Any use, distribution, reproduction or disclosure by any person other than the intended recipient is strictly prohibited and the person responsible may incur in penalties.
The use of this e-mail is only for professional purposes; there is no guarantee that the correspondence towards this e-mail will be read only by the recipient, because, under certain circumstances, there may be a need to access this email by third subjects belonging to the Company.
________________________________
CONFIDENTIALITY & PRIVACY NOTICE
This e-mail (including any attachments) is strictly confidential and may also contain privileged information. If you are not the intended recipient you are not authorised to read, print, save, process or disclose this message. If you have received this message by mistake, please inform the sender immediately and destroy this e-mail, its attachments and any copies. Any use, distribution, reproduction or disclosure by any person other than the intended recipient is strictly prohibited and the person responsible may incur in penalties.
The use of this e-mail is only for professional purposes; there is no guarantee that the correspondence towards this e-mail will be read only by the recipient, because, under certain circumstances, there may be a need to access this email by third subjects belonging to the Company.
Re: upgrade from 3.4.5 to 3.5.6
Posted by Enrico Olivelli - Diennea <en...@diennea.com.INVALID>.
Hi
You have to enable Netty on the server side
Something like:
serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
Hope that helps
Enrico
Il giorno 24/06/20, 19:17 "kuldeep singh" <ku...@gmail.com> ha scritto:
Hi,
I got below error while setting SSL properties in zkEnv.sh
==========================================================================================
2020-06-24 15:49:35,864 - INFO [main:QuorumPeerConfig@133] - Reading
configuration from: /etc/zookeeper/zoo.cfg
2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@385] -
clientPortAddress is 0.0.0.0/0.0.0.0:10181
2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@399] -
secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
2020-06-24 15:49:35,878 - INFO [main:X509Util@79] - Setting -D
jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated
TLS renegotiation
2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@78] -
autopurge.snapRetainCount set to 3
2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@79] -
autopurge.purgeInterval set to 1
2020-06-24 15:49:35,898 - INFO [
PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge task started.
2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] - Log4j found with
jmx enabled.
2020-06-24 15:49:35,903 - INFO [PurgeTask:FileTxnSnapLog@103] -
zookeeper.snapshot.trust.empty : false
2020-06-24 15:49:35,910 - INFO [
PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge task completed.
2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141] - Starting quorum
peer
2020-06-24 15:49:35,983 - INFO [main:ServerCnxnFactory@135] - Using
org.apache.zookeeper.server.NIOServerCnxnFactory as server connection
factory
2020-06-24 15:49:35,986 - INFO [main:NIOServerCnxnFactory@673] -
Configuring NIO connection handler with 10s sessionless connection timeout,
2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
2020-06-24 15:49:35,992 - INFO [main:NIOServerCnxnFactory@686] - binding
to port 0.0.0.0/0.0.0.0:10181
2020-06-24 15:49:35,994 - INFO [main:ServerCnxnFactory@135] - Using
org.apache.zookeeper.server.NIOServerCnxnFactory as server connection
factory
2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101] - Unexpected
exception, exiting abnormally
java.lang.UnsupportedOperationException: SSL isn't supported in
NIOServerCnxn
at
org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
at
org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
at
org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
at
org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
I have set the following properties in SERVER_JVMFLAGS in zkEnv.sh file :
"-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
-Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
-Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
-Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
-Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
Thanks,
---------------------
Kuldeep Singh Budania
On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <jo...@jordanzimmerman.com>
wrote:
> It's the same as the normal ZooKeeper client:
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> <
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >
>
> -Jordan
>
> > On Jun 22, 2020, at 5:50 AM, kuldeep singh <ku...@gmail.com>
> wrote:
> >
> > Hi Team,
> > How we will do secure communication between the Curator framework and
> > zookeeper 3.5.6 ?
> > I didn't get any solution right now.
> > I appreciate it if someone could help me with the same.
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> > Software Architect
> >
> >
> > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
> szalay.beko.mate@gmail.com>
> > wrote:
> >
> >> Hello Kuldeep,
> >>
> >> did you download the source from the ZooKeeper webpage, or checked out
> from
> >> git?
> >> Anyway, the following commands should work:
> >>
> >> wget
> >>
> >>
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
> >> cd apache-zookeeper-3.5.7
> >> mvn clean install -DskipTests
> >>
> >> I tested it with OpenJDK 8u424 and maven 3.6.0.
> >>
> >> Kind regards,
> >> Mate
> >>
> >>
> >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
> kuldeep.singh08@gmail.com>
> >> wrote:
> >>
> >>> Hi All,
> >>>
> >>> I have download the zookeeper source code and run the mvn command for
> >>> packaging but get problem on "zookeeper-server" directory.
> >>>
> >>> *command :- mvn clean package*
> >>>
> >>> [ERROR] Failed to execute goal
> >>> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >>> (default-compile) on project zookeeper: Fatal error compiling:
> >>> java.lang.NullPointerException -> [Help 1]
> >>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
> execute
> >>> goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >>> (default-compile) on project zookeeper: Fatal error compiling
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> >>> at
> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> >>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> >>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> >>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> >>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >>> at
> >>>
> >>>
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >>> at
> >>>
> >>>
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>> at java.lang.reflect.Method.invoke(Method.java:498)
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> >>> at
> >>>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> >>> at
> >>>
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> >>> Caused by: org.apache.maven.plugin.MojoExecutionException: Fatal error
> >>> compiling
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> >>> ... 19 more
> >>> Caused by: org.codehaus.plexus.compiler.CompilerException:
> >>> java.lang.NullPointerException
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> >>> ... 22 more
> >>> Caused by: java.lang.RuntimeException: java.lang.NullPointerException
> >>> at com.sun.tools.javac.main.Main.compile(Main.java:559)
> >>> at
> >>> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> >>> at
> >>> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> >>> ... 24 more
> >>> Caused by: java.lang.NullPointerException
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> >>> at com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> >>> at com.sun.tools.doclint.Checker.scan(Checker.java:144)
> >>> at com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> >>> at
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> >>> at
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >>> at
> >>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> at
> >>> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> >>> at
> >>> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> at
> >>> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> >>> at
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> >>> at
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> >>> at
> >>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> at com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >>> at
> >> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> >>> at
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> >>> at
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >>> at
> >>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >>> at
> >>>
> >>
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> >>> at
> >>>
> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> >>> at
> >>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> >>> at
> >>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> >>> at
> >>> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> >>> at com.sun.tools.javac.main.Main.compile(Main.java:523)
> >>> ... 27 more
> >>> [ERROR]
> >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> >>> [ERROR]
> >>> [ERROR] For more information about the errors and possible solutions,
> >>> please read the following articles:
> >>> [ERROR] [Help 1]
> >>>
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> >>>
> >>> Can someone help me on this issue?
> >>>
> >>> Thanks,
> >>> ---------------------
> >>> Kuldeep Singh Budania
> >>>
> >>>
> >>>
> >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
> >>> szalay.beko.mate@gmail.com>
> >>> wrote:
> >>>
> >>>> these exceptions can mean many things... I think this can be even
> >> normal
> >>>> duding rolling restart (as some connections get broken in this case)
> >>>>
> >>>> However, I saw cases already when exceptions like these killed
> receiver
> >>> or
> >>>> sender threads in QuorumCnxManager / Leader Election in such a way
> that
> >>>> they were not able to recover, so the node was unable to connect to
> any
> >>>> quorum until restart. I remember seeing this in 3.4 too.
> >>>>
> >>>> Do you see these exceptions in the second server (the one which you
> >> just
> >>>> upgraded in step 3)?
> >>>> Is this issue reproducible?
> >>>>
> >>>> What is the tickTime and initLimit you use? Maybe the server just
> >> require
> >>>> more time to sync?
> >>>>
> >>>> I would need more logs to really see what happened. Can you create a
> >> Jira
> >>>> issue and upload the logs and also the ZooKeeper configs? I am happy
> to
> >>>> take a closer look.
> >>>> (if you need to re-run the test to collect the logs, then enabling
> >> DEBUG
> >>>> logs would be great. The INFO level logs are usually enough for these
> >>>> problems, but one can never know...)
> >>>>
> >>>> Kind regards,
> >>>> Mate
> >>>>
> >>>>
> >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
> >> kuldeep.singh08@gmail.com
> >>>>
> >>>> wrote:
> >>>>
> >>>>> Hi Team,
> >>>>>
> >>>>> I have done some POC on rolling upgrade and found below result.
> >>>>>
> >>>>>
> >>>>> 1. On 1st node upgrade zookeeper . Traffic was running fine
> >> because
> >>> 2
> >>>>> nodes are already on old zookeeper.
> >>>>> 2. On 1st node upgrade our application and didn’t find any issue
> >>>>> 3. On 2nd node upgrade zookeeper but got below error and zookeeper
> >>> is
> >>>>> not taking any requests
> >>>>> 4.
> >>>>>
> >>>>> java.io.EOFException
> >>>>>
> >>>>> at java.io.DataInputStream.readInt(DataInputStream.java:392)
> >>>>>
> >>>>> at
> >>>>>
> >>>>>
> >>>>
> >>>
> >>
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> >>>>>
> >>>>> 2020-03-30 14:19:55,587 - WARN
> >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765] - Interrupting
> >>> SendWorker
> >>>>>
> >>>>> 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/192.168.44.73:33754
> >>>>> :LearnerHandler@562] - Unexpected exception causing shutdown while
> >>> sock
> >>>>> still open
> >>>>>
> >>>>> java.io.EOFException
> >>>>>
> >>>>> at java.io.DataInputStream.readInt(DataInputStream.java:392)
> >>>>>
> >>>>> at
> >>>>>
> >> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> >>>>>
> >>>>> at
> >>>>>
> >>>>>
> >>>>
> >>>
> >>
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> >>>>>
> >>>>> at
> >>>>>
> >>>>
> >>>
> >>
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> >>>>>
> >>>>> at
> >>>>>
> >>>>>
> >>>>
> >>>
> >>
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> >>>>>
> >>>>> 2020-03-30 14:19:55,588 - WARN
> >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679] - Interrupted while
> >>>> waiting
> >>>>> for message on queue
> >>>>>
> >>>>> Please let me know is this the known issue or this is different issue
> >>>> which
> >>>>> is mention in Apache zookeeper documentation when upgrading from
> >> 3.4.5
> >>> to
> >>>>> 3.5.6
> >>>>>
> >>>>> Thanks,
> >>>>> ---------------------
> >>>>> Kuldeep Singh Budania
> >>>>> Software Architect
> >>>>>
> >>>>>
> >>>>>
> >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer <sh...@gmail.com>
> >>>>> wrote:
> >>>>>
> >>>>>> +1 to what Mate said (I wrote the quoted instructions).
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő Máté <
> >>>>>> szalay.beko.mate@gmail.com>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> Hi Kuldeep,
> >>>>>>>
> >>>>>>> I just want to provide you some background info about our
> >>>>> documentation.
> >>>>>>> The reason to upgrade to 3.4.6 first is to avoid the following
> >>> error:
> >>>>>>>
> >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
> >>> 127.0.0.1:2784
> >>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
> >>>>>>>
> >>>>>>> This error comes because of the protocol changes between
> >> ZooKeeper
> >>>>> server
> >>>>>>> nodes during connection initiation for leader election. In
> >>> ZooKeeper
> >>>>> 3.5
> >>>>>> a
> >>>>>>> protocol version was introduced (see ZOOKEEPER-107) and since
> >> that
> >>>> time
> >>>>>> the
> >>>>>>> fist long value sent in the initial message is not the server ID
> >>> but
> >>>>> the
> >>>>>>> protocol version (-65536). In ZooKeeper 3.4.6 we made the old 3.4
> >>>>>>> ZooKeepers backward compatible, so they are able to parse both
> >> the
> >>>> old
> >>>>>> and
> >>>>>>> the new protocol format (see ZOOKEEPER-1633). This issue happens
> >>> only
> >>>>>> when
> >>>>>>> you need to use old (3.4.0 - 3.4.5) and new (3.5.0+) ZooKeeper
> >>>> servers
> >>>>>>> together in the same cluster. During a rolling upgrade, this is
> >>>> usually
> >>>>>> the
> >>>>>>> case to have old and new ZooKeepers present together.
> >>>>>>>
> >>>>>>> The fact that you haven't seen any issues might be caused by the
> >>>> order
> >>>>> of
> >>>>>>> the servers. In ZooKeeper the connection initiation between the
> >>>> servers
> >>>>>>> during the leader election follows a specific rule. As far as I
> >>>>> remember
> >>>>>>> always the server with the larger ID 'wins the challenge', so it
> >> is
> >>>>>>> possible, that the old server didn't need to parse any initial
> >>>> message
> >>>>>> (if
> >>>>>>> it had the largest ID) and this is why you haven't seen the
> >> issue.
> >>>> Also
> >>>>>>> having 2 nodes up from the 3 nodes cluster still makes the
> >> cluster
> >>>> work
> >>>>>> (so
> >>>>>>> you should also check if all the servers are part of the quorum).
> >>>>>>>
> >>>>>>> I agree with Enrico and Norbert, the safest and most stable way
> >> is
> >>>>>> upgrade
> >>>>>>> first to 3.4.latest, then go to 3.5.latest. Still, if you don't
> >> see
> >>>>> that
> >>>>>>> you would hit this specific issue (e.g. no "Invalid server id" in
> >>> the
> >>>>> log
> >>>>>>> files), and all the three servers can handle traffic, then maybe
> >>> you
> >>>>>> don't
> >>>>>>> need to upgrade first to 3.4.latest, it is your decision.
> >>> Definitely
> >>>>> you
> >>>>>>> should test it first, as suggested by the others.
> >>>>>>>
> >>>>>>> Kind regards,
> >>>>>>> Mate
> >>>>>>>
> >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
> >>>>>>> <nk...@cloudera.com.invalid> wrote:
> >>>>>>>
> >>>>>>>> Hi,
> >>>>>>>>
> >>>>>>>> That guide is to upgrade to 3.5.0, which was an alpha version.
> >> A
> >>>> lot
> >>>>>> has
> >>>>>>>> changed for the first stable release of 3.5.5 and then a few
> >>> more,
> >>>>> even
> >>>>>>>> rolling upgrade issues have been fixed for 3.5.6.
> >>>>>>>> This is a more up-to-date guide:
> >>>>>>>>
> >>> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> >>>>>>>>
> >>>>>>>> If you have done your testing (with prod snapshot!), then you
> >> can
> >>>>> skip
> >>>>>>> 3.4
> >>>>>>>> latest upgrade, but keep in mind we do our recommendations for
> >> a
> >>>>>> reason.
> >>>>>>>> There were issues reported and/or found during testing. Some
> >> are
> >>>>> fixed
> >>>>>>> with
> >>>>>>>> 3.5.6, some only happens if certain conditions stand
> >>> (IOException:
> >>>> No
> >>>>>>>> snapshot found - mentioned in the guide, fixed in 3.5.6).
> >>>>>>>>
> >>>>>>>> So it is up to you, I would still recommend to do an 3.4
> >> upgrade
> >>>>> first,
> >>>>>>> if
> >>>>>>>> it's feasible.
> >>>>>>>>
> >>>>>>>> Regards,
> >>>>>>>> Norbert
> >>>>>>>>
> >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep singh <
> >>>>>>> kuldeep.singh08@gmail.com>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Hi,
> >>>>>>>>>
> >>>>>>>>> Current Zookeeper version :- 3.4.5
> >>>>>>>>> Upgraded version :- 3.5.6
> >>>>>>>>>
> >>>>>>>>> We are not going with 3.5.7. Our final decision is zookeeper
> >>>>> version
> >>>>>> is
> >>>>>>>>> 3.5.6
> >>>>>>>>> as per your reply first we need to move latest version of
> >>> 3.4.x,
> >>>>> like
> >>>>>>>> below
> >>>>>>>>>
> >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am wrong here)
> >>>>>>>>>
> >>>>>>>>> But if We are not facing any problem that i have shared you
> >>> that
> >>>> we
> >>>>>>> have
> >>>>>>>>> set up of 3 node cluster where 2 node are on 3.5.6 version
> >> and
> >>> 1
> >>>>> node
> >>>>>>> on
> >>>>>>>>> 3.4.5, Everything is running fine and didn't get any issue,
> >> So
> >>>> what
> >>>>>>> other
> >>>>>>>>> problem we can face if we directly move to 3.5.6
> >>>>>>>>>
> >>>>>>>>> Thanks,
> >>>>>>>>> ---------------------
> >>>>>>>>> Kuldeep Singh Budania
> >>>>>>>>> Software Architect
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico Olivelli <
> >>>>> eolivelli@gmail.com
> >>>>>>>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi
> >>>>>>>>>> You have to upgrade to latest 3.4.x Zookeeper then you will
> >>>>> upgrade
> >>>>>>> to
> >>>>>>>>>> 3.5.7.
> >>>>>>>>>> All should run well without issues
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Enrico
> >>>>>>>>>>
> >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
> >>>>> kuldeep.singh08@gmail.com
> >>>>>>>
> >>>>>>> ha
> >>>>>>>>>> scritto:
> >>>>>>>>>>
> >>>>>>>>>>> Hi Team,
> >>>>>>>>>>>
> >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to 3.5.6. I have
> >> set
> >>>> up 3
> >>>>>>> node
> >>>>>>>>>>> cluster where 2 node are on 3.5.6 version and 1 node on
> >>>> 3.4.5.
> >>>>>>>>>>>
> >>>>>>>>>>> Everything is running fine and didn't get any issue on my
> >>>>> system.
> >>>>>>>>>>>
> >>>>>>>>>>> but I found something on apache site that first we need
> >> to
> >>>>>> upgrade
> >>>>>>>> on
> >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is it mandatory
> >> to
> >>> go
> >>>>> on
> >>>>>>>> 3.4.6
> >>>>>>>>>>> first.
> >>>>>>>>>>>
> >>>>>>>>>>> *Upgrading to 3.5.0*
> >>>>>>>>>>>
> >>>>>>>>>>> Upgrading a running ZooKeeper ensemble to 3.5.0 should be
> >>>> done
> >>>>>> only
> >>>>>>>>> after
> >>>>>>>>>>> upgrading your ensemble to the 3.4.6 release. Note that
> >>> this
> >>>> is
> >>>>>>> only
> >>>>>>>>>>> necessary for rolling upgrades (if you're fine with
> >>> shutting
> >>>>> down
> >>>>>>> the
> >>>>>>>>>>> system completely, you don't have to go through 3.4.6).
> >> If
> >>>> you
> >>>>>>>> attempt
> >>>>>>>>> a
> >>>>>>>>>>> rolling upgrade without going through 3.4.6 (for example
> >>> from
> >>>>>>> 3.4.5),
> >>>>>>>>> you
> >>>>>>>>>>> may get the following error:
> >>>>>>>>>>>
> >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO [localhost/
> >>>>>> 127.0.0.1:2784
> >>>>>>>>>>> :QuorumCnxManager$Listener@498] - Received connection
> >>>> request
> >>>>> /
> >>>>>>>>>>> 127.0.0.1:60876
> >>>>>>>>>>>
> >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
> >>>>>> 127.0.0.1:2784
> >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
> >>>>>>>>>>>
> >>>>>>>>>>> During a rolling upgrade, each server is taken down in
> >> turn
> >>>> and
> >>>>>>>>> rebooted
> >>>>>>>>>>> with the new 3.5.0 binaries. Before starting the server
> >>> with
> >>>>>> 3.5.0
> >>>>>>>>>>> binaries, we highly recommend updating the configuration
> >>> file
> >>>>> so
> >>>>>>> that
> >>>>>>>>> all
> >>>>>>>>>>> server statements "server.x=..." contain client ports
> >> (see
> >>>> the
> >>>>>>>> section
> >>>>>>>>>>> Specifying
> >>>>>>>>>>> the client port). As explained earlier you may leave the
> >>>>>>>> configuration
> >>>>>>>>>> in a
> >>>>>>>>>>> single file, as well as leave the
> >>>> clientPort/clientPortAddress
> >>>>>>>>> statements
> >>>>>>>>>>> (although if you specify client ports in the new format,
> >>>> these
> >>>>>>>>> statements
> >>>>>>>>>>> are now redundant).
> >>>>>>>>>>>
> >>>>>>>>>>> Could you please let me know about this case. Appreciate
> >> if
> >>>>>> respond
> >>>>>>>>> soon.
> >>>>>>>>>>>
> >>>>>>>>>>> Thanks,
> >>>>>>>>>>> ---------------------
> >>>>>>>>>>> Kuldeep Singh Budania
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>
>
>
________________________________
CONFIDENTIALITY & PRIVACY NOTICE
This e-mail (including any attachments) is strictly confidential and may also contain privileged information. If you are not the intended recipient you are not authorised to read, print, save, process or disclose this message. If you have received this message by mistake, please inform the sender immediately and destroy this e-mail, its attachments and any copies. Any use, distribution, reproduction or disclosure by any person other than the intended recipient is strictly prohibited and the person responsible may incur in penalties.
The use of this e-mail is only for professional purposes; there is no guarantee that the correspondence towards this e-mail will be read only by the recipient, because, under certain circumstances, there may be a need to access this email by third subjects belonging to the Company.
Re: upgrade from 3.4.5 to 3.5.6
Posted by kuldeep singh <ku...@gmail.com>.
Hi,
I got below error while setting SSL properties in zkEnv.sh
==========================================================================================
2020-06-24 15:49:35,864 - INFO [main:QuorumPeerConfig@133] - Reading
configuration from: /etc/zookeeper/zoo.cfg
2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@385] -
clientPortAddress is 0.0.0.0/0.0.0.0:10181
2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@399] -
secureClientPortAddress is 0.0.0.0/0.0.0.0:2281
2020-06-24 15:49:35,878 - INFO [main:X509Util@79] - Setting -D
jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated
TLS renegotiation
2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@78] -
autopurge.snapRetainCount set to 3
2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@79] -
autopurge.purgeInterval set to 1
2020-06-24 15:49:35,898 - INFO [
PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge task started.
2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] - Log4j found with
jmx enabled.
2020-06-24 15:49:35,903 - INFO [PurgeTask:FileTxnSnapLog@103] -
zookeeper.snapshot.trust.empty : false
2020-06-24 15:49:35,910 - INFO [
PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge task completed.
2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141] - Starting quorum
peer
2020-06-24 15:49:35,983 - INFO [main:ServerCnxnFactory@135] - Using
org.apache.zookeeper.server.NIOServerCnxnFactory as server connection
factory
2020-06-24 15:49:35,986 - INFO [main:NIOServerCnxnFactory@673] -
Configuring NIO connection handler with 10s sessionless connection timeout,
2 selector thread(s), 16 worker threads, and 64 kB direct buffers.
2020-06-24 15:49:35,992 - INFO [main:NIOServerCnxnFactory@686] - binding
to port 0.0.0.0/0.0.0.0:10181
2020-06-24 15:49:35,994 - INFO [main:ServerCnxnFactory@135] - Using
org.apache.zookeeper.server.NIOServerCnxnFactory as server connection
factory
2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101] - Unexpected
exception, exiting abnormally
java.lang.UnsupportedOperationException: SSL isn't supported in
NIOServerCnxn
at
org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644)
at
org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155)
at
org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
at
org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
I have set the following properties in SERVER_JVMFLAGS in zkEnv.sh file :
"-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory
-Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12
-Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456
-Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks
-Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456"
Thanks,
---------------------
Kuldeep Singh Budania
On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman <jo...@jordanzimmerman.com>
wrote:
> It's the same as the normal ZooKeeper client:
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> <
> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions
> >
>
> -Jordan
>
> > On Jun 22, 2020, at 5:50 AM, kuldeep singh <ku...@gmail.com>
> wrote:
> >
> > Hi Team,
> > How we will do secure communication between the Curator framework and
> > zookeeper 3.5.6 ?
> > I didn't get any solution right now.
> > I appreciate it if someone could help me with the same.
> >
> > Thanks,
> > ---------------------
> > Kuldeep Singh Budania
> > Software Architect
> >
> >
> > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <
> szalay.beko.mate@gmail.com>
> > wrote:
> >
> >> Hello Kuldeep,
> >>
> >> did you download the source from the ZooKeeper webpage, or checked out
> from
> >> git?
> >> Anyway, the following commands should work:
> >>
> >> wget
> >>
> >>
> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
> >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
> >> cd apache-zookeeper-3.5.7
> >> mvn clean install -DskipTests
> >>
> >> I tested it with OpenJDK 8u424 and maven 3.6.0.
> >>
> >> Kind regards,
> >> Mate
> >>
> >>
> >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <
> kuldeep.singh08@gmail.com>
> >> wrote:
> >>
> >>> Hi All,
> >>>
> >>> I have download the zookeeper source code and run the mvn command for
> >>> packaging but get problem on "zookeeper-server" directory.
> >>>
> >>> *command :- mvn clean package*
> >>>
> >>> [ERROR] Failed to execute goal
> >>> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >>> (default-compile) on project zookeeper: Fatal error compiling:
> >>> java.lang.NullPointerException -> [Help 1]
> >>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
> execute
> >>> goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
> >>> (default-compile) on project zookeeper: Fatal error compiling
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> >>> at
> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> >>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> >>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> >>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> >>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >>> at
> >>>
> >>>
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >>> at
> >>>
> >>>
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>> at java.lang.reflect.Method.invoke(Method.java:498)
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> >>> at
> >>>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> >>> at
> >>>
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> >>> Caused by: org.apache.maven.plugin.MojoExecutionException: Fatal error
> >>> compiling
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> >>> ... 19 more
> >>> Caused by: org.codehaus.plexus.compiler.CompilerException:
> >>> java.lang.NullPointerException
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
> >>> at
> >>>
> >>>
> >>
> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
> >>> ... 22 more
> >>> Caused by: java.lang.RuntimeException: java.lang.NullPointerException
> >>> at com.sun.tools.javac.main.Main.compile(Main.java:559)
> >>> at
> >>> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
> >>> at
> >>> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
> >>> at
> >>>
> >>>
> >>
> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
> >>> ... 24 more
> >>> Caused by: java.lang.NullPointerException
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
> >>> at com.sun.tools.doclint.Env.setCurrent(Env.java:155)
> >>> at com.sun.tools.doclint.Checker.scan(Checker.java:144)
> >>> at com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
> >>> at
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
> >>> at
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >>> at
> >>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> at
> >>> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
> >>> at
> >>> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> at
> >>> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
> >>> at
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
> >>> at
> >>>
> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
> >>> at
> >>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
> >>> at com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >>> at
> >> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
> >>> at
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
> >>> at
> >>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
> >>> at
> >>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
> >>> at
> >>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
> >>> at
> >>>
> >>
> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
> >>> at
> >>>
> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
> >>> at
> >>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
> >>> at com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
> >>> at
> >>>
> >>>
> >>
> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
> >>> at
> >>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
> >>> at
> >>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
> >>> at
> >>> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
> >>> at com.sun.tools.javac.main.Main.compile(Main.java:523)
> >>> ... 27 more
> >>> [ERROR]
> >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> >>> [ERROR]
> >>> [ERROR] For more information about the errors and possible solutions,
> >>> please read the following articles:
> >>> [ERROR] [Help 1]
> >>>
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> >>>
> >>> Can someone help me on this issue?
> >>>
> >>> Thanks,
> >>> ---------------------
> >>> Kuldeep Singh Budania
> >>>
> >>>
> >>>
> >>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
> >>> szalay.beko.mate@gmail.com>
> >>> wrote:
> >>>
> >>>> these exceptions can mean many things... I think this can be even
> >> normal
> >>>> duding rolling restart (as some connections get broken in this case)
> >>>>
> >>>> However, I saw cases already when exceptions like these killed
> receiver
> >>> or
> >>>> sender threads in QuorumCnxManager / Leader Election in such a way
> that
> >>>> they were not able to recover, so the node was unable to connect to
> any
> >>>> quorum until restart. I remember seeing this in 3.4 too.
> >>>>
> >>>> Do you see these exceptions in the second server (the one which you
> >> just
> >>>> upgraded in step 3)?
> >>>> Is this issue reproducible?
> >>>>
> >>>> What is the tickTime and initLimit you use? Maybe the server just
> >> require
> >>>> more time to sync?
> >>>>
> >>>> I would need more logs to really see what happened. Can you create a
> >> Jira
> >>>> issue and upload the logs and also the ZooKeeper configs? I am happy
> to
> >>>> take a closer look.
> >>>> (if you need to re-run the test to collect the logs, then enabling
> >> DEBUG
> >>>> logs would be great. The INFO level logs are usually enough for these
> >>>> problems, but one can never know...)
> >>>>
> >>>> Kind regards,
> >>>> Mate
> >>>>
> >>>>
> >>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
> >> kuldeep.singh08@gmail.com
> >>>>
> >>>> wrote:
> >>>>
> >>>>> Hi Team,
> >>>>>
> >>>>> I have done some POC on rolling upgrade and found below result.
> >>>>>
> >>>>>
> >>>>> 1. On 1st node upgrade zookeeper . Traffic was running fine
> >> because
> >>> 2
> >>>>> nodes are already on old zookeeper.
> >>>>> 2. On 1st node upgrade our application and didn’t find any issue
> >>>>> 3. On 2nd node upgrade zookeeper but got below error and zookeeper
> >>> is
> >>>>> not taking any requests
> >>>>> 4.
> >>>>>
> >>>>> java.io.EOFException
> >>>>>
> >>>>> at java.io.DataInputStream.readInt(DataInputStream.java:392)
> >>>>>
> >>>>> at
> >>>>>
> >>>>>
> >>>>
> >>>
> >>
> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
> >>>>>
> >>>>> 2020-03-30 14:19:55,587 - WARN
> >>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765] - Interrupting
> >>> SendWorker
> >>>>>
> >>>>> 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/192.168.44.73:33754
> >>>>> :LearnerHandler@562] - Unexpected exception causing shutdown while
> >>> sock
> >>>>> still open
> >>>>>
> >>>>> java.io.EOFException
> >>>>>
> >>>>> at java.io.DataInputStream.readInt(DataInputStream.java:392)
> >>>>>
> >>>>> at
> >>>>>
> >> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
> >>>>>
> >>>>> at
> >>>>>
> >>>>>
> >>>>
> >>>
> >>
> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
> >>>>>
> >>>>> at
> >>>>>
> >>>>
> >>>
> >>
> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
> >>>>>
> >>>>> at
> >>>>>
> >>>>>
> >>>>
> >>>
> >>
> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
> >>>>>
> >>>>> 2020-03-30 14:19:55,588 - WARN
> >>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679] - Interrupted while
> >>>> waiting
> >>>>> for message on queue
> >>>>>
> >>>>> Please let me know is this the known issue or this is different issue
> >>>> which
> >>>>> is mention in Apache zookeeper documentation when upgrading from
> >> 3.4.5
> >>> to
> >>>>> 3.5.6
> >>>>>
> >>>>> Thanks,
> >>>>> ---------------------
> >>>>> Kuldeep Singh Budania
> >>>>> Software Architect
> >>>>>
> >>>>>
> >>>>>
> >>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer <sh...@gmail.com>
> >>>>> wrote:
> >>>>>
> >>>>>> +1 to what Mate said (I wrote the quoted instructions).
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő Máté <
> >>>>>> szalay.beko.mate@gmail.com>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> Hi Kuldeep,
> >>>>>>>
> >>>>>>> I just want to provide you some background info about our
> >>>>> documentation.
> >>>>>>> The reason to upgrade to 3.4.6 first is to avoid the following
> >>> error:
> >>>>>>>
> >>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
> >>> 127.0.0.1:2784
> >>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
> >>>>>>>
> >>>>>>> This error comes because of the protocol changes between
> >> ZooKeeper
> >>>>> server
> >>>>>>> nodes during connection initiation for leader election. In
> >>> ZooKeeper
> >>>>> 3.5
> >>>>>> a
> >>>>>>> protocol version was introduced (see ZOOKEEPER-107) and since
> >> that
> >>>> time
> >>>>>> the
> >>>>>>> fist long value sent in the initial message is not the server ID
> >>> but
> >>>>> the
> >>>>>>> protocol version (-65536). In ZooKeeper 3.4.6 we made the old 3.4
> >>>>>>> ZooKeepers backward compatible, so they are able to parse both
> >> the
> >>>> old
> >>>>>> and
> >>>>>>> the new protocol format (see ZOOKEEPER-1633). This issue happens
> >>> only
> >>>>>> when
> >>>>>>> you need to use old (3.4.0 - 3.4.5) and new (3.5.0+) ZooKeeper
> >>>> servers
> >>>>>>> together in the same cluster. During a rolling upgrade, this is
> >>>> usually
> >>>>>> the
> >>>>>>> case to have old and new ZooKeepers present together.
> >>>>>>>
> >>>>>>> The fact that you haven't seen any issues might be caused by the
> >>>> order
> >>>>> of
> >>>>>>> the servers. In ZooKeeper the connection initiation between the
> >>>> servers
> >>>>>>> during the leader election follows a specific rule. As far as I
> >>>>> remember
> >>>>>>> always the server with the larger ID 'wins the challenge', so it
> >> is
> >>>>>>> possible, that the old server didn't need to parse any initial
> >>>> message
> >>>>>> (if
> >>>>>>> it had the largest ID) and this is why you haven't seen the
> >> issue.
> >>>> Also
> >>>>>>> having 2 nodes up from the 3 nodes cluster still makes the
> >> cluster
> >>>> work
> >>>>>> (so
> >>>>>>> you should also check if all the servers are part of the quorum).
> >>>>>>>
> >>>>>>> I agree with Enrico and Norbert, the safest and most stable way
> >> is
> >>>>>> upgrade
> >>>>>>> first to 3.4.latest, then go to 3.5.latest. Still, if you don't
> >> see
> >>>>> that
> >>>>>>> you would hit this specific issue (e.g. no "Invalid server id" in
> >>> the
> >>>>> log
> >>>>>>> files), and all the three servers can handle traffic, then maybe
> >>> you
> >>>>>> don't
> >>>>>>> need to upgrade first to 3.4.latest, it is your decision.
> >>> Definitely
> >>>>> you
> >>>>>>> should test it first, as suggested by the others.
> >>>>>>>
> >>>>>>> Kind regards,
> >>>>>>> Mate
> >>>>>>>
> >>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
> >>>>>>> <nk...@cloudera.com.invalid> wrote:
> >>>>>>>
> >>>>>>>> Hi,
> >>>>>>>>
> >>>>>>>> That guide is to upgrade to 3.5.0, which was an alpha version.
> >> A
> >>>> lot
> >>>>>> has
> >>>>>>>> changed for the first stable release of 3.5.5 and then a few
> >>> more,
> >>>>> even
> >>>>>>>> rolling upgrade issues have been fixed for 3.5.6.
> >>>>>>>> This is a more up-to-date guide:
> >>>>>>>>
> >>> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
> >>>>>>>>
> >>>>>>>> If you have done your testing (with prod snapshot!), then you
> >> can
> >>>>> skip
> >>>>>>> 3.4
> >>>>>>>> latest upgrade, but keep in mind we do our recommendations for
> >> a
> >>>>>> reason.
> >>>>>>>> There were issues reported and/or found during testing. Some
> >> are
> >>>>> fixed
> >>>>>>> with
> >>>>>>>> 3.5.6, some only happens if certain conditions stand
> >>> (IOException:
> >>>> No
> >>>>>>>> snapshot found - mentioned in the guide, fixed in 3.5.6).
> >>>>>>>>
> >>>>>>>> So it is up to you, I would still recommend to do an 3.4
> >> upgrade
> >>>>> first,
> >>>>>>> if
> >>>>>>>> it's feasible.
> >>>>>>>>
> >>>>>>>> Regards,
> >>>>>>>> Norbert
> >>>>>>>>
> >>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep singh <
> >>>>>>> kuldeep.singh08@gmail.com>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Hi,
> >>>>>>>>>
> >>>>>>>>> Current Zookeeper version :- 3.4.5
> >>>>>>>>> Upgraded version :- 3.5.6
> >>>>>>>>>
> >>>>>>>>> We are not going with 3.5.7. Our final decision is zookeeper
> >>>>> version
> >>>>>> is
> >>>>>>>>> 3.5.6
> >>>>>>>>> as per your reply first we need to move latest version of
> >>> 3.4.x,
> >>>>> like
> >>>>>>>> below
> >>>>>>>>>
> >>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am wrong here)
> >>>>>>>>>
> >>>>>>>>> But if We are not facing any problem that i have shared you
> >>> that
> >>>> we
> >>>>>>> have
> >>>>>>>>> set up of 3 node cluster where 2 node are on 3.5.6 version
> >> and
> >>> 1
> >>>>> node
> >>>>>>> on
> >>>>>>>>> 3.4.5, Everything is running fine and didn't get any issue,
> >> So
> >>>> what
> >>>>>>> other
> >>>>>>>>> problem we can face if we directly move to 3.5.6
> >>>>>>>>>
> >>>>>>>>> Thanks,
> >>>>>>>>> ---------------------
> >>>>>>>>> Kuldeep Singh Budania
> >>>>>>>>> Software Architect
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico Olivelli <
> >>>>> eolivelli@gmail.com
> >>>>>>>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi
> >>>>>>>>>> You have to upgrade to latest 3.4.x Zookeeper then you will
> >>>>> upgrade
> >>>>>>> to
> >>>>>>>>>> 3.5.7.
> >>>>>>>>>> All should run well without issues
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Enrico
> >>>>>>>>>>
> >>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
> >>>>> kuldeep.singh08@gmail.com
> >>>>>>>
> >>>>>>> ha
> >>>>>>>>>> scritto:
> >>>>>>>>>>
> >>>>>>>>>>> Hi Team,
> >>>>>>>>>>>
> >>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to 3.5.6. I have
> >> set
> >>>> up 3
> >>>>>>> node
> >>>>>>>>>>> cluster where 2 node are on 3.5.6 version and 1 node on
> >>>> 3.4.5.
> >>>>>>>>>>>
> >>>>>>>>>>> Everything is running fine and didn't get any issue on my
> >>>>> system.
> >>>>>>>>>>>
> >>>>>>>>>>> but I found something on apache site that first we need
> >> to
> >>>>>> upgrade
> >>>>>>>> on
> >>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is it mandatory
> >> to
> >>> go
> >>>>> on
> >>>>>>>> 3.4.6
> >>>>>>>>>>> first.
> >>>>>>>>>>>
> >>>>>>>>>>> *Upgrading to 3.5.0*
> >>>>>>>>>>>
> >>>>>>>>>>> Upgrading a running ZooKeeper ensemble to 3.5.0 should be
> >>>> done
> >>>>>> only
> >>>>>>>>> after
> >>>>>>>>>>> upgrading your ensemble to the 3.4.6 release. Note that
> >>> this
> >>>> is
> >>>>>>> only
> >>>>>>>>>>> necessary for rolling upgrades (if you're fine with
> >>> shutting
> >>>>> down
> >>>>>>> the
> >>>>>>>>>>> system completely, you don't have to go through 3.4.6).
> >> If
> >>>> you
> >>>>>>>> attempt
> >>>>>>>>> a
> >>>>>>>>>>> rolling upgrade without going through 3.4.6 (for example
> >>> from
> >>>>>>> 3.4.5),
> >>>>>>>>> you
> >>>>>>>>>>> may get the following error:
> >>>>>>>>>>>
> >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO [localhost/
> >>>>>> 127.0.0.1:2784
> >>>>>>>>>>> :QuorumCnxManager$Listener@498] - Received connection
> >>>> request
> >>>>> /
> >>>>>>>>>>> 127.0.0.1:60876
> >>>>>>>>>>>
> >>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
> >>>>>> 127.0.0.1:2784
> >>>>>>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
> >>>>>>>>>>>
> >>>>>>>>>>> During a rolling upgrade, each server is taken down in
> >> turn
> >>>> and
> >>>>>>>>> rebooted
> >>>>>>>>>>> with the new 3.5.0 binaries. Before starting the server
> >>> with
> >>>>>> 3.5.0
> >>>>>>>>>>> binaries, we highly recommend updating the configuration
> >>> file
> >>>>> so
> >>>>>>> that
> >>>>>>>>> all
> >>>>>>>>>>> server statements "server.x=..." contain client ports
> >> (see
> >>>> the
> >>>>>>>> section
> >>>>>>>>>>> Specifying
> >>>>>>>>>>> the client port). As explained earlier you may leave the
> >>>>>>>> configuration
> >>>>>>>>>> in a
> >>>>>>>>>>> single file, as well as leave the
> >>>> clientPort/clientPortAddress
> >>>>>>>>> statements
> >>>>>>>>>>> (although if you specify client ports in the new format,
> >>>> these
> >>>>>>>>> statements
> >>>>>>>>>>> are now redundant).
> >>>>>>>>>>>
> >>>>>>>>>>> Could you please let me know about this case. Appreciate
> >> if
> >>>>>> respond
> >>>>>>>>> soon.
> >>>>>>>>>>>
> >>>>>>>>>>> Thanks,
> >>>>>>>>>>> ---------------------
> >>>>>>>>>>> Kuldeep Singh Budania
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>
>
>
Re: upgrade from 3.4.5 to 3.5.6
Posted by Jordan Zimmerman <jo...@jordanzimmerman.com>.
It's the same as the normal ZooKeeper client: https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions <https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions>
-Jordan
> On Jun 22, 2020, at 5:50 AM, kuldeep singh <ku...@gmail.com> wrote:
>
> Hi Team,
> How we will do secure communication between the Curator framework and
> zookeeper 3.5.6 ?
> I didn't get any solution right now.
> I appreciate it if someone could help me with the same.
>
> Thanks,
> ---------------------
> Kuldeep Singh Budania
> Software Architect
>
>
> On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté <sz...@gmail.com>
> wrote:
>
>> Hello Kuldeep,
>>
>> did you download the source from the ZooKeeper webpage, or checked out from
>> git?
>> Anyway, the following commands should work:
>>
>> wget
>>
>> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz
>> tar xzvf ./apache-zookeeper-3.5.7.tar.gz
>> cd apache-zookeeper-3.5.7
>> mvn clean install -DskipTests
>>
>> I tested it with OpenJDK 8u424 and maven 3.6.0.
>>
>> Kind regards,
>> Mate
>>
>>
>> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh <ku...@gmail.com>
>> wrote:
>>
>>> Hi All,
>>>
>>> I have download the zookeeper source code and run the mvn command for
>>> packaging but get problem on "zookeeper-server" directory.
>>>
>>> *command :- mvn clean package*
>>>
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>>> (default-compile) on project zookeeper: Fatal error compiling:
>>> java.lang.NullPointerException -> [Help 1]
>>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
>>> goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile
>>> (default-compile) on project zookeeper: Fatal error compiling
>>> at
>>>
>>>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>>> at
>>>
>>>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>>> at
>>>
>>>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>>> at
>>>
>>>
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
>>> at
>>>
>>>
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
>>> at
>>>
>>>
>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>>> at
>>>
>>>
>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
>>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
>>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
>>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
>>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
>>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at
>>>
>>>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>> at
>>>
>>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:498)
>>> at
>>>
>>>
>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>>> at
>>>
>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>>> at
>>>
>>>
>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>>> at
>>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>>> Caused by: org.apache.maven.plugin.MojoExecutionException: Fatal error
>>> compiling
>>> at
>>>
>>>
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1140)
>>> at
>>>
>>>
>> org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:188)
>>> at
>>>
>>>
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
>>> at
>>>
>>>
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>>> ... 19 more
>>> Caused by: org.codehaus.plexus.compiler.CompilerException:
>>> java.lang.NullPointerException
>>> at
>>>
>>>
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:173)
>>> at
>>>
>>>
>> org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:174)
>>> at
>>>
>>>
>> org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1129)
>>> ... 22 more
>>> Caused by: java.lang.RuntimeException: java.lang.NullPointerException
>>> at com.sun.tools.javac.main.Main.compile(Main.java:559)
>>> at
>>> com.sun.tools.javac.api.JavacTaskImpl.doCall(JavacTaskImpl.java:129)
>>> at
>>> com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:138)
>>> at
>>>
>>>
>> org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
>>> ... 24 more
>>> Caused by: java.lang.NullPointerException
>>> at
>>>
>>>
>> com.sun.tools.javac.model.JavacTypes.getOverriddenMethods(JavacTypes.java:306)
>>> at com.sun.tools.doclint.Env.setCurrent(Env.java:155)
>>> at com.sun.tools.doclint.Checker.scan(Checker.java:144)
>>> at com.sun.tools.doclint.DocLint$2.visitDecl(DocLint.java:285)
>>> at
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:359)
>>> at
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>>> at
>>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>>> at
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> at
>>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>>> at
>>> com.sun.source.util.TreeScanner.visitNewClass(TreeScanner.java:280)
>>> at
>>> com.sun.tools.javac.tree.JCTree$JCNewClass.accept(JCTree.java:1532)
>>> at
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> at
>>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>>> at
>>> com.sun.source.util.TreeScanner.visitVariable(TreeScanner.java:153)
>>> at
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:373)
>>> at
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitVariable(DocLint.java:346)
>>> at
>>> com.sun.tools.javac.tree.JCTree$JCVariableDecl.accept(JCTree.java:864)
>>> at
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> at
>>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:81)
>>> at com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>>> at
>>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>>> at
>> com.sun.source.util.TreeScanner.visitClass(TreeScanner.java:133)
>>> at
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:360)
>>> at
>>> com.sun.tools.doclint.DocLint$DeclScanner.visitClass(DocLint.java:346)
>>> at
>>> com.sun.tools.javac.tree.JCTree$JCClassDecl.accept(JCTree.java:720)
>>> at
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> at com.sun.source.util.TreeScanner.scan(TreeScanner.java:91)
>>> at
>>> com.sun.source.util.TreeScanner.scanAndReduce(TreeScanner.java:99)
>>> at
>>>
>> com.sun.source.util.TreeScanner.visitCompilationUnit(TreeScanner.java:120)
>>> at
>>>
>>>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:354)
>>> at
>>>
>>>
>> com.sun.tools.doclint.DocLint$DeclScanner.visitCompilationUnit(DocLint.java:346)
>>> at
>>> com.sun.tools.javac.tree.JCTree$JCCompilationUnit.accept(JCTree.java:550)
>>> at
>>> com.sun.source.util.TreePathScanner.scan(TreePathScanner.java:68)
>>> at com.sun.tools.doclint.DocLint$3.started(DocLint.java:296)
>>> at
>>>
>>>
>> com.sun.tools.javac.api.ClientCodeWrapper$WrappedTaskListener.started(ClientCodeWrapper.java:668)
>>> at
>>>
>>>
>> com.sun.tools.javac.api.MultiTaskListener.started(MultiTaskListener.java:103)
>>> at
>>> com.sun.tools.javac.main.JavaCompiler.attribute(JavaCompiler.java:1240)
>>> at
>>> com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:901)
>>> at
>>> com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:860)
>>> at com.sun.tools.javac.main.Main.compile(Main.java:523)
>>> ... 27 more
>>> [ERROR]
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions,
>>> please read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>>>
>>> Can someone help me on this issue?
>>>
>>> Thanks,
>>> ---------------------
>>> Kuldeep Singh Budania
>>>
>>>
>>>
>>> On Sat, Apr 4, 2020 at 5:57 PM Szalay-Bekő Máté <
>>> szalay.beko.mate@gmail.com>
>>> wrote:
>>>
>>>> these exceptions can mean many things... I think this can be even
>> normal
>>>> duding rolling restart (as some connections get broken in this case)
>>>>
>>>> However, I saw cases already when exceptions like these killed receiver
>>> or
>>>> sender threads in QuorumCnxManager / Leader Election in such a way that
>>>> they were not able to recover, so the node was unable to connect to any
>>>> quorum until restart. I remember seeing this in 3.4 too.
>>>>
>>>> Do you see these exceptions in the second server (the one which you
>> just
>>>> upgraded in step 3)?
>>>> Is this issue reproducible?
>>>>
>>>> What is the tickTime and initLimit you use? Maybe the server just
>> require
>>>> more time to sync?
>>>>
>>>> I would need more logs to really see what happened. Can you create a
>> Jira
>>>> issue and upload the logs and also the ZooKeeper configs? I am happy to
>>>> take a closer look.
>>>> (if you need to re-run the test to collect the logs, then enabling
>> DEBUG
>>>> logs would be great. The INFO level logs are usually enough for these
>>>> problems, but one can never know...)
>>>>
>>>> Kind regards,
>>>> Mate
>>>>
>>>>
>>>> On Fri, Apr 3, 2020 at 10:05 AM kuldeep singh <
>> kuldeep.singh08@gmail.com
>>>>
>>>> wrote:
>>>>
>>>>> Hi Team,
>>>>>
>>>>> I have done some POC on rolling upgrade and found below result.
>>>>>
>>>>>
>>>>> 1. On 1st node upgrade zookeeper . Traffic was running fine
>> because
>>> 2
>>>>> nodes are already on old zookeeper.
>>>>> 2. On 1st node upgrade our application and didn’t find any issue
>>>>> 3. On 2nd node upgrade zookeeper but got below error and zookeeper
>>> is
>>>>> not taking any requests
>>>>> 4.
>>>>>
>>>>> java.io.EOFException
>>>>>
>>>>> at java.io.DataInputStream.readInt(DataInputStream.java:392)
>>>>>
>>>>> at
>>>>>
>>>>>
>>>>
>>>
>> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
>>>>>
>>>>> 2020-03-30 14:19:55,587 - WARN
>>>>> [RecvWorker:1:QuorumCnxManager$RecvWorker@765] - Interrupting
>>> SendWorker
>>>>>
>>>>> 2020-03-30 14:19:55,588 - ERROR [LearnerHandler-/192.168.44.73:33754
>>>>> :LearnerHandler@562] - Unexpected exception causing shutdown while
>>> sock
>>>>> still open
>>>>>
>>>>> java.io.EOFException
>>>>>
>>>>> at java.io.DataInputStream.readInt(DataInputStream.java:392)
>>>>>
>>>>> at
>>>>>
>> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
>>>>>
>>>>> at
>>>>>
>>>>>
>>>>
>>>
>> org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
>>>>>
>>>>> at
>>>>>
>>>>
>>>
>> org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:108)
>>>>>
>>>>> at
>>>>>
>>>>>
>>>>
>>>
>> org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:476)
>>>>>
>>>>> 2020-03-30 14:19:55,588 - WARN
>>>>> [SendWorker:1:QuorumCnxManager$SendWorker@679] - Interrupted while
>>>> waiting
>>>>> for message on queue
>>>>>
>>>>> Please let me know is this the known issue or this is different issue
>>>> which
>>>>> is mention in Apache zookeeper documentation when upgrading from
>> 3.4.5
>>> to
>>>>> 3.5.6
>>>>>
>>>>> Thanks,
>>>>> ---------------------
>>>>> Kuldeep Singh Budania
>>>>> Software Architect
>>>>>
>>>>>
>>>>>
>>>>> On Sun, Mar 29, 2020 at 9:06 AM Alexander Shraer <sh...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> +1 to what Mate said (I wrote the quoted instructions).
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Tue, Mar 24, 2020 at 7:03 AM Szalay-Bekő Máté <
>>>>>> szalay.beko.mate@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Kuldeep,
>>>>>>>
>>>>>>> I just want to provide you some background info about our
>>>>> documentation.
>>>>>>> The reason to upgrade to 3.4.6 first is to avoid the following
>>> error:
>>>>>>>
>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
>>> 127.0.0.1:2784
>>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
>>>>>>>
>>>>>>> This error comes because of the protocol changes between
>> ZooKeeper
>>>>> server
>>>>>>> nodes during connection initiation for leader election. In
>>> ZooKeeper
>>>>> 3.5
>>>>>> a
>>>>>>> protocol version was introduced (see ZOOKEEPER-107) and since
>> that
>>>> time
>>>>>> the
>>>>>>> fist long value sent in the initial message is not the server ID
>>> but
>>>>> the
>>>>>>> protocol version (-65536). In ZooKeeper 3.4.6 we made the old 3.4
>>>>>>> ZooKeepers backward compatible, so they are able to parse both
>> the
>>>> old
>>>>>> and
>>>>>>> the new protocol format (see ZOOKEEPER-1633). This issue happens
>>> only
>>>>>> when
>>>>>>> you need to use old (3.4.0 - 3.4.5) and new (3.5.0+) ZooKeeper
>>>> servers
>>>>>>> together in the same cluster. During a rolling upgrade, this is
>>>> usually
>>>>>> the
>>>>>>> case to have old and new ZooKeepers present together.
>>>>>>>
>>>>>>> The fact that you haven't seen any issues might be caused by the
>>>> order
>>>>> of
>>>>>>> the servers. In ZooKeeper the connection initiation between the
>>>> servers
>>>>>>> during the leader election follows a specific rule. As far as I
>>>>> remember
>>>>>>> always the server with the larger ID 'wins the challenge', so it
>> is
>>>>>>> possible, that the old server didn't need to parse any initial
>>>> message
>>>>>> (if
>>>>>>> it had the largest ID) and this is why you haven't seen the
>> issue.
>>>> Also
>>>>>>> having 2 nodes up from the 3 nodes cluster still makes the
>> cluster
>>>> work
>>>>>> (so
>>>>>>> you should also check if all the servers are part of the quorum).
>>>>>>>
>>>>>>> I agree with Enrico and Norbert, the safest and most stable way
>> is
>>>>>> upgrade
>>>>>>> first to 3.4.latest, then go to 3.5.latest. Still, if you don't
>> see
>>>>> that
>>>>>>> you would hit this specific issue (e.g. no "Invalid server id" in
>>> the
>>>>> log
>>>>>>> files), and all the three servers can handle traffic, then maybe
>>> you
>>>>>> don't
>>>>>>> need to upgrade first to 3.4.latest, it is your decision.
>>> Definitely
>>>>> you
>>>>>>> should test it first, as suggested by the others.
>>>>>>>
>>>>>>> Kind regards,
>>>>>>> Mate
>>>>>>>
>>>>>>> On Tue, Mar 24, 2020 at 12:29 PM Norbert Kalmar
>>>>>>> <nk...@cloudera.com.invalid> wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> That guide is to upgrade to 3.5.0, which was an alpha version.
>> A
>>>> lot
>>>>>> has
>>>>>>>> changed for the first stable release of 3.5.5 and then a few
>>> more,
>>>>> even
>>>>>>>> rolling upgrade issues have been fixed for 3.5.6.
>>>>>>>> This is a more up-to-date guide:
>>>>>>>>
>>> https://cwiki.apache.org/confluence/display/ZOOKEEPER/Upgrade+FAQ
>>>>>>>>
>>>>>>>> If you have done your testing (with prod snapshot!), then you
>> can
>>>>> skip
>>>>>>> 3.4
>>>>>>>> latest upgrade, but keep in mind we do our recommendations for
>> a
>>>>>> reason.
>>>>>>>> There were issues reported and/or found during testing. Some
>> are
>>>>> fixed
>>>>>>> with
>>>>>>>> 3.5.6, some only happens if certain conditions stand
>>> (IOException:
>>>> No
>>>>>>>> snapshot found - mentioned in the guide, fixed in 3.5.6).
>>>>>>>>
>>>>>>>> So it is up to you, I would still recommend to do an 3.4
>> upgrade
>>>>> first,
>>>>>>> if
>>>>>>>> it's feasible.
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Norbert
>>>>>>>>
>>>>>>>> On Tue, Mar 24, 2020 at 11:45 AM kuldeep singh <
>>>>>>> kuldeep.singh08@gmail.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> Current Zookeeper version :- 3.4.5
>>>>>>>>> Upgraded version :- 3.5.6
>>>>>>>>>
>>>>>>>>> We are not going with 3.5.7. Our final decision is zookeeper
>>>>> version
>>>>>> is
>>>>>>>>> 3.5.6
>>>>>>>>> as per your reply first we need to move latest version of
>>> 3.4.x,
>>>>> like
>>>>>>>> below
>>>>>>>>>
>>>>>>>>> 3.4.5 -> 3.4.14 -> 3.5.6 (Correct me if I am wrong here)
>>>>>>>>>
>>>>>>>>> But if We are not facing any problem that i have shared you
>>> that
>>>> we
>>>>>>> have
>>>>>>>>> set up of 3 node cluster where 2 node are on 3.5.6 version
>> and
>>> 1
>>>>> node
>>>>>>> on
>>>>>>>>> 3.4.5, Everything is running fine and didn't get any issue,
>> So
>>>> what
>>>>>>> other
>>>>>>>>> problem we can face if we directly move to 3.5.6
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> ---------------------
>>>>>>>>> Kuldeep Singh Budania
>>>>>>>>> Software Architect
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Tue, Mar 24, 2020 at 3:58 PM Enrico Olivelli <
>>>>> eolivelli@gmail.com
>>>>>>>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi
>>>>>>>>>> You have to upgrade to latest 3.4.x Zookeeper then you will
>>>>> upgrade
>>>>>>> to
>>>>>>>>>> 3.5.7.
>>>>>>>>>> All should run well without issues
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Enrico
>>>>>>>>>>
>>>>>>>>>> Il Mar 24 Mar 2020, 10:18 kuldeep singh <
>>>>> kuldeep.singh08@gmail.com
>>>>>>>
>>>>>>> ha
>>>>>>>>>> scritto:
>>>>>>>>>>
>>>>>>>>>>> Hi Team,
>>>>>>>>>>>
>>>>>>>>>>> We are upgrading zookeeper from 3.4.5 to 3.5.6. I have
>> set
>>>> up 3
>>>>>>> node
>>>>>>>>>>> cluster where 2 node are on 3.5.6 version and 1 node on
>>>> 3.4.5.
>>>>>>>>>>>
>>>>>>>>>>> Everything is running fine and didn't get any issue on my
>>>>> system.
>>>>>>>>>>>
>>>>>>>>>>> but I found something on apache site that first we need
>> to
>>>>>> upgrade
>>>>>>>> on
>>>>>>>>>>> 3.4.6 than we can upgrade to 3.5.6. So is it mandatory
>> to
>>> go
>>>>> on
>>>>>>>> 3.4.6
>>>>>>>>>>> first.
>>>>>>>>>>>
>>>>>>>>>>> *Upgrading to 3.5.0*
>>>>>>>>>>>
>>>>>>>>>>> Upgrading a running ZooKeeper ensemble to 3.5.0 should be
>>>> done
>>>>>> only
>>>>>>>>> after
>>>>>>>>>>> upgrading your ensemble to the 3.4.6 release. Note that
>>> this
>>>> is
>>>>>>> only
>>>>>>>>>>> necessary for rolling upgrades (if you're fine with
>>> shutting
>>>>> down
>>>>>>> the
>>>>>>>>>>> system completely, you don't have to go through 3.4.6).
>> If
>>>> you
>>>>>>>> attempt
>>>>>>>>> a
>>>>>>>>>>> rolling upgrade without going through 3.4.6 (for example
>>> from
>>>>>>> 3.4.5),
>>>>>>>>> you
>>>>>>>>>>> may get the following error:
>>>>>>>>>>>
>>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - INFO [localhost/
>>>>>> 127.0.0.1:2784
>>>>>>>>>>> :QuorumCnxManager$Listener@498] - Received connection
>>>> request
>>>>> /
>>>>>>>>>>> 127.0.0.1:60876
>>>>>>>>>>>
>>>>>>>>>>> 2013-01-30 11:32:10,663 [myid:2] - WARN [localhost/
>>>>>> 127.0.0.1:2784
>>>>>>>>>>> :QuorumCnxManager@349] - Invalid server id: -65536
>>>>>>>>>>>
>>>>>>>>>>> During a rolling upgrade, each server is taken down in
>> turn
>>>> and
>>>>>>>>> rebooted
>>>>>>>>>>> with the new 3.5.0 binaries. Before starting the server
>>> with
>>>>>> 3.5.0
>>>>>>>>>>> binaries, we highly recommend updating the configuration
>>> file
>>>>> so
>>>>>>> that
>>>>>>>>> all
>>>>>>>>>>> server statements "server.x=..." contain client ports
>> (see
>>>> the
>>>>>>>> section
>>>>>>>>>>> Specifying
>>>>>>>>>>> the client port). As explained earlier you may leave the
>>>>>>>> configuration
>>>>>>>>>> in a
>>>>>>>>>>> single file, as well as leave the
>>>> clientPort/clientPortAddress
>>>>>>>>> statements
>>>>>>>>>>> (although if you specify client ports in the new format,
>>>> these
>>>>>>>>> statements
>>>>>>>>>>> are now redundant).
>>>>>>>>>>>
>>>>>>>>>>> Could you please let me know about this case. Appreciate
>> if
>>>>>> respond
>>>>>>>>> soon.
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> ---------------------
>>>>>>>>>>> Kuldeep Singh Budania
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>