You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by "Michael G. Noll" <mi...@michael-noll.com> on 2014/03/04 19:51:15 UTC
Re: Storm 0.9.0.1 and Zookeeper 3.4.5 hung issue.
As you can see in
https://github.com/apache/incubator-storm/pull/29/files, Storm's
project.clj (as of today) does not explicitly require ZooKeeper as a
dependency. So you will not find a reference to ZooKeeper in project.clj.
Rather, Storm 0.9.0.1/0.9.1 requires Netflix Curator 1.0.1, which in
turn requires ZK 3.3.3.
So if you want to upgrade ZK to 3.4.5, you should need to:
1. Upgrade Curator to, say, 1.3.3.
2. (Optional) Add an explicit dependency on ZK 3.4.5.
Again, the pull request above has all the details.
--Michael
On 02/15/2014 12:31 AM, P. Taylor Goetz wrote:
> Look for project.clj in storm-core.
>
> -Taylor
>
>> On Feb 14, 2014, at 6:12 PM, "Saurabh Agarwal (BLOOMBERG/ 731 LEXIN)" <sa...@bloomberg.net> wrote:
>>
>>
>> After adding the changes, I am building storm 0.9.0.1 source code using Leiningen . Can anyone point me out from where lein pick up the classpath? I am trying to change from zookeeper 3.3.3 to 3.4.5, but unable to find how to change it.
>>
>>
>> ----- Original Message -----
>> From: derekd@yahoo-inc.com
>> To: SAURABH AGARWAL (BLOOMBERG/ 731 LEXIN), user@storm.incubator.apache.org
>> At: Feb 14 2014 13:17:04
>>
>> Some changes to storm code are necessary for this.
>>
>> See https://github.com/apache/incubator-storm/pull/29/files
>> --
>> Derek
>>
>>> On 2/14/14, 11:50, Saurabh Agarwal (BLOOMBERG/ 731 LEXIN) wrote:
>>> Thanks Bijoy for reply.
>>>
>>> We can't downgrade to 3.3.3 as our system has zookeeper 3.4.5 server running. and we would like to keep same version of zookeeper client to avoid any incompatibility issues.
>>>
>>> The error we are getting with 3.4.5 is.
>>> Caused by: java.lang.ClassNotFoundException: org.apache.zookeeper.server.NIOServerCnxn$Factory
>>>
>>> After looking at zookeeper code, static Factory class within NIOSeverCnxn class has been removed in 3.4.5 version.
>>>
>>> zookeeper version 3.3.3 is 3 years old. Should not Storm be updated the code to run with zookeeper latest version. Should I create a jira for this?
>>>
>>>
>>> ----- Original Message -----
>>> From: user@storm.incubator.apache.org
>>> To: SAURABH AGARWAL (BLOOMBERG/ 731 LEXIN), user@storm.incubator.apache.org
>>> At: Feb 14 2014 11:45:50
>>>
>>> Hi,
>>>
>>> We had also downgraded zookeeper from 3.4.5 to 3.3.3 due to issues with
>>> Storm.But we are not facing any issues related to Kafka after the
>>> downgrade.We are using Storm 0.9.0-rc2 and Kafka 0.8.0.
>>>
>>> Thanks
>>> Bijoy
>>>
>>> On Fri, Feb 14, 2014 at 9:57 PM, Saurabh Agarwal (BLOOMBERG/ 731 LEXIN) <
>>> sagarwal144@bloomberg.net> wrote:
>>>
>>>> Hi,
>>>>
>>>> Storm 0.9.0.1 client linked with zookeeper 3.4.5 library hung on zookeeper
>>>> initialize. Is it known issue?
>>>>
>>>> 453 [main] INFO org.apache.zookeeper.server.ZooKeeperServer - <init> -
>>>> Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout
>>>> 40000 datadir /tmp/7b520ac7-ff87-4eb6-9fc5-3a16deec0272/version-2 snapdir
>>>> /tmp/7b520ac7-ff87-4eb6-9fc5-3a16deec0272/version-2
>>>>
>>>> The client works fine with zookeeper 3.3.3. As we are using storm with
>>>> kafka, kafka does not work with zookeeper 3.3.3 but work with 3.4.5.
>>>>
>>>> any help is appreciated...
>>>> Thanks,
>>>> Saurabh.
>>
Re: Storm 0.9.0.1 and Zookeeper 3.4.5 hung issue.
Posted by Jeff Ramsdale <je...@gmail.com>.
Storm's use of the Netflix Curator project should probably bump to the
Apache Curator (the successor, as of a year ago), which is currently at
2.4.0. I'll add this comment to the pull request.
-jeff
On Tue, Mar 4, 2014 at 10:51 AM, Michael G. Noll <
michael+storm@michael-noll.com> wrote:
> As you can see in
> https://github.com/apache/incubator-storm/pull/29/files, Storm's
> project.clj (as of today) does not explicitly require ZooKeeper as a
> dependency. So you will not find a reference to ZooKeeper in project.clj.
>
> Rather, Storm 0.9.0.1/0.9.1 requires Netflix Curator 1.0.1, which in
> turn requires ZK 3.3.3.
>
> So if you want to upgrade ZK to 3.4.5, you should need to:
>
> 1. Upgrade Curator to, say, 1.3.3.
> 2. (Optional) Add an explicit dependency on ZK 3.4.5.
>
> Again, the pull request above has all the details.
>
> --Michael
>
>
> On 02/15/2014 12:31 AM, P. Taylor Goetz wrote:
> > Look for project.clj in storm-core.
> >
> > -Taylor
> >
> >> On Feb 14, 2014, at 6:12 PM, "Saurabh Agarwal (BLOOMBERG/ 731 LEXIN)" <
> sagarwal144@bloomberg.net> wrote:
> >>
> >>
> >> After adding the changes, I am building storm 0.9.0.1 source code using
> Leiningen . Can anyone point me out from where lein pick up the classpath?
> I am trying to change from zookeeper 3.3.3 to 3.4.5, but unable to find how
> to change it.
> >>
> >>
> >> ----- Original Message -----
> >> From: derekd@yahoo-inc.com
> >> To: SAURABH AGARWAL (BLOOMBERG/ 731 LEXIN),
> user@storm.incubator.apache.org
> >> At: Feb 14 2014 13:17:04
> >>
> >> Some changes to storm code are necessary for this.
> >>
> >> See https://github.com/apache/incubator-storm/pull/29/files
> >> --
> >> Derek
> >>
> >>> On 2/14/14, 11:50, Saurabh Agarwal (BLOOMBERG/ 731 LEXIN) wrote:
> >>> Thanks Bijoy for reply.
> >>>
> >>> We can't downgrade to 3.3.3 as our system has zookeeper 3.4.5 server
> running. and we would like to keep same version of zookeeper client to
> avoid any incompatibility issues.
> >>>
> >>> The error we are getting with 3.4.5 is.
> >>> Caused by: java.lang.ClassNotFoundException:
> org.apache.zookeeper.server.NIOServerCnxn$Factory
> >>>
> >>> After looking at zookeeper code, static Factory class within
> NIOSeverCnxn class has been removed in 3.4.5 version.
> >>>
> >>> zookeeper version 3.3.3 is 3 years old. Should not Storm be updated
> the code to run with zookeeper latest version. Should I create a jira for
> this?
> >>>
> >>>
> >>> ----- Original Message -----
> >>> From: user@storm.incubator.apache.org
> >>> To: SAURABH AGARWAL (BLOOMBERG/ 731 LEXIN),
> user@storm.incubator.apache.org
> >>> At: Feb 14 2014 11:45:50
> >>>
> >>> Hi,
> >>>
> >>> We had also downgraded zookeeper from 3.4.5 to 3.3.3 due to issues with
> >>> Storm.But we are not facing any issues related to Kafka after the
> >>> downgrade.We are using Storm 0.9.0-rc2 and Kafka 0.8.0.
> >>>
> >>> Thanks
> >>> Bijoy
> >>>
> >>> On Fri, Feb 14, 2014 at 9:57 PM, Saurabh Agarwal (BLOOMBERG/ 731
> LEXIN) <
> >>> sagarwal144@bloomberg.net> wrote:
> >>>
> >>>> Hi,
> >>>>
> >>>> Storm 0.9.0.1 client linked with zookeeper 3.4.5 library hung on
> zookeeper
> >>>> initialize. Is it known issue?
> >>>>
> >>>> 453 [main] INFO org.apache.zookeeper.server.ZooKeeperServer -
> <init> -
> >>>> Created server with tickTime 2000 minSessionTimeout 4000
> maxSessionTimeout
> >>>> 40000 datadir /tmp/7b520ac7-ff87-4eb6-9fc5-3a16deec0272/version-2
> snapdir
> >>>> /tmp/7b520ac7-ff87-4eb6-9fc5-3a16deec0272/version-2
> >>>>
> >>>> The client works fine with zookeeper 3.3.3. As we are using storm with
> >>>> kafka, kafka does not work with zookeeper 3.3.3 but work with 3.4.5.
> >>>>
> >>>> any help is appreciated...
> >>>> Thanks,
> >>>> Saurabh.
> >>
>
>