Re: Storm cannot run in combination with a recent Hadoop/HBa

["Sudarshan Kadambi (BLOOMBERG/ 731 LEXIN)" <sk...@bloomberg.net>]

We faced this issue couple weeks ago and ended up patching the code ourselves since it was such a small change.

We weren't aware of the performance issue with the curator client. We don't see anything obvious, so I wonder if that's an edge case of some sort.

----- Original Message -----
From: Niels Basjes <us...@storm.incubator.apache.org>
To: user@storm.incubator.apache.org
At: Feb 26, 2014 11:43:37 AM


Hi,

I'm trying to write some storm bolts and I want them to output the information they produce into HBase.
Now the HBase we have running here is based on CDH 4.5.0 which is fully based on the zookeeper versions in the 3.4.x range.

The problem I have is that Storm currently still uses zookeeper 3.3.3

The important difference in my case between these two is that 
3.3.x has:  org.apache.zookeeper.server.NIOServerCnxn$Factory
3.4.x has:  org.apache.zookeeper.server.NIOServerCnxnFactory  

As a consequence I'm getting a ClassNotFoundException.

I found that during a short period this problem was fixed but because of a performance problem in curator was turned back.
https://github.com/nathanmarz/storm/pull/225

What does it take to get this fixed (i.e. zookeeper goes to a 3.4.x version)?

-- 
Best regards / Met vriendelijke groeten,

Niels Basjes 

Re: Storm cannot run in combination with a recent Hadoop/HBa

[Niels Basjes <Ni...@basjes.nl>]

Thanks.

A few days ago I found this recent pull request that seems to work
https://github.com/apache/incubator-storm/pull/29

Today I updated my RPM scripting to include this update
https://github.com/nielsbasjes/storm-rhel-packaging

Tomorrow I'll do some testing to see if I can actually get a record from
Storm into HBase.

Niels Basjes



On Sat, Mar 1, 2014 at 1:19 PM, Sudarshan Kadambi (BLOOMBERG/ 731 LEXIN) <
skadambi@bloomberg.net> wrote:

> We faced this issue couple weeks ago and ended up patching the code
> ourselves since it was such a small change.
>
> We weren't aware of the performance issue with the curator client. We
> don't see anything obvious, so I wonder if that's an edge case of some sort.
>
> ----- Original Message -----
> From: Niels Basjes <us...@storm.incubator.apache.org>
> To: user@storm.incubator.apache.org
> At: Feb 26, 2014 11:43:37 AM
>
> Hi,
>
> I'm trying to write some storm bolts and I want them to output the
> information they produce into HBase.
> Now the HBase we have running here is based on CDH 4.5.0 which is fully
> based on the zookeeper versions in the 3.4.x range.
>
> The problem I have is that Storm currently still uses zookeeper 3.3.3
>
> The important difference in my case between these two is that
> 3.3.x has: org.apache.zookeeper.server.NIOServerCnxn$Factory
> 3.4.x has: org.apache.zookeeper.server.NIOServerCnxnFactory
>
> As a consequence I'm getting a ClassNotFoundException.
>
> I found that during a short period this problem was fixed but because of a
> performance problem in curator was turned back.
> https://github.com/nathanmarz/storm/pull/225
>
> What does it take to get this fixed (i.e. zookeeper goes to a 3.4.x
> version)?
>
> --
> Best regards / Met vriendelijke groeten,
>
> Niels Basjes
>
>


-- 
Best regards / Met vriendelijke groeten,

Niels Basjes