You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Andrew Milkowski <am...@gmail.com> on 2014/02/19 16:51:41 UTC
storm version 0.9.0.1 and zeromq 2.2.0 compatibility
I have tried running zeromq-2.2.0 with storm version 0.9.0.1
java.library.path:
"/opt/local/src/zeromq/zeromq-2.2.0/dist/lib:/opt/local/src/git/jzmq/dist/lib"
but ran into sigfault below (are these versions compatible) thanks!
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native
code)
C [libzmq.so.1+0x1ac60] zmq::signaler_t::signaler_t()+0x1e0
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j org.zeromq.ZMQ$Socket.setLongSockopt(IJ)V+0
j org.zeromq.ZMQ$Socket.setHWM(J)V+16
j zilch.mq
$set_hwm.invoke(Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+25
j
backtype.storm.messaging.zmq.ZMQContext.connect(Ljava/lang/String;Ljava/lang/String;I)Lbacktype/storm/messaging/IConnection;+82
j
backtype.storm.daemon.worker$mk_refresh_connections$this__5827$iter__5834__5838$fn__5839.invoke()Ljava/lang/Object;+474
J clojure.lang.LazySeq.sval()Ljava/lang/Object;
j clojure.lang.LazySeq.seq()Lclojure/lang/ISeq;+1
J clojure.lang.RT.seq(Ljava/lang/Object;)Lclojure/lang/ISeq;
J clojure.core$seq.invoke(Ljava/lang/Object;)Ljava/lang/Object;
j clojure.core$dorun.invoke(Ljava/lang/Object;)Ljava/lang/Object;+10
j clojure.core$doall.invoke(Ljava/lang/Object;)Ljava/lang/Object;+10
j
backtype.storm.daemon.worker$mk_refresh_connections$this__5827.invoke(Ljava/lang/Object;)Ljava/lang/Object;+512
j
backtype.storm.daemon.worker$fn__5882$exec_fn__1229__auto____5883.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+62
Re: storm version 0.9.0.1 and zeromq 2.2.0 compatibility
Posted by "P. Taylor Goetz" <pt...@gmail.com>.
Hi Andrew,
There’s not a way that I know of to use multiple versions of zeromq with Storms zeromq transport.
I think your best option is to use Storm’s Netty transport to avoid zeromq version conflicts.
- Taylor
On Feb 19, 2014, at 11:06 AM, Andrew Milkowski <am...@gmail.com> wrote:
> thanks so much bijoy, will need to do netty , because one of my spouts needs to read from certain version of zeromq! I have bo choice but use 2.2 zeromq version... unless there is a way to have storm executing one version 2.1.7 and spout another such as 2.2.2
>
> thanks for netty tip trying it now, but if you know above, appreciate it!
>
>
> On Wed, Feb 19, 2014 at 10:57 AM, bijoy deb <bi...@gmail.com> wrote:
> Hi,
>
> Try using zeromq 2.1.7 with the given Storm version.Storm seems to have compatibility issues with later versions of zeromq.
>
> Also, to avoid this version compatibility problem,you can also switch to using Netty transport instead of zeromq by setting certain parameters in storm.yaml file.See thye Storm 0.9 documentation page on Github.
>
> Thanks
> Bijoy
>
> On Wed, Feb 19, 2014 at 9:21 PM, Andrew Milkowski <am...@gmail.com> wrote:
> I have tried running zeromq-2.2.0 with storm version 0.9.0.1
>
> java.library.path: "/opt/local/src/zeromq/zeromq-2.2.0/dist/lib:/opt/local/src/git/jzmq/dist/lib"
>
> but ran into sigfault below (are these versions compatible) thanks!
>
> Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
> C [libzmq.so.1+0x1ac60] zmq::signaler_t::signaler_t()+0x1e0
>
> Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
> j org.zeromq.ZMQ$Socket.setLongSockopt(IJ)V+0
> j org.zeromq.ZMQ$Socket.setHWM(J)V+16
> j zilch.mq$set_hwm.invoke(Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+25
> j backtype.storm.messaging.zmq.ZMQContext.connect(Ljava/lang/String;Ljava/lang/String;I)Lbacktype/storm/messaging/IConnection;+82
> j backtype.storm.daemon.worker$mk_refresh_connections$this__5827$iter__5834__5838$fn__5839.invoke()Ljava/lang/Object;+474
> J clojure.lang.LazySeq.sval()Ljava/lang/Object;
> j clojure.lang.LazySeq.seq()Lclojure/lang/ISeq;+1
> J clojure.lang.RT.seq(Ljava/lang/Object;)Lclojure/lang/ISeq;
> J clojure.core$seq.invoke(Ljava/lang/Object;)Ljava/lang/Object;
> j clojure.core$dorun.invoke(Ljava/lang/Object;)Ljava/lang/Object;+10
> j clojure.core$doall.invoke(Ljava/lang/Object;)Ljava/lang/Object;+10
> j backtype.storm.daemon.worker$mk_refresh_connections$this__5827.invoke(Ljava/lang/Object;)Ljava/lang/Object;+512
> j backtype.storm.daemon.worker$fn__5882$exec_fn__1229__auto____5883.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+62
>
>
Re: storm version 0.9.0.1 and zeromq 2.2.0 compatibility
Posted by Andrew Milkowski <am...@gmail.com>.
thanks so much bijoy, will need to do netty , because one of my spouts
needs to read from certain version of zeromq! I have bo choice but use 2.2
zeromq version... unless there is a way to have storm executing one version
2.1.7 and spout another such as 2.2.2
thanks for netty tip trying it now, but if you know above, appreciate it!
On Wed, Feb 19, 2014 at 10:57 AM, bijoy deb <bi...@gmail.com>wrote:
> Hi,
>
> Try using zeromq 2.1.7 with the given Storm version.Storm seems to have
> compatibility issues with later versions of zeromq.
>
> Also, to avoid this version compatibility problem,you can also switch to
> using Netty transport instead of zeromq by setting certain parameters in
> storm.yaml file.See thye Storm 0.9 documentation page on Github.
>
> Thanks
> Bijoy
>
> On Wed, Feb 19, 2014 at 9:21 PM, Andrew Milkowski <am...@gmail.com>wrote:
>
>> I have tried running zeromq-2.2.0 with storm version 0.9.0.1
>>
>> java.library.path:
>> "/opt/local/src/zeromq/zeromq-2.2.0/dist/lib:/opt/local/src/git/jzmq/dist/lib"
>>
>> but ran into sigfault below (are these versions compatible) thanks!
>>
>> Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,
>> C=native code)
>> C [libzmq.so.1+0x1ac60] zmq::signaler_t::signaler_t()+0x1e0
>>
>> Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
>> j org.zeromq.ZMQ$Socket.setLongSockopt(IJ)V+0
>> j org.zeromq.ZMQ$Socket.setHWM(J)V+16
>> j zilch.mq
>> $set_hwm.invoke(Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+25
>> j
>> backtype.storm.messaging.zmq.ZMQContext.connect(Ljava/lang/String;Ljava/lang/String;I)Lbacktype/storm/messaging/IConnection;+82
>> j
>> backtype.storm.daemon.worker$mk_refresh_connections$this__5827$iter__5834__5838$fn__5839.invoke()Ljava/lang/Object;+474
>> J clojure.lang.LazySeq.sval()Ljava/lang/Object;
>> j clojure.lang.LazySeq.seq()Lclojure/lang/ISeq;+1
>> J clojure.lang.RT.seq(Ljava/lang/Object;)Lclojure/lang/ISeq;
>> J clojure.core$seq.invoke(Ljava/lang/Object;)Ljava/lang/Object;
>> j clojure.core$dorun.invoke(Ljava/lang/Object;)Ljava/lang/Object;+10
>> j clojure.core$doall.invoke(Ljava/lang/Object;)Ljava/lang/Object;+10
>> j
>> backtype.storm.daemon.worker$mk_refresh_connections$this__5827.invoke(Ljava/lang/Object;)Ljava/lang/Object;+512
>> j
>> backtype.storm.daemon.worker$fn__5882$exec_fn__1229__auto____5883.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+62
>>
>
>
Re: storm version 0.9.0.1 and zeromq 2.2.0 compatibility
Posted by bijoy deb <bi...@gmail.com>.
Hi,
Try using zeromq 2.1.7 with the given Storm version.Storm seems to have
compatibility issues with later versions of zeromq.
Also, to avoid this version compatibility problem,you can also switch to
using Netty transport instead of zeromq by setting certain parameters in
storm.yaml file.See thye Storm 0.9 documentation page on Github.
Thanks
Bijoy
On Wed, Feb 19, 2014 at 9:21 PM, Andrew Milkowski <am...@gmail.com>wrote:
> I have tried running zeromq-2.2.0 with storm version 0.9.0.1
>
> java.library.path:
> "/opt/local/src/zeromq/zeromq-2.2.0/dist/lib:/opt/local/src/git/jzmq/dist/lib"
>
> but ran into sigfault below (are these versions compatible) thanks!
>
> Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,
> C=native code)
> C [libzmq.so.1+0x1ac60] zmq::signaler_t::signaler_t()+0x1e0
>
> Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
> j org.zeromq.ZMQ$Socket.setLongSockopt(IJ)V+0
> j org.zeromq.ZMQ$Socket.setHWM(J)V+16
> j zilch.mq
> $set_hwm.invoke(Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+25
> j
> backtype.storm.messaging.zmq.ZMQContext.connect(Ljava/lang/String;Ljava/lang/String;I)Lbacktype/storm/messaging/IConnection;+82
> j
> backtype.storm.daemon.worker$mk_refresh_connections$this__5827$iter__5834__5838$fn__5839.invoke()Ljava/lang/Object;+474
> J clojure.lang.LazySeq.sval()Ljava/lang/Object;
> j clojure.lang.LazySeq.seq()Lclojure/lang/ISeq;+1
> J clojure.lang.RT.seq(Ljava/lang/Object;)Lclojure/lang/ISeq;
> J clojure.core$seq.invoke(Ljava/lang/Object;)Ljava/lang/Object;
> j clojure.core$dorun.invoke(Ljava/lang/Object;)Ljava/lang/Object;+10
> j clojure.core$doall.invoke(Ljava/lang/Object;)Ljava/lang/Object;+10
> j
> backtype.storm.daemon.worker$mk_refresh_connections$this__5827.invoke(Ljava/lang/Object;)Ljava/lang/Object;+512
> j
> backtype.storm.daemon.worker$fn__5882$exec_fn__1229__auto____5883.invoke(Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+62
>