I want to bind the spout with an IP and want to configure this ip wherever spout goes(at the time of crash of spout)

["M.Tarkeshwar Rao" <ta...@gmail.com>]

Hello Friends,

I want to bind the spout with an IP and want to configure this IP wherever
spout runs in the cluster.

Actually external clients sending data on this IP. We want that if the
spout is up and running in any machine then
this IP should also configured on that machine and if that spout is going
down by any reason(crash or rebalance or any other reason) this configured
IP should also go down. This is the virtual IP for external world.


For now we are achieving it by creating ephemeral znode on zookeeper for
each spout and continously watching(using pathchildrencache) it from
another jvm process on each machine in the cluster.

Is it a good way? can you please suggest more on this?


Regards
Tarkeshwar

Re: I want to bind the spout with an IP and want to configure this ip wherever spout goes(at the time of crash of spout)

["M.Tarkeshwar Rao" <ta...@gmail.com>]

Hi Vikas,

We are not using kafka spout. It is normal trident spout.
This spout is working as a collector. but it is not active it is passive

We have a virtual floating IP assigned to the machine where this spout is
running.

our clients sending the data to this spout directly and then spout start
processing in it.

all is well till now. But the problems comes when the spout going down and
up on other machine in the network.

We need to unconfigure this IP where it was initially running and configure
the same virtual floating ip on another machine where spout running now.

configuring it is simple. It can be done in open method of spout but how
can we achieve to unconfigure it during failure of the spout.




Regards
Tarkeshwar

On Fri, Sep 12, 2014 at 12:38 PM, Vikas Agarwal <vi...@infoobjects.com>
wrote:

> Not sure about how to monitor spout assignments, however, I am not sure
> what is preventing you in putting the virtual ip on machine which has as
> queue (kafka or jms) and the read messages from that kafka instance in your
> spout.
>
>
> On Fri, Sep 12, 2014 at 12:05 PM, M.Tarkeshwar Rao <tarkeshwar4u@gmail.com
> > wrote:
>
>> Hello Friends,
>>
>> I want to bind the spout with an IP and want to configure this IP
>> wherever spout runs in the cluster.
>>
>> Actually external clients sending data on this IP. We want that if the
>> spout is up and running in any machine then
>> this IP should also configured on that machine and if that spout is going
>> down by any reason(crash or rebalance or any other reason) this configured
>> IP should also go down. This is the virtual IP for external world.
>>
>>
>> For now we are achieving it by creating ephemeral znode on zookeeper for
>> each spout and continously watching(using pathchildrencache) it from
>> another jvm process on each machine in the cluster.
>>
>> Is it a good way? can you please suggest more on this?
>>
>>
>> Regards
>> Tarkeshwar
>>
>
>
>
> --
> Regards,
> Vikas Agarwal
> 91 – 9928301411
>
> InfoObjects, Inc.
> Execution Matters
> http://www.infoobjects.com
> 2041 Mission College Boulevard, #280
> Santa Clara, CA 95054
> +1 (408) 988-2000 Work
> +1 (408) 716-2726 Fax
>
>

Re: I want to bind the spout with an IP and want to configure this ip wherever spout goes(at the time of crash of spout)

[Vikas Agarwal <vi...@infoobjects.com>]

Not sure about how to monitor spout assignments, however, I am not sure
what is preventing you in putting the virtual ip on machine which has as
queue (kafka or jms) and the read messages from that kafka instance in your
spout.


On Fri, Sep 12, 2014 at 12:05 PM, M.Tarkeshwar Rao <ta...@gmail.com>
wrote:

> Hello Friends,
>
> I want to bind the spout with an IP and want to configure this IP wherever
> spout runs in the cluster.
>
> Actually external clients sending data on this IP. We want that if the
> spout is up and running in any machine then
> this IP should also configured on that machine and if that spout is going
> down by any reason(crash or rebalance or any other reason) this configured
> IP should also go down. This is the virtual IP for external world.
>
>
> For now we are achieving it by creating ephemeral znode on zookeeper for
> each spout and continously watching(using pathchildrencache) it from
> another jvm process on each machine in the cluster.
>
> Is it a good way? can you please suggest more on this?
>
>
> Regards
> Tarkeshwar
>



-- 
Regards,
Vikas Agarwal
91 – 9928301411

InfoObjects, Inc.
Execution Matters
http://www.infoobjects.com
2041 Mission College Boulevard, #280
Santa Clara, CA 95054
+1 (408) 988-2000 Work
+1 (408) 716-2726 Fax