You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Derrick Karimi <de...@gmail.com> on 2013/12/29 18:03:05 UTC
storm over WAN and NAT
Hello,
I have a requirement for real time data processing where data sources are
spread over a wide geographic area on multiple networks. Are there any
known previous deployments, or any forseen issues with deploying a storm
cluster where machines are behind firewalls/using nat, and spread out such
that latency issues and network reliability issues will be noticeable?
--
--Derrick
Re: storm over WAN and NAT
Posted by Derrick Karimi <de...@gmail.com>.
Yes I can, I am exploring different options. I found some information
about ZeroMQ functioning in such an environment and was wondering if any
experts had some insight to how storm would behave.
On Sun, Dec 29, 2013 at 12:27 PM, Michael Rose <mi...@fullcontact.com>wrote:
> Generally speaking, I don't know of many services that work exceedingly
> well over a WAN.
>
> Can you not do processing at each location and forward it on with a queue
> that isn't adverse to WAN links?
> On Dec 29, 2013 10:03 AM, "Derrick Karimi" <de...@gmail.com>
> wrote:
>
>> Hello,
>>
>> I have a requirement for real time data processing where data sources are
>> spread over a wide geographic area on multiple networks. Are there any
>> known previous deployments, or any forseen issues with deploying a storm
>> cluster where machines are behind firewalls/using nat, and spread out such
>> that latency issues and network reliability issues will be noticeable?
>>
>> --
>> --Derrick
>>
>
--
--Derrick
Re: storm over WAN and NAT
Posted by Michael Rose <mi...@fullcontact.com>.
Generally speaking, I don't know of many services that work exceedingly
well over a WAN.
Can you not do processing at each location and forward it on with a queue
that isn't adverse to WAN links?
On Dec 29, 2013 10:03 AM, "Derrick Karimi" <de...@gmail.com> wrote:
> Hello,
>
> I have a requirement for real time data processing where data sources are
> spread over a wide geographic area on multiple networks. Are there any
> known previous deployments, or any forseen issues with deploying a storm
> cluster where machines are behind firewalls/using nat, and spread out such
> that latency issues and network reliability issues will be noticeable?
>
> --
> --Derrick
>