You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Andrey Dudin <do...@gmail.com> on 2016/04/21 11:13:37 UTC
move topologies between servers
Hi all.
Do someone have working way to move topologies between servers or up
topology on specific server? Is it possible?
--
С уважением Дудин Андрей
Re: move topologies between servers
Posted by "Matthias J. Sax" <mj...@apache.org>.
That is possible, as long as the default scheduler is allowed to deploy
topologies to **all** servers (ie, your special servers are available to
default scheduler, too).
(At least I think no, maybe it is even possible to exclude your special
servers -- see comment below.)
For this, you can instantiate the default scheduler within your custom
one (or let you custom inherit from default).
Each time, you get a scheduling request, you just decide if you want to
forward the request to the default scheduler, or take care of it in you
custom implementation.
(If you are able to modify the cluster meta data about about available
supervisors before you do the forward call to default scheduler, you
might be able to hide your special servers from the default scheduler, too.)
-Matthias
On 04/21/2016 12:08 PM, Susana González wrote:
> Hi,
>
> As Matthias says, you need to implement your own scheduler and use some
> metadata in the storm.yaml file. This link is a good starting point:
> https://dcvan24.wordpress.com/2015/04/07/metadata-aware-custom-scheduler-in-storm/
>
> What I haven't been able to do yet it is to mix a customized scheduler
> with the default scheduler. I mean, to configure that some supervisor is
> in charge of some bolts (use your custom scheduler) but the rest of
> supervisors use the default Storm scheduler to be assigned automatically.
>
> Do someone know how to do this? Thanks!
>
> Best,
> Susana
>
>
>
> On Thu, Apr 21, 2016 at 11:58 AM, Matthias J. Sax <mjsax@apache.org
> <ma...@apache.org>> wrote:
>
> For this, you need to provide a custom scheduler. Just search the
> Internet for example how to do this.
>
> Keep in mind, that a custom scheduler will not easily allow you to
> **move** topologies after they are deployed... But you can control to
> which servers you want to deploy a topology.
>
>
> -Matthias
>
> On 04/21/2016 11:13 AM, Andrey Dudin wrote:
> > Hi all.
> >
> > Do someone have working way to move topologies between servers or up
> > topology on specific server? Is it possible?
> >
> >
> > --
> > С уважением Дудин Андрей
> >
>
>
Re: move topologies between servers
Posted by Susana González <su...@gmail.com>.
Hi,
As Matthias says, you need to implement your own scheduler and use some
metadata in the storm.yaml file. This link is a good starting point:
https://dcvan24.wordpress.com/2015/04/07/metadata-aware-custom-scheduler-in-storm/
What I haven't been able to do yet it is to mix a customized scheduler with
the default scheduler. I mean, to configure that some supervisor is in
charge of some bolts (use your custom scheduler) but the rest of
supervisors use the default Storm scheduler to be assigned automatically.
Do someone know how to do this? Thanks!
Best,
Susana
On Thu, Apr 21, 2016 at 11:58 AM, Matthias J. Sax <mj...@apache.org> wrote:
> For this, you need to provide a custom scheduler. Just search the
> Internet for example how to do this.
>
> Keep in mind, that a custom scheduler will not easily allow you to
> **move** topologies after they are deployed... But you can control to
> which servers you want to deploy a topology.
>
>
> -Matthias
>
> On 04/21/2016 11:13 AM, Andrey Dudin wrote:
> > Hi all.
> >
> > Do someone have working way to move topologies between servers or up
> > topology on specific server? Is it possible?
> >
> >
> > --
> > С уважением Дудин Андрей
> >
>
>
Re: move topologies between servers
Posted by "Matthias J. Sax" <mj...@apache.org>.
For this, you need to provide a custom scheduler. Just search the
Internet for example how to do this.
Keep in mind, that a custom scheduler will not easily allow you to
**move** topologies after they are deployed... But you can control to
which servers you want to deploy a topology.
-Matthias
On 04/21/2016 11:13 AM, Andrey Dudin wrote:
> Hi all.
>
> Do someone have working way to move topologies between servers or up
> topology on specific server? Is it possible?
>
>
> --
> С уважением Дудин Андрей
>