You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@metron.apache.org by Otto Fowler <ot...@gmail.com> on 2017/06/02 17:10:15 UTC
Storm Slots - creating and deploying parsers
What is our current thinking on storm slot requirements for adding parsers
to the system? Please correct me if I am wrong but I don’t think the rest
services do this, so we have to go into ambari.
Re: Storm Slots - creating and deploying parsers
Posted by Otto Fowler <ot...@gmail.com>.
https://issues.apache.org/jira/browse/METRON-981
Simon, please feel free to edit or expound.
On June 2, 2017 at 13:30:46, Otto Fowler (ottobackwards@gmail.com) wrote:
Thanks, you can shoot that to the list or comment on METRON-947 ( PR#580 )
I’ll add the lira.
On June 2, 2017 at 13:29:28, Simon Elliston Ball (
simon@simonellistonball.com) wrote:
That’s a great idea, at the moment I believe it just sort of fails silently
when creating the topology, so we should definitely get a JIRA for that.
I’ll kick off something to collect some of the collected wisdom from
everyone as well I think on Storm, maybe we need a tuning page similar to
Jon’s excellent Search tuning page.
Simon
On 2 Jun 2017, at 18:27, Otto Fowler <ot...@gmail.com> wrote:
Simon,
Can you write a blurb on your best practices? I would like to add it to
METRON-947 steps and documentation.
Maybe the Jira for the Management UI would be to have something tell you if
you don’t have enough slots to activate a parser or something?
On June 2, 2017 at 13:23:30, Simon Elliston Ball (
simon@simonellistonball.com) wrote:
Correct, you need to make sure you have sufficient slots in Ambari.
Personally I tend to just add a bunch of ports at install, and create slots
across the supervisors, but you can always add more supervisors too.
Simon
> On 2 Jun 2017, at 18:10, Otto Fowler <ot...@gmail.com> wrote:
>
> What is our current thinking on storm slot requirements for adding parsers
> to the system? Please correct me if I am wrong but I don’t think the rest
> services do this, so we have to go into ambari.
Re: Storm Slots - creating and deploying parsers
Posted by Otto Fowler <ot...@gmail.com>.
Thanks, you can shoot that to the list or comment on METRON-947 ( PR#580 )
I’ll add the lira.
On June 2, 2017 at 13:29:28, Simon Elliston Ball (
simon@simonellistonball.com) wrote:
That’s a great idea, at the moment I believe it just sort of fails silently
when creating the topology, so we should definitely get a JIRA for that.
I’ll kick off something to collect some of the collected wisdom from
everyone as well I think on Storm, maybe we need a tuning page similar to
Jon’s excellent Search tuning page.
Simon
On 2 Jun 2017, at 18:27, Otto Fowler <ot...@gmail.com> wrote:
Simon,
Can you write a blurb on your best practices? I would like to add it to
METRON-947 steps and documentation.
Maybe the Jira for the Management UI would be to have something tell you if
you don’t have enough slots to activate a parser or something?
On June 2, 2017 at 13:23:30, Simon Elliston Ball (
simon@simonellistonball.com) wrote:
Correct, you need to make sure you have sufficient slots in Ambari.
Personally I tend to just add a bunch of ports at install, and create slots
across the supervisors, but you can always add more supervisors too.
Simon
> On 2 Jun 2017, at 18:10, Otto Fowler <ot...@gmail.com> wrote:
>
> What is our current thinking on storm slot requirements for adding parsers
> to the system? Please correct me if I am wrong but I don’t think the rest
> services do this, so we have to go into ambari.
Re: Storm Slots - creating and deploying parsers
Posted by Simon Elliston Ball <si...@simonellistonball.com>.
That’s a great idea, at the moment I believe it just sort of fails silently when creating the topology, so we should definitely get a JIRA for that. I’ll kick off something to collect some of the collected wisdom from everyone as well I think on Storm, maybe we need a tuning page similar to Jon’s excellent Search tuning page.
Simon
> On 2 Jun 2017, at 18:27, Otto Fowler <ot...@gmail.com> wrote:
>
> Simon,
> Can you write a blurb on your best practices? I would like to add it to METRON-947 steps and documentation.
>
> Maybe the Jira for the Management UI would be to have something tell you if you don’t have enough slots to activate a parser or something?
>
>
> On June 2, 2017 at 13:23:30, Simon Elliston Ball (simon@simonellistonball.com <ma...@simonellistonball.com>) wrote:
>
>> Correct, you need to make sure you have sufficient slots in Ambari. Personally I tend to just add a bunch of ports at install, and create slots across the supervisors, but you can always add more supervisors too.
>>
>> Simon
>>
>> > On 2 Jun 2017, at 18:10, Otto Fowler <ottobackwards@gmail.com <ma...@gmail.com>> wrote:
>> >
>> > What is our current thinking on storm slot requirements for adding parsers
>> > to the system? Please correct me if I am wrong but I don’t think the rest
>> > services do this, so we have to go into ambari.
Re: Storm Slots - creating and deploying parsers
Posted by Otto Fowler <ot...@gmail.com>.
Simon,
Can you write a blurb on your best practices? I would like to add it to
METRON-947 steps and documentation.
Maybe the Jira for the Management UI would be to have something tell you if
you don’t have enough slots to activate a parser or something?
On June 2, 2017 at 13:23:30, Simon Elliston Ball (
simon@simonellistonball.com) wrote:
Correct, you need to make sure you have sufficient slots in Ambari.
Personally I tend to just add a bunch of ports at install, and create slots
across the supervisors, but you can always add more supervisors too.
Simon
> On 2 Jun 2017, at 18:10, Otto Fowler <ot...@gmail.com> wrote:
>
> What is our current thinking on storm slot requirements for adding
parsers
> to the system? Please correct me if I am wrong but I don’t think the rest
> services do this, so we have to go into ambari.
Re: Storm Slots - creating and deploying parsers
Posted by Simon Elliston Ball <si...@simonellistonball.com>.
Correct, you need to make sure you have sufficient slots in Ambari. Personally I tend to just add a bunch of ports at install, and create slots across the supervisors, but you can always add more supervisors too.
Simon
> On 2 Jun 2017, at 18:10, Otto Fowler <ot...@gmail.com> wrote:
>
> What is our current thinking on storm slot requirements for adding parsers
> to the system? Please correct me if I am wrong but I don’t think the rest
> services do this, so we have to go into ambari.