Can you help on this about performance of topology

[sam mohel <sa...@gmail.com>]

How can algoritm like" text similarity between tweets" affect on the
performance of storm topology ?

Re: Can you help on this about performance of topology

[sam mohel <sa...@gmail.com>]

Can someone check with me this ?

On Thursday, November 17, 2016, sam mohel <sa...@gmail.com> wrote:

> sure , as Rudraneel said
> 1. How many topologies?
> >> one
>
> 2. What are the workload parameters (e.g. tuple arrival rate, number of
> executors per component, size of each tuple)
> >>
> ​
> 3. System environment ( Number of cores in each supervisor node, Available
> RAM)
> >> I have numbis working on 8 GB RAM but supervisor has 4 GB
> 4. What is the nature of the algorithm? Is it CPU intensive?
> >> Algorithm usage is to improve result of finding simialrity between
> texts . How can i know if there is CPU intensive or not ?
>
> Next determine the performance metric. Usually, for storm it can be
> average tuple processing latency/ throughput etc.
> >> How can i calculate it ?
>
> Sorry but what do you mean by high throughput ?
>
>
> On Thu, Nov 17, 2016 at 8:22 AM, Manu Zhang <owenzhang1990@gmail.com
> <javascript:_e(%7B%7D,'cvml','owenzhang1990@gmail.com');>> wrote:
>
>> Hi Sam,
>>
>> Could you share you topology ? More background information will help us
>> to understand your problem.
>> And what kind of performance do you want to achieve, low latency or high
>> throughput ?
>>
>> Cheers,
>> Manu Zhang
>>
>> On Thu, Nov 17, 2016 at 5:34 AM sam mohel <sammohel5@gmail.com
>> <javascript:_e(%7B%7D,'cvml','sammohel5@gmail.com');>> wrote:
>>
>>> Please .Is there any help ?
>>>
>>> On Wednesday, November 16, 2016, sam mohel <sammohel5@gmail.com
>>> <javascript:_e(%7B%7D,'cvml','sammohel5@gmail.com');>> wrote:
>>>
>>> > How can algoritm like" text similarity between tweets" affect on the
>>> > performance of storm topology ?
>>>
>>
>

Re: Can you help on this about performance of topology

[sam mohel <sa...@gmail.com>]

sure , as Rudraneel said
1. How many topologies?
>> one

2. What are the workload parameters (e.g. tuple arrival rate, number of
executors per component, size of each tuple)
>>
​
3. System environment ( Number of cores in each supervisor node, Available
RAM)
>> I have numbis working on 8 GB RAM but supervisor has 4 GB
4. What is the nature of the algorithm? Is it CPU intensive?
>> Algorithm usage is to improve result of finding simialrity between texts
. How can i know if there is CPU intensive or not ?

Next determine the performance metric. Usually, for storm it can be average
tuple processing latency/ throughput etc.
>> How can i calculate it ?

Sorry but what do you mean by high throughput ?


On Thu, Nov 17, 2016 at 8:22 AM, Manu Zhang <ow...@gmail.com> wrote:

> Hi Sam,
>
> Could you share you topology ? More background information will help us to
> understand your problem.
> And what kind of performance do you want to achieve, low latency or high
> throughput ?
>
> Cheers,
> Manu Zhang
>
> On Thu, Nov 17, 2016 at 5:34 AM sam mohel <sa...@gmail.com> wrote:
>
>> Please .Is there any help ?
>>
>> On Wednesday, November 16, 2016, sam mohel <sa...@gmail.com> wrote:
>>
>> > How can algoritm like" text similarity between tweets" affect on the
>> > performance of storm topology ?
>>
>

Re: Can you help on this about performance of topology

[Manu Zhang <ow...@gmail.com>]

Hi Sam,

Could you share you topology ? More background information will help us to
understand your problem.
And what kind of performance do you want to achieve, low latency or high
throughput ?

Cheers,
Manu Zhang

On Thu, Nov 17, 2016 at 5:34 AM sam mohel <sa...@gmail.com> wrote:

> Please .Is there any help ?
>
> On Wednesday, November 16, 2016, sam mohel <sa...@gmail.com> wrote:
>
> > How can algoritm like" text similarity between tweets" affect on the
> > performance of storm topology ?
>

Re: Can you help on this about performance of topology

[Manu Zhang <ow...@gmail.com>]

Hi Sam,

Could you share you topology ? More background information will help us to
understand your problem.
And what kind of performance do you want to achieve, low latency or high
throughput ?

Cheers,
Manu Zhang

On Thu, Nov 17, 2016 at 5:34 AM sam mohel <sa...@gmail.com> wrote:

> Please .Is there any help ?
>
> On Wednesday, November 16, 2016, sam mohel <sa...@gmail.com> wrote:
>
> > How can algoritm like" text similarity between tweets" affect on the
> > performance of storm topology ?
>

Re: Can you help on this about performance of topology

[sam mohel <sa...@gmail.com>]

Thanks for your help

On Thursday, November 17, 2016, Rudraneel chakraborty <
rudraneel.chakraborty@gmail.com> wrote:

> Hi,
>
> For any kin of performance analysis, first determine the following
> 1. How many topologies?
> 2. What are the workload parameters (e.g. tuple arrival rate, number of
> executors per component, size of each tuple)
> 3. System environment ( Number of cores in each supervisor node, Available
> RAM)
> 4. What is the nature of the algorithm? Is it CPU intensive?
>
>
> Next determine the performance metric. Usually, for storm it can be
> average tuple processing latency/ throughput etc.
>
> Then you need to follow the factor at a time approach where you change one
> workload parameter per experiment and measure the performance metric while
> keeping others same. This will help you to identify the effect of each
> parameter on the performance.
>
>
>
>
>
>
> On Wed, Nov 16, 2016 at 4:46 PM, Matt Lowe <matthewneillowe@gmail.com
> <javascript:_e(%7B%7D,'cvml','matthewneillowe@gmail.com');>> wrote:
>
>> Performance in what way?
>>
>> If you mean from the storm Twitter example, that is part of the business
>> logic. It is a way of filtering.
>>
>> Best Regards
>> Matthew Lowe
>>
>> On 16 Nov 2016, at 22:34, sam mohel <sammohel5@gmail.com
>> <javascript:_e(%7B%7D,'cvml','sammohel5@gmail.com');>> wrote:
>>
>> Please .Is there any help ?
>>
>> On Wednesday, November 16, 2016, sam mohel <sammohel5@gmail.com
>> <javascript:_e(%7B%7D,'cvml','sammohel5@gmail.com');>> wrote:
>>
>>> How can algoritm like" text similarity between tweets" affect on the
>>> performance of storm topology ?
>>
>>
>
>
> --
>
>

Re: Can you help on this about performance of topology

[Rudraneel chakraborty <ru...@gmail.com>]

Hi,

For any kin of performance analysis, first determine the following
1. How many topologies?
2. What are the workload parameters (e.g. tuple arrival rate, number of
executors per component, size of each tuple)
3. System environment ( Number of cores in each supervisor node, Available
RAM)
4. What is the nature of the algorithm? Is it CPU intensive?


Next determine the performance metric. Usually, for storm it can be average
tuple processing latency/ throughput etc.

Then you need to follow the factor at a time approach where you change one
workload parameter per experiment and measure the performance metric while
keeping others same. This will help you to identify the effect of each
parameter on the performance.






On Wed, Nov 16, 2016 at 4:46 PM, Matt Lowe <ma...@gmail.com>
wrote:

> Performance in what way?
>
> If you mean from the storm Twitter example, that is part of the business
> logic. It is a way of filtering.
>
> Best Regards
> Matthew Lowe
>
> On 16 Nov 2016, at 22:34, sam mohel <sa...@gmail.com> wrote:
>
> Please .Is there any help ?
>
> On Wednesday, November 16, 2016, sam mohel <sa...@gmail.com> wrote:
>
>> How can algoritm like" text similarity between tweets" affect on the
>> performance of storm topology ?
>
>


--

Re: Can you help on this about performance of topology

[Matt Lowe <ma...@gmail.com>]

Performance in what way?

If you mean from the storm Twitter example, that is part of the business logic. It is a way of filtering. 

Best Regards
Matthew Lowe

> On 16 Nov 2016, at 22:34, sam mohel <sa...@gmail.com> wrote:
> 
> Please .Is there any help ?
> 
>> On Wednesday, November 16, 2016, sam mohel <sa...@gmail.com> wrote:
>> How can algoritm like" text similarity between tweets" affect on the performance of storm topology ? 

Re: Can you help on this about performance of topology

[sam mohel <sa...@gmail.com>]

Please .Is there any help ?

On Wednesday, November 16, 2016, sam mohel <sa...@gmail.com> wrote:

> How can algoritm like" text similarity between tweets" affect on the
> performance of storm topology ?

Re: Can you help on this about performance of topology

[sam mohel <sa...@gmail.com>]

Please .Is there any help ?

On Wednesday, November 16, 2016, sam mohel <sa...@gmail.com> wrote:

> How can algoritm like" text similarity between tweets" affect on the
> performance of storm topology ?