You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Klausen Schaefersinho <kl...@gmail.com> on 2014/01/22 15:40:16 UTC
LocalCluster looses events
Hi,
I am developing a topology and I am testing it with a local cluster. I have
one spud and one bolt and they are connected through a field grouping.
I assigned to the spout a parallelization hint of 2 and to the bolt 10.
While I was studying some of my performance logs I found that there are
actually 6 bolts running. Well its just a hint, so it' fine with me. But I
saw also that they a emitting quite a number of events that do not seem to
reach bolt. The spouts have a sleep inside, so you can see that
DMSInputBolt.I_1 and DMSInputBolt.I_2 are really invoked and the sum of
their events sums up correctly to the sum of events in the worker. My
questions is now, what are the other spouits doing, and what where do their
events do?
Component | # Events | Ev / Sec |
Time(s) | Time(%)
-------------------------------------+--------------+--------------+--------------+--------------
RecommendationBolt | 968 | 20 | 1.53
| 2.0%
DMSInputBolt | 2902 | 60 | 97.25
| 98.0%
Component.Instance | # Events | Ev / Sec |
Time(s) | Time(%)
-------------------------------------+--------------+--------------+--------------+--------------
RecommendationBolt.I_13 | 85 | 2 | 0.1
| 0.0%
RecommendationBolt.I_12 | 89 | 2 | 0.1
| 0.0%
RecommendationBolt.I_14 | 93 | 2 | 0.11
| 0.0%
RecommendationBolt.I_8 | 95 | 2 | 0.12
| 0.0%
RecommendationBolt.I_9 | 96 | 2 | 0.11
| 0.0%
RecommendationBolt.I_11 | 97 | 2 | 0.11
| 0.0%
RecommendationBolt.I_7 | 98 | 2 | 0.11
| 0.0%
RecommendationBolt.I_15 | 99 | 2 | 0.11
| 0.0%
RecommendationBolt.I_16 | 103 | 2 | 0.55
| 1.0%
RecommendationBolt.I_10 | 113 | 2 | 0.12
| 0.0%
DMSInputBolt.I_3 | 482 | 10 | 0.05
| 0.0%
DMSInputBolt.I_1 | 482 | 10 | 48.44
| 49.0%
DMSInputBolt.I_6 | 483 | 10 | 0.03
| 0.0%
DMSInputBolt.I_2 | 484 | 10 | 48.65
| 49.0%
DMSInputBolt.I_5 | 485 | 10 | 0.03
| 0.0%
DMSInputBolt.I_4 | 486 | 10 | 0.05
| 0.0%
If this is just an issue of the LocalCluster I won't mind any more...
Best Regards,
Klaus
Re: LocalCluster looses events
Posted by Klausen Schaefersinho <kl...@gmail.com>.
Hi Guys,
sorry I had a bug in my logging code :-(
On Wed, Jan 22, 2014 at 3:40 PM, Klausen Schaefersinho <
klaus.schaefers@gmail.com> wrote:
> Hi,
>
> I am developing a topology and I am testing it with a local cluster. I
> have one spud and one bolt and they are connected through a field grouping.
>
> I assigned to the spout a parallelization hint of 2 and to the bolt 10.
> While I was studying some of my performance logs I found that there are
> actually 6 bolts running. Well its just a hint, so it' fine with me. But I
> saw also that they a emitting quite a number of events that do not seem to
> reach bolt. The spouts have a sleep inside, so you can see that
> DMSInputBolt.I_1 and DMSInputBolt.I_2 are really invoked and the sum of
> their events sums up correctly to the sum of events in the worker. My
> questions is now, what are the other spouits doing, and what where do their
> events do?
>
>
> Component | # Events | Ev / Sec |
> Time(s) | Time(%)
>
> -------------------------------------+--------------+--------------+--------------+--------------
> RecommendationBolt | 968 | 20 | 1.53
> | 2.0%
> DMSInputBolt | 2902 | 60 |
> 97.25 | 98.0%
>
>
>
> Component.Instance | # Events | Ev / Sec |
> Time(s) | Time(%)
>
> -------------------------------------+--------------+--------------+--------------+--------------
> RecommendationBolt.I_13 | 85 | 2 | 0.1
> | 0.0%
> RecommendationBolt.I_12 | 89 | 2 | 0.1
> | 0.0%
> RecommendationBolt.I_14 | 93 | 2 | 0.11
> | 0.0%
> RecommendationBolt.I_8 | 95 | 2 | 0.12
> | 0.0%
> RecommendationBolt.I_9 | 96 | 2 | 0.11
> | 0.0%
> RecommendationBolt.I_11 | 97 | 2 | 0.11
> | 0.0%
> RecommendationBolt.I_7 | 98 | 2 | 0.11
> | 0.0%
> RecommendationBolt.I_15 | 99 | 2 | 0.11
> | 0.0%
> RecommendationBolt.I_16 | 103 | 2 | 0.55
> | 1.0%
> RecommendationBolt.I_10 | 113 | 2 | 0.12
> | 0.0%
> DMSInputBolt.I_3 | 482 | 10 | 0.05
> | 0.0%
> DMSInputBolt.I_1 | 482 | 10 |
> 48.44 | 49.0%
> DMSInputBolt.I_6 | 483 | 10 | 0.03
> | 0.0%
> DMSInputBolt.I_2 | 484 | 10 |
> 48.65 | 49.0%
> DMSInputBolt.I_5 | 485 | 10 | 0.03
> | 0.0%
> DMSInputBolt.I_4 | 486 | 10 | 0.05
> | 0.0%
>
>
> If this is just an issue of the LocalCluster I won't mind any more...
>
> Best Regards,
>
>
> Klaus
>