You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Anas A <an...@trinitymobility.com> on 2017/02/10 07:12:18 UTC
Storm Message Discarding Error
Hi,
We are using eventhub spout to collect data from iothub and 2 bolts where
there to process the same , one is using for parsing the data and another
one is using to storing it on hbase. When I look in to the Eventhub spout
more than 50 percentage message ACK getting failed when I look it through
the log the only information available is
Line 544189: 2017-02-09 07:28:33.663 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopslave01/10.0.0.7:6700 is being closed
Line 544308: 2017-02-09 07:28:33.847 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopmaster1/10.0.0.5:6700 is being closed
Line 544425: 2017-02-09 07:29:03.008 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopmaster1/10.0.0.5:6701 is being closed
Line 544591: 2017-02-09 07:29:03.009 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopslave01/10.0.0.7:6700 is being closed
Line 544799: 2017-02-09 07:29:03.011 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopslave01/10.0.0.7:6700 is being closed
Line 545107: 2017-02-09 07:29:03.035 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopmaster1/10.0.0.5:6701 is being closed
Line 545175: 2017-02-09 07:29:03.035 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopslave01/10.0.0.7:6700 is being closed
Line 545312: 2017-02-09 07:29:03.071 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopslave01/10.0.0.7:6700 is being closed
Line 545490: 2017-02-09 07:29:03.119 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopslave01/10.0.0.7:6700 is being closed
Line 545559: 2017-02-09 07:29:03.126 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopslave01/10.0.0.7:6700 is being closed
Line 545863: 2017-02-09 07:29:03.323 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopmaster1/10.0.0.5:6701 is being closed
Line 545904: 2017-02-09 07:29:03.338 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopmaster1/10.0.0.5:6701 is being closed
Line 545977: 2017-02-09 07:29:03.447 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopmaster1/10.0.0.5:6701 is being closed
Line 546073: 2017-02-09 07:29:33.008 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopslave01/10.0.0.7:6700 is being closed
Line 546142: 2017-02-09 07:29:33.009 b.s.m.n.Client [ERROR]
discarding 1 messages because the Netty client to
Netty-Client-apachehadoopmaster1/10.0.0.5:6701 is being closed
Line 546492: 2017-02-09 07:29:33.012 b.s.m.n.Client [ERROR]
discarding 2 messages because the Netty client to
Netty-Client-apachehadoopmaster1/10.0.0.5:6701 is being closed
when I look through the log of 10.0.0.7 and 10.0.0.5 there is no much
information on that particular time. what Might be the reason for this
failure
Thanks & Regards
Anas A,
Trinity Mobility Pvt. Ltd | Bangalore | +91-7736368236
<http://www.trinityiot.in/>
<https://www.facebook.com/trinitymobilityltd>
<http://www.linkedin.com/company/trinity-mobility>
Re: Storm Message Discarding Error
Posted by Navin Ipe <na...@searchlighthealth.com>.
One possibility is that one of the nodes might've crashed due to using
excessive memory or the garbage collector not kicking in because of a lack
of swap space.
On Fri, Feb 10, 2017 at 12:42 PM, Anas A <an...@trinitymobility.com> wrote:
> Hi,
>
> We are using eventhub spout to collect data from iothub and 2 bolts where
> there to process the same , one is using for parsing the data and another
> one is using to storing it on hbase. When I look in to the Eventhub spout
> more than 50 percentage message ACK getting failed when I look it through
> the log the only information available is
>
>
>
> * Line 544189: 2017-02-09 07:28:33.663 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopslave01/10.0.0.7:6700 <http://10.0.0.7:6700> is
> being closed*
>
> * Line 544308: 2017-02-09 07:28:33.847 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopmaster1/10.0.0.5:6700 <http://10.0.0.5:6700> is
> being closed*
>
> * Line 544425: 2017-02-09 07:29:03.008 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopmaster1/10.0.0.5:6701 <http://10.0.0.5:6701> is
> being closed*
>
> * Line 544591: 2017-02-09 07:29:03.009 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopslave01/10.0.0.7:6700 <http://10.0.0.7:6700> is
> being closed*
>
> * Line 544799: 2017-02-09 07:29:03.011 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopslave01/10.0.0.7:6700 <http://10.0.0.7:6700> is
> being closed*
>
> * Line 545107: 2017-02-09 07:29:03.035 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopmaster1/10.0.0.5:6701 <http://10.0.0.5:6701> is
> being closed*
>
> * Line 545175: 2017-02-09 07:29:03.035 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopslave01/10.0.0.7:6700 <http://10.0.0.7:6700> is
> being closed*
>
> * Line 545312: 2017-02-09 07:29:03.071 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopslave01/10.0.0.7:6700 <http://10.0.0.7:6700> is
> being closed*
>
> * Line 545490: 2017-02-09 07:29:03.119 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopslave01/10.0.0.7:6700 <http://10.0.0.7:6700> is
> being closed*
>
> * Line 545559: 2017-02-09 07:29:03.126 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopslave01/10.0.0.7:6700 <http://10.0.0.7:6700> is
> being closed*
>
> * Line 545863: 2017-02-09 07:29:03.323 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopmaster1/10.0.0.5:6701 <http://10.0.0.5:6701> is
> being closed*
>
> * Line 545904: 2017-02-09 07:29:03.338 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopmaster1/10.0.0.5:6701 <http://10.0.0.5:6701> is
> being closed*
>
> * Line 545977: 2017-02-09 07:29:03.447 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopmaster1/10.0.0.5:6701 <http://10.0.0.5:6701> is
> being closed*
>
> * Line 546073: 2017-02-09 07:29:33.008 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopslave01/10.0.0.7:6700 <http://10.0.0.7:6700> is
> being closed*
>
> * Line 546142: 2017-02-09 07:29:33.009 b.s.m.n.Client [ERROR]
> discarding 1 messages because the Netty client to
> Netty-Client-apachehadoopmaster1/10.0.0.5:6701 <http://10.0.0.5:6701> is
> being closed*
>
> * Line 546492: 2017-02-09 07:29:33.012 b.s.m.n.Client [ERROR]
> discarding 2 messages because the Netty client to
> Netty-Client-apachehadoopmaster1/10.0.0.5:6701 <http://10.0.0.5:6701> is
> being closed*
>
>
>
>
>
> when I look through the log of 10.0.0.7 and 10.0.0.5 there is no much
> information on that particular time. what Might be the reason for this
> failure
>
> *Thanks & Regards*
>
>
> *Anas A,Trinity Mobility Pvt. Ltd | Bangalore | **+91-7736368236*
>
> [image: 148221140437883 (1)] <http://www.trinityiot.in/>
>
>
>
> [image: like_us_facebook] <https://www.facebook.com/trinitymobilityltd> [image:
> follow_us_on_linkedin] <http://www.linkedin.com/company/trinity-mobility>
>
>
>
--
Regards,
Navin