You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@storm.apache.org by anil_ah <an...@yahoo.co.in> on 2015/08/21 11:58:50 UTC

Toplogy Hang for Msg bigger than 5MB

    

Hi    I have a toplogy with 1 worker node and 40 task executor ,with 5gb heap. This is working fine if messages are of size between 200 kb to 2MB. Can process Around 25k++ msg in less than 10 min. But if some time msg come around 5MB to 15MB. Its got hang and also stop processing other small size msg.
This toplogy is inserting these xml message to cassandra. 
Please provide some pointers how to fix this issue. MSG could come up to size of 50MB.
Regards Anil 

Sent from my Samsung device

-------- Original message --------
From: Martin Burian <ma...@gmail.com> 
Date: 21/08/2015  5:17 pm  (GMT+08:00) 
To: user@storm.apache.org 
Subject: Re: Workers maxing out heap, excessive GC, mk_acker_bolt->pending map is huge (0.9.5)