You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@storm.apache.org by Jaime Solano <jd...@gmail.com> on 2015/06/26 17:00:56 UTC

Thrift Error while submitting Topology - Message Length Exceeded

Hi guys,

I'm new in the list, so I'm not sure if this question has already been
answered. I'm getting the following error while trying to submit a topology:

org.apache.thrift7.TException: Message length exceeded: 111990.

I'm using storm-0.9.3, on HDP 2.2.0.

Thanks,
-Jaime

Re: Thrift Error while submitting Topology - Message Length Exceeded

Posted by Jaime Solano <jd...@gmail.com>.

Hi guys,
Yes, modifying nimbus.thrift.max_buffer_size did the trick. We increased it
from 1048576 to 10485760.
-Jaime

On Wed, Jul 8, 2015 at 11:58 AM, Jaime Solano <jd...@gmail.com> wrote:

> Hi John,
> In storm.yaml I found nimbus.thrift.max_buffer_size. But according to
> ambari, is a buffer used for reading thrift messages.
> Is this the property you were refering to?
> Thanks,
> -Jaime
>
> On Sat, Jun 27, 2015 at 2:59 PM, John Reilly <jr...@inconspicuous.org> wrote:
>
>> I've seen that before when sending a large Config Map during storm
>> submit. There is a config in storm.yaml to set the max thrift message size
>> (can't remember it off the top of my head).
>>
>> On Fri, Jun 26, 2015 at 18:40 임정택 <ka...@gmail.com> wrote:
>>
>>> Could you provide stack traces about submitting and nimbus?
>>>
>>> Regards,
>>> Jungtaek Lim (HeartSaVioR)
>>>
>>> 2015-06-27 0:00 GMT+09:00 Jaime Solano <jd...@gmail.com>:
>>>
>>>> Hi guys,
>>>>
>>>> I'm new in the list, so I'm not sure if this question has already been
>>>> answered. I'm getting the following error while trying to submit a topology:
>>>>
>>>> org.apache.thrift7.TException: Message length exceeded: 111990.
>>>>
>>>> I'm using storm-0.9.3, on HDP 2.2.0.
>>>>
>>>> Thanks,
>>>> -Jaime
>>>>
>>>
>>>
>>>
>>> --
>>> Name : 임 정택
>>> Blog : http://www.heartsavior.net / http://dev.heartsavior.net
>>> Twitter : http://twitter.com/heartsavior
>>> LinkedIn : http://www.linkedin.com/in/heartsavior
>>>
>>
>

Re: Thrift Error while submitting Topology - Message Length Exceeded

Posted by Jaime Solano <jd...@gmail.com>.

Hi John,
In storm.yaml I found nimbus.thrift.max_buffer_size. But according to
ambari, is a buffer used for reading thrift messages.
Is this the property you were refering to?
Thanks,
-Jaime

On Sat, Jun 27, 2015 at 2:59 PM, John Reilly <jr...@inconspicuous.org> wrote:

> I've seen that before when sending a large Config Map during storm submit.
> There is a config in storm.yaml to set the max thrift message size (can't
> remember it off the top of my head).
>
> On Fri, Jun 26, 2015 at 18:40 임정택 <ka...@gmail.com> wrote:
>
>> Could you provide stack traces about submitting and nimbus?
>>
>> Regards,
>> Jungtaek Lim (HeartSaVioR)
>>
>> 2015-06-27 0:00 GMT+09:00 Jaime Solano <jd...@gmail.com>:
>>
>>> Hi guys,
>>>
>>> I'm new in the list, so I'm not sure if this question has already been
>>> answered. I'm getting the following error while trying to submit a topology:
>>>
>>> org.apache.thrift7.TException: Message length exceeded: 111990.
>>>
>>> I'm using storm-0.9.3, on HDP 2.2.0.
>>>
>>> Thanks,
>>> -Jaime
>>>
>>
>>
>>
>> --
>> Name : 임 정택
>> Blog : http://www.heartsavior.net / http://dev.heartsavior.net
>> Twitter : http://twitter.com/heartsavior
>> LinkedIn : http://www.linkedin.com/in/heartsavior
>>
>

Re: Thrift Error while submitting Topology - Message Length Exceeded

Posted by John Reilly <jr...@inconspicuous.org>.

I've seen that before when sending a large Config Map during storm submit.
There is a config in storm.yaml to set the max thrift message size (can't
remember it off the top of my head).
On Fri, Jun 26, 2015 at 18:40 임정택 <ka...@gmail.com> wrote:

> Could you provide stack traces about submitting and nimbus?
>
> Regards,
> Jungtaek Lim (HeartSaVioR)
>
> 2015-06-27 0:00 GMT+09:00 Jaime Solano <jd...@gmail.com>:
>
>> Hi guys,
>>
>> I'm new in the list, so I'm not sure if this question has already been
>> answered. I'm getting the following error while trying to submit a topology:
>>
>> org.apache.thrift7.TException: Message length exceeded: 111990.
>>
>> I'm using storm-0.9.3, on HDP 2.2.0.
>>
>> Thanks,
>> -Jaime
>>
>
>
>
> --
> Name : 임 정택
> Blog : http://www.heartsavior.net / http://dev.heartsavior.net
> Twitter : http://twitter.com/heartsavior
> LinkedIn : http://www.linkedin.com/in/heartsavior
>

Re: Thrift Error while submitting Topology - Message Length Exceeded

Posted by 임정택 <ka...@gmail.com>.

Could you provide stack traces about submitting and nimbus?

Regards,
Jungtaek Lim (HeartSaVioR)

2015-06-27 0:00 GMT+09:00 Jaime Solano <jd...@gmail.com>:

> Hi guys,
>
> I'm new in the list, so I'm not sure if this question has already been
> answered. I'm getting the following error while trying to submit a topology:
>
> org.apache.thrift7.TException: Message length exceeded: 111990.
>
> I'm using storm-0.9.3, on HDP 2.2.0.
>
> Thanks,
> -Jaime
>



-- 
Name : 임 정택
Blog : http://www.heartsavior.net / http://dev.heartsavior.net
Twitter : http://twitter.com/heartsavior
LinkedIn : http://www.linkedin.com/in/heartsavior