You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Stephen Powis <sp...@salesforce.com> on 2016/05/05 17:08:05 UTC

Issue with Storm WebUI - Frame size (X) larger than max length (Y)

 Hey!

We've started getting this error frequently when trying to view our
topology details via the webUI.  Does anyone have any idea how to solve
this?  It seems like if we re-deploy the topology the error goes away (for
awhile) or if we just wait eventually the error will go away (to reappear
again later).


Thanks!

Stephen

Internal Server Error

org.apache.thrift7.transport.TTransportException: Frame size (1124200)
larger than max length (1048576)!
	at org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:137)
	at org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
	at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:86)
	at org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
	at org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
	at org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
	at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
	at backtype.storm.generated.Nimbus$Client.recv_getTopologyInfoWithOpts(Nimbus.java:625)
	at backtype.storm.generated.Nimbus$Client.getTopologyInfoWithOpts(Nimbus.java:611)
	at backtype.storm.ui.core$topology_page.invoke(core.clj:710)
	at backtype.storm.ui.core$fn__9644.invoke(core.clj:976)
	at org.apache.storm.shade.compojure.core$make_route$fn__1829.invoke(core.clj:93)
	at org.apache.storm.shade.compojure.core$if_route$fn__1817.invoke(core.clj:39)
	at org.apache.storm.shade.compojure.core$if_method$fn__1810.invoke(core.clj:24)
	at org.apache.storm.shade.compojure.core$routing$fn__1835.invoke(core.clj:106)
	at clojure.core$some.invoke(core.clj:2515)
	at org.apache.storm.shade.compojure.core$routing.doInvoke(core.clj:106)
	at clojure.lang.RestFn.applyTo(RestFn.java:139)
	at clojure.core$apply.invoke(core.clj:626)
	at org.apache.storm.shade.compojure.core$routes$fn__1839.invoke(core.clj:111)
	at org.apache.storm.shade.ring.middleware.json$wrap_json_params$fn__8916.invoke(json.clj:56)
	at org.apache.storm.shade.ring.middleware.multipart_params$wrap_multipart_params$fn__2889.invoke(multipart_params.clj:103)
	at org.apache.storm.shade.ring.middleware.reload$wrap_reload$fn__3610.invoke(reload.clj:22)
	at backtype.storm.ui.core$catch_errors$fn__9709.invoke(core.clj:1061)
	at org.apache.storm.shade.ring.middleware.keyword_params$wrap_keyword_params$fn__2822.invoke(keyword_params.clj:27)
	at org.apache.storm.shade.ring.middleware.nested_params$wrap_nested_params$fn__2861.invoke(nested_params.clj:65)
	at org.apache.storm.shade.ring.middleware.params$wrap_params$fn__2794.invoke(params.clj:55)
	at org.apache.storm.shade.ring.middleware.multipart_params$wrap_multipart_params$fn__2889.invoke(multipart_params.clj:103)
	at org.apache.storm.shade.ring.middleware.flash$wrap_flash$fn__3070.invoke(flash.clj:14)
	at org.apache.storm.shade.ring.middleware.session$wrap_session$fn__3059.invoke(session.clj:43)
	at org.apache.storm.shade.ring.middleware.cookies$wrap_cookies$fn__2990.invoke(cookies.clj:160)
	at org.apache.storm.shade.ring.util.servlet$make_service_method$fn__2707.invoke(servlet.clj:127)
	at org.apache.storm.shade.ring.util.servlet$servlet$fn__2711.invoke(servlet.clj:136)
	at org.apache.storm.shade.ring.util.servlet.proxy$javax.servlet.http.HttpServlet$ff19274a.service(Unknown
Source)
	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:654)
	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1320)
	at org.apache.storm.shade.org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:247)
	at org.apache.storm.shade.org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:210)
	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1291)
	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:443)
	at org.apache.storm.shade.org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1044)
	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:372)
	at org.apache.storm.shade.org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:978)
	at org.apache.storm.shade.org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
	at org.apache.storm.shade.org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
	at org.apache.storm.shade.org.eclipse.jetty.server.Server.handle(Server.java:369)
	at org.apache.storm.shade.org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:486)
	at org.apache.storm.shade.org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:933)
	at org.apache.storm.shade.org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:995)
	at org.apache.storm.shade.org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:644)
	at org.apache.storm.shade.org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
	at org.apache.storm.shade.org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
	at org.apache.storm.shade.org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:668)
	at org.apache.storm.shade.org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
	at org.apache.storm.shade.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
	at org.apache.storm.shade.org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
	at java.lang.Thread.run(Thread.java:745)

Re: Issue with Storm WebUI - Frame size (X) larger than max length (Y)

Posted by Stephen Powis <sp...@salesforce.com>.
That did the trick!  Thanks! :D

On Thu, May 5, 2016 at 2:16 PM, Stephen Powis <sp...@salesforce.com> wrote:

> Thanks!
>
> On Thu, May 5, 2016 at 2:06 PM, Aditya Rajan <ad...@whizdm.com>
> wrote:
>
>> Hey Stephen,
>>
>>  Increase nimbus.thrift.max_buffer_size in your storm.yaml file and
>> restart the cluster. It should work fine
>>
>> Thanks and Regards
>> Aditya Rajan
>> On May 5, 2016 11:08 PM, "Harsha" <st...@harsha.io> wrote:
>>
>>> HI Stephen,
>>>                Can you try setting ui.header.buffer.bytes to higher
>>> value in storm.yaml.
>>> -Harsha
>>>
>>>
>>> On Thu, May 5, 2016, at 10:08 AM, Stephen Powis wrote:
>>>
>>> Hey!
>>>
>>> We've started getting this error frequently when trying to view our
>>> topology details via the webUI.  Does anyone have any idea how to solve
>>> this?  It seems like if we re-deploy the topology the error goes away (for
>>> awhile) or if we just wait eventually the error will go away (to reappear
>>> again later).
>>>
>>>
>>> Thanks!
>>>
>>> Stephen
>>>
>>> Internal Server Error
>>>
>>> org.apache.thrift7.transport.TTransportException: Frame size (1124200) larger than max length (1048576)!
>>> 	at org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:137)
>>> 	at org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
>>> 	at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:86)
>>> 	at org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
>>> 	at org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
>>> 	at org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
>>> 	at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
>>> 	at backtype.storm.generated.Nimbus$Client.recv_getTopologyInfoWithOpts(Nimbus.java:625)
>>> 	at backtype.storm.generated.Nimbus$Client.getTopologyInfoWithOpts(Nimbus.java:611)
>>> 	at backtype.storm.ui.core$topology_page.invoke(core.clj:710)
>>> 	at backtype.storm.ui.core$fn__9644.invoke(core.clj:976)
>>> 	at org.apache.storm.shade.compojure.core$make_route$fn__1829.invoke(core.clj:93)
>>> 	at org.apache.storm.shade.compojure.core$if_route$fn__1817.invoke(core.clj:39)
>>> 	at org.apache.storm.shade.compojure.core$if_method$fn__1810.invoke(core.clj:24)
>>> 	at org.apache.storm.shade.compojure.core$routing$fn__1835.invoke(core.clj:106)
>>> 	at clojure.core$some.invoke(core.clj:2515)
>>> 	at org.apache.storm.shade.compojure.core$routing.doInvoke(core.clj:106)
>>> 	at clojure.lang.RestFn.applyTo(RestFn.java:139)
>>> 	at clojure.core$apply.invoke(core.clj:626)
>>> 	at org.apache.storm.shade.compojure.core$routes$fn__1839.invoke(core.clj:111)
>>> 	at org.apache.storm.shade.ring.middleware.json$wrap_json_params$fn__8916.invoke(json.clj:56)
>>> 	at org.apache.storm.shade.ring.middleware.multipart_params$wrap_multipart_params$fn__2889.invoke(multipart_params.clj:103)
>>> 	at org.apache.storm.shade.ring.middleware.reload$wrap_reload$fn__3610.invoke(reload.clj:22)
>>> 	at backtype.storm.ui.core$catch_errors$fn__9709.invoke(core.clj:1061)
>>> 	at org.apache.storm.shade.ring.middleware.keyword_params$wrap_keyword_params$fn__2822.invoke(keyword_params.clj:27)
>>> 	at org.apache.storm.shade.ring.middleware.nested_params$wrap_nested_params$fn__2861.invoke(nested_params.clj:65)
>>> 	at org.apache.storm.shade.ring.middleware.params$wrap_params$fn__2794.invoke(params.clj:55)
>>> 	at org.apache.storm.shade.ring.middleware.multipart_params$wrap_multipart_params$fn__2889.invoke(multipart_params.clj:103)
>>> 	at org.apache.storm.shade.ring.middleware.flash$wrap_flash$fn__3070.invoke(flash.clj:14)
>>> 	at org.apache.storm.shade.ring.middleware.session$wrap_session$fn__3059.invoke(session.clj:43)
>>> 	at org.apache.storm.shade.ring.middleware.cookies$wrap_cookies$fn__2990.invoke(cookies.clj:160)
>>> 	at org.apache.storm.shade.ring.util.servlet$make_service_method$fn__2707.invoke(servlet.clj:127)
>>> 	at org.apache.storm.shade.ring.util.servlet$servlet$fn__2711.invoke(servlet.clj:136)
>>> 	at org.apache.storm.shade.ring.util.servlet.proxy$javax.servlet.http.HttpServlet$ff19274a.service(Unknown Source)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:654)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1320)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:247)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:210)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1291)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:443)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1044)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:372)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:978)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.server.Server.handle(Server.java:369)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:486)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:933)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:995)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:644)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:668)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>> 	at org.apache.storm.shade.org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>> 	at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>>
>>
>

Re: Issue with Storm WebUI - Frame size (X) larger than max length (Y)

Posted by Stephen Powis <sp...@salesforce.com>.
Thanks!

On Thu, May 5, 2016 at 2:06 PM, Aditya Rajan <ad...@whizdm.com>
wrote:

> Hey Stephen,
>
>  Increase nimbus.thrift.max_buffer_size in your storm.yaml file and
> restart the cluster. It should work fine
>
> Thanks and Regards
> Aditya Rajan
> On May 5, 2016 11:08 PM, "Harsha" <st...@harsha.io> wrote:
>
>> HI Stephen,
>>                Can you try setting ui.header.buffer.bytes to higher value
>> in storm.yaml.
>> -Harsha
>>
>>
>> On Thu, May 5, 2016, at 10:08 AM, Stephen Powis wrote:
>>
>> Hey!
>>
>> We've started getting this error frequently when trying to view our
>> topology details via the webUI.  Does anyone have any idea how to solve
>> this?  It seems like if we re-deploy the topology the error goes away (for
>> awhile) or if we just wait eventually the error will go away (to reappear
>> again later).
>>
>>
>> Thanks!
>>
>> Stephen
>>
>> Internal Server Error
>>
>> org.apache.thrift7.transport.TTransportException: Frame size (1124200) larger than max length (1048576)!
>> 	at org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:137)
>> 	at org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
>> 	at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:86)
>> 	at org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
>> 	at org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
>> 	at org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
>> 	at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
>> 	at backtype.storm.generated.Nimbus$Client.recv_getTopologyInfoWithOpts(Nimbus.java:625)
>> 	at backtype.storm.generated.Nimbus$Client.getTopologyInfoWithOpts(Nimbus.java:611)
>> 	at backtype.storm.ui.core$topology_page.invoke(core.clj:710)
>> 	at backtype.storm.ui.core$fn__9644.invoke(core.clj:976)
>> 	at org.apache.storm.shade.compojure.core$make_route$fn__1829.invoke(core.clj:93)
>> 	at org.apache.storm.shade.compojure.core$if_route$fn__1817.invoke(core.clj:39)
>> 	at org.apache.storm.shade.compojure.core$if_method$fn__1810.invoke(core.clj:24)
>> 	at org.apache.storm.shade.compojure.core$routing$fn__1835.invoke(core.clj:106)
>> 	at clojure.core$some.invoke(core.clj:2515)
>> 	at org.apache.storm.shade.compojure.core$routing.doInvoke(core.clj:106)
>> 	at clojure.lang.RestFn.applyTo(RestFn.java:139)
>> 	at clojure.core$apply.invoke(core.clj:626)
>> 	at org.apache.storm.shade.compojure.core$routes$fn__1839.invoke(core.clj:111)
>> 	at org.apache.storm.shade.ring.middleware.json$wrap_json_params$fn__8916.invoke(json.clj:56)
>> 	at org.apache.storm.shade.ring.middleware.multipart_params$wrap_multipart_params$fn__2889.invoke(multipart_params.clj:103)
>> 	at org.apache.storm.shade.ring.middleware.reload$wrap_reload$fn__3610.invoke(reload.clj:22)
>> 	at backtype.storm.ui.core$catch_errors$fn__9709.invoke(core.clj:1061)
>> 	at org.apache.storm.shade.ring.middleware.keyword_params$wrap_keyword_params$fn__2822.invoke(keyword_params.clj:27)
>> 	at org.apache.storm.shade.ring.middleware.nested_params$wrap_nested_params$fn__2861.invoke(nested_params.clj:65)
>> 	at org.apache.storm.shade.ring.middleware.params$wrap_params$fn__2794.invoke(params.clj:55)
>> 	at org.apache.storm.shade.ring.middleware.multipart_params$wrap_multipart_params$fn__2889.invoke(multipart_params.clj:103)
>> 	at org.apache.storm.shade.ring.middleware.flash$wrap_flash$fn__3070.invoke(flash.clj:14)
>> 	at org.apache.storm.shade.ring.middleware.session$wrap_session$fn__3059.invoke(session.clj:43)
>> 	at org.apache.storm.shade.ring.middleware.cookies$wrap_cookies$fn__2990.invoke(cookies.clj:160)
>> 	at org.apache.storm.shade.ring.util.servlet$make_service_method$fn__2707.invoke(servlet.clj:127)
>> 	at org.apache.storm.shade.ring.util.servlet$servlet$fn__2711.invoke(servlet.clj:136)
>> 	at org.apache.storm.shade.ring.util.servlet.proxy$javax.servlet.http.HttpServlet$ff19274a.service(Unknown Source)
>> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:654)
>> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1320)
>> 	at org.apache.storm.shade.org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:247)
>> 	at org.apache.storm.shade.org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:210)
>> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1291)
>> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:443)
>> 	at org.apache.storm.shade.org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1044)
>> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:372)
>> 	at org.apache.storm.shade.org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:978)
>> 	at org.apache.storm.shade.org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>> 	at org.apache.storm.shade.org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>> 	at org.apache.storm.shade.org.eclipse.jetty.server.Server.handle(Server.java:369)
>> 	at org.apache.storm.shade.org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:486)
>> 	at org.apache.storm.shade.org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:933)
>> 	at org.apache.storm.shade.org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:995)
>> 	at org.apache.storm.shade.org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:644)
>> 	at org.apache.storm.shade.org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>> 	at org.apache.storm.shade.org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
>> 	at org.apache.storm.shade.org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:668)
>> 	at org.apache.storm.shade.org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
>> 	at org.apache.storm.shade.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>> 	at org.apache.storm.shade.org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>> 	at java.lang.Thread.run(Thread.java:745)
>>
>>
>>
>

Re: Issue with Storm WebUI - Frame size (X) larger than max length (Y)

Posted by Aditya Rajan <ad...@whizdm.com>.
Hey Stephen,

 Increase nimbus.thrift.max_buffer_size in your storm.yaml file and restart
the cluster. It should work fine

Thanks and Regards
Aditya Rajan
On May 5, 2016 11:08 PM, "Harsha" <st...@harsha.io> wrote:

> HI Stephen,
>                Can you try setting ui.header.buffer.bytes to higher value
> in storm.yaml.
> -Harsha
>
>
> On Thu, May 5, 2016, at 10:08 AM, Stephen Powis wrote:
>
> Hey!
>
> We've started getting this error frequently when trying to view our
> topology details via the webUI.  Does anyone have any idea how to solve
> this?  It seems like if we re-deploy the topology the error goes away (for
> awhile) or if we just wait eventually the error will go away (to reappear
> again later).
>
>
> Thanks!
>
> Stephen
>
> Internal Server Error
>
> org.apache.thrift7.transport.TTransportException: Frame size (1124200) larger than max length (1048576)!
> 	at org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:137)
> 	at org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
> 	at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:86)
> 	at org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
> 	at org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
> 	at org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
> 	at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
> 	at backtype.storm.generated.Nimbus$Client.recv_getTopologyInfoWithOpts(Nimbus.java:625)
> 	at backtype.storm.generated.Nimbus$Client.getTopologyInfoWithOpts(Nimbus.java:611)
> 	at backtype.storm.ui.core$topology_page.invoke(core.clj:710)
> 	at backtype.storm.ui.core$fn__9644.invoke(core.clj:976)
> 	at org.apache.storm.shade.compojure.core$make_route$fn__1829.invoke(core.clj:93)
> 	at org.apache.storm.shade.compojure.core$if_route$fn__1817.invoke(core.clj:39)
> 	at org.apache.storm.shade.compojure.core$if_method$fn__1810.invoke(core.clj:24)
> 	at org.apache.storm.shade.compojure.core$routing$fn__1835.invoke(core.clj:106)
> 	at clojure.core$some.invoke(core.clj:2515)
> 	at org.apache.storm.shade.compojure.core$routing.doInvoke(core.clj:106)
> 	at clojure.lang.RestFn.applyTo(RestFn.java:139)
> 	at clojure.core$apply.invoke(core.clj:626)
> 	at org.apache.storm.shade.compojure.core$routes$fn__1839.invoke(core.clj:111)
> 	at org.apache.storm.shade.ring.middleware.json$wrap_json_params$fn__8916.invoke(json.clj:56)
> 	at org.apache.storm.shade.ring.middleware.multipart_params$wrap_multipart_params$fn__2889.invoke(multipart_params.clj:103)
> 	at org.apache.storm.shade.ring.middleware.reload$wrap_reload$fn__3610.invoke(reload.clj:22)
> 	at backtype.storm.ui.core$catch_errors$fn__9709.invoke(core.clj:1061)
> 	at org.apache.storm.shade.ring.middleware.keyword_params$wrap_keyword_params$fn__2822.invoke(keyword_params.clj:27)
> 	at org.apache.storm.shade.ring.middleware.nested_params$wrap_nested_params$fn__2861.invoke(nested_params.clj:65)
> 	at org.apache.storm.shade.ring.middleware.params$wrap_params$fn__2794.invoke(params.clj:55)
> 	at org.apache.storm.shade.ring.middleware.multipart_params$wrap_multipart_params$fn__2889.invoke(multipart_params.clj:103)
> 	at org.apache.storm.shade.ring.middleware.flash$wrap_flash$fn__3070.invoke(flash.clj:14)
> 	at org.apache.storm.shade.ring.middleware.session$wrap_session$fn__3059.invoke(session.clj:43)
> 	at org.apache.storm.shade.ring.middleware.cookies$wrap_cookies$fn__2990.invoke(cookies.clj:160)
> 	at org.apache.storm.shade.ring.util.servlet$make_service_method$fn__2707.invoke(servlet.clj:127)
> 	at org.apache.storm.shade.ring.util.servlet$servlet$fn__2711.invoke(servlet.clj:136)
> 	at org.apache.storm.shade.ring.util.servlet.proxy$javax.servlet.http.HttpServlet$ff19274a.service(Unknown Source)
> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:654)
> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1320)
> 	at org.apache.storm.shade.org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:247)
> 	at org.apache.storm.shade.org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:210)
> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1291)
> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:443)
> 	at org.apache.storm.shade.org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1044)
> 	at org.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:372)
> 	at org.apache.storm.shade.org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:978)
> 	at org.apache.storm.shade.org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
> 	at org.apache.storm.shade.org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
> 	at org.apache.storm.shade.org.eclipse.jetty.server.Server.handle(Server.java:369)
> 	at org.apache.storm.shade.org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:486)
> 	at org.apache.storm.shade.org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:933)
> 	at org.apache.storm.shade.org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:995)
> 	at org.apache.storm.shade.org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:644)
> 	at org.apache.storm.shade.org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
> 	at org.apache.storm.shade.org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
> 	at org.apache.storm.shade.org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:668)
> 	at org.apache.storm.shade.org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
> 	at org.apache.storm.shade.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
> 	at org.apache.storm.shade.org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
> 	at java.lang.Thread.run(Thread.java:745)
>
>
>

Re: Issue with Storm WebUI - Frame size (X) larger than max length (Y)

Posted by Harsha <st...@harsha.io>.
HI Stephen,
Can you try setting ui.header.buffer.bytes to higher value in
storm.yaml.
-Harsha
 
 
On Thu, May 5, 2016, at 10:08 AM, Stephen Powis wrote:
> Hey!
> We've started getting this error frequently when trying to view our
> topology details via the webUI.  Does anyone have any idea how to
> solve this?  It seems like if we re-deploy the topology the error goes
> away (for awhile) or if we just wait eventually the error will go away
> (to reappear again later).
>
> Thanks!
> Stephen
>
> Internal Server Error


> org.apache.thrift7.transport.TTransportException: Frame size (1124200)
> larger than max length (1048576)!      at org.apache.thrift7.transpor-
> t.TFramedTransport.readFrame(TFramedTransport.java:137)   at org.apac-
> he.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
> at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:86)
> at org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtoco-
> l.java:429)        at org.apache.thrift7.protocol.TBinaryProtocol.rea-
> dI32(TBinaryProtocol.java:318)        at org.apache.thrift7.protocol.-
> TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)       at
> org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
> at backtype.storm.generated.Nimbus$Client.recv_getTopologyInfoWithOpt-
> s(Nimbus.java:625)         at backtype.storm.generated.Nimbus$Client.-
> getTopologyInfoWithOpts(Nimbus.java:611)      at
> backtype.storm.ui.core$topology_page.invoke(core.clj:710)    at
> backtype.storm.ui.core$fn__9644.invoke(core.clj:976)         at org.a-
> pache.storm.shade.compojure.core$make_route$fn__1829.invoke(core.clj:-
> 93)        at org.apache.storm.shade.compojure.core$if_route$fn__1817-
> .invoke(core.clj:39)  at org.apache.storm.shade.compojure.core$if_met-
> hod$fn__1810.invoke(core.clj:24)         at org.apache.storm.shade.co-
> mpojure.core$routing$fn__1835.invoke(core.clj:106)  at
> clojure.core$some.invoke(core.clj:2515)      at
> org.apache.storm.shade.compojure.core$routing.doInvoke(core.clj:106)
> at clojure.lang.RestFn.applyTo(RestFn.java:139)         at
> clojure.core$apply.invoke(core.clj:626)      at org.apache.storm.shad-
> e.compojure.core$routes$fn__1839.invoke(core.clj:111)   at org.apache-
> .storm.shade.ring.middleware.json$wrap_json_params$fn__8916.invoke(js-
> on.clj:56)    at org.apache.storm.shade.ring.middleware.multipart_par-
> ams$wrap_multipart_params$fn__2889.invoke(multipart_params.clj:103)
> at org.apache.storm.shade.ring.middleware.reload$wrap_reload$fn__3610-
> .invoke(reload.clj:22)     at
> backtype.storm.ui.core$catch_errors$fn__9709.invoke(core.clj:1061)
> at org.apache.storm.shade.ring.middleware.keyword_params$wrap_keyword-
> _params$fn__2822.invoke(keyword_params.clj:27)     at org.apache.stor-
> m.shade.ring.middleware.nested_params$wrap_nested_params$fn__2861.inv-
> oke(nested_params.clj:65)        at org.apache.storm.shade.ring.middl-
> eware.params$wrap_params$fn__2794.invoke(params.clj:55)     at org.ap-
> ache.storm.shade.ring.middleware.multipart_params$wrap_multipart_para-
> ms$fn__2889.invoke(multipart_params.clj:103)      at org.apache.storm-
> .shade.ring.middleware.flash$wrap_flash$fn__3070.invoke(flash.clj:14)
> at org.apache.storm.shade.ring.middleware.session$wrap_session$fn__30-
> 59.invoke(session.clj:43)  at org.apache.storm.shade.ring.middleware.-
> cookies$wrap_cookies$fn__2990.invoke(cookies.clj:160)         at org.-
> apache.storm.shade.ring.util.servlet$make_service_method$fn__2707.inv-
> oke(servlet.clj:127)        at org.apache.storm.shade.ring.util.servl-
> et$servlet$fn__2711.invoke(servlet.clj:136)    at org.apache.storm.sh-
> ade.ring.util.servlet.proxy$javax.servlet.http.HttpServlet$ff19274a.s-
> ervice(Unknown Source)       at org.apache.storm.shade.org.eclipse.je-
> tty.servlet.ServletHolder.handle(ServletHolder.java:654)        at or-
> g.apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler$CachedC-
> hain.doFilter(ServletHandler.java:1320)       at org.apache.storm.sha-
> de.org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFil-
> ter.java:247)       at org.apache.storm.shade.org.eclipse.jetty.servl-
> ets.CrossOriginFilter.doFilter(CrossOriginFilter.java:210)     at org-
> .apache.storm.shade.org.eclipse.jetty.servlet.ServletHandler$CachedCh-
> ain.doFilter(ServletHandler.java:1291)       at org.apache.storm.shad-
> e.org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.ja-
> va:443)    at org.apache.storm.shade.org.eclipse.jetty.server.handler-
> .ContextHandler.doHandle(ContextHandler.java:1044)    at org.apache.s-
> torm.shade.org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHa-
> ndler.java:372)     at org.apache.storm.shade.org.eclipse.jetty.serve-
> r.handler.ContextHandler.doScope(ContextHandler.java:978)      at org-
> .apache.storm.shade.org.eclipse.jetty.server.handler.ScopedHandler.ha-
> ndle(ScopedHandler.java:135)         at org.apache.storm.shade.org.ec-
> lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:-
> 116)       at org.apache.storm.shade.org.eclipse.jetty.server.Server.-
> handle(Server.java:369)       at org.apache.storm.shade.org.eclipse.j-
> etty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnecti-
> on.java:486)        at org.apache.storm.shade.org.eclipse.jetty.serve-
> r.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:9-
> 33)       at org.apache.storm.shade.org.eclipse.jetty.server.Abstract-
> HttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.j-
> ava:995)        at org.apache.storm.shade.org.eclipse.jetty.http.Http-
> Parser.parseNext(HttpParser.java:644)      at org.apache.storm.shade.-
> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
> at org.apache.storm.shade.org.eclipse.jetty.server.AsyncHttpConnectio-
> n.handle(AsyncHttpConnection.java:82)      at org.apache.storm.shade.-
> org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEn-
> dPoint.java:668)         at org.apache.storm.shade.org.eclipse.jetty.-
> io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)   at
> org.apache.storm.shade.org.eclipse.jetty.util.thread.QueuedThreadPool-
> .runJob(QueuedThreadPool.java:608)      at org.apache.storm.shade.org-
> .eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.ja-
> va:543)       at java.lang.Thread.run(Thread.java:745)
>