You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Chandrahas Gurram <ch...@peel.com> on 2014/08/12 09:04:50 UTC
Unable to deploy jar onto nimbus
Hello,
whenever I try to deploy my jar onto nimbus I am getting the following
exception
I am able to login into nimbus and also the port i am using is open.
please help me with this issue.
1198 [main] INFO backtype.storm.StormSubmitter - Jar not uploaded to
master yet. Submitting jar...
1704 [main] INFO backtype.storm.StormSubmitter - Uploading topology jar
storm-sample-0.0.1-SNAPSHOT-jar-with-dependencies.jar to assigned location:
/mnt/storm/nimbus/inbox/stormjar-b2fc636e-fc02-4cda-ab6a-bf06f73dd7c3.jar
Exception in thread "main" java.lang.RuntimeException:
org.apache.thrift7.transport.TTransportException: java.net.SocketException:
Connection reset
at backtype.storm.StormSubmitter.submitJar(StormSubmitter.java:266)
at backtype.storm.StormSubmitter.submitJar(StormSubmitter.java:207)
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:104)
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:70)
at com.peel.kinesisStorm.SampleTopology.main(SampleTopology.java:91)
Caused by: org.apache.thrift7.transport.TTransportException:
java.net.SocketException: Connection reset
at
org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:129)
at
org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
at
org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
at
org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
at
backtype.storm.generated.Nimbus$Client.recv_uploadChunk(Nimbus.java:361)
at backtype.storm.generated.Nimbus$Client.uploadChunk(Nimbus.java:347)
at backtype.storm.StormSubmitter.submitJar(StormSubmitter.java:255)
... 4 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:196)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at
org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 15 more
ThankYou,
G V Chandrahas Raj
Re: Unable to deploy jar onto nimbus
Posted by Chandrahas Gurram <ch...@peel.com>.
Thanks a lot. That worked.
On Saturday, August 16, 2014, Spico Florin <sp...@gmail.com> wrote:
> Hello!
> Check into the nimbus log file a text that o.a.t.s.TNonblockingServer
[ERROR] Read a frame size of , which is bigger than the maximum allowable
buffer size for ALL connections.
> If you find this text your topology has more than the default 1MB size
allowed to be passed with the thrift protocol.
> Solution: in the storm.yaml on the nimbus node increase the parameter
"nimbus.thrift.max_buffer_size" (it is specified in bytes). in order to fit
your topology needs. According to this post
http://qnalist.com/questions/4768442/nimbus-fails-after-uploading-topology-reading-too-large-of-frame-size
(look at the bottom of the page the Adam's response) set up a larger size.
> I hope that these help.
> Good luck.
> Florin
>
> On Fri, Aug 15, 2014 at 6:52 PM, Spico Florin <sp...@gmail.com>
wrote:
>>
>> Hello!
>> How many bolts do you have in the topology? I'm getting the same error
when I have more than 20 bolts in the topology. My cluster configuration is:
>> 1 ZK, 4 Woker Machines. Is there any limitation regarding the number of
bolts in the topology or is due the fact that I have 1 ZK in the topology?
>> Thanks.
>> Florin
>>
>>
>> On Tue, Aug 12, 2014 at 10:04 AM, Chandrahas Gurram <
chandrahas.g@peel.com> wrote:
>>>
>>> Hello,
>>> whenever I try to deploy my jar onto nimbus I am getting the following
exception
>>> I am able to login into nimbus and also the port i am using is open.
>>> please help me with this issue.
>>>
>>> 1198 [main] INFO backtype.storm.StormSubmitter - Jar not uploaded to
master yet. Submitting jar...
>>> 1704 [main] INFO backtype.storm.StormSubmitter - Uploading topology
jar storm-sample-0.0.1-SNAPSHOT-jar-with-dependencies.jar to assigned
location:
/mnt/storm/nimbus/inbox/stormjar-b2fc636e-fc02-4cda-ab6a-bf06f73dd7c3.jar
>>> Exception in thread "main" java.lang.RuntimeException:
org.apache.thrift7.transport.TTransportException: java.net.SocketException:
Connection reset
>>> at backtype.storm.StormSubmitter.submitJar(StormSubmitter.java:266)
>>> at backtype.storm.StormSubmitter.submitJar(StormSubmitter.java:207)
>>> at
backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:104)
>>> at
backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:70)
>>> at com.peel.kinesisStorm.SampleTopology.main(SampleTopology.java:91)
>>> Caused by: org.apache.thrift7.transport.TTransportException:
java.net.SocketException: Connection reset
>>> at
org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
>>> at
org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
>>> at
org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:129)
>>> at
org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
>>> at
org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
>>> at
org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
>>> at
org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
>>> at
org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
>>> at
org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
>>> at
backtype.storm.generated.Nimbus$Client.recv_uploadChunk(Nimbus.java:361)
>>> at
backtype.storm.generated.Nimbus$Client.uploadChunk(Nimbus.java:347)
>>> at backtype.storm.StormSubmitter.submitJar(StormSubmitter.java:255)
>>> ... 4 more
>>> Caused by: java.net.SocketException: Connection reset
>>> at java.net.SocketInputStream.read(SocketInputStream.java:196)
>>> at java.net.SocketInputStream.read(SocketInputStream.java:122)
>>> at
org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
>>> ... 15 more
>>>
>>>
>>> ThankYou,
>>> G V Chandrahas Raj
>
>
--
ThankYou,
G V Chandrahas Raj
Re: Unable to deploy jar onto nimbus
Posted by Spico Florin <sp...@gmail.com>.
Hello!
Check into the nimbus log file a text that o.a.t.s.TNonblockingServer
[ERROR] Read a frame size of , which is bigger than the maximum allowable
buffer size for ALL connections.
If you find this text your topology has more than the default 1MB size
allowed to be passed with the thrift protocol.
Solution: in the storm.yaml on the nimbus node increase the
parameter "nimbus.thrift.max_buffer_size"
(it is specified in bytes). in order to fit your topology needs. According
to this post
http://qnalist.com/questions/4768442/nimbus-fails-after-uploading-topology-reading-too-large-of-frame-size
(look at the bottom of the page the Adam's response) set up a larger size.
I hope that these help.
Good luck.
Florin
On Fri, Aug 15, 2014 at 6:52 PM, Spico Florin <sp...@gmail.com> wrote:
> Hello!
> How many bolts do you have in the topology? I'm getting the same error
> when I have more than 20 bolts in the topology. My cluster configuration is:
> 1 ZK, 4 Woker Machines. Is there any limitation regarding the number of
> bolts in the topology or is due the fact that I have 1 ZK in the topology?
> Thanks.
> Florin
>
>
>
> On Tue, Aug 12, 2014 at 10:04 AM, Chandrahas Gurram <
> chandrahas.g@peel.com> wrote:
>
>> Hello,
>> whenever I try to deploy my jar onto nimbus I am getting the following
>> exception
>> I am able to login into nimbus and also the port i am using is open.
>> please help me with this issue.
>>
>> 1198 [main] INFO backtype.storm.StormSubmitter - Jar not uploaded to
>> master yet. Submitting jar...
>> 1704 [main] INFO backtype.storm.StormSubmitter - Uploading topology jar
>> storm-sample-0.0.1-SNAPSHOT-jar-with-dependencies.jar to assigned location:
>> /mnt/storm/nimbus/inbox/stormjar-b2fc636e-fc02-4cda-ab6a-bf06f73dd7c3.jar
>> Exception in thread "main" java.lang.RuntimeException:
>> org.apache.thrift7.transport.TTransportException: java.net.SocketException:
>> Connection reset
>> at backtype.storm.StormSubmitter.submitJar(StormSubmitter.java:266)
>> at backtype.storm.StormSubmitter.submitJar(StormSubmitter.java:207)
>> at
>> backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:104)
>> at
>> backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:70)
>> at com.peel.kinesisStorm.SampleTopology.main(SampleTopology.java:91)
>> Caused by: org.apache.thrift7.transport.TTransportException:
>> java.net.SocketException: Connection reset
>> at
>> org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
>> at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
>> at
>> org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:129)
>> at
>> org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
>> at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
>> at
>> org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
>> at
>> org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
>> at
>> org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
>> at
>> org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
>> at
>> backtype.storm.generated.Nimbus$Client.recv_uploadChunk(Nimbus.java:361)
>> at backtype.storm.generated.Nimbus$Client.uploadChunk(Nimbus.java:347)
>> at backtype.storm.StormSubmitter.submitJar(StormSubmitter.java:255)
>> ... 4 more
>> Caused by: java.net.SocketException: Connection reset
>> at java.net.SocketInputStream.read(SocketInputStream.java:196)
>> at java.net.SocketInputStream.read(SocketInputStream.java:122)
>> at
>> org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
>> ... 15 more
>>
>>
>> ThankYou,
>> G V Chandrahas Raj
>>
>
>
Re: Unable to deploy jar onto nimbus
Posted by Spico Florin <sp...@gmail.com>.
Hello!
How many bolts do you have in the topology? I'm getting the same error
when I have more than 20 bolts in the topology. My cluster configuration is:
1 ZK, 4 Woker Machines. Is there any limitation regarding the number of
bolts in the topology or is due the fact that I have 1 ZK in the topology?
Thanks.
Florin
On Tue, Aug 12, 2014 at 10:04 AM, Chandrahas Gurram <ch...@peel.com>
wrote:
> Hello,
> whenever I try to deploy my jar onto nimbus I am getting the following
> exception
> I am able to login into nimbus and also the port i am using is open.
> please help me with this issue.
>
> 1198 [main] INFO backtype.storm.StormSubmitter - Jar not uploaded to
> master yet. Submitting jar...
> 1704 [main] INFO backtype.storm.StormSubmitter - Uploading topology jar
> storm-sample-0.0.1-SNAPSHOT-jar-with-dependencies.jar to assigned location:
> /mnt/storm/nimbus/inbox/stormjar-b2fc636e-fc02-4cda-ab6a-bf06f73dd7c3.jar
> Exception in thread "main" java.lang.RuntimeException:
> org.apache.thrift7.transport.TTransportException: java.net.SocketException:
> Connection reset
> at backtype.storm.StormSubmitter.submitJar(StormSubmitter.java:266)
> at backtype.storm.StormSubmitter.submitJar(StormSubmitter.java:207)
> at
> backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:104)
> at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:70)
> at com.peel.kinesisStorm.SampleTopology.main(SampleTopology.java:91)
> Caused by: org.apache.thrift7.transport.TTransportException:
> java.net.SocketException: Connection reset
> at
> org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
> at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
> at
> org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:129)
> at
> org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
> at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
> at
> org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
> at
> org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
> at
> org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
> at
> org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
> at
> backtype.storm.generated.Nimbus$Client.recv_uploadChunk(Nimbus.java:361)
> at backtype.storm.generated.Nimbus$Client.uploadChunk(Nimbus.java:347)
> at backtype.storm.StormSubmitter.submitJar(StormSubmitter.java:255)
> ... 4 more
> Caused by: java.net.SocketException: Connection reset
> at java.net.SocketInputStream.read(SocketInputStream.java:196)
> at java.net.SocketInputStream.read(SocketInputStream.java:122)
> at
> org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
> ... 15 more
>
>
> ThankYou,
> G V Chandrahas Raj
>