You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Ajeesh <aj...@gmail.com> on 2018/03/07 12:59:50 UTC

Transport Exception: Broken pipe exception while submitting topology

I have upgraded storm version 1.2.1, I am getting the below exception while
submitting the topology.

58946 [pool-7-thread-1] WARN  o.a.s.u.StormBoundedExponentialBackoffRetry -
WILL SLEEP FOR 2001ms (NOT MAX)
60948 [pool-7-thread-1] WARN  o.a.s.u.StormBoundedExponentialBackoffRetry -
WILL SLEEP FOR 2002ms (NOT MAX)
62951 [pool-7-thread-1] WARN  o.a.s.u.StormBoundedExponentialBackoffRetry -
WILL SLEEP FOR 2007ms (NOT MAX)
64960 [pool-7-thread-1] WARN  o.a.s.u.StormBoundedExponentialBackoffRetry -
WILL SLEEP FOR 2014ms (NOT MAX)
66975 [pool-7-thread-1] WARN  o.a.s.u.StormBoundedExponentialBackoffRetry -
WILL SLEEP FOR 2025ms (NOT MAX)
69001 [pool-7-thread-1] WARN  o.a.s.u.NimbusClient - Ignoring exception
while trying to get leader nimbus info from <ip>. will retry with a
different seed host.
java.lang.RuntimeException: java.lang.RuntimeException:
org.apache.storm.thrift.transport.TTransportException:
java.net.SocketException: Broken pipe
        at
org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:112)
~[storm-core-1.2.1.jar:1.2.1]
        at
org.apache.storm.security.auth.ThriftClient.<init>(ThriftClient.java:73)
~[storm-core-1.2.1.jar:1.2.1]
        at
org.apache.storm.utils.NimbusClient.<init>(NimbusClient.java:136)
~[storm-core-1.2.1.jar:1.2.1]
        at
org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:92)
[storm-core-1.2.1.jar:1.2.1]
        at
org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:66)
[storm-core-1.2.1.jar:1.2.1]
        at
org.apache.storm.utils.NimbusClient.getConfiguredClient(NimbusClient.java:58)
[storm-core-1.2.1.jar:1.2.1]
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[?:1.7.0_79]
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[?:1.7.0_79]
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[?:1.7.0_79]
        at java.lang.Thread.run(Thread.java:745) [?:1.7.0_79]
Caused by: java.lang.RuntimeException:
org.apache.storm.thrift.transport.TTransportException:
java.net.SocketException: Broken pipe
        at
org.apache.storm.security.auth.TBackoffConnect.retryNext(TBackoffConnect.java:64)
~[storm-core-1.2.1.jar:1.2.1]
        at
org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:56)
~[storm-core-1.2.1.jar:1.2.1]
        at
org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:104)
~[storm-core-1.2.1.jar:1.2.1]
        ... 16 more

After checking nimbus log I could find the below error message,

 o.a.s.t.s.AbstractNonblockingServer$FrameBuffer Thread-9 [ERROR] Read a
frame size of 16777216, which is bigger than the maximum allowable buffer
size for ALL connections.

Any suggestions will be most helpful? I have created an SO question "
https://stackoverflow.com/questions/49152254/apache-storm-1-2-1-transport-exception-broken-pipe
"