You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by HeartSaVioR <gi...@git.apache.org> on 2017/11/02 22:33:06 UTC

[GitHub] storm issue #2389: [STORM-2693] Storm heartbeats promotion

Github user HeartSaVioR commented on the issue:

    https://github.com/apache/storm/pull/2389
  
    I'm running `mvn clean install -Pall-tests` and seeing some failures. 
    
    In addition, even test itself doesn't fail, I've seen error message which makes me feeling the thing to fix. I'm pasting some of messages to below. Maybe the patch should consider local cluster as well.
    
    ```
    Running org.apache.storm.submitter-test
    Tests run: 1, Passed: 13, Failures: 0, Errors: 0
    47159 [timer] WARN  o.a.s.u.NimbusClient - Ignoring exception while trying to get leader nimbus info from localhost. will retry with a different seed host.
    java.lang.RuntimeException: java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
    	at org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:108) ~[classes/:?]
    	at org.apache.storm.security.auth.ThriftClient.<init>(ThriftClient.java:69) ~[classes/:?]
    	at org.apache.storm.utils.NimbusClient.<init>(NimbusClient.java:127) ~[classes/:?]
    	at org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:83) [classes/:?]
    	at org.apache.storm.utils.NimbusClient.getConfiguredClient(NimbusClient.java:57) [classes/:?]
    	at org.apache.storm.daemon.supervisor.timer.ReportWorkerHeartbeats.reportWorkerHeartbeats(ReportWorkerHeartbeats.java:98) [classes/:?]
    	at org.apache.storm.daemon.supervisor.timer.ReportWorkerHeartbeats.run(ReportWorkerHeartbeats.java:52) [classes/:?]
    	at org.apache.storm.StormTimer$1.run(StormTimer.java:190) [classes/:?]
    	at org.apache.storm.StormTimer$StormTimerTask.run(StormTimer.java:83) [classes/:?]
    Caused by: java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
    	at org.apache.storm.security.auth.TBackoffConnect.retryNext(TBackoffConnect.java:64) ~[classes/:?]
    	at org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:56) ~[classes/:?]
    	at org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:100) ~[classes/:?]
    	... 8 more
    Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
    	at org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[libthrift-0.9.3.jar:0.9.3]
    	at org.apache.thrift.transport.TFramedTransport.open(TFramedTransport.java:81) ~[libthrift-0.9.3.jar:0.9.3]
    	at org.apache.storm.security.auth.SimpleTransportPlugin.connect(SimpleTransportPlugin.java:105) ~[classes/:?]
    	at org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:53) ~[classes/:?]
    	at org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:100) ~[classes/:?]
    	... 8 more
    Caused by: java.net.ConnectException: Connection refused (Connection refused)
    	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_144]
    	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_144]
    	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_144]
    	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_144]
    	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_144]
    	at java.net.Socket.connect(Socket.java:589) ~[?:1.8.0_144]
    	at org.apache.thrift.transport.TSocket.open(TSocket.java:221) ~[libthrift-0.9.3.jar:0.9.3]
    	at org.apache.thrift.transport.TFramedTransport.open(TFramedTransport.java:81) ~[libthrift-0.9.3.jar:0.9.3]
    	at org.apache.storm.security.auth.SimpleTransportPlugin.connect(SimpleTransportPlugin.java:105) ~[classes/:?]
    	at org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:53) ~[classes/:?]
    	at org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:100) ~[classes/:?]
    	... 8 more
    ```
    
    ```
    Running org.apache.storm.submitter-test
    Tests run: 1, Passed: 13, Failures: 0, Errors: 0
    47159 [timer] WARN  o.a.s.u.NimbusClient - Ignoring exception while trying to get leader nimbus info from localhost. will retry with a different seed host.
    java.lang.RuntimeException: java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
    	at org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:108) ~[classes/:?]
    	at org.apache.storm.security.auth.ThriftClient.<init>(ThriftClient.java:69) ~[classes/:?]
    	at org.apache.storm.utils.NimbusClient.<init>(NimbusClient.java:127) ~[classes/:?]
    	at org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:83) [classes/:?]
    	at org.apache.storm.utils.NimbusClient.getConfiguredClient(NimbusClient.java:57) [classes/:?]
    	at org.apache.storm.daemon.supervisor.timer.ReportWorkerHeartbeats.reportWorkerHeartbeats(ReportWorkerHeartbeats.java:98) [classes/:?]
    	at org.apache.storm.daemon.supervisor.timer.ReportWorkerHeartbeats.run(ReportWorkerHeartbeats.java:52) [classes/:?]
    	at org.apache.storm.StormTimer$1.run(StormTimer.java:190) [classes/:?]
    	at org.apache.storm.StormTimer$StormTimerTask.run(StormTimer.java:83) [classes/:?]
    Caused by: java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
    	at org.apache.storm.security.auth.TBackoffConnect.retryNext(TBackoffConnect.java:64) ~[classes/:?]
    	at org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:56) ~[classes/:?]
    	at org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:100) ~[classes/:?]
    	... 8 more
    Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
    	at org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[libthrift-0.9.3.jar:0.9.3]
    	at org.apache.thrift.transport.TFramedTransport.open(TFramedTransport.java:81) ~[libthrift-0.9.3.jar:0.9.3]
    	at org.apache.storm.security.auth.SimpleTransportPlugin.connect(SimpleTransportPlugin.java:105) ~[classes/:?]
    	at org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:53) ~[classes/:?]
    	at org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:100) ~[classes/:?]
    	... 8 more
    Caused by: java.net.ConnectException: Connection refused (Connection refused)
    	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_144]
    	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_144]
    	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_144]
    	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_144]
    	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_144]
    	at java.net.Socket.connect(Socket.java:589) ~[?:1.8.0_144]
    	at org.apache.thrift.transport.TSocket.open(TSocket.java:221) ~[libthrift-0.9.3.jar:0.9.3]
    	at org.apache.thrift.transport.TFramedTransport.open(TFramedTransport.java:81) ~[libthrift-0.9.3.jar:0.9.3]
    	at org.apache.storm.security.auth.SimpleTransportPlugin.connect(SimpleTransportPlugin.java:105) ~[classes/:?]
    	at org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:53) ~[classes/:?]
    	at org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:100) ~[classes/:?]
    	... 8 more
    ```
    
    ```
    Running org.apache.storm.scheduler-test
    47159 [timer] ERROR o.a.s.d.s.t.ReportWorkerHeartbeats - Send worker heartbeats to master exception
    org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts ["localhost"]. Did you specify a valid list of nimbus hosts for config nimbus.seeds?
    	at org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:111) ~[classes/:?]
    	at org.apache.storm.utils.NimbusClient.getConfiguredClient(NimbusClient.java:57) ~[classes/:?]
    	at org.apache.storm.daemon.supervisor.timer.ReportWorkerHeartbeats.reportWorkerHeartbeats(ReportWorkerHeartbeats.java:98) [classes/:?]
    	at org.apache.storm.daemon.supervisor.timer.ReportWorkerHeartbeats.run(ReportWorkerHeartbeats.java:52) [classes/:?]
    	at org.apache.storm.StormTimer$1.run(StormTimer.java:190) [classes/:?]
    	at org.apache.storm.StormTimer$StormTimerTask.run(StormTimer.java:83) [classes/:?]
    ```


---