You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by "Robert Joseph Evans (JIRA)" <ji...@apache.org> on 2015/10/14 21:47:05 UTC

[jira] [Commented] (STORM-982) Random test failures on backtype.storm.grouping-test

    [ https://issues.apache.org/jira/browse/STORM-982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957609#comment-14957609 ] 

Robert Joseph Evans commented on STORM-982:
-------------------------------------------

This is a race condition between nimbus and the worker.  The worker is writing heartbeats, but nimbus has decided the topology is gone and cleaned up zookeeper.  I'm not sure the best thing to do, because this is arguably a desired behavior, the topology is gone and the worker didn't get the message yet through the normal path.

> Random test failures on backtype.storm.grouping-test
> ----------------------------------------------------
>
>                 Key: STORM-982
>                 URL: https://issues.apache.org/jira/browse/STORM-982
>             Project: Apache Storm
>          Issue Type: Sub-task
>          Components: storm-core
>            Reporter: Jungtaek Lim
>
> {code}
> Error parsing /home/travis/build/HeartSaVioR/storm/storm-core/target/test-reports/backtype.storm.grouping-test.xml
> <?xml version="1.0" encoding="UTF-8"?>
> <testsuites>
>     <testsuite package="backtype.storm" name="grouping-test">
>         <testcase name="test-custom-groupings" classname="backtype.storm.grouping-test">
>             <system-out>
> <![CDATA[119127 [main] INFO  b.s.zookeeper - Starting inprocess zookeeper at port 2002 and dir /tmp/da732832-bada-4305-9132-e4b0e2de0e5b
> 119130 [main] INFO  b.s.u.Utils - Using defaults.yaml from resources
> 119139 [main] INFO  b.s.d.nimbus - Starting Nimbus with conf {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" 1, "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "zmq.threads" 1, "storm.group.mapping.service" "backtype.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" 1, "drpc.invocations.port" 3773, "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" 1, "topology.max.error.report.per.interval" 5, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0, "storm.principal.tolocal" "backtype.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" 1, "storm.zookeeper.retry.times" 5, "ui.actions.enabled" true, "zmq.linger.millis" 0, "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2002, "supervisor.heartbeat.frequency.secs" 5, "topology.enable.message.timeouts" false, "drpc.worker.threads" 64, "drpc.queue.size" 128, "drpc.https.keystore.password" "", "logviewer.port" 8000, "nimbus.reassign" true, "topology.executor.send.buffer.size" 1024, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" 2000, "nimbus.inbox.jar.expiration.secs" 3600, "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" 64, "logviewer.cleanup.age.mins" 10080, "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" 3, "nimbus.credential.renewers.freq.secs" 600, "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "storm.group.mapping.service.cache.duration.secs" 120, "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10, "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1, "storm.local.dir" "/tmp/855275ea-e2eb-456c-a8f0-50fcc178969f", "worker.childopts" "-Xmx768m", "storm.auth.simple-white-list.users" [], "topology.message.timeout.secs" 30, "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "storm.messaging.netty.max_retries" 300, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "backtype.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "backtype.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "nimbus.supervisor.timeout.secs" 60, "nimbus.task.timeout.secs" 30, "drpc.port" 3772, "storm.zookeeper.retry.intervalceiling.millis" 30000, "nimbus.thrift.port" 6627, "storm.auth.simple-acl.admins" [], "storm.nimbus.retry.times" 5, "supervisor.worker.start.timeout.secs" 120, "storm.zookeeper.retry.interval" 1000, "logs.users" nil, "transactional.zookeeper.port" nil, "drpc.max_buffer_size" 1048576, "task.credentials.poll.secs" 30, "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" 1, "supervisor.slots.ports" [6700 6701 6702 6703], "topology.transfer.buffer.size" 1024, "topology.worker.shared.thread.pool.size" 4, "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" 600, "topology.executor.receive.buffer.size" 1024, "nimbus.task.launch.secs" 120, "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" 5242880, "worker.heartbeat.frequency.secs" 1, "ui.http.creds.plugin" "backtype.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -1, "task.refresh.poll.secs" 10, "task.heartbeat.frequency.secs" 3, "storm.messaging.netty.max_wait_ms" 1000, "drpc.http.port" 3774, "topology.error.throttle.interval.secs" 10, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "nimbus.cleanup.inbox.freq.secs" 600, "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30, "storm.zookeeper.auth.password" nil, "supervisor.childopts" "-Xmx256m", "ui.filter" nil, "ui.header.buffer.bytes" 4096, "topology.disruptor.wait.timeout.millis" 1000, "storm.nimbus.retry.intervalceiling.millis" 60000, "topology.trident.batch.emit.interval.millis" 50, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080, "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" 1048576, "nimbus.host" "localhost", "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600}
> 119139 [main] INFO  b.s.d.nimbus - Using default scheduler
> 119140 [main] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119146 [main-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
> 119146 [main-EventThread] INFO  b.s.zookeeper - Zookeeper state update: :connected:none
> 119150 [main] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119152 [main-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
> 119158 [main] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119160 [main-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
> 119161 [main-EventThread] INFO  b.s.zookeeper - Zookeeper state update: :connected:none
> 119162 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2002] WARN  o.a.z.s.NIOServerCnxn - caught end of stream exception
> org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client sessionid 0x14f1cc844830002, likely client has closed socket
> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) [zookeeper-3.4.6.jar:3.4.6-1569965]
> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) [zookeeper-3.4.6.jar:3.4.6-1569965]
> 	at java.lang.Thread.run(Thread.java:745) [?:1.7.0_76]
> 119162 [main] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119164 [main] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119164 [main-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
> 119166 [main-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
> 119166 [main-EventThread] INFO  b.s.zookeeper - Zookeeper state update: :connected:none
> 119168 [main] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119170 [main-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
> 119174 [main] INFO  b.s.d.supervisor - Starting Supervisor with conf {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" 1, "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "zmq.threads" 1, "storm.group.mapping.service" "backtype.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" 1, "drpc.invocations.port" 3773, "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" 1, "topology.max.error.report.per.interval" 5, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0, "storm.principal.tolocal" "backtype.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" 1, "storm.zookeeper.retry.times" 5, "ui.actions.enabled" true, "zmq.linger.millis" 0, "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2002, "supervisor.heartbeat.frequency.secs" 5, "topology.enable.message.timeouts" false, "drpc.worker.threads" 64, "drpc.queue.size" 128, "drpc.https.keystore.password" "", "logviewer.port" 8000, "nimbus.reassign" true, "topology.executor.send.buffer.size" 1024, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" 2000, "nimbus.inbox.jar.expiration.secs" 3600, "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" 64, "logviewer.cleanup.age.mins" 10080, "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" 3, "nimbus.credential.renewers.freq.secs" 600, "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "storm.group.mapping.service.cache.duration.secs" 120, "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10, "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1, "storm.local.dir" "/tmp/b74f8021-d3c3-48ff-a172-bb649daedd96", "worker.childopts" "-Xmx768m", "storm.auth.simple-white-list.users" [], "topology.message.timeout.secs" 30, "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "storm.messaging.netty.max_retries" 300, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "backtype.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "backtype.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "nimbus.supervisor.timeout.secs" 60, "nimbus.task.timeout.secs" 30, "drpc.port" 3772, "storm.zookeeper.retry.intervalceiling.millis" 30000, "nimbus.thrift.port" 6627, "storm.auth.simple-acl.admins" [], "storm.nimbus.retry.times" 5, "supervisor.worker.start.timeout.secs" 120, "storm.zookeeper.retry.interval" 1000, "logs.users" nil, "transactional.zookeeper.port" nil, "drpc.max_buffer_size" 1048576, "task.credentials.poll.secs" 30, "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" 1, "supervisor.slots.ports" (1024 1025 1026), "topology.transfer.buffer.size" 1024, "topology.worker.shared.thread.pool.size" 4, "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" 600, "topology.executor.receive.buffer.size" 1024, "nimbus.task.launch.secs" 120, "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" 5242880, "worker.heartbeat.frequency.secs" 1, "ui.http.creds.plugin" "backtype.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -1, "task.refresh.poll.secs" 10, "task.heartbeat.frequency.secs" 3, "storm.messaging.netty.max_wait_ms" 1000, "drpc.http.port" 3774, "topology.error.throttle.interval.secs" 10, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "nimbus.cleanup.inbox.freq.secs" 600, "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30, "storm.zookeeper.auth.password" nil, "supervisor.childopts" "-Xmx256m", "ui.filter" nil, "ui.header.buffer.bytes" 4096, "topology.disruptor.wait.timeout.millis" 1000, "storm.nimbus.retry.intervalceiling.millis" 60000, "topology.trident.batch.emit.interval.millis" 50, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080, "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" 1048576, "nimbus.host" "localhost", "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600}
> 119176 [main] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119177 [main-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
> 119178 [main-EventThread] INFO  b.s.zookeeper - Zookeeper state update: :connected:none
> 119179 [main] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119181 [main-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
> 119186 [main] INFO  b.s.d.supervisor - Starting supervisor with id a675baeb-c40f-4589-a33b-d828ea24e42b at host localhost
> 119188 [main] INFO  b.s.d.supervisor - Starting Supervisor with conf {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" 1, "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "zmq.threads" 1, "storm.group.mapping.service" "backtype.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" 1, "drpc.invocations.port" 3773, "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" 1, "topology.max.error.report.per.interval" 5, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0, "storm.principal.tolocal" "backtype.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" 1, "storm.zookeeper.retry.times" 5, "ui.actions.enabled" true, "zmq.linger.millis" 0, "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2002, "supervisor.heartbeat.frequency.secs" 5, "topology.enable.message.timeouts" false, "drpc.worker.threads" 64, "drpc.queue.size" 128, "drpc.https.keystore.password" "", "logviewer.port" 8000, "nimbus.reassign" true, "topology.executor.send.buffer.size" 1024, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" 2000, "nimbus.inbox.jar.expiration.secs" 3600, "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" 64, "logviewer.cleanup.age.mins" 10080, "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" 3, "nimbus.credential.renewers.freq.secs" 600, "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "storm.group.mapping.service.cache.duration.secs" 120, "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10, "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1, "storm.local.dir" "/tmp/94b40e92-cc7a-4bcb-aab3-cb6be4f31a87", "worker.childopts" "-Xmx768m", "storm.auth.simple-white-list.users" [], "topology.message.timeout.secs" 30, "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "storm.messaging.netty.max_retries" 300, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "backtype.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "backtype.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "nimbus.supervisor.timeout.secs" 60, "nimbus.task.timeout.secs" 30, "drpc.port" 3772, "storm.zookeeper.retry.intervalceiling.millis" 30000, "nimbus.thrift.port" 6627, "storm.auth.simple-acl.admins" [], "storm.nimbus.retry.times" 5, "supervisor.worker.start.timeout.secs" 120, "storm.zookeeper.retry.interval" 1000, "logs.users" nil, "transactional.zookeeper.port" nil, "drpc.max_buffer_size" 1048576, "task.credentials.poll.secs" 30, "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" 1, "supervisor.slots.ports" (1027 1028 1029), "topology.transfer.buffer.size" 1024, "topology.worker.shared.thread.pool.size" 4, "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" 600, "topology.executor.receive.buffer.size" 1024, "nimbus.task.launch.secs" 120, "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" 5242880, "worker.heartbeat.frequency.secs" 1, "ui.http.creds.plugin" "backtype.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -1, "task.refresh.poll.secs" 10, "task.heartbeat.frequency.secs" 3, "storm.messaging.netty.max_wait_ms" 1000, "drpc.http.port" 3774, "topology.error.throttle.interval.secs" 10, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "nimbus.cleanup.inbox.freq.secs" 600, "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30, "storm.zookeeper.auth.password" nil, "supervisor.childopts" "-Xmx256m", "ui.filter" nil, "ui.header.buffer.bytes" 4096, "topology.disruptor.wait.timeout.millis" 1000, "storm.nimbus.retry.intervalceiling.millis" 60000, "topology.trident.batch.emit.interval.millis" 50, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080, "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" 1048576, "nimbus.host" "localhost", "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600}
> 119189 [main] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119191 [main-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
> 119191 [main-EventThread] INFO  b.s.zookeeper - Zookeeper state update: :connected:none
> 119193 [main] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119195 [main-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
> 119199 [main] INFO  b.s.d.supervisor - Starting supervisor with id 392aa8b2-1060-4cc0-b938-8dfe090ce254 at host localhost
> 119213 [main] INFO  b.s.d.nimbus - [req 1] Access from:  principal: op:submitTopology
> 119217 [main] INFO  b.s.d.nimbus - Received topology submission for topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef with conf {"topology.max.task.parallelism" nil, "topology.submitter.principal" "", "topology.acker.executors" nil, "storm.zookeeper.superACL" nil, "topology.users" (), "topology.submitter.user" "", "topology.kryo.register" nil, "topology.kryo.decorators" (), "storm.id" "topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0", "topology.name" "topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef"}
> 119220 [main] INFO  b.s.d.nimbus - nimbus file location:/tmp/855275ea-e2eb-456c-a8f0-50fcc178969f/nimbus/stormdist/topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0
> 119228 [main] INFO  b.s.d.nimbus - Activating topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef: topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0
> 119250 [main] INFO  b.s.s.EvenScheduler - Available slots: (["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1025] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1026] ["392aa8b2-1060-4cc0-b938-8dfe090ce254" 1027] ["392aa8b2-1060-4cc0-b938-8dfe090ce254" 1028] ["392aa8b2-1060-4cc0-b938-8dfe090ce254" 1029])
> 119253 [main] INFO  b.s.d.nimbus - Setting new assignment for topology id topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0: #backtype.storm.daemon.common.Assignment{:master-code-dir "/tmp/855275ea-e2eb-456c-a8f0-50fcc178969f/nimbus/stormdist/topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0", :node->host {"a675baeb-c40f-4589-a33b-d828ea24e42b" "localhost"}, :executor->node+port {[8 8] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [12 12] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [2 2] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [7 7] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [3 3] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [1 1] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [6 6] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [9 9] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [11 11] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [13 13] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [5 5] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [10 10] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024], [4 4] ["a675baeb-c40f-4589-a33b-d828ea24e42b" 1024]}, :executor->start-time-secs {[8 8] 0, [12 12] 0, [2 2] 0, [7 7] 0, [3 3] 0, [1 1] 0, [6 6] 0, [9 9] 0, [11 11] 0, [13 13] 0, [5 5] 0, [10 10] 0, [4 4] 0}}
> 119271 [Thread-745] INFO  b.s.d.supervisor - Copying resources at file:/home/travis/build/HeartSaVioR/storm/storm-core/target/test-classes/resources to /tmp/b74f8021-d3c3-48ff-a172-bb649daedd96/supervisor/stormdist/topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0/resources
> 119276 [Thread-746] INFO  b.s.d.supervisor - Launching worker with assignment {:storm-id "topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0", :executors [[8 8] [12 12] [2 2] [7 7] [3 3] [1 1] [6 6] [9 9] [11 11] [13 13] [5 5] [10 10] [4 4]]} for this supervisor a675baeb-c40f-4589-a33b-d828ea24e42b on port 1024 with id a1dfcef2-be80-43b9-841f-93a170d3f96a
> 119277 [Thread-746] INFO  b.s.d.worker - Launching worker for topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0 on a675baeb-c40f-4589-a33b-d828ea24e42b:1024 with id a1dfcef2-be80-43b9-841f-93a170d3f96a and conf {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" 1, "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "zmq.threads" 1, "storm.group.mapping.service" "backtype.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" 1, "drpc.invocations.port" 3773, "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" 1, "topology.max.error.report.per.interval" 5, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0, "storm.principal.tolocal" "backtype.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" 1, "storm.zookeeper.retry.times" 5, "ui.actions.enabled" true, "zmq.linger.millis" 0, "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2002, "supervisor.heartbeat.frequency.secs" 5, "topology.enable.message.timeouts" false, "drpc.worker.threads" 64, "drpc.queue.size" 128, "drpc.https.keystore.password" "", "logviewer.port" 8000, "nimbus.reassign" true, "topology.executor.send.buffer.size" 1024, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" 2000, "nimbus.inbox.jar.expiration.secs" 3600, "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" 64, "logviewer.cleanup.age.mins" 10080, "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" 3, "nimbus.credential.renewers.freq.secs" 600, "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "storm.group.mapping.service.cache.duration.secs" 120, "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10, "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1, "storm.local.dir" "/tmp/b74f8021-d3c3-48ff-a172-bb649daedd96", "worker.childopts" "-Xmx768m", "storm.auth.simple-white-list.users" [], "topology.message.timeout.secs" 30, "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "storm.messaging.netty.max_retries" 300, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "backtype.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "backtype.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "nimbus.supervisor.timeout.secs" 60, "nimbus.task.timeout.secs" 30, "drpc.port" 3772, "storm.zookeeper.retry.intervalceiling.millis" 30000, "nimbus.thrift.port" 6627, "storm.auth.simple-acl.admins" [], "storm.nimbus.retry.times" 5, "supervisor.worker.start.timeout.secs" 120, "storm.zookeeper.retry.interval" 1000, "logs.users" nil, "transactional.zookeeper.port" nil, "drpc.max_buffer_size" 1048576, "task.credentials.poll.secs" 30, "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" 1, "supervisor.slots.ports" (1024 1025 1026), "topology.transfer.buffer.size" 1024, "topology.worker.shared.thread.pool.size" 4, "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" 600, "topology.executor.receive.buffer.size" 1024, "nimbus.task.launch.secs" 120, "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" 5242880, "worker.heartbeat.frequency.secs" 1, "ui.http.creds.plugin" "backtype.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -1, "task.refresh.poll.secs" 10, "task.heartbeat.frequency.secs" 3, "storm.messaging.netty.max_wait_ms" 1000, "drpc.http.port" 3774, "topology.error.throttle.interval.secs" 10, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "nimbus.cleanup.inbox.freq.secs" 600, "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30, "storm.zookeeper.auth.password" nil, "supervisor.childopts" "-Xmx256m", "ui.filter" nil, "ui.header.buffer.bytes" 4096, "topology.disruptor.wait.timeout.millis" 1000, "storm.nimbus.retry.intervalceiling.millis" 60000, "topology.trident.batch.emit.interval.millis" 50, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080, "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" 1048576, "nimbus.host" "localhost", "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600}
> 119279 [Thread-746] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119281 [Thread-746-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
> 119281 [Thread-746-EventThread] INFO  b.s.zookeeper - Zookeeper state update: :connected:none
> 119283 [Thread-746] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
> 119285 [Thread-746-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
> 119289 [Thread-746] INFO  b.s.s.a.AuthUtils - Got AutoCreds []
> 119289 [Thread-746] INFO  b.s.d.worker - Reading Assignments.
> 119304 [Thread-746] INFO  b.s.d.worker - Launching receive-thread for a675baeb-c40f-4589-a33b-d828ea24e42b:1024
> 119304 [Thread-749-worker-receiver-thread-0] INFO  b.s.m.loader - Starting receive-thread: [stormId: topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0, port: 1024, thread-id: 0 ]
> 119316 [Thread-746] INFO  b.s.d.executor - Loading executor 3:[8 8]
> 119318 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks 3:[8 8]
> 119319 [Thread-746] INFO  b.s.d.executor - Finished loading executor 3:[8 8]
> 119324 [Thread-746] INFO  b.s.d.executor - Loading executor 7db2538f-2c23-487a-9a75-1afda66c6134:[12 12]
> 119324 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks 7db2538f-2c23-487a-9a75-1afda66c6134:[12 12]
> 119326 [Thread-746] INFO  b.s.d.executor - Finished loading executor 7db2538f-2c23-487a-9a75-1afda66c6134:[12 12]
> 119330 [Thread-746] INFO  b.s.d.executor - Loading executor 2:[2 2]
> 119332 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks 2:[2 2]
> 119333 [Thread-746] INFO  b.s.d.executor - Finished loading executor 2:[2 2]
> 119337 [Thread-746] INFO  b.s.d.executor - Loading executor 3:[7 7]
> 119339 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks 3:[7 7]
> 119341 [Thread-746] INFO  b.s.d.executor - Finished loading executor 3:[7 7]
> 119345 [Thread-746] INFO  b.s.d.executor - Loading executor 2:[3 3]
> 119346 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks 2:[3 3]
> 119348 [Thread-746] INFO  b.s.d.executor - Finished loading executor 2:[3 3]
> 119355 [Thread-746] INFO  b.s.d.executor - Loading executor 1:[1 1]
> 119356 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks 1:[1 1]
> 119359 [Thread-746] INFO  b.s.d.executor - Timeouts disabled for executor 1:[1 1]
> 119359 [Thread-746] INFO  b.s.d.executor - Finished loading executor 1:[1 1]
> 119363 [Thread-746] INFO  b.s.d.executor - Loading executor 3:[6 6]
> 119365 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks 3:[6 6]
> 119367 [Thread-746] INFO  b.s.d.executor - Finished loading executor 3:[6 6]
> 119371 [Thread-746] INFO  b.s.d.executor - Loading executor 3:[9 9]
> 119373 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks 3:[9 9]
> 119374 [Thread-746] INFO  b.s.d.executor - Finished loading executor 3:[9 9]
> 119379 [Thread-746] INFO  b.s.d.executor - Loading executor 3:[11 11]
> 119380 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks 3:[11 11]
> 119382 [Thread-746] INFO  b.s.d.executor - Finished loading executor 3:[11 11]
> 119386 [Thread-746] INFO  b.s.d.executor - Loading executor __system:[-1 -1]
> 119386 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks __system:[-1 -1]
> 119388 [Thread-746] INFO  b.s.d.executor - Finished loading executor __system:[-1 -1]
> 119391 [Thread-746] INFO  b.s.d.executor - Loading executor __acker:[13 13]
> 119392 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks __acker:[13 13]
> 119393 [Thread-746] INFO  b.s.d.executor - Timeouts disabled for executor __acker:[13 13]
> 119394 [Thread-746] INFO  b.s.d.executor - Finished loading executor __acker:[13 13]
> 119397 [Thread-746] INFO  b.s.d.executor - Loading executor 2:[5 5]
> 119399 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks 2:[5 5]
> 119401 [Thread-746] INFO  b.s.d.executor - Finished loading executor 2:[5 5]
> 119405 [Thread-746] INFO  b.s.d.executor - Loading executor 3:[10 10]
> 119406 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks 3:[10 10]
> 119408 [Thread-746] INFO  b.s.d.executor - Finished loading executor 3:[10 10]
> 119412 [Thread-746] INFO  b.s.d.executor - Loading executor 2:[4 4]
> 119414 [Thread-746] INFO  b.s.d.executor - Loaded executor tasks 2:[4 4]
> 119416 [Thread-746] INFO  b.s.d.executor - Finished loading executor 2:[4 4]
> 119419 [Thread-746] INFO  b.s.d.worker - Worker has topology config {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" 1, "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "zmq.threads" 1, "storm.group.mapping.service" "backtype.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" 1, "drpc.invocations.port" 3773, "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" 1, "topology.max.error.report.per.interval" 5, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0, "storm.principal.tolocal" "backtype.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" 1, "storm.zookeeper.retry.times" 5, "ui.actions.enabled" true, "zmq.linger.millis" 0, "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2002, "supervisor.heartbeat.frequency.secs" 5, "topology.enable.message.timeouts" false, "drpc.worker.threads" 64, "drpc.queue.size" 128, "drpc.https.keystore.password" "", "logviewer.port" 8000, "nimbus.reassign" true, "topology.executor.send.buffer.size" 1024, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "topology.submitter.principal" "", "storm.nimbus.retry.interval.millis" 2000, "nimbus.inbox.jar.expiration.secs" 3600, "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" 64, "logviewer.cleanup.age.mins" 10080, "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" 3, "nimbus.credential.renewers.freq.secs" 600, "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "storm.group.mapping.service.cache.duration.secs" 120, "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10, "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1, "storm.local.dir" "/tmp/b74f8021-d3c3-48ff-a172-bb649daedd96", "worker.childopts" "-Xmx768m", "storm.auth.simple-white-list.users" [], "topology.message.timeout.secs" 30, "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "storm.messaging.netty.max_retries" 300, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "backtype.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "backtype.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "nimbus.supervisor.timeout.secs" 60, "nimbus.task.timeout.secs" 30, "storm.zookeeper.superACL" nil, "drpc.port" 3772, "storm.zookeeper.retry.intervalceiling.millis" 30000, "nimbus.thrift.port" 6627, "storm.auth.simple-acl.admins" [], "storm.nimbus.retry.times" 5, "supervisor.worker.start.timeout.secs" 120, "storm.zookeeper.retry.interval" 1000, "logs.users" nil, "transactional.zookeeper.port" nil, "drpc.max_buffer_size" 1048576, "task.credentials.poll.secs" 30, "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" 1, "supervisor.slots.ports" (1024 1025 1026), "topology.transfer.buffer.size" 1024, "topology.worker.shared.thread.pool.size" 4, "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" 600, "topology.executor.receive.buffer.size" 1024, "topology.users" [], "nimbus.task.launch.secs" 120, "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" 5242880, "worker.heartbeat.frequency.secs" 1, "ui.http.creds.plugin" "backtype.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.submitter.user" "", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -1, "task.refresh.poll.secs" 10, "task.heartbeat.frequency.secs" 3, "storm.messaging.netty.max_wait_ms" 1000, "drpc.http.port" 3774, "topology.error.throttle.interval.secs" 10, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "topology.kryo.register" nil, "worker.gc.childopts" "", "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "nimbus.cleanup.inbox.freq.secs" 600, "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30, "storm.zookeeper.auth.password" nil, "supervisor.childopts" "-Xmx256m", "ui.filter" nil, "ui.header.buffer.bytes" 4096, "topology.disruptor.wait.timeout.millis" 1000, "storm.nimbus.retry.intervalceiling.millis" 60000, "topology.trident.batch.emit.interval.millis" 50, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080, "topology.kryo.decorators" [], "storm.id" "topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0", "topology.name" "topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef", "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" 1048576, "nimbus.host" "localhost", "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600}
> 119419 [Thread-746] INFO  b.s.d.worker - Worker a1dfcef2-be80-43b9-841f-93a170d3f96a for storm topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0 on a675baeb-c40f-4589-a33b-d828ea24e42b:1024 has finished loading
> 119419 [Thread-746] INFO  b.s.config - SET worker-user a1dfcef2-be80-43b9-841f-93a170d3f96a 
> 119438 [refresh-active-timer] INFO  b.s.d.worker - All connections are ready for worker a675baeb-c40f-4589-a33b-d828ea24e42b:1024 with id a1dfcef2-be80-43b9-841f-93a170d3f96a
> 119441 [Thread-757-3] INFO  b.s.d.executor - Preparing bolt 3:(7)
> 119443 [Thread-757-3] INFO  b.s.d.executor - Prepared bolt 3:(7)
> 119448 [Thread-759-2] INFO  b.s.d.executor - Preparing bolt 2:(3)
> 119450 [Thread-759-2] INFO  b.s.d.executor - Prepared bolt 2:(3)
> 119459 [Thread-761-1] INFO  b.s.d.executor - Opening spout 1:(1)
> 119459 [Thread-761-1] INFO  b.s.d.executor - Opened spout 1:(1)
> 119460 [Thread-761-1] INFO  b.s.d.executor - Activating spout 1:(1)
> 119467 [Thread-763-3] INFO  b.s.d.executor - Preparing bolt 3:(6)
> 119469 [Thread-763-3] INFO  b.s.d.executor - Prepared bolt 3:(6)
> 119475 [Thread-765-3] INFO  b.s.d.executor - Preparing bolt 3:(9)
> 119476 [Thread-765-3] INFO  b.s.d.executor - Prepared bolt 3:(9)
> 119482 [Thread-767-3] INFO  b.s.d.executor - Preparing bolt 3:(11)
> 119483 [Thread-767-3] INFO  b.s.d.executor - Prepared bolt 3:(11)
> 119488 [Thread-769-__system] INFO  b.s.d.executor - Preparing bolt __system:(-1)
> 119488 [Thread-769-__system] INFO  b.s.d.executor - Prepared bolt __system:(-1)
> 119494 [Thread-771-__acker] INFO  b.s.d.executor - Preparing bolt __acker:(13)
> 119494 [Thread-771-__acker] INFO  b.s.d.executor - Prepared bolt __acker:(13)
> 119501 [Thread-773-2] INFO  b.s.d.executor - Preparing bolt 2:(5)
> 119502 [Thread-773-2] INFO  b.s.d.executor - Prepared bolt 2:(5)
> 119508 [Thread-775-3] INFO  b.s.d.executor - Preparing bolt 3:(10)
> 119510 [Thread-775-3] INFO  b.s.d.executor - Prepared bolt 3:(10)
> 119516 [Thread-777-2] INFO  b.s.d.executor - Preparing bolt 2:(4)
> 119518 [Thread-777-2] INFO  b.s.d.executor - Prepared bolt 2:(4)
> 119520 [Thread-751-3] INFO  b.s.d.executor - Preparing bolt 3:(8)
> 119521 [Thread-751-3] INFO  b.s.d.executor - Prepared bolt 3:(8)
> 119526 [Thread-753-7db2538f-2c23-487a-9a75-1afda66c6134] INFO  b.s.d.executor - Preparing bolt 7db2538f-2c23-487a-9a75-1afda66c6134:(12)
> 119527 [Thread-753-7db2538f-2c23-487a-9a75-1afda66c6134] INFO  b.s.d.executor - Prepared bolt 7db2538f-2c23-487a-9a75-1afda66c6134:(12)
> 119534 [Thread-755-2] INFO  b.s.d.executor - Preparing bolt 2:(2)
> 119535 [Thread-755-2] INFO  b.s.d.executor - Prepared bolt 2:(2)
> 119583 [main] INFO  b.s.d.nimbus - [req 1] Access from:  principal: op:killTopology
> 119586 [main] INFO  b.s.d.nimbus - Delaying event :remove for 0 secs for topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0
> 119593 [timer] INFO  b.s.d.nimbus - Killing topology: topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0
> 119596 [Thread-745] INFO  b.s.d.supervisor - Removing code for storm id topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0
> 119600 [Thread-746] INFO  b.s.d.supervisor - Shutting down and clearing state for id a1dfcef2-be80-43b9-841f-93a170d3f96a. Current supervisor time: 11. State: :disallowed, Heartbeat: {:time-secs 11, :storm-id "topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0", :executors [[8 8] [12 12] [2 2] [7 7] [3 3] [1 1] [6 6] [9 9] [11 11] [-1 -1] [13 13] [5 5] [10 10] [4 4]], :port 1024}
> 119600 [Thread-746] INFO  b.s.d.supervisor - Shutting down a675baeb-c40f-4589-a33b-d828ea24e42b:a1dfcef2-be80-43b9-841f-93a170d3f96a
> 119600 [Thread-746] INFO  b.s.config - GET worker-user a1dfcef2-be80-43b9-841f-93a170d3f96a
> 119600 [Thread-746] INFO  b.s.process-simulator - Killing process 49e76a1a-4cc0-4037-af28-2dc46cdf36c5
> 119600 [Thread-746] INFO  b.s.d.worker - Shutting down worker topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0 a675baeb-c40f-4589-a33b-d828ea24e42b 1024
> 119600 [Thread-746] INFO  b.s.d.worker - Shutting down receive thread
> 119601 [Thread-746] INFO  b.s.m.loader - Shutting down receiving-thread: [topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0, 1024]
> 119601 [Thread-746] INFO  b.s.m.loader - Waiting for receiving-thread:[topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0, 1024] to die
> 119601 [Thread-746] INFO  b.s.m.loader - Shutdown receiving-thread: [topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0, 1024]
> 119601 [Thread-749-worker-receiver-thread-0] INFO  b.s.m.loader - Receiving-thread:[topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0, 1024] received shutdown notice
> 119601 [Thread-746] INFO  b.s.d.worker - Shut down receive thread
> 119601 [Thread-746] INFO  b.s.d.worker - Terminating messaging context
> 119601 [Thread-746] INFO  b.s.d.worker - Shutting down executors
> 119601 [Thread-746] INFO  b.s.d.executor - Shutting down executor 3:[8 8]
> 119601 [Thread-751-3] INFO  b.s.util - Async loop interrupted!
> 119601 [Thread-750-disruptor-executor[8 8]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119601 [Thread-746] INFO  b.s.d.executor - Shut down executor 3:[8 8]
> 119603 [Thread-746] INFO  b.s.d.executor - Shutting down executor 7db2538f-2c23-487a-9a75-1afda66c6134:[12 12]
> 119603 [Thread-753-7db2538f-2c23-487a-9a75-1afda66c6134] INFO  b.s.util - Async loop interrupted!
> 119603 [Thread-752-disruptor-executor[12 12]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119603 [Thread-746] INFO  b.s.d.executor - Shut down executor 7db2538f-2c23-487a-9a75-1afda66c6134:[12 12]
> 119603 [Thread-746] INFO  b.s.d.executor - Shutting down executor 2:[2 2]
> 119603 [Thread-754-disruptor-executor[2 2]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119603 [Thread-755-2] INFO  b.s.util - Async loop interrupted!
> 119604 [Thread-746] INFO  b.s.d.executor - Shut down executor 2:[2 2]
> 119604 [Thread-746] INFO  b.s.d.executor - Shutting down executor 3:[7 7]
> 119604 [Thread-756-disruptor-executor[7 7]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119604 [Thread-757-3] INFO  b.s.util - Async loop interrupted!
> 119604 [Thread-746] INFO  b.s.d.executor - Shut down executor 3:[7 7]
> 119604 [Thread-746] INFO  b.s.d.executor - Shutting down executor 2:[3 3]
> 119605 [Thread-759-2] INFO  b.s.util - Async loop interrupted!
> 119605 [Thread-758-disruptor-executor[3 3]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119605 [Thread-746] INFO  b.s.d.executor - Shut down executor 2:[3 3]
> 119605 [Thread-746] INFO  b.s.d.executor - Shutting down executor 1:[1 1]
> 119605 [Thread-760-disruptor-executor[1 1]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119605 [Thread-761-1] INFO  b.s.util - Async loop interrupted!
> 119605 [Thread-746] INFO  b.s.d.executor - Shut down executor 1:[1 1]
> 119605 [Thread-746] INFO  b.s.d.executor - Shutting down executor 3:[6 6]
> 119606 [timer] INFO  b.s.d.nimbus - Cleaning up topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0
> 119606 [Thread-762-disruptor-executor[6 6]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119606 [Thread-763-3] INFO  b.s.util - Async loop interrupted!
> 119606 [Thread-746] INFO  b.s.d.executor - Shut down executor 3:[6 6]
> 119606 [Thread-746] INFO  b.s.d.executor - Shutting down executor 3:[9 9]
> 119606 [Thread-765-3] INFO  b.s.util - Async loop interrupted!
> 119606 [Thread-764-disruptor-executor[9 9]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119607 [Thread-746] INFO  b.s.d.executor - Shut down executor 3:[9 9]
> 119607 [Thread-746] INFO  b.s.d.executor - Shutting down executor 3:[11 11]
> 119607 [Thread-767-3] INFO  b.s.util - Async loop interrupted!
> 119607 [Thread-766-disruptor-executor[11 11]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119607 [Thread-746] INFO  b.s.d.executor - Shut down executor 3:[11 11]
> 119607 [Thread-746] INFO  b.s.d.executor - Shutting down executor __system:[-1 -1]
> 119607 [Thread-769-__system] INFO  b.s.util - Async loop interrupted!
> 119607 [Thread-768-disruptor-executor[-1 -1]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119608 [Thread-746] INFO  b.s.d.executor - Shut down executor __system:[-1 -1]
> 119608 [Thread-746] INFO  b.s.d.executor - Shutting down executor __acker:[13 13]
> 119608 [Thread-771-__acker] INFO  b.s.util - Async loop interrupted!
> 119608 [Thread-770-disruptor-executor[13 13]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119608 [Thread-746] INFO  b.s.d.executor - Shut down executor __acker:[13 13]
> 119608 [Thread-746] INFO  b.s.d.executor - Shutting down executor 2:[5 5]
> 119608 [Thread-772-disruptor-executor[5 5]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119608 [Thread-773-2] INFO  b.s.util - Async loop interrupted!
> 119608 [Thread-746] INFO  b.s.d.executor - Shut down executor 2:[5 5]
> 119609 [Thread-746] INFO  b.s.d.executor - Shutting down executor 3:[10 10]
> 119609 [Thread-775-3] INFO  b.s.util - Async loop interrupted!
> 119609 [Thread-774-disruptor-executor[10 10]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119610 [Thread-746] INFO  b.s.d.executor - Shut down executor 3:[10 10]
> 119610 [Thread-746] INFO  b.s.d.executor - Shutting down executor 2:[4 4]
> 119610 [Thread-777-2] INFO  b.s.util - Async loop interrupted!
> 119610 [Thread-776-disruptor-executor[4 4]-send-queue] INFO  b.s.util - Async loop interrupted!
> 119610 [Thread-746] INFO  b.s.d.executor - Shut down executor 2:[4 4]
> 119610 [Thread-746] INFO  b.s.d.worker - Shut down executors
> 119610 [Thread-746] INFO  b.s.d.worker - Shutting down transfer thread
> 119611 [Thread-778-disruptor-worker-transfer-queue] INFO  b.s.util - Async loop interrupted!
> 119611 [Thread-746] INFO  b.s.d.worker - Shut down transfer thread
> 119608 [executor-heartbeat-timer] ERROR b.s.d.worker - Error when processing event
> java.lang.RuntimeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /workerbeats/topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0/a675baeb-c40f-4589-a33b-d828ea24e42b-1024
> 	at backtype.storm.util$wrap_in_runtime.invoke(util.clj:48) ~[classes/:?]
> 	at backtype.storm.zookeeper$set_data.invoke(zookeeper.clj:177) ~[classes/:?]
> 	at backtype.storm.cluster$mk_distributed_cluster_state$reify__5018.set_data(cluster.clj:103) ~[classes/:?]
> 	at backtype.storm.cluster$mk_storm_cluster_state$reify__5558.worker_heartbeat_BANG_(cluster.clj:376) ~[classes/:?]
> 	at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) ~[?:?]
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_76]
> 	at java.lang.reflect.Method.invoke(Method.java:606) ~[?:1.7.0_76]
> 	at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93) ~[clojure-1.6.0.jar:?]
> 	at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28) ~[clojure-1.6.0.jar:?]
> 	at backtype.storm.daemon.worker$do_executor_heartbeats.doInvoke(worker.clj:66) ~[classes/:?]
> 	at clojure.lang.RestFn.invoke(RestFn.java:439) ~[clojure-1.6.0.jar:?]
> 	at backtype.storm.daemon.worker$fn__7341$exec_fn__1689__auto__$reify__7343$fn__7346.invoke(worker.clj:439) ~[classes/:?]
> 	at backtype.storm.timer$schedule_recurring$this__4173.invoke(timer.clj:99) ~[classes/:?]
> 	at backtype.storm.timer$mk_timer$fn__4156$fn__4157.invoke(timer.clj:50) [classes/:?]
> 	at backtype.storm.timer$mk_timer$fn__4156.invoke(timer.clj:42) [classes/:?]
> 	at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
> 	at java.lang.Thread.run(Thread.java:745) [?:1.7.0_76]
> Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /workerbeats/topologytest-b78aef30-864a-4b00-a92b-fe20712f44ef-1-0/a675baeb-c40f-4589-a33b-d828ea24e42b-1024
> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:111) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
> 	at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1270) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
> 	at org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:260) ~[curator-framework-2.5.0.jar:?]
> 	at org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:256) ~[curator-framework-2.5.0.jar:?]
> 	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107) ~[curator-client-2.5.0.jar:?]
> 	at org.apache.curator.framework.imps.SetDataBuilderImpl.pathInForeground(SetDataBuilderImpl.java:252) ~[curator-framework-2.5.0.jar:?]
> 	at org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:239) ~[curator-framework-2.5.0.jar:?]
> 	at org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:39) ~[curator-framework-2.5.0.jar:?]
> 	at backtype.storm.zookeeper$set_data.invoke(zookeeper.clj:176) ~[classes/:?]
> 	... 15 more
> 119617 [executor-heartbeat-timer] ERROR b.s.util - Halting process: ("Error when processing an event")
> java.lang.RuntimeException: ("Error when processing an event")
> 	at backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:332) [classes/:?]
> 	at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.6.0.jar:?]
> 	at backtype.storm.daemon.worker$mk_halting_timer$fn__7151.invoke(worker.clj:190) [classes/:?]
> 	at backtype.storm.timer$mk_timer$fn__4156$fn__4157.invoke(timer.clj:68) [classes/:?]
> 	at backtype.storm.timer$mk_timer$fn__4156.invoke(timer.clj:42) [classes/:?]
> 	at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?]
> 	at java.lang.Thread.run(Thread.java:745) [?:1.7.0_76]
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)