You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Dong Mo <mo...@gmail.com> on 2014/03/30 04:03:08 UTC
Error when running wordcount in storm starter -- multilang error?
Dear list,
I am very new for storm and I want to try out things in the storm-starter.
I created a java project and link the source in src/jvm and multilang in
storm-starter and also all the lib from storm release. I can run
Exclamation successfully, but when I try to run worldcountTopology, I got
this error output:
23071 [main] INFO backtype.storm.zookeeper - Starting inprocess zookeeper
at port 2000 and dir /tmp/a0626050-530b-4b25-b2c2-7a0224c2b562
23582 [main] INFO backtype.storm.daemon.nimbus - Starting Nimbus with conf
{"dev.zookeeper.path" "/tmp/dev-storm-zookeeper",
"topology.tick.tuple.freq.secs" nil,
"topology.builtin.metrics.bucket.size.secs" 60,
"topology.fall.back.on.java.serialization" true,
"topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0,
"topology.skip.missing.kryo.registrations" true,
"storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m",
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"topology.trident.batch.emit.interval.millis" 50,
"nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m",
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"topology.executor.send.buffer.size" 1024, "storm.local.dir"
"/tmp/8c4509e1-8c81-4893-a113-9a2731cf159a",
"storm.messaging.netty.buffer_size" 5242880,
"supervisor.worker.start.timeout.secs" 120,
"topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs"
600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64,
"topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost",
"storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000,
"transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size"
1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root"
"/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000,
"supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1,
"storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root"
"/transactional", "topology.acker.executors" nil,
"topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil,
"drpc.queue.size" 128, "worker.childopts" "-Xmx768m",
"supervisor.heartbeat.frequency.secs" 5,
"topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772,
"supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m",
"topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3,
"topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
"topology.spout.wait.strategy"
"backtype.storm.spout.SleepSpoutWaitStrategy",
"nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
"storm.zookeeper.retry.interval" 1000, "
topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator"
"backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports"
[6700 6701 6702 6703], "topology.debug" false, "nimbus.task.launch.secs"
120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs"
30, "task.refresh.poll.secs" 10, "topology.workers" 1,
"supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627,
"topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1,
"topology.tuple.serializer"
"backtype.storm.serialization.types.ListDelegateSerializer",
"topology.disruptor.wait.strategy"
"com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30,
"storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory"
"backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port"
3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times"
5, "storm.thrift.transport"
"backtype.storm.security.auth.SimpleTransportPlugin",
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs"
600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "
logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000,
"drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port"
8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local",
"topology.optimize" true, "topology.max.task.parallelism" nil}
23594 [main] INFO backtype.storm.daemon.nimbus - Using default scheduler
23672 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
23761 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
23817 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
23927 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
23936 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
23953 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
23961 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
23969 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
23982 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
24023 [main] INFO backtype.storm.daemon.supervisor - Starting Supervisor
with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper",
"topology.tick.tuple.freq.secs" nil,
"topology.builtin.metrics.bucket.size.secs" 60,
"topology.fall.back.on.java.serialization" true,
"topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0,
"topology.skip.missing.kryo.registrations" true,
"storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m",
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"topology.trident.batch.emit.interval.millis" 50,
"nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m",
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"topology.executor.send.buffer.size" 1024, "storm.local.dir"
"/tmp/0a13a653-6260-4217-a073-e1436b3ea995",
"storm.messaging.netty.buffer_size" 5242880,
"supervisor.worker.start.timeout.secs" 120,
"topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs"
600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64,
"topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost",
"storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000,
"transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size"
1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root"
"/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000,
"supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1,
"storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root"
"/transactional", "topology.acker.executors" nil,
"topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil,
"drpc.queue.size" 128, "worker.childopts" "-Xmx768m",
"supervisor.heartbeat.frequency.secs" 5,
"topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772,
"supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m",
"topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3,
"topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
"topology.spout.wait.strategy"
"backtype.storm.spout.SleepSpoutWaitStrategy",
"nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
"storm.zookeeper.retry.interval" 1000, "
topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator"
"backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports"
(1024 1025 1026), "topology.debug" false, "nimbus.task.launch.secs" 120,
"nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30,
"task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts"
"-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05,
"worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer"
"backtype.storm.serialization.types.ListDelegateSerializer",
"topology.disruptor.wait.strategy"
"com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30,
"storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory"
"backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port"
3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times"
5, "storm.thrift.transport"
"backtype.storm.security.auth.SimpleTransportPlugin",
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs"
600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "
logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000,
"drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port"
8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local",
"topology.optimize" true, "topology.max.task.parallelism" nil}
24076 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
24084 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
24095 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
24166 [main] INFO backtype.storm.daemon.supervisor - Starting supervisor
with id 83906402-1043-4d4f-9bbe-70bbdd7fa0ec at host ubuntu
24180 [main] INFO backtype.storm.daemon.supervisor - Starting Supervisor
with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper",
"topology.tick.tuple.freq.secs" nil,
"topology.builtin.metrics.bucket.size.secs" 60,
"topology.fall.back.on.java.serialization" true,
"topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0,
"topology.skip.missing.kryo.registrations" true,
"storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m",
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"topology.trident.batch.emit.interval.millis" 50,
"nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m",
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"topology.executor.send.buffer.size" 1024, "storm.local.dir"
"/tmp/a3499c14-5c0a-4284-ac83-fad0cb3a421b",
"storm.messaging.netty.buffer_size" 5242880,
"supervisor.worker.start.timeout.secs" 120,
"topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs"
600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64,
"topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost",
"storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000,
"transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size"
1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root"
"/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000,
"supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1,
"storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root"
"/transactional", "topology.acker.executors" nil,
"topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil,
"drpc.queue.size" 128, "worker.childopts" "-Xmx768m",
"supervisor.heartbeat.frequency.secs" 5,
"topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772,
"supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m",
"topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3,
"topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
"topology.spout.wait.strategy"
"backtype.storm.spout.SleepSpoutWaitStrategy",
"nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
"storm.zookeeper.retry.interval" 1000, "
topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator"
"backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports"
(1027 1028 1029), "topology.debug" false, "nimbus.task.launch.secs" 120,
"nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30,
"task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts"
"-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05,
"worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer"
"backtype.storm.serialization.types.ListDelegateSerializer",
"topology.disruptor.wait.strategy"
"com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30,
"storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory"
"backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port"
3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times"
5, "storm.thrift.transport"
"backtype.storm.security.auth.SimpleTransportPlugin",
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs"
600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "
logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000,
"drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port"
8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local",
"topology.optimize" true, "topology.max.task.parallelism" nil}
24185 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
24193 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
24200 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
24276 [main] INFO backtype.storm.daemon.supervisor - Starting supervisor
with id eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8 at host ubuntu
24440 [main] INFO backtype.storm.daemon.nimbus - Received topology
submission for word-count with conf {"topology.acker.executors" nil,
"topology.kryo.register" nil, "topology.kryo.decorators" (), "topology.name"
"word-count", "storm.id" "word-count-1-1396105643",
"topology.max.task.parallelism" 3, "topology.debug" true}
24502 [main] INFO backtype.storm.daemon.nimbus - Activating word-count:
word-count-1-1396105643
24672 [main] INFO backtype.storm.scheduler.EvenScheduler - Available
slots: (["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1028]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1029]
["83906402-1043-4d4f-9bbe-70bbdd7fa0ec" 1024]
["83906402-1043-4d4f-9bbe-70bbdd7fa0ec" 1025]
["83906402-1043-4d4f-9bbe-70bbdd7fa0ec" 1026])
24707 [main] INFO backtype.storm.daemon.nimbus - Setting new assignment
for topology id word-count-1-1396105643:
#backtype.storm.daemon.common.Assignment{:master-code-dir
"/tmp/8c4509e1-8c81-4893-a113-9a2731cf159a/nimbus/stormdist/word-count-1-1396105643",
:node->host {"eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" "ubuntu"},
:executor->node+port {[2 2] ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027],
[3 3] ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [4 4]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [5 5]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [6 6]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [7 7]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [8 8]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [9 9]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [10 10]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [1 1]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027]}, :executor->start-time-secs
{[2 2] 1396105643, [3 3] 1396105643, [4 4] 1396105643, [5 5] 1396105643, [6
6] 1396105643, [7 7] 1396105643, [8 8] 1396105643, [9 9] 1396105643, [10
10] 1396105643, [1 1] 1396105643}}
25249 [Thread-8] INFO backtype.storm.daemon.supervisor - Downloading code
for storm id word-count-1-1396105643 from
/tmp/8c4509e1-8c81-4893-a113-9a2731cf159a/nimbus/stormdist/word-count-1-1396105643
26509 [Thread-8] INFO backtype.storm.daemon.supervisor - Extracting
resources from jar at
/home/momo/commons-collections-3.2.1/commons-collections-3.2.1-javadoc.jar
to
/tmp/a3499c14-5c0a-4284-ac83-fad0cb3a421b/supervisor/stormdist/word-count-1-1396105643/resources
26560 [Thread-8] INFO backtype.storm.daemon.supervisor - Finished
downloading code for storm id word-count-1-1396105643 from
/tmp/8c4509e1-8c81-4893-a113-9a2731cf159a/nimbus/stormdist/word-count-1-1396105643
26637 [Thread-9] INFO backtype.storm.daemon.supervisor - Launching worker
with assignment #backtype.storm.daemon.supervisor.LocalAssignment{:storm-id
"word-count-1-1396105643", :executors ([2 2] [3 3] [4 4] [5 5] [6 6] [7 7]
[8 8] [9 9] [10 10] [1 1])} for this supervisor
eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8 on port 1027 with id
2c80a44c-2468-4b14-a73e-1bf1f975b62c
26656 [Thread-9] INFO backtype.storm.daemon.worker - Launching worker for
word-count-1-1396105643 on eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8:1027 with
id 2c80a44c-2468-4b14-a73e-1bf1f975b62c and conf {"dev.zookeeper.path"
"/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil,
"topology.builtin.metrics.bucket.size.secs" 60,
"topology.fall.back.on.java.serialization" true,
"topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0,
"topology.skip.missing.kryo.registrations" true,
"storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m",
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"topology.trident.batch.emit.interval.millis" 50,
"nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m",
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"topology.executor.send.buffer.size" 1024, "storm.local.dir"
"/tmp/a3499c14-5c0a-4284-ac83-fad0cb3a421b",
"storm.messaging.netty.buffer_size" 5242880,
"supervisor.worker.start.timeout.secs" 120,
"topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs"
600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64,
"topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost",
"storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000,
"transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size"
1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root"
"/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000,
"supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1,
"storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root"
"/transactional", "topology.acker.executors" nil,
"topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil,
"drpc.queue.size" 128, "worker.childopts" "-Xmx768m",
"supervisor.heartbeat.frequency.secs" 5,
"topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772,
"supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m",
"topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3,
"topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
"topology.spout.wait.strategy"
"backtype.storm.spout.SleepSpoutWaitStrategy",
"nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
"storm.zookeeper.retry.interval" 1000, "
topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator"
"backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports"
(1027 1028 1029), "topology.debug" false, "nimbus.task.launch.secs" 120,
"nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30,
"task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts"
"-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05,
"worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer"
"backtype.storm.serialization.types.ListDelegateSerializer",
"topology.disruptor.wait.strategy"
"com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30,
"storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory"
"backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port"
3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times"
5, "storm.thrift.transport"
"backtype.storm.security.auth.SimpleTransportPlugin",
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs"
600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "
logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000,
"drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port"
8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local",
"topology.optimize" true, "topology.max.task.parallelism" nil}
26658 [Thread-9] INFO
com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
26718 [Thread-9-EventThread] INFO backtype.storm.zookeeper - Zookeeper
state update: :connected:none
26726 [Thread-9] INFO
com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
27259 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
count:[2 2]
27279 [Thread-9] INFO backtype.storm.daemon.task - Emitting: count
__system ["startup"]
27281 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks count:[2 2]
27299 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
executor count:[2 2]
27307 [Thread-16-count] INFO backtype.storm.daemon.executor - Preparing
bolt count:(2)
27313 [Thread-16-count] INFO backtype.storm.daemon.executor - Prepared
bolt count:(2)
27348 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
count:[3 3]
27350 [Thread-9] INFO backtype.storm.daemon.task - Emitting: count
__system ["startup"]
27350 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks count:[3 3]
27364 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
executor count:[3 3]
27380 [Thread-18-count] INFO backtype.storm.daemon.executor - Preparing
bolt count:(3)
27382 [Thread-18-count] INFO backtype.storm.daemon.executor - Prepared
bolt count:(3)
27432 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
count:[4 4]
27433 [Thread-9] INFO backtype.storm.daemon.task - Emitting: count
__system ["startup"]
27434 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks count:[4 4]
27446 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
executor count:[4 4]
27446 [Thread-20-count] INFO backtype.storm.daemon.executor - Preparing
bolt count:(4)
27447 [Thread-20-count] INFO backtype.storm.daemon.executor - Prepared
bolt count:(4)
27461 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
split:[5 5]
27467 [Thread-9] INFO backtype.storm.daemon.task - Emitting: split
__system ["startup"]
27467 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks split:[5 5]
27470 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
executor split:[5 5]
27471 [Thread-22-split] INFO backtype.storm.daemon.executor - Preparing
bolt split:(5)
27497 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
split:[6 6]
27501 [Thread-9] INFO backtype.storm.daemon.task - Emitting: split
__system ["startup"]
27502 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks split:[6 6]
27519 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
executor split:[6 6]
27519 [Thread-24-split] INFO backtype.storm.daemon.executor - Preparing
bolt split:(6)
27535 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
split:[7 7]
27544 [Thread-9] INFO backtype.storm.daemon.task - Emitting: split
__system ["startup"]
27544 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks split:[7 7]
27549 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
executor split:[7 7]
27549 [Thread-26-split] INFO backtype.storm.daemon.executor - Preparing
bolt split:(7)
27556 [Thread-22-split] ERROR backtype.storm.util - Async loop died!
java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
output read.
Shell Process Exception:
python: can't open file 'splitsentence.py': [Errno 2] No such file or
directory
at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at
backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
~[na:na]
at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
27559 [Thread-22-split] ERROR backtype.storm.daemon.executor -
java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
output read.
Shell Process Exception:
python: can't open file 'splitsentence.py': [Errno 2] No such file or
directory
at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at
backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
~[na:na]
at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
27581 [Thread-24-split] ERROR backtype.storm.util - Async loop died!
java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
output read.
Shell Process Exception:
python: can't open file 'splitsentence.py': [Errno 2] No such file or
directory
at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at
backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
~[na:na]
at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
27585 [Thread-24-split] ERROR backtype.storm.daemon.executor -
java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
output read.
Shell Process Exception:
python: can't open file 'splitsentence.py': [Errno 2] No such file or
directory
at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at
backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
~[na:na]
at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
27590 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
spout:[8 8]
27602 [Thread-9] INFO backtype.storm.daemon.task - Emitting: spout
__system ["startup"]
27608 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks spout:[8 8]
27629 [Thread-26-split] ERROR backtype.storm.util - Async loop died!
java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
output read.
Shell Process Exception:
python: can't open file 'splitsentence.py': [Errno 2] No such file or
directory
at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at
backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
~[na:na]
at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
27632 [Thread-26-split] ERROR backtype.storm.daemon.executor -
java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
output read.
Shell Process Exception:
python: can't open file 'splitsentence.py': [Errno 2] No such file or
directory
at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at
backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
~[na:na]
at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
27643 [Thread-26-split] INFO backtype.storm.util - Halting process:
("Worker died")
27643 [Thread-24-split] INFO backtype.storm.util - Halting process:
("Worker died")
27643 [Thread-22-split] INFO backtype.storm.util - Halting process:
("Worker died")
Anyone knows why?
Thank you so much
Failed tuples
Posted by David Crossland <da...@elastacloud.com>.
Ive got a problem where I'm suddenly getting a lot of failed tuple in the spout. I see that the message-bolt hasn't failed any tuple.
Ive enabled all the logging I can think of. I've not seen an instance where a tuple has been explicitly failed. I do anchor my tuple with an ID (UUID.randomUUID()). I may not know exactly what to look for as to why a tuple gets failed. Ive tried to follow the tuple through in the logs;
I'm assuming in the following excerpt id: {5184102412552063103=4567870737448092900} is a representation of my UUID?
2014-03-31 14:50:23 b.s.d.executor [INFO] Processing received message source: sb-queue-reader:12, stream: default, id: {5184102412552063103=4567870737448092900}, [{"time":1396269843487,"date":"2014-03-31T12:44:03.487Z","clientIp":"216.48.255.131","app":"AS3_Android","appVersion":"1.0b","device":"samsung SGH-T989","event":"view","localTime":"1396026583000","platform":"android","properties":{"id":"PauseScreen","type":"menu"},"queueDuration":"243258000","uid":"gf-guid.24880366c6561b02.209933711"}]
I note the following two lines
2014-03-31 14:50:23 b.s.d.task [INFO] Emitting: sb-queue-reader __ack_init [5184102412552063103 4567870737448092900 12]
2014-03-31 14:50:23 b.s.d.task [INFO] Emitting: message-bolt __ack_ack [5184102412552063103 4567870737448092900]
Where there are similarities between to the ID, but slightly modified in both instances. I assume from what I've read that this is normal and is storms internal representation of the ID I generated and the two have been linked internally?
Anyhow it seems that after a while the topology is restarted and all my stats go to 0.
I do see the following exceptions in the logs; I don't think these errors explain why I'm registering failures in the spout. As far as I can tell all messages are being emitted.
2014-03-31 13:24:35 b.s.m.n.StormClientHandler [INFO] Connection failed:
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method) ~[na:1.7.0_51]
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) ~[na:1.7.0_51]
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) ~[na:1.7.0_51]
at sun.nio.ch.IOUtil.read(IOUtil.java:192) ~[na:1.7.0_51]
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379) ~[na:1.7.0_51]
at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:64) ~[netty-3.6.3.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107) ~[netty-3.6.3.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) ~[netty-3.6.3.Final.jar:na]
at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) ~[netty-3.6.3.Final.jar:na]
at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) ~[netty-3.6.3.Final.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_51]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_51]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51]
2014-03-31 13:24:35 b.s.m.n.Client [WARN] Remote address is not reachable. We will close this client.
Followed by another error shortly after.
014-03-31 13:24:36 b.s.util [ERROR] Async loop died!
java.lang.RuntimeException: java.lang.RuntimeException: Client is being closed, and does not take requests any more
at backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:90) ~[storm-core-0.9.0.1.jar:na]
at backtype.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:61) ~[storm-core-0.9.0.1.jar:na]
at backtype.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:62) ~[storm-core-0.9.0.1.jar:na]
at backtype.storm.disruptor$consume_loop_STAR_$fn__2975.invoke(disruptor.clj:74) ~[storm-core-0.9.0.1.jar:na]
at backtype.storm.util$async_loop$fn__444.invoke(util.clj:403) ~[storm-core-0.9.0.1.jar:na]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.4.0.jar:na]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51]
Caused by: java.lang.RuntimeException: Client is being closed, and does not take requests any more
at backtype.storm.messaging.netty.Client.send(Client.java:109) ~[storm-netty-0.9.0.1.jar:na]
at backtype.storm.daemon.worker$mk_transfer_tuples_handler$fn__5867$fn__5868.invoke(worker.clj:304) ~[storm-core-0.9.0.1.jar:na]
at backtype.storm.daemon.worker$mk_transfer_tuples_handler$fn__5867.invoke(worker.clj:293) ~[storm-core-0.9.0.1.jar:na]
at backtype.storm.disruptor$clojure_handler$reify__2962.onEvent(disruptor.clj:43) ~[storm-core-0.9.0.1.jar:na]
at backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:87) ~[storm-core-0.9.0.1.jar:na]
... 6 common frames omitted
2014-03-31 13:24:36 b.s.util [INFO] Halting process: ("Async loop died!")
Re: Error when running wordcount in storm starter -- multilang error?
Posted by yogesh panchal <ys...@gmail.com>.
Hi montedong,
error shows "python: can't open file 'splitsentence.py': [Errno 2] No such
file or directory" is there file called splitsentence.py, and one more
thing, if you want to use python, why dont you try petrel library for
storm, here is the url, https://github.com/AirSage/Petrel
Even i am new in storm & using this python library to write topology.
Thank you.
On Sun, Mar 30, 2014 at 7:33 AM, Dong Mo <mo...@gmail.com> wrote:
> Dear list,
>
> I am very new for storm and I want to try out things in the storm-starter.
>
> I created a java project and link the source in src/jvm and multilang in
> storm-starter and also all the lib from storm release. I can run
> Exclamation successfully, but when I try to run worldcountTopology, I got
> this error output:
>
> 23071 [main] INFO backtype.storm.zookeeper - Starting inprocess zookeeper
> at port 2000 and dir /tmp/a0626050-530b-4b25-b2c2-7a0224c2b562
> 23582 [main] INFO backtype.storm.daemon.nimbus - Starting Nimbus with
> conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper",
> "topology.tick.tuple.freq.secs" nil,
> "topology.builtin.metrics.bucket.size.secs" 60,
> "topology.fall.back.on.java.serialization" true,
> "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0,
> "topology.skip.missing.kryo.registrations" true,
> "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m",
> "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
> "topology.trident.batch.emit.interval.millis" 50,
> "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m",
> "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
> "topology.executor.send.buffer.size" 1024, "storm.local.dir"
> "/tmp/8c4509e1-8c81-4893-a113-9a2731cf159a",
> "storm.messaging.netty.buffer_size" 5242880,
> "supervisor.worker.start.timeout.secs" 120,
> "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs"
> 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64,
> "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost",
> "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000,
> "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size"
> 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root"
> "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000,
> "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1,
> "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root"
> "/transactional", "topology.acker.executors" nil,
> "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil,
> "drpc.queue.size" 128, "worker.childopts" "-Xmx768m",
> "supervisor.heartbeat.frequency.secs" 5,
> "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772,
> "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m",
> "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3,
> "topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
> "topology.spout.wait.strategy"
> "backtype.storm.spout.SleepSpoutWaitStrategy",
> "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
> "storm.zookeeper.retry.interval" 1000, "
> topology.sleep.spout.wait.strategy.time.ms" 1,
> "nimbus.topology.validator"
> "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports"
> [6700 6701 6702 6703], "topology.debug" false, "nimbus.task.launch.secs"
> 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs"
> 30, "task.refresh.poll.secs" 10, "topology.workers" 1,
> "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627,
> "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1,
> "topology.tuple.serializer"
> "backtype.storm.serialization.types.ListDelegateSerializer",
> "topology.disruptor.wait.strategy"
> "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30,
> "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory"
> "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port"
> 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times"
> 5, "storm.thrift.transport"
> "backtype.storm.security.auth.SimpleTransportPlugin",
> "topology.state.synchronization.timeout.secs" 60,
> "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs"
> 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "
> logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000,
> "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port"
> 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local",
> "topology.optimize" true, "topology.max.task.parallelism" nil}
> 23594 [main] INFO backtype.storm.daemon.nimbus - Using default scheduler
> 23672 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
> - Starting
> 23761 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
> update: :connected:none
> 23817 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
> - Starting
> 23927 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
> - Starting
> 23936 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
> update: :connected:none
> 23953 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
> - Starting
> 23961 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
> - Starting
> 23969 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
> update: :connected:none
> 23982 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
> - Starting
> 24023 [main] INFO backtype.storm.daemon.supervisor - Starting Supervisor
> with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper",
> "topology.tick.tuple.freq.secs" nil,
> "topology.builtin.metrics.bucket.size.secs" 60,
> "topology.fall.back.on.java.serialization" true,
> "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0,
> "topology.skip.missing.kryo.registrations" true,
> "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m",
> "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
> "topology.trident.batch.emit.interval.millis" 50,
> "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m",
> "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
> "topology.executor.send.buffer.size" 1024, "storm.local.dir"
> "/tmp/0a13a653-6260-4217-a073-e1436b3ea995",
> "storm.messaging.netty.buffer_size" 5242880,
> "supervisor.worker.start.timeout.secs" 120,
> "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs"
> 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64,
> "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost",
> "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000,
> "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size"
> 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root"
> "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000,
> "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1,
> "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root"
> "/transactional", "topology.acker.executors" nil,
> "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil,
> "drpc.queue.size" 128, "worker.childopts" "-Xmx768m",
> "supervisor.heartbeat.frequency.secs" 5,
> "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772,
> "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m",
> "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3,
> "topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
> "topology.spout.wait.strategy"
> "backtype.storm.spout.SleepSpoutWaitStrategy",
> "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
> "storm.zookeeper.retry.interval" 1000, "
> topology.sleep.spout.wait.strategy.time.ms" 1,
> "nimbus.topology.validator"
> "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports"
> (1024 1025 1026), "topology.debug" false, "nimbus.task.launch.secs" 120,
> "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30,
> "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts"
> "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05,
> "worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer"
> "backtype.storm.serialization.types.ListDelegateSerializer",
> "topology.disruptor.wait.strategy"
> "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30,
> "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory"
> "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port"
> 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times"
> 5, "storm.thrift.transport"
> "backtype.storm.security.auth.SimpleTransportPlugin",
> "topology.state.synchronization.timeout.secs" 60,
> "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs"
> 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "
> logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000,
> "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port"
> 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local",
> "topology.optimize" true, "topology.max.task.parallelism" nil}
> 24076 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
> - Starting
> 24084 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
> update: :connected:none
> 24095 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
> - Starting
> 24166 [main] INFO backtype.storm.daemon.supervisor - Starting supervisor
> with id 83906402-1043-4d4f-9bbe-70bbdd7fa0ec at host ubuntu
> 24180 [main] INFO backtype.storm.daemon.supervisor - Starting Supervisor
> with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper",
> "topology.tick.tuple.freq.secs" nil,
> "topology.builtin.metrics.bucket.size.secs" 60,
> "topology.fall.back.on.java.serialization" true,
> "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0,
> "topology.skip.missing.kryo.registrations" true,
> "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m",
> "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
> "topology.trident.batch.emit.interval.millis" 50,
> "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m",
> "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
> "topology.executor.send.buffer.size" 1024, "storm.local.dir"
> "/tmp/a3499c14-5c0a-4284-ac83-fad0cb3a421b",
> "storm.messaging.netty.buffer_size" 5242880,
> "supervisor.worker.start.timeout.secs" 120,
> "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs"
> 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64,
> "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost",
> "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000,
> "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size"
> 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root"
> "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000,
> "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1,
> "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root"
> "/transactional", "topology.acker.executors" nil,
> "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil,
> "drpc.queue.size" 128, "worker.childopts" "-Xmx768m",
> "supervisor.heartbeat.frequency.secs" 5,
> "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772,
> "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m",
> "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3,
> "topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
> "topology.spout.wait.strategy"
> "backtype.storm.spout.SleepSpoutWaitStrategy",
> "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
> "storm.zookeeper.retry.interval" 1000, "
> topology.sleep.spout.wait.strategy.time.ms" 1,
> "nimbus.topology.validator"
> "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports"
> (1027 1028 1029), "topology.debug" false, "nimbus.task.launch.secs" 120,
> "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30,
> "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts"
> "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05,
> "worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer"
> "backtype.storm.serialization.types.ListDelegateSerializer",
> "topology.disruptor.wait.strategy"
> "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30,
> "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory"
> "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port"
> 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times"
> 5, "storm.thrift.transport"
> "backtype.storm.security.auth.SimpleTransportPlugin",
> "topology.state.synchronization.timeout.secs" 60,
> "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs"
> 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "
> logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000,
> "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port"
> 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local",
> "topology.optimize" true, "topology.max.task.parallelism" nil}
> 24185 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
> - Starting
> 24193 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
> update: :connected:none
> 24200 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
> - Starting
> 24276 [main] INFO backtype.storm.daemon.supervisor - Starting supervisor
> with id eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8 at host ubuntu
> 24440 [main] INFO backtype.storm.daemon.nimbus - Received topology
> submission for word-count with conf {"topology.acker.executors" nil,
> "topology.kryo.register" nil, "topology.kryo.decorators" (), "
> topology.name" "word-count", "storm.id" "word-count-1-1396105643",
> "topology.max.task.parallelism" 3, "topology.debug" true}
> 24502 [main] INFO backtype.storm.daemon.nimbus - Activating word-count:
> word-count-1-1396105643
> 24672 [main] INFO backtype.storm.scheduler.EvenScheduler - Available
> slots: (["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027]
> ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1028]
> ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1029]
> ["83906402-1043-4d4f-9bbe-70bbdd7fa0ec" 1024]
> ["83906402-1043-4d4f-9bbe-70bbdd7fa0ec" 1025]
> ["83906402-1043-4d4f-9bbe-70bbdd7fa0ec" 1026])
> 24707 [main] INFO backtype.storm.daemon.nimbus - Setting new assignment
> for topology id word-count-1-1396105643:
> #backtype.storm.daemon.common.Assignment{:master-code-dir
> "/tmp/8c4509e1-8c81-4893-a113-9a2731cf159a/nimbus/stormdist/word-count-1-1396105643",
> :node->host {"eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" "ubuntu"},
> :executor->node+port {[2 2] ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027],
> [3 3] ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [4 4]
> ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [5 5]
> ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [6 6]
> ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [7 7]
> ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [8 8]
> ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [9 9]
> ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [10 10]
> ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [1 1]
> ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027]}, :executor->start-time-secs
> {[2 2] 1396105643, [3 3] 1396105643, [4 4] 1396105643, [5 5] 1396105643, [6
> 6] 1396105643, [7 7] 1396105643, [8 8] 1396105643, [9 9] 1396105643, [10
> 10] 1396105643, [1 1] 1396105643}}
> 25249 [Thread-8] INFO backtype.storm.daemon.supervisor - Downloading code
> for storm id word-count-1-1396105643 from
> /tmp/8c4509e1-8c81-4893-a113-9a2731cf159a/nimbus/stormdist/word-count-1-1396105643
> 26509 [Thread-8] INFO backtype.storm.daemon.supervisor - Extracting
> resources from jar at
> /home/momo/commons-collections-3.2.1/commons-collections-3.2.1-javadoc.jar
> to
> /tmp/a3499c14-5c0a-4284-ac83-fad0cb3a421b/supervisor/stormdist/word-count-1-1396105643/resources
> 26560 [Thread-8] INFO backtype.storm.daemon.supervisor - Finished
> downloading code for storm id word-count-1-1396105643 from
> /tmp/8c4509e1-8c81-4893-a113-9a2731cf159a/nimbus/stormdist/word-count-1-1396105643
> 26637 [Thread-9] INFO backtype.storm.daemon.supervisor - Launching worker
> with assignment #backtype.storm.daemon.supervisor.LocalAssignment{:storm-id
> "word-count-1-1396105643", :executors ([2 2] [3 3] [4 4] [5 5] [6 6] [7 7]
> [8 8] [9 9] [10 10] [1 1])} for this supervisor
> eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8 on port 1027 with id
> 2c80a44c-2468-4b14-a73e-1bf1f975b62c
> 26656 [Thread-9] INFO backtype.storm.daemon.worker - Launching worker for
> word-count-1-1396105643 on eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8:1027 with
> id 2c80a44c-2468-4b14-a73e-1bf1f975b62c and conf {"dev.zookeeper.path"
> "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil,
> "topology.builtin.metrics.bucket.size.secs" 60,
> "topology.fall.back.on.java.serialization" true,
> "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0,
> "topology.skip.missing.kryo.registrations" true,
> "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m",
> "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
> "topology.trident.batch.emit.interval.millis" 50,
> "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m",
> "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
> "topology.executor.send.buffer.size" 1024, "storm.local.dir"
> "/tmp/a3499c14-5c0a-4284-ac83-fad0cb3a421b",
> "storm.messaging.netty.buffer_size" 5242880,
> "supervisor.worker.start.timeout.secs" 120,
> "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs"
> 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64,
> "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost",
> "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000,
> "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size"
> 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root"
> "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000,
> "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1,
> "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root"
> "/transactional", "topology.acker.executors" nil,
> "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil,
> "drpc.queue.size" 128, "worker.childopts" "-Xmx768m",
> "supervisor.heartbeat.frequency.secs" 5,
> "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772,
> "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m",
> "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3,
> "topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
> "topology.spout.wait.strategy"
> "backtype.storm.spout.SleepSpoutWaitStrategy",
> "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
> "storm.zookeeper.retry.interval" 1000, "
> topology.sleep.spout.wait.strategy.time.ms" 1,
> "nimbus.topology.validator"
> "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports"
> (1027 1028 1029), "topology.debug" false, "nimbus.task.launch.secs" 120,
> "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30,
> "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts"
> "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05,
> "worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer"
> "backtype.storm.serialization.types.ListDelegateSerializer",
> "topology.disruptor.wait.strategy"
> "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30,
> "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory"
> "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port"
> 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times"
> 5, "storm.thrift.transport"
> "backtype.storm.security.auth.SimpleTransportPlugin",
> "topology.state.synchronization.timeout.secs" 60,
> "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs"
> 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "
> logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000,
> "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port"
> 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local",
> "topology.optimize" true, "topology.max.task.parallelism" nil}
> 26658 [Thread-9] INFO
> com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
> 26718 [Thread-9-EventThread] INFO backtype.storm.zookeeper - Zookeeper
> state update: :connected:none
> 26726 [Thread-9] INFO
> com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
> 27259 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
> count:[2 2]
> 27279 [Thread-9] INFO backtype.storm.daemon.task - Emitting: count
> __system ["startup"]
> 27281 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
> tasks count:[2 2]
> 27299 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
> executor count:[2 2]
> 27307 [Thread-16-count] INFO backtype.storm.daemon.executor - Preparing
> bolt count:(2)
> 27313 [Thread-16-count] INFO backtype.storm.daemon.executor - Prepared
> bolt count:(2)
> 27348 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
> count:[3 3]
> 27350 [Thread-9] INFO backtype.storm.daemon.task - Emitting: count
> __system ["startup"]
> 27350 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
> tasks count:[3 3]
> 27364 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
> executor count:[3 3]
> 27380 [Thread-18-count] INFO backtype.storm.daemon.executor - Preparing
> bolt count:(3)
> 27382 [Thread-18-count] INFO backtype.storm.daemon.executor - Prepared
> bolt count:(3)
> 27432 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
> count:[4 4]
> 27433 [Thread-9] INFO backtype.storm.daemon.task - Emitting: count
> __system ["startup"]
> 27434 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
> tasks count:[4 4]
> 27446 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
> executor count:[4 4]
> 27446 [Thread-20-count] INFO backtype.storm.daemon.executor - Preparing
> bolt count:(4)
> 27447 [Thread-20-count] INFO backtype.storm.daemon.executor - Prepared
> bolt count:(4)
> 27461 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
> split:[5 5]
> 27467 [Thread-9] INFO backtype.storm.daemon.task - Emitting: split
> __system ["startup"]
> 27467 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
> tasks split:[5 5]
> 27470 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
> executor split:[5 5]
> 27471 [Thread-22-split] INFO backtype.storm.daemon.executor - Preparing
> bolt split:(5)
> 27497 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
> split:[6 6]
> 27501 [Thread-9] INFO backtype.storm.daemon.task - Emitting: split
> __system ["startup"]
> 27502 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
> tasks split:[6 6]
> 27519 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
> executor split:[6 6]
> 27519 [Thread-24-split] INFO backtype.storm.daemon.executor - Preparing
> bolt split:(6)
> 27535 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
> split:[7 7]
> 27544 [Thread-9] INFO backtype.storm.daemon.task - Emitting: split
> __system ["startup"]
> 27544 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
> tasks split:[7 7]
> 27549 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
> executor split:[7 7]
> 27549 [Thread-26-split] INFO backtype.storm.daemon.executor - Preparing
> bolt split:(7)
> 27556 [Thread-22-split] ERROR backtype.storm.util - Async loop died!
> java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
> output read.
> Shell Process Exception:
> python: can't open file 'splitsentence.py': [Errno 2] No such file or
> directory
>
>
> at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at
> backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
> ~[na:na]
> at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
> at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
> at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
> 27559 [Thread-22-split] ERROR backtype.storm.daemon.executor -
> java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
> output read.
> Shell Process Exception:
> python: can't open file 'splitsentence.py': [Errno 2] No such file or
> directory
>
>
> at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at
> backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
> ~[na:na]
> at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
> at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
> at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
> 27581 [Thread-24-split] ERROR backtype.storm.util - Async loop died!
> java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
> output read.
> Shell Process Exception:
> python: can't open file 'splitsentence.py': [Errno 2] No such file or
> directory
>
>
> at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at
> backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
> ~[na:na]
> at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
> at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
> at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
> 27585 [Thread-24-split] ERROR backtype.storm.daemon.executor -
> java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
> output read.
> Shell Process Exception:
> python: can't open file 'splitsentence.py': [Errno 2] No such file or
> directory
>
>
> at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at
> backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
> ~[na:na]
> at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
> at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
> at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
> 27590 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
> spout:[8 8]
> 27602 [Thread-9] INFO backtype.storm.daemon.task - Emitting: spout
> __system ["startup"]
> 27608 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
> tasks spout:[8 8]
> 27629 [Thread-26-split] ERROR backtype.storm.util - Async loop died!
> java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
> output read.
> Shell Process Exception:
> python: can't open file 'splitsentence.py': [Errno 2] No such file or
> directory
>
>
> at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at
> backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
> ~[na:na]
> at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
> at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
> at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
> 27632 [Thread-26-split] ERROR backtype.storm.daemon.executor -
> java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
> output read.
> Shell Process Exception:
> python: can't open file 'splitsentence.py': [Errno 2] No such file or
> directory
>
>
> at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
> ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
> at
> backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
> ~[na:na]
> at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
> at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
> at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
> 27643 [Thread-26-split] INFO backtype.storm.util - Halting process:
> ("Worker died")
> 27643 [Thread-24-split] INFO backtype.storm.util - Halting process:
> ("Worker died")
> 27643 [Thread-22-split] INFO backtype.storm.util - Halting process:
> ("Worker died")
>
>
> Anyone knows why?
>
> Thank you so much
>
--
Thanks & Regards
Yogesh Panchal
>>> If You Go Black There is No Other Way to Come Back ........!