You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Dong Mo <mo...@gmail.com> on 2014/03/29 16:18:58 UTC
problem when running wordcount in storm-starter: cannot find splitsentence.py
Dear list,
I am very new for storm and I want to try out things in the storm-starter.
I created a java project and link the source in src/jvm and multilang in
storm-starter and also all the lib from storm release. I can run
Exclamation successfully, but when I try to run worldcountTopology, I got
this error output:
23071 [main] INFO backtype.storm.zookeeper - Starting inprocess zookeeper
at port 2000 and dir /tmp/a0626050-530b-4b25-b2c2-7a0224c2b562
23582 [main] INFO backtype.storm.daemon.nimbus - Starting Nimbus with conf
{"dev.zookeeper.path" "/tmp/dev-storm-zookeeper",
"topology.tick.tuple.freq.secs" nil,
"topology.builtin.metrics.bucket.size.secs" 60,
"topology.fall.back.on.java.serialization" true,
"topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0,
"topology.skip.missing.kryo.registrations" true,
"storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m",
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"topology.trident.batch.emit.interval.millis" 50,
"nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m",
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"topology.executor.send.buffer.size" 1024, "storm.local.dir"
"/tmp/8c4509e1-8c81-4893-a113-9a2731cf159a",
"storm.messaging.netty.buffer_size" 5242880,
"supervisor.worker.start.timeout.secs" 120,
"topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs"
600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64,
"topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost",
"storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000,
"transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size"
1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root"
"/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000,
"supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1,
"storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root"
"/transactional", "topology.acker.executors" nil,
"topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil,
"drpc.queue.size" 128, "worker.childopts" "-Xmx768m",
"supervisor.heartbeat.frequency.secs" 5,
"topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772,
"supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m",
"topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3,
"topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
"topology.spout.wait.strategy"
"backtype.storm.spout.SleepSpoutWaitStrategy",
"nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
"storm.zookeeper.retry.interval" 1000, "
topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator"
"backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports"
[6700 6701 6702 6703], "topology.debug" false, "nimbus.task.launch.secs"
120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs"
30, "task.refresh.poll.secs" 10, "topology.workers" 1,
"supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627,
"topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1,
"topology.tuple.serializer"
"backtype.storm.serialization.types.ListDelegateSerializer",
"topology.disruptor.wait.strategy"
"com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30,
"storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory"
"backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port"
3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times"
5, "storm.thrift.transport"
"backtype.storm.security.auth.SimpleTransportPlugin",
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs"
600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "
logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000,
"drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port"
8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local",
"topology.optimize" true, "topology.max.task.parallelism" nil}
23594 [main] INFO backtype.storm.daemon.nimbus - Using default scheduler
23672 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
23761 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
23817 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
23927 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
23936 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
23953 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
23961 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
23969 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
23982 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
24023 [main] INFO backtype.storm.daemon.supervisor - Starting Supervisor
with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper",
"topology.tick.tuple.freq.secs" nil,
"topology.builtin.metrics.bucket.size.secs" 60,
"topology.fall.back.on.java.serialization" true,
"topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0,
"topology.skip.missing.kryo.registrations" true,
"storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m",
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"topology.trident.batch.emit.interval.millis" 50,
"nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m",
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"topology.executor.send.buffer.size" 1024, "storm.local.dir"
"/tmp/0a13a653-6260-4217-a073-e1436b3ea995",
"storm.messaging.netty.buffer_size" 5242880,
"supervisor.worker.start.timeout.secs" 120,
"topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs"
600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64,
"topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost",
"storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000,
"transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size"
1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root"
"/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000,
"supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1,
"storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root"
"/transactional", "topology.acker.executors" nil,
"topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil,
"drpc.queue.size" 128, "worker.childopts" "-Xmx768m",
"supervisor.heartbeat.frequency.secs" 5,
"topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772,
"supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m",
"topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3,
"topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
"topology.spout.wait.strategy"
"backtype.storm.spout.SleepSpoutWaitStrategy",
"nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
"storm.zookeeper.retry.interval" 1000, "
topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator"
"backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports"
(1024 1025 1026), "topology.debug" false, "nimbus.task.launch.secs" 120,
"nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30,
"task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts"
"-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05,
"worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer"
"backtype.storm.serialization.types.ListDelegateSerializer",
"topology.disruptor.wait.strategy"
"com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30,
"storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory"
"backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port"
3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times"
5, "storm.thrift.transport"
"backtype.storm.security.auth.SimpleTransportPlugin",
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs"
600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "
logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000,
"drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port"
8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local",
"topology.optimize" true, "topology.max.task.parallelism" nil}
24076 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
24084 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
24095 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
24166 [main] INFO backtype.storm.daemon.supervisor - Starting supervisor
with id 83906402-1043-4d4f-9bbe-70bbdd7fa0ec at host ubuntu
24180 [main] INFO backtype.storm.daemon.supervisor - Starting Supervisor
with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper",
"topology.tick.tuple.freq.secs" nil,
"topology.builtin.metrics.bucket.size.secs" 60,
"topology.fall.back.on.java.serialization" true,
"topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0,
"topology.skip.missing.kryo.registrations" true,
"storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m",
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"topology.trident.batch.emit.interval.millis" 50,
"nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m",
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"topology.executor.send.buffer.size" 1024, "storm.local.dir"
"/tmp/a3499c14-5c0a-4284-ac83-fad0cb3a421b",
"storm.messaging.netty.buffer_size" 5242880,
"supervisor.worker.start.timeout.secs" 120,
"topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs"
600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64,
"topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost",
"storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000,
"transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size"
1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root"
"/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000,
"supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1,
"storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root"
"/transactional", "topology.acker.executors" nil,
"topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil,
"drpc.queue.size" 128, "worker.childopts" "-Xmx768m",
"supervisor.heartbeat.frequency.secs" 5,
"topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772,
"supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m",
"topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3,
"topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
"topology.spout.wait.strategy"
"backtype.storm.spout.SleepSpoutWaitStrategy",
"nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
"storm.zookeeper.retry.interval" 1000, "
topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator"
"backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports"
(1027 1028 1029), "topology.debug" false, "nimbus.task.launch.secs" 120,
"nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30,
"task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts"
"-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05,
"worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer"
"backtype.storm.serialization.types.ListDelegateSerializer",
"topology.disruptor.wait.strategy"
"com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30,
"storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory"
"backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port"
3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times"
5, "storm.thrift.transport"
"backtype.storm.security.auth.SimpleTransportPlugin",
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs"
600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "
logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000,
"drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port"
8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local",
"topology.optimize" true, "topology.max.task.parallelism" nil}
24185 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
24193 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
24200 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl
- Starting
24276 [main] INFO backtype.storm.daemon.supervisor - Starting supervisor
with id eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8 at host ubuntu
24440 [main] INFO backtype.storm.daemon.nimbus - Received topology
submission for word-count with conf {"topology.acker.executors" nil,
"topology.kryo.register" nil, "topology.kryo.decorators" (), "topology.name"
"word-count", "storm.id" "word-count-1-1396105643",
"topology.max.task.parallelism" 3, "topology.debug" true}
24502 [main] INFO backtype.storm.daemon.nimbus - Activating word-count:
word-count-1-1396105643
24672 [main] INFO backtype.storm.scheduler.EvenScheduler - Available
slots: (["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1028]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1029]
["83906402-1043-4d4f-9bbe-70bbdd7fa0ec" 1024]
["83906402-1043-4d4f-9bbe-70bbdd7fa0ec" 1025]
["83906402-1043-4d4f-9bbe-70bbdd7fa0ec" 1026])
24707 [main] INFO backtype.storm.daemon.nimbus - Setting new assignment
for topology id word-count-1-1396105643:
#backtype.storm.daemon.common.Assignment{:master-code-dir
"/tmp/8c4509e1-8c81-4893-a113-9a2731cf159a/nimbus/stormdist/word-count-1-1396105643",
:node->host {"eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" "ubuntu"},
:executor->node+port {[2 2] ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027],
[3 3] ["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [4 4]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [5 5]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [6 6]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [7 7]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [8 8]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [9 9]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [10 10]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027], [1 1]
["eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8" 1027]}, :executor->start-time-secs
{[2 2] 1396105643, [3 3] 1396105643, [4 4] 1396105643, [5 5] 1396105643, [6
6] 1396105643, [7 7] 1396105643, [8 8] 1396105643, [9 9] 1396105643, [10
10] 1396105643, [1 1] 1396105643}}
25249 [Thread-8] INFO backtype.storm.daemon.supervisor - Downloading code
for storm id word-count-1-1396105643 from
/tmp/8c4509e1-8c81-4893-a113-9a2731cf159a/nimbus/stormdist/word-count-1-1396105643
26509 [Thread-8] INFO backtype.storm.daemon.supervisor - Extracting
resources from jar at
/home/momo/commons-collections-3.2.1/commons-collections-3.2.1-javadoc.jar
to
/tmp/a3499c14-5c0a-4284-ac83-fad0cb3a421b/supervisor/stormdist/word-count-1-1396105643/resources
26560 [Thread-8] INFO backtype.storm.daemon.supervisor - Finished
downloading code for storm id word-count-1-1396105643 from
/tmp/8c4509e1-8c81-4893-a113-9a2731cf159a/nimbus/stormdist/word-count-1-1396105643
26637 [Thread-9] INFO backtype.storm.daemon.supervisor - Launching worker
with assignment #backtype.storm.daemon.supervisor.LocalAssignment{:storm-id
"word-count-1-1396105643", :executors ([2 2] [3 3] [4 4] [5 5] [6 6] [7 7]
[8 8] [9 9] [10 10] [1 1])} for this supervisor
eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8 on port 1027 with id
2c80a44c-2468-4b14-a73e-1bf1f975b62c
26656 [Thread-9] INFO backtype.storm.daemon.worker - Launching worker for
word-count-1-1396105643 on eef91c20-6dd3-4540-b4cb-d6dc6d0b3dd8:1027 with
id 2c80a44c-2468-4b14-a73e-1bf1f975b62c and conf {"dev.zookeeper.path"
"/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil,
"topology.builtin.metrics.bucket.size.secs" 60,
"topology.fall.back.on.java.serialization" true,
"topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0,
"topology.skip.missing.kryo.registrations" true,
"storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m",
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"topology.trident.batch.emit.interval.millis" 50,
"nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m",
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"topology.executor.send.buffer.size" 1024, "storm.local.dir"
"/tmp/a3499c14-5c0a-4284-ac83-fad0cb3a421b",
"storm.messaging.netty.buffer_size" 5242880,
"supervisor.worker.start.timeout.secs" 120,
"topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs"
600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64,
"topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost",
"storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000,
"transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size"
1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root"
"/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000,
"supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1,
"storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root"
"/transactional", "topology.acker.executors" nil,
"topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil,
"drpc.queue.size" 128, "worker.childopts" "-Xmx768m",
"supervisor.heartbeat.frequency.secs" 5,
"topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772,
"supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m",
"topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3,
"topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
"topology.spout.wait.strategy"
"backtype.storm.spout.SleepSpoutWaitStrategy",
"nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
"storm.zookeeper.retry.interval" 1000, "
topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator"
"backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports"
(1027 1028 1029), "topology.debug" false, "nimbus.task.launch.secs" 120,
"nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30,
"task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts"
"-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05,
"worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer"
"backtype.storm.serialization.types.ListDelegateSerializer",
"topology.disruptor.wait.strategy"
"com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30,
"storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory"
"backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port"
3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times"
5, "storm.thrift.transport"
"backtype.storm.security.auth.SimpleTransportPlugin",
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs"
600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "
logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000,
"drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port"
8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local",
"topology.optimize" true, "topology.max.task.parallelism" nil}
26658 [Thread-9] INFO
com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
26718 [Thread-9-EventThread] INFO backtype.storm.zookeeper - Zookeeper
state update: :connected:none
26726 [Thread-9] INFO
com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
27259 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
count:[2 2]
27279 [Thread-9] INFO backtype.storm.daemon.task - Emitting: count
__system ["startup"]
27281 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks count:[2 2]
27299 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
executor count:[2 2]
27307 [Thread-16-count] INFO backtype.storm.daemon.executor - Preparing
bolt count:(2)
27313 [Thread-16-count] INFO backtype.storm.daemon.executor - Prepared
bolt count:(2)
27348 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
count:[3 3]
27350 [Thread-9] INFO backtype.storm.daemon.task - Emitting: count
__system ["startup"]
27350 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks count:[3 3]
27364 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
executor count:[3 3]
27380 [Thread-18-count] INFO backtype.storm.daemon.executor - Preparing
bolt count:(3)
27382 [Thread-18-count] INFO backtype.storm.daemon.executor - Prepared
bolt count:(3)
27432 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
count:[4 4]
27433 [Thread-9] INFO backtype.storm.daemon.task - Emitting: count
__system ["startup"]
27434 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks count:[4 4]
27446 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
executor count:[4 4]
27446 [Thread-20-count] INFO backtype.storm.daemon.executor - Preparing
bolt count:(4)
27447 [Thread-20-count] INFO backtype.storm.daemon.executor - Prepared
bolt count:(4)
27461 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
split:[5 5]
27467 [Thread-9] INFO backtype.storm.daemon.task - Emitting: split
__system ["startup"]
27467 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks split:[5 5]
27470 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
executor split:[5 5]
27471 [Thread-22-split] INFO backtype.storm.daemon.executor - Preparing
bolt split:(5)
27497 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
split:[6 6]
27501 [Thread-9] INFO backtype.storm.daemon.task - Emitting: split
__system ["startup"]
27502 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks split:[6 6]
27519 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
executor split:[6 6]
27519 [Thread-24-split] INFO backtype.storm.daemon.executor - Preparing
bolt split:(6)
27535 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
split:[7 7]
27544 [Thread-9] INFO backtype.storm.daemon.task - Emitting: split
__system ["startup"]
27544 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks split:[7 7]
27549 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading
executor split:[7 7]
27549 [Thread-26-split] INFO backtype.storm.daemon.executor - Preparing
bolt split:(7)
27556 [Thread-22-split] ERROR backtype.storm.util - Async loop died!
java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
output read.
Shell Process Exception:
python: can't open file 'splitsentence.py': [Errno 2] No such file or
directory
at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at
backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
~[na:na]
at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
27559 [Thread-22-split] ERROR backtype.storm.daemon.executor -
java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
output read.
Shell Process Exception:
python: can't open file 'splitsentence.py': [Errno 2] No such file or
directory
at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at
backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
~[na:na]
at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
27581 [Thread-24-split] ERROR backtype.storm.util - Async loop died!
java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
output read.
Shell Process Exception:
python: can't open file 'splitsentence.py': [Errno 2] No such file or
directory
at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at
backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
~[na:na]
at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
27585 [Thread-24-split] ERROR backtype.storm.daemon.executor -
java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
output read.
Shell Process Exception:
python: can't open file 'splitsentence.py': [Errno 2] No such file or
directory
at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at
backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
~[na:na]
at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
27590 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor
spout:[8 8]
27602 [Thread-9] INFO backtype.storm.daemon.task - Emitting: spout
__system ["startup"]
27608 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor
tasks spout:[8 8]
27629 [Thread-26-split] ERROR backtype.storm.util - Async loop died!
java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
output read.
Shell Process Exception:
python: can't open file 'splitsentence.py': [Errno 2] No such file or
directory
at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at
backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
~[na:na]
at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
27632 [Thread-26-split] ERROR backtype.storm.daemon.executor -
java.lang.RuntimeException: Pipe to subprocess seems to be broken! No
output read.
Shell Process Exception:
python: can't open file 'splitsentence.py': [Errno 2] No such file or
directory
at backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at backtype.storm.task.ShellBolt.prepare(ShellBolt.java:102)
~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
at
backtype.storm.daemon.executor$eval5170$fn__5171$fn__5183.invoke(executor.clj:689)
~[na:na]
at backtype.storm.util$async_loop$fn__390.invoke(util.clj:431) ~[na:na]
at clojure.lang.AFn.run(AFn.java:24) ~[clojure-1.4.0.jar:na]
at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_25]
27643 [Thread-26-split] INFO backtype.storm.util - Halting process:
("Worker died")
27643 [Thread-24-split] INFO backtype.storm.util - Halting process:
("Worker died")
27643 [Thread-22-split] INFO backtype.storm.util - Halting process:
("Worker died")
Anyone knows why?
Thank you so much
-Mo