You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "王海涛 (JIRA)" <ji...@apache.org> on 2017/07/05 01:49:00 UTC
[jira] [Commented] (FLUME-2996) Flume process shutdown automaticly
[ https://issues.apache.org/jira/browse/FLUME-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074162#comment-16074162 ]
王海涛 commented on FLUME-2996:
----------------------------
I got this bug too..
Below is the log , log show that agent-shutdown-hook shutdown myagent, but why?
[conf-file-poller-0] (org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run:127) - Checking file:./conf/tongji-app.conf for changes
04 Jul 2017 19:04:39,527 INFO [Log-BackgroundWorker-c1] (org.apache.flume.channel.file.EventQueueBackingStoreFile.beginCheckpoint:227) - Start checkpoint for /data1/www/apache-flume-1.7.0-bin/data/checkpoint/checkpoint, elements to sync = 1
04 Jul 2017 19:04:39,531 INFO [Log-BackgroundWorker-c1] (org.apache.flume.channel.file.EventQueueBackingStoreFile.checkpoint:252) - Updating checkpoint metadata: logWriteOrderID: 1499158064976, queueSize: 0, queueHead: 39113
04 Jul 2017 19:04:39,534 INFO [Log-BackgroundWorker-c1] (org.apache.flume.channel.file.Log.writeCheckpoint:1052) - Updated checkpoint for file: /data1/www/apache-flume-1.7.0-bin/data/log-65 position: 6833759 logWriteOrderID: 1499158064976
04 Jul 2017 19:04:39,534 INFO [Log-BackgroundWorker-c1] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-55
04 Jul 2017 19:04:39,540 DEBUG [Log-BackgroundWorker-c1] (org.apache.flume.channel.file.Log.writeCheckpoint:1074) - Updated checkpoint for file: /data1/www/apache-flume-1.7.0-bin/data/log-55logWriteOrderID 1499158064976
04 Jul 2017 19:04:39,540 DEBUG [Log-BackgroundWorker-c1] (org.apache.flume.channel.file.Log.removeOldLogs:1115) - Files currently in use: [55, 65]
04 Jul 2017 19:04:53,803 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.sink.kafka.KafkaSink.process:187) - event #0
04 Jul 2017 19:04:53,804 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.flume.sink.kafka.SinkCallback.onCompletion:455) - Acked message partition:2 ofset:8000
04 Jul 2017 19:04:53,805 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.flume.sink.kafka.SinkCallback.onCompletion:456) - Elapsed time for send: 1
04 Jul 2017 19:05:03,807 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.sink.kafka.KafkaSink.process:187) - event #0
04 Jul 2017 19:05:03,808 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.sink.kafka.KafkaSink.process:187) - event #1
04 Jul 2017 19:05:03,808 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.sink.kafka.KafkaSink.process:187) - event #2
04 Jul 2017 19:05:03,808 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.sink.kafka.KafkaSink.process:187) - event #3
04 Jul 2017 19:05:03,809 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.flume.sink.kafka.SinkCallback.onCompletion:455) - Acked message partition:1 ofset:8000
04 Jul 2017 19:05:03,810 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.flume.sink.kafka.SinkCallback.onCompletion:456) - Elapsed time for send: 2
04 Jul 2017 19:05:03,810 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.flume.sink.kafka.SinkCallback.onCompletion:455) - Acked message partition:2 ofset:8001
04 Jul 2017 19:05:03,810 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.flume.sink.kafka.SinkCallback.onCompletion:456) - Elapsed time for send: 2
04 Jul 2017 19:05:03,810 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.flume.sink.kafka.SinkCallback.onCompletion:455) - Acked message partition:1 ofset:8001
04 Jul 2017 19:05:03,810 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.flume.sink.kafka.SinkCallback.onCompletion:456) - Elapsed time for send: 2
04 Jul 2017 19:05:03,810 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.flume.sink.kafka.SinkCallback.onCompletion:455) - Acked message partition:0 ofset:8001
04 Jul 2017 19:05:03,810 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.flume.sink.kafka.SinkCallback.onCompletion:456) - Elapsed time for send: 2
04 Jul 2017 19:05:07,814 DEBUG [conf-file-poller-0] (org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run:127) - Checking file:./conf/tongji-app.conf for changes
04 Jul 2017 19:05:09,541 INFO [Log-BackgroundWorker-c1] (org.apache.flume.channel.file.EventQueueBackingStoreFile.beginCheckpoint:227) - Start checkpoint for /data1/www/apache-flume-1.7.0-bin/data/checkpoint/checkpoint, elements to sync = 4
04 Jul 2017 19:05:09,544 INFO [Log-BackgroundWorker-c1] (org.apache.flume.channel.file.EventQueueBackingStoreFile.checkpoint:252) - Updating checkpoint metadata: logWriteOrderID: 1499158064992, queueSize: 0, queueHead: 39115
04 Jul 2017 19:05:09,547 INFO [Log-BackgroundWorker-c1] (org.apache.flume.channel.file.Log.writeCheckpoint:1052) - Updated checkpoint for file: /data1/www/apache-flume-1.7.0-bin/data/log-65 position: 6842163 logWriteOrderID: 1499158064992
04 Jul 2017 19:05:09,547 INFO [Log-BackgroundWorker-c1] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-55
04 Jul 2017 19:05:09,554 DEBUG [Log-BackgroundWorker-c1] (org.apache.flume.channel.file.Log.writeCheckpoint:1074) - Updated checkpoint for file: /data1/www/apache-flume-1.7.0-bin/data/log-55logWriteOrderID 1499158064992
04 Jul 2017 19:05:09,554 DEBUG [Log-BackgroundWorker-c1] (org.apache.flume.channel.file.Log.removeOldLogs:1115) - Files currently in use: [55, 65]
04 Jul 2017 19:05:26,339 INFO [agent-shutdown-hook] (org.apache.flume.lifecycle.LifecycleSupervisor.stop:78) - Stopping lifecycle supervisor 12
04 Jul 2017 19:05:26,345 INFO [agent-shutdown-hook] (org.apache.flume.node.PollingPropertiesFileConfigurationProvider.stop:84) - Configuration provider stopping
04 Jul 2017 19:05:26,346 DEBUG [agent-shutdown-hook] (org.apache.flume.node.PollingPropertiesFileConfigurationProvider.stop:96) - Configuration provider stopped
04 Jul 2017 19:05:26,346 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.FileChannel.stop:324) - Stopping FileChannel c1 { dataDirs: [/data1/www/apache-flume-1.7.0-bin/data] }...
04 Jul 2017 19:05:26,347 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.EventQueueBackingStoreFile.beginCheckpoint:227) - Start checkpoint for /data1/www/apache-flume-1.7.0-bin/data/checkpoint/checkpoint, elements to sync = 0
04 Jul 2017 19:05:26,350 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.EventQueueBackingStoreFile.checkpoint:252) - Updating checkpoint metadata: logWriteOrderID: 1499158064993, queueSize: 0, queueHead: 39115
04 Jul 2017 19:05:26,352 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.Log.writeCheckpoint:1052) - Updated checkpoint for file: /data1/www/apache-flume-1.7.0-bin/data/log-65 position: 6842163 logWriteOrderID: 1499158064993
04 Jul 2017 19:05:26,352 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-55
04 Jul 2017 19:05:26,359 DEBUG [agent-shutdown-hook] (org.apache.flume.channel.file.Log.writeCheckpoint:1074) - Updated checkpoint for file: /data1/www/apache-flume-1.7.0-bin/data/log-55logWriteOrderID 1499158064993
04 Jul 2017 19:05:26,361 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.Log.shutdownWorker:868) - Attempting to shutdown background worker.
04 Jul 2017 19:05:26,361 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.LogFile$Writer.close:384) - Closing /data1/www/apache-flume-1.7.0-bin/data/log-65
04 Jul 2017 19:05:26,361 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-64
04 Jul 2017 19:05:26,367 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-65
04 Jul 2017 19:05:26,372 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-55
04 Jul 2017 19:05:26,377 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-56
04 Jul 2017 19:05:26,383 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-57
04 Jul 2017 19:05:26,388 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-58
04 Jul 2017 19:05:26,393 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-59
04 Jul 2017 19:05:26,399 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-60
04 Jul 2017 19:05:26,404 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-61
04 Jul 2017 19:05:26,409 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-62
04 Jul 2017 19:05:26,415 INFO [agent-shutdown-hook] (org.apache.flume.channel.file.LogFile$RandomReader.close:520) - Closing RandomReader /data1/www/apache-flume-1.7.0-bin/data/log-63
04 Jul 2017 19:05:26,421 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:149) - Component type: CHANNEL, name: c1 stopped
04 Jul 2017 19:05:26,421 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:155) - Shutdown Metric for type: CHANNEL, name: c1. channel.start.time == 1499158057628
04 Jul 2017 19:05:26,421 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:161) - Shutdown Metric for type: CHANNEL, name: c1. channel.stop.time == 1499166326421
04 Jul 2017 19:05:26,421 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: CHANNEL, name: c1. channel.capacity == 1000000
04 Jul 2017 19:05:26,421 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: CHANNEL, name: c1. channel.current.size == 0
04 Jul 2017 19:05:26,421 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: CHANNEL, name: c1. channel.event.put.attempt == 3624
04 Jul 2017 19:05:26,422 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: CHANNEL, name: c1. channel.event.put.success == 3624
04 Jul 2017 19:05:26,422 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: CHANNEL, name: c1. channel.event.take.attempt == 7054
04 Jul 2017 19:05:26,422 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: CHANNEL, name: c1. channel.event.take.success == 3624
04 Jul 2017 19:05:26,422 INFO [PollableSourceRunner-TaildirSource-r1] (org.apache.flume.source.taildir.TaildirSource.process:233) - Interrupted while sleeping
04 Jul 2017 19:05:26,422 DEBUG [PollableSourceRunner-TaildirSource-r1] (org.apache.flume.source.PollableSourceRunner$PollingRunner.run:160) - Polling runner exiting. Metrics:{ name:null counters:{runner.backoffs.consecutive=0, runner.polls=8265} }
04 Jul 2017 19:05:26,424 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:149) - Component type: SOURCE, name: r1 stopped
04 Jul 2017 19:05:26,424 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:155) - Shutdown Metric for type: SOURCE, name: r1. source.start.time == 1499158057657
04 Jul 2017 19:05:26,424 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:161) - Shutdown Metric for type: SOURCE, name: r1. source.stop.time == 1499166326424
04 Jul 2017 19:05:26,424 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SOURCE, name: r1. src.append-batch.accepted == 970
04 Jul 2017 19:05:26,424 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SOURCE, name: r1. src.append-batch.received == 970
04 Jul 2017 19:05:26,424 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SOURCE, name: r1. src.append.accepted == 0
04 Jul 2017 19:05:26,424 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SOURCE, name: r1. src.append.received == 0
04 Jul 2017 19:05:26,425 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SOURCE, name: r1. src.events.accepted == 3624
04 Jul 2017 19:05:26,425 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SOURCE, name: r1. src.events.received == 3624
04 Jul 2017 19:05:26,425 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SOURCE, name: r1. src.open-connection.count == 0
04 Jul 2017 19:05:26,425 INFO [agent-shutdown-hook] (org.apache.flume.source.taildir.TaildirSource.stop:142) - Taildir source r1 stopped. Metrics: SOURCE:r1{src.events.accepted=3624, src.open-connection.count=0, src.append.received=0, src.append-batch.received=970, src.append-batch.accepted=970, src.append.accepted=0, src.events.received=3624}
04 Jul 2017 19:05:26,425 DEBUG [agent-shutdown-hook] (org.apache.flume.SinkRunner.stop:104) - Waiting for runner thread to exit
04 Jul 2017 19:05:26,425 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.SinkRunner$PollingRunner.run:155) - Interrupted while processing an event. Exiting.
04 Jul 2017 19:05:26,426 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.SinkRunner$PollingRunner.run:171) - Polling runner exiting. Metrics:{ name:null counters:{runner.interruptions=1, runner.backoffs.consecutive=7, runner.backoffs=2787} }
04 Jul 2017 19:05:26,427 INFO [agent-shutdown-hook] (org.apache.kafka.clients.producer.KafkaProducer.close:613) - Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms.
04 Jul 2017 19:05:26,427 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.clients.producer.internals.Sender.run:134) - Beginning shutdown of Kafka producer I/O thread, sending remaining records.
04 Jul 2017 19:05:26,429 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name connections-closed:client-id-producer-1
04 Jul 2017 19:05:26,429 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name connections-created:client-id-producer-1
04 Jul 2017 19:05:26,430 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name bytes-sent-received:client-id-producer-1
04 Jul 2017 19:05:26,430 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name bytes-sent:client-id-producer-1
04 Jul 2017 19:05:26,431 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name bytes-received:client-id-producer-1
04 Jul 2017 19:05:26,431 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name select-time:client-id-producer-1
04 Jul 2017 19:05:26,432 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name io-time:client-id-producer-1
04 Jul 2017 19:05:26,432 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name node--1.bytes-sent
04 Jul 2017 19:05:26,433 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name node--1.bytes-received
04 Jul 2017 19:05:26,433 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name node--1.latency
04 Jul 2017 19:05:26,433 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name node-2.bytes-sent
04 Jul 2017 19:05:26,434 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name node-2.bytes-received
04 Jul 2017 19:05:26,434 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name node-2.latency
04 Jul 2017 19:05:26,435 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name node-1.bytes-sent
04 Jul 2017 19:05:26,435 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name node-1.bytes-received
04 Jul 2017 19:05:26,435 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name node-1.latency
04 Jul 2017 19:05:26,436 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name node-0.bytes-sent
04 Jul 2017 19:05:26,436 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name node-0.bytes-received
04 Jul 2017 19:05:26,436 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.common.metrics.Metrics.removeSensor:220) - Removed sensor with name node-0.latency
04 Jul 2017 19:05:26,436 DEBUG [kafka-producer-network-thread | producer-1] (org.apache.kafka.clients.producer.internals.Sender.run:157) - Shutdown of Kafka producer I/O thread has completed.
04 Jul 2017 19:05:26,437 DEBUG [agent-shutdown-hook] (org.apache.kafka.clients.producer.KafkaProducer.close:654) - The Kafka producer has closed.
04 Jul 2017 19:05:26,437 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:149) - Component type: SINK, name: k1 stopped
04 Jul 2017 19:05:26,437 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:155) - Shutdown Metric for type: SINK, name: k1. sink.start.time == 1499158057712
04 Jul 2017 19:05:26,438 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:161) - Shutdown Metric for type: SINK, name: k1. sink.stop.time == 1499166326437
04 Jul 2017 19:05:26,438 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SINK, name: k1. channel.kafka.event.send.time == 4472
04 Jul 2017 19:05:26,438 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SINK, name: k1. channel.rollback.count == 0
04 Jul 2017 19:05:26,438 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SINK, name: k1. sink.batch.complete == 0
04 Jul 2017 19:05:26,438 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SINK, name: k1. sink.batch.empty == 2787
04 Jul 2017 19:05:26,438 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SINK, name: k1. sink.batch.underflow == 643
04 Jul 2017 19:05:26,438 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SINK, name: k1. sink.connection.closed.count == 0
04 Jul 2017 19:05:26,438 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SINK, name: k1. sink.connection.creation.count == 0
04 Jul 2017 19:05:26,438 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SINK, name: k1. sink.connection.failed.count == 0
04 Jul 2017 19:05:26,438 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SINK, name: k1. sink.event.drain.attempt == 0
04 Jul 2017 19:05:26,438 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:177) - Shutdown Metric for type: SINK, name: k1. sink.event.drain.sucess == 3624
04 Jul 2017 19:05:26,439 INFO [agent-shutdown-hook] (org.apache.flume.sink.kafka.KafkaSink.stop:274) - Kafka Sink k1 stopped. Metrics: SINK:k1{sink.batch.underflow=643, sink.connection.failed.count=0, sink.connection.closed.count=0, channel.kafka.event.send.time=4472, sink.event.drain.attempt=0, sink.batch.complete=0, sink.event.drain.sucess=3624, sink.connection.creation.count=0, channel.rollback.count=0, sink.batch.empty=2787}
> Flume process shutdown automaticly
> ----------------------------------
>
> Key: FLUME-2996
> URL: https://issues.apache.org/jira/browse/FLUME-2996
> Project: Flume
> Issue Type: Bug
> Environment: Amazon Linux
> Reporter: hailin
>
> hi guys,
> I install flume from apache-flume-1.6.0-bin.tar.gz, and startup flume with some my custom configure file with cmd line like this:
> bin/flume-ng agent -Dflume.monitoring.type=http -Dflume.monitoring.port=41414 -c conf -f conf/flume.conf --name a1 -Dflume.root.logger=INFO,DAILY
> it works fine without any issue, but after several hours when I check the process, I found it was shutdown automaticly. Bellow is the flume log information:
> .....
> 24 Sep 2016 05:53:59,391 INFO [agent-shutdown-hook] (org.apache.flume.lifecycle.LifecycleSupervisor.stop:79) - Stopping lifecycle supervisor 10
> 24 Sep 2016 05:53:59,394 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:150) - Component type: SINK, name: sink_kinesis_stream stopped
> 24 Sep 2016 05:53:59,394 INFO [agent-shutdown-hook] (org.apache.flume.instrumentation.MonitoredCounterGroup.stop:156) - Shutdown Metric for type: SINK, name: sink_kinesis_stream. sink.start.time == 1474685921906
> ....
> Can anyone help me fix it? How can I do to stop this issue as our bussiness already block because of this.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)