about collector error

["yingnan.ma" <yi...@ipinyou.com>]

Hi, 

After I restart the hadoop(namenode ./start-all.sh), and I found the collectors(two colloctors) doesnot work, and I try to restart it, it also cannot work,and then I restart the maskter and configure it, then one can work and another cannot.


and then I try to stop 2collectors and 1master. and start the master and then start the 2 collectors, and they cannot work!!

and I check the collector log as following:

2012-06-15 15:18:59,926 INFO com.cloudera.flume.handlers.rolling.RollSink: Created RollSink: trigger=[TimeTrigger: maxAge=300000 tagger=com.cloudera.flume.handlers.rolling.ProcessTagger@410d3f0d] checkPeriodMs = 250 spec='escapedCustomDfs("hdfs://hadoop220:54310/user/root/flume/log_access/%Y/%m/%d/%H","access%{rolltag}" )'
2012-06-15 15:19:09,932 WARN com.cloudera.flume.agent.LivenessManager: Heartbeats are backing up, currently behind by 1 heartbeats
2012-06-15 15:19:14,936 WARN com.cloudera.flume.agent.LivenessManager: Heartbeats are backing up, currently behind by 2 heartbeats
2012-06-15 15:19:19,939 WARN com.cloudera.flume.agent.LivenessManager: Heartbeats are backing up, currently behind by 3 heartbeats
2012-06-15 15:19:24,942 WARN com.cloudera.flume.agent.LivenessManager: Heartbeats are backing up, currently behind by 4 heartbeats
2012-06-15 15:19:29,933 ERROR com.cloudera.flume.agent.LogicalNode: Forcing driver to exit uncleanly
2012-06-15 15:19:29,933 ERROR com.cloudera.flume.core.connector.DirectDriver: Closing down due to exception during append calls
java.io.IOException: Waiting for queue element was interrupted! null
        at com.cloudera.flume.handlers.thrift.ThriftEventSource.next(ThriftEventSource.java:222)
        at com.cloudera.flume.collector.CollectorSource.next(CollectorSource.java:72)
        at com.cloudera.flume.core.connector.DirectDriver$PumperThread.run(DirectDriver.java:105)
Caused by: java.lang.InterruptedException
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:1961)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2038)
        at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
        at com.cloudera.flume.handlers.thrift.ThriftEventSource.next(ThriftEventSource.java:209)
        ... 2 more
2012-06-15 15:19:29,933 INFO com.cloudera.flume.collector.CollectorSource: opened
2012-06-15 15:19:29,933 INFO com.cloudera.flume.core.connector.DirectDriver: Connector logicalNode collector180-27 exited with error: Waiting for queue element was interrupted! null
java.io.IOException: Waiting for queue element was interrupted! null
        at com.cloudera.flume.handlers.thrift.ThriftEventSource.next(ThriftEventSource.java:222)
        at com.cloudera.flume.collector.CollectorSource.next(CollectorSource.java:72)
        at com.cloudera.flume.core.connector.DirectDriver$PumperThread.run(DirectDriver.java:105)
Caused by: java.lang.InterruptedException
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:1961)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2038)
        at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
        at com.cloudera.flume.handlers.thrift.ThriftEventSource.next(ThriftEventSource.java:209)
        ... 2 more
2012-06-15 15:19:29,933 INFO com.cloudera.flume.agent.LogicalNode: Node config successfully set to com.cloudera.flume.conf.FlumeConfigData@782cbc86
2012-06-15 15:19:29,934 INFO com.cloudera.flume.collector.CollectorSource: closed
2012-06-15 15:19:29,934 INFO com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking thread pool server on port 35853...
2012-06-15 15:19:29,934 INFO com.cloudera.flume.handlers.thrift.ThriftEventSource: Closed server on port 35853...
2012-06-15 15:19:29,934 INFO com.cloudera.flume.handlers.thrift.ThriftEventSource: Queue still has 0 elements ...
2012-06-15 15:19:29,934 INFO com.cloudera.flume.handlers.rolling.RollSink: closing RollSink 'escapedCustomDfs("hdfs://hadoop220:54310/user/root/flume/log_access_flume/%Y/%m/%d/%H","access%{rolltag}" )'
2012-06-15 15:19:29,935 INFO com.cloudera.flume.handlers.rolling.RollSink: opening RollSink  'escapedCustomDfs("hdfs://hadoop220:54310/user/root/flume/log_access/%Y/%m/%d/%H","access%{rolltag}" )'
2012-06-15 15:19:29,935 ERROR com.cloudera.flume.core.connector.DirectDriver: Exiting driver logicalNode collector180-27 in error state CollectorSource | Collector because Waiting for queue element was interrupted! null
2012-06-15 15:19:29,937 WARN com.cloudera.flume.conf.FlumeBuilder: Deprecated syntax: Expected a format spec but instead had a (String) raw
2012-06-15 15:19:29,937 INFO com.cloudera.flume.handlers.debug.InsistentOpenDecorator: Opened MaskDecorator on try 0
2012-06-15 15:24:30,120 WARN com.cloudera.flume.conf.FlumeBuilder: Deprecated syntax: Expected a format spec but instead had a (String) raw
2012-06-15 15:29:30,300 WARN com.cloudera.flume.conf.FlumeBuilder: Deprecated syntax: Expected a format spec but instead had a (String) raw
2012-06-15 15:34:30,494 WARN com.cloudera.flume.conf.FlumeBuilder: Deprecated syntax: Expected a format spec but instead had a (String) raw

and I have no idea about this, Please help, Thank you.

Best Regards

Malone

2012-06-15