Automatic collector fall over

[Jonathan <jo...@gmail.com>]

Hey flume expert,

First off I wanted to thank everybody for all the help so far. I managed to
get flume working consistantly across many nodes. Today I tried to update to
Automatic Fallover chains and I seem to have run into a bunch of issues.
Namely both the source node and collector nodes are throwing errors.

The source nodes are saying that they are configured without a collector.
{ ackedWriteAhead => { stubbornAppend => { insistentOpen => fail( "no
collectors" ) } } }

and the collector nodes are throwing this error in the log files.
2011-10-06 18:06:50,512 ERROR
com.cloudera.flume.core.connector.DirectDriver: Exiting driver logicalNode
beacon_flume01use-18 in error state StubSource | Collector because
Attempting to open a Stub Source!
2011-10-06 18:06:50,512 INFO com.cloudera.flume.agent.LogicalNode: Node
config successfully set to com.cloudera.flume.conf.FlumeConfigData@134ce4a
2011-10-06 18:06:50,513 ERROR
com.cloudera.flume.core.connector.DirectDriver: Closing down due to
exception on open calls
2011-10-06 18:06:50,513 INFO com.cloudera.flume.core.connector.DirectDriver:
Connector logicalNode beacon_flume01use-19 exited with error: Attempting to
open a Stub Source!
java.io.IOException: Attempting to open a Stub Source!
        at
com.cloudera.flume.core.EventSource$StubSource.open(EventSource.java:75)
        at
com.cloudera.flume.core.connector.DirectDriver$PumperThread.run(DirectDriver.java:87)
2011-10-06 18:06:50,513 ERROR
com.cloudera.flume.core.connector.DirectDriver: Error closing logicalNode
beacon_flume01use-19 source: Attempting to close a Stub Source!
2011-10-06 18:06:50,513 INFO com.cloudera.flume.handlers.rolling.RollSink:
closing RollSink
'escapedCustomDfs("hdfs://private/user/flume/%Y/beaconlog","syslog%{rolltag}"
)'
2011-10-06 18:06:50,513 INFO com.cloudera.flume.handlers.rolling.RollSink:
double close
'escapedCustomDfs("hdfs://private/user/flume/%Y/beaconlog","syslog%{rolltag}"
)'
2011-10-06 18:06:50,513 ERROR
com.cloudera.flume.core.connector.DirectDriver: Exiting driver logicalNode
beacon_flume01use-19 in error state StubSource | Collector because
Attempting to open a Stub Source!


The config that I am using is
beacon_beacon02use : rpcSource(12345) | autoE2EChain ;
beacon_beacon03use : rpcSource(12345) | autoE2EChain ;
beacon_beacon04use : rpcSource(12345) | autoE2EChain ;
beacon_flume01use : collectorSource(35853) |
collectorSink("hdfs://private/user/flume/%Y/beaconlog","syslog" , 30000);


Thanks in advance for your help,
Jonathan