You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by 荆棘鸟 <li...@qq.com> on 2012/07/26 05:47:19 UTC
A problem about flume-ng's HDFSAgent
hello,people:
This is my configuration.
agent_foo.sources = tailsource-1
agent_foo.channels = memoryChannel-1
agent_foo.sinks = hdfsSink-1
agent_foo.sources.tailsource-1.type = exec
agent_foo.sources.tailsource-1.command = tail -F /home/hadoop/test/hello.txt
agent_foo.sources.tailsource-1.channels = memoryChannel-1
agent_foo.channels.memoryChannel-1.type = memory
agent_foo.channels.memoryChannel-1.capacity = 1000
agent_foo.sinks.hdfsSink-1.type = hdfs
agent_foo.sinks.hdfsSink-1.channels = memoryChannel-1
agent_foo.sinks.hdfsSink-1.hdfs.path = hdfs://CMN-NJ-2-579:9000/user/hadoop/flume
But it has a wrong that is "2012-07-26 11:37:12,719 WARN conf.FlumeConfiguration: Configuration empty for: hdfsSink-1.Removed.
".I hope to get you help.Please give me a way for solve the proble.
My name
Yanzhi.liu
Re: A problem about flume-ng's HDFSAgent
Posted by "Stern, Mark" <ms...@iskoot.com>.
A sink can only read from one channel. So
agent_foo.sinks.hdfsSink-1.channels = memoryChannel-1
should be:
agent_foo.sinks.hdfsSink-1.channel = memoryChannel-1
On Thu, 2012-07-26 at 11:47 +0800, 荆棘鸟 wrote:
> hello,people:
> This is my configuration.
> agent_foo.sources = tailsource-1
> agent_foo.channels = memoryChannel-1
> agent_foo.sinks = hdfsSink-1
> agent_foo.sources.tailsource-1.type = exec
> agent_foo.sources.tailsource-1.command = tail
> -F /home/hadoop/test/hello.txt
> agent_foo.sources.tailsource-1.channels = memoryChannel-1
> agent_foo.channels.memoryChannel-1.type = memory
> agent_foo.channels.memoryChannel-1.capacity = 1000
> agent_foo.sinks.hdfsSink-1.type = hdfs
> agent_foo.sinks.hdfsSink-1.channels = memoryChannel-1
> agent_foo.sinks.hdfsSink-1.hdfs.path =
> hdfs://CMN-NJ-2-579:9000/user/hadoop/flume
> But it has a wrong that is "2012-07-26 11:37:12,719 WARN
> conf.FlumeConfiguration: Configuration empty for: hdfsSink-1.Removed.
> ".I hope to get you help.Please give me a way for solve the proble.
> My name
> Yanzhi.liu
>
>
Re: A problem about flume-ng's HDFSAgent
Posted by Brock Noland <br...@cloudera.com>.
Hi,
I believe the line
agent_foo.sinks.hdfsSink-1.channels = memoryChannel-1
should be
agent_foo.sinks.hdfsSink-1.channel = memoryChannel-1
On Wed, Jul 25, 2012 at 10:47 PM, 荆棘鸟 <li...@qq.com> wrote:
> hello,people:
> This is my configuration.
> agent_foo.sources = tailsource-1
> agent_foo.channels = memoryChannel-1
> agent_foo.sinks = hdfsSink-1
> agent_foo.sources.tailsource-1.type = exec
> agent_foo.sources.tailsource-1.command = tail -F
> /home/hadoop/test/hello.txt
> agent_foo.sources.tailsource-1.channels = memoryChannel-1
> agent_foo.channels.memoryChannel-1.type = memory
> agent_foo.channels.memoryChannel-1.capacity = 1000
> agent_foo.sinks.hdfsSink-1.type = hdfs
> agent_foo.sinks.hdfsSink-1.channels = memoryChannel-1
> agent_foo.sinks.hdfsSink-1.hdfs.path =
> hdfs://CMN-NJ-2-579:9000/user/hadoop/flume
> But it has a wrong that is "2012-07-26 11:37:12,719 WARN
> conf.FlumeConfiguration: Configuration empty for: hdfsSink-1.Removed.
> ".I hope to get you help.Please give me a way for solve the proble.
> My name
> Yanzhi.liu
>
>
--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/