You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flume.apache.org by kashif khan <dr...@gmail.com> on 2012/12/29 17:52:38 UTC

Pushing data from outbox to cluster using Flume1.3.

HI dear all

My scenario as:

I am collecting the data from sensor devices on window base machine and
store on local disk. I have hadoop cluster on ubuntu OS. Is it possible to
use the flume (spool directory option) on window system to  push data
directly to cluster? My window machine is not part of the cluster.
If it is possible then how I can make the setup.

Many thanks

Re: Pushing data from outbox to cluster using Flume1.3.

Posted by Alexander Alten-Lorenz <wg...@gmail.com>.

You could build Flume on Windows:
https://cwiki.apache.org/confluence/display/FLUME/Build+Flume+1.3.x+up+on+Windows

And use the tail or spooldir exec. You have to setup the path in Windows URI style.

Other way could be to setup a syslog agent or avro source on windows which will tail the file to a flume agent.

- Alex 

On Dec 29, 2012, at 5:52 PM, kashif khan <dr...@gmail.com> wrote:

> HI dear all
> 
> My scenario as:
> 
> I am collecting the data from sensor devices on window base machine and
> store on local disk. I have hadoop cluster on ubuntu OS. Is it possible to
> use the flume (spool directory option) on window system to  push data
> directly to cluster? My window machine is not part of the cluster.
> If it is possible then how I can make the setup.
> 
> Many thanks