You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flume.apache.org by Matt Wise <ma...@nextdoor.com> on 2013/05/15 18:22:28 UTC

Setting Hadoop-specific settings for the HDFS plugin?

How do I pass hadoop-specific configuration settings to the HDFS plugin in Flume 1.3.0? Specifically, I need to modify the fs.s3.buffer.dir and hadoop.tmp.dir settings.

--matt

Re: Setting Hadoop-specific settings for the HDFS plugin?

Posted by Matt Wise <ma...@nextdoor.com>.

Ah yes, I did eventually figure that out... I should have emailed out. Once I got that XML file in place, it worked well. Thanks!

--Matt

On May 22, 2013, at 12:42 AM, Mike Percy <mp...@apache.org> wrote:

> You can do it in your hdfs-site.xml file which Flume will pull in when it detects Hadoop from the environment.
> 
> Mike
> 
> 
> On Wed, May 15, 2013 at 9:22 AM, Matt Wise <ma...@nextdoor.com> wrote:
> How do I pass hadoop-specific configuration settings to the HDFS plugin in Flume 1.3.0? Specifically, I need to modify the fs.s3.buffer.dir and hadoop.tmp.dir settings.
> 
> --matt
> 
>

Re: Setting Hadoop-specific settings for the HDFS plugin?

Posted by Mike Percy <mp...@apache.org>.

You can do it in your hdfs-site.xml file which Flume will pull in when it
detects Hadoop from the environment.

Mike

On Wed, May 15, 2013 at 9:22 AM, Matt Wise <ma...@nextdoor.com> wrote:

> How do I pass hadoop-specific configuration settings to the HDFS plugin in
> Flume 1.3.0? Specifically, I need to modify the fs.s3.buffer.dir and
> hadoop.tmp.dir settings.
>
> --matt
>
>