You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Hu Liu <hl...@gopivotal.com> on 2014/05/15 07:20:46 UTC

Does HDFS have a temp directory?

Hi Experts,

Does HDFS have a temp directory for general use like linux and what is the
strategy of deleting files in the temp directory?

-- 
Best Regards,
Hu Liu

Re: Does HDFS have a temp directory?

Posted by Raj K Singh <ra...@gmail.com>.
hadoop.tmp.dir is used as the temporary directories in HDFS.
for the mapreduce processing there is mapred.system.dir is set by default
to "${hadoop.tmp.dir}/mapred/system" where the mapreduce framework stores
system files.

if you dont want to tied the hdfs temp and mapreduce temp then you can edit
 mapred-site.xml such a way that mapred.system.dir is  not tied to
${hadoop.tmp.dir}

::::::::::::::::::::::::::::::::::::::::
Raj K Singh
http://in.linkedin.com/in/rajkrrsingh
http://www.rajkrrsingh.blogspot.com
Mobile  Tel: +91 (0)9899821370


On Thu, May 15, 2014 at 10:50 AM, Hu Liu <hl...@gopivotal.com> wrote:

> Hi Experts,
>
> Does HDFS have a temp directory for general use like linux and what is the
> strategy of deleting files in the temp directory?
>
> --
> Best Regards,
> Hu Liu
>

Re: Does HDFS have a temp directory?

Posted by Raj K Singh <ra...@gmail.com>.
hadoop.tmp.dir is used as the temporary directories in HDFS.
for the mapreduce processing there is mapred.system.dir is set by default
to "${hadoop.tmp.dir}/mapred/system" where the mapreduce framework stores
system files.

if you dont want to tied the hdfs temp and mapreduce temp then you can edit
 mapred-site.xml such a way that mapred.system.dir is  not tied to
${hadoop.tmp.dir}

::::::::::::::::::::::::::::::::::::::::
Raj K Singh
http://in.linkedin.com/in/rajkrrsingh
http://www.rajkrrsingh.blogspot.com
Mobile  Tel: +91 (0)9899821370


On Thu, May 15, 2014 at 10:50 AM, Hu Liu <hl...@gopivotal.com> wrote:

> Hi Experts,
>
> Does HDFS have a temp directory for general use like linux and what is the
> strategy of deleting files in the temp directory?
>
> --
> Best Regards,
> Hu Liu
>

Re: Does HDFS have a temp directory?

Posted by Raj K Singh <ra...@gmail.com>.
hadoop.tmp.dir is used as the temporary directories in HDFS.
for the mapreduce processing there is mapred.system.dir is set by default
to "${hadoop.tmp.dir}/mapred/system" where the mapreduce framework stores
system files.

if you dont want to tied the hdfs temp and mapreduce temp then you can edit
 mapred-site.xml such a way that mapred.system.dir is  not tied to
${hadoop.tmp.dir}

::::::::::::::::::::::::::::::::::::::::
Raj K Singh
http://in.linkedin.com/in/rajkrrsingh
http://www.rajkrrsingh.blogspot.com
Mobile  Tel: +91 (0)9899821370


On Thu, May 15, 2014 at 10:50 AM, Hu Liu <hl...@gopivotal.com> wrote:

> Hi Experts,
>
> Does HDFS have a temp directory for general use like linux and what is the
> strategy of deleting files in the temp directory?
>
> --
> Best Regards,
> Hu Liu
>

Re: Does HDFS have a temp directory?

Posted by Raj K Singh <ra...@gmail.com>.
hadoop.tmp.dir is used as the temporary directories in HDFS.
for the mapreduce processing there is mapred.system.dir is set by default
to "${hadoop.tmp.dir}/mapred/system" where the mapreduce framework stores
system files.

if you dont want to tied the hdfs temp and mapreduce temp then you can edit
 mapred-site.xml such a way that mapred.system.dir is  not tied to
${hadoop.tmp.dir}

::::::::::::::::::::::::::::::::::::::::
Raj K Singh
http://in.linkedin.com/in/rajkrrsingh
http://www.rajkrrsingh.blogspot.com
Mobile  Tel: +91 (0)9899821370


On Thu, May 15, 2014 at 10:50 AM, Hu Liu <hl...@gopivotal.com> wrote:

> Hi Experts,
>
> Does HDFS have a temp directory for general use like linux and what is the
> strategy of deleting files in the temp directory?
>
> --
> Best Regards,
> Hu Liu
>