HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

Hi,
 
I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
 
/usr/home/hadoop
 
I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
 
How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
 
Thanks,
Raj

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

 
But Tariq - /SD1/hadoop_data is in a separate group.
 
My hadoop is in group 'grp1'
Filesystem /SD1 is under group 'grp2'
 
As I have space under SD1, I want to use SD1 for hadoop.
 
so setting permissions like '755' on /SD1/hadoop_data -> will it work?


________________________________
From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
Sent: Friday, June 14, 2013 1:44 PM
Subject: Re: HDFS to a different location other than HADOOP HOME

Change the permissions of /SD1/hadoop_data to 755 and restart the process.
Warm Regards, 
Tariq
cloudfront.blogspot.com

On Fri, Jun 14, 2013 at 11:10 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
I have modified dfs.data.dir from the default value to another value which is outside 'HADOOP_HOME' and it is >/SD1/hadoop_data.
> 
><property>
><name>dfs.data.dir</name>
><value>/SD1/hadoop_data</value>
><description>Where DataNodes store their blocks</description>
></property>
> 
>My data node is not starting after the above change. Can anyone tell whats the issue?
>
>
>From: Sandeep L <sa...@outlook.com>
>To: "user@hadoop.apache.org" <us...@hadoop.apache.org> 
>Sent: Wednesday, June 12, 2013 1:48 AM
>Subject: RE: HDFS to a different location other than HADOOP HOME
>
>Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths. 
>Just try as follows:
><property>
><name>hadoop.tmp.dir</name>
><value>/home1/user1/dir1,/home2/user2/dir2</value>
></property>
>This will allow HDFS to write data into all specified directories.
>From: dontariq@gmail.comDate: Tue, 11 Jun 2013 23:14:08 +0530Subject: Re: HDFS to a different location other than HADOOP HOMETo: user@hadoop.apache.org 
>Thank you Pramod and Shahab.
>Warm Regards, 
>Tariq
>cloudfront.blogspot.com
>
>On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote: 
>http://hadoop.apache.org/docs/stable/hdfs-default.html 
>>dfs.data.dir ${hadoop.tmp.dir}/dfs/data Determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. 
>>On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>Hi Tariq,
>>> 
>>>What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
>>> 
>>>Thanks,
>>>Raj
>>>From: Mohammad Tariq <do...@gmail.com>
>>>To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>>Sent: Tuesday, June 11, 2013 12:49 PM
>>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>>
>>>Hello Raj, 
>>>    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.
>>>Warm Regards, 
>>>Tariq
>>>cloudfront.blogspot.com
>>>On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>> 
>>>>Thanks Mustaqeem.
>>>> 
>>>>hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
>>>> 
>>>> 
>>>>From: Mohammad Mustaqeem <3m...@gmail.com>
>>>>To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>>>Sent: Tuesday, June 11, 2013 10:28 AM
>>>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>>>
>>>>You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
>>>><property>
>>>><name>hadoop.tmp.dir</name>
>>>><value>/app/software/app1</value>
>>>></property>
>>>>"/app/software/app1" will be used as location for storing the hdfs files.
>>>>On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>>>Hi,
>>>>>
>>>>>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>>>>>
>>>>>/usr/home/hadoop
>>>>>
>>>>>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>>>>>
>>>>>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>>>>>
>>>>>Thanks,
>>>>>Raj-- 
>>>>
>>>>With regards --- 
>>>>Mohammad Mustaqeem,
>>>>M.Tech (CSE)
>>>>MNNIT Allahabad
>>>>9026604270
>>>>
>>>>

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

 
But Tariq - /SD1/hadoop_data is in a separate group.
 
My hadoop is in group 'grp1'
Filesystem /SD1 is under group 'grp2'
 
As I have space under SD1, I want to use SD1 for hadoop.
 
so setting permissions like '755' on /SD1/hadoop_data -> will it work?


________________________________
From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
Sent: Friday, June 14, 2013 1:44 PM
Subject: Re: HDFS to a different location other than HADOOP HOME

Change the permissions of /SD1/hadoop_data to 755 and restart the process.
Warm Regards, 
Tariq
cloudfront.blogspot.com

On Fri, Jun 14, 2013 at 11:10 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
I have modified dfs.data.dir from the default value to another value which is outside 'HADOOP_HOME' and it is >/SD1/hadoop_data.
> 
><property>
><name>dfs.data.dir</name>
><value>/SD1/hadoop_data</value>
><description>Where DataNodes store their blocks</description>
></property>
> 
>My data node is not starting after the above change. Can anyone tell whats the issue?
>
>
>From: Sandeep L <sa...@outlook.com>
>To: "user@hadoop.apache.org" <us...@hadoop.apache.org> 
>Sent: Wednesday, June 12, 2013 1:48 AM
>Subject: RE: HDFS to a different location other than HADOOP HOME
>
>Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths. 
>Just try as follows:
><property>
><name>hadoop.tmp.dir</name>
><value>/home1/user1/dir1,/home2/user2/dir2</value>
></property>
>This will allow HDFS to write data into all specified directories.
>From: dontariq@gmail.comDate: Tue, 11 Jun 2013 23:14:08 +0530Subject: Re: HDFS to a different location other than HADOOP HOMETo: user@hadoop.apache.org 
>Thank you Pramod and Shahab.
>Warm Regards, 
>Tariq
>cloudfront.blogspot.com
>
>On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote: 
>http://hadoop.apache.org/docs/stable/hdfs-default.html 
>>dfs.data.dir ${hadoop.tmp.dir}/dfs/data Determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. 
>>On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>Hi Tariq,
>>> 
>>>What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
>>> 
>>>Thanks,
>>>Raj
>>>From: Mohammad Tariq <do...@gmail.com>
>>>To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>>Sent: Tuesday, June 11, 2013 12:49 PM
>>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>>
>>>Hello Raj, 
>>>    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.
>>>Warm Regards, 
>>>Tariq
>>>cloudfront.blogspot.com
>>>On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>> 
>>>>Thanks Mustaqeem.
>>>> 
>>>>hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
>>>> 
>>>> 
>>>>From: Mohammad Mustaqeem <3m...@gmail.com>
>>>>To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>>>Sent: Tuesday, June 11, 2013 10:28 AM
>>>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>>>
>>>>You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
>>>><property>
>>>><name>hadoop.tmp.dir</name>
>>>><value>/app/software/app1</value>
>>>></property>
>>>>"/app/software/app1" will be used as location for storing the hdfs files.
>>>>On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>>>Hi,
>>>>>
>>>>>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>>>>>
>>>>>/usr/home/hadoop
>>>>>
>>>>>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>>>>>
>>>>>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>>>>>
>>>>>Thanks,
>>>>>Raj-- 
>>>>
>>>>With regards --- 
>>>>Mohammad Mustaqeem,
>>>>M.Tech (CSE)
>>>>MNNIT Allahabad
>>>>9026604270
>>>>
>>>>

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

 
But Tariq - /SD1/hadoop_data is in a separate group.
 
My hadoop is in group 'grp1'
Filesystem /SD1 is under group 'grp2'
 
As I have space under SD1, I want to use SD1 for hadoop.
 
so setting permissions like '755' on /SD1/hadoop_data -> will it work?


________________________________
From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
Sent: Friday, June 14, 2013 1:44 PM
Subject: Re: HDFS to a different location other than HADOOP HOME

Change the permissions of /SD1/hadoop_data to 755 and restart the process.
Warm Regards, 
Tariq
cloudfront.blogspot.com

On Fri, Jun 14, 2013 at 11:10 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
I have modified dfs.data.dir from the default value to another value which is outside 'HADOOP_HOME' and it is >/SD1/hadoop_data.
> 
><property>
><name>dfs.data.dir</name>
><value>/SD1/hadoop_data</value>
><description>Where DataNodes store their blocks</description>
></property>
> 
>My data node is not starting after the above change. Can anyone tell whats the issue?
>
>
>From: Sandeep L <sa...@outlook.com>
>To: "user@hadoop.apache.org" <us...@hadoop.apache.org> 
>Sent: Wednesday, June 12, 2013 1:48 AM
>Subject: RE: HDFS to a different location other than HADOOP HOME
>
>Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths. 
>Just try as follows:
><property>
><name>hadoop.tmp.dir</name>
><value>/home1/user1/dir1,/home2/user2/dir2</value>
></property>
>This will allow HDFS to write data into all specified directories.
>From: dontariq@gmail.comDate: Tue, 11 Jun 2013 23:14:08 +0530Subject: Re: HDFS to a different location other than HADOOP HOMETo: user@hadoop.apache.org 
>Thank you Pramod and Shahab.
>Warm Regards, 
>Tariq
>cloudfront.blogspot.com
>
>On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote: 
>http://hadoop.apache.org/docs/stable/hdfs-default.html 
>>dfs.data.dir ${hadoop.tmp.dir}/dfs/data Determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. 
>>On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>Hi Tariq,
>>> 
>>>What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
>>> 
>>>Thanks,
>>>Raj
>>>From: Mohammad Tariq <do...@gmail.com>
>>>To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>>Sent: Tuesday, June 11, 2013 12:49 PM
>>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>>
>>>Hello Raj, 
>>>    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.
>>>Warm Regards, 
>>>Tariq
>>>cloudfront.blogspot.com
>>>On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>> 
>>>>Thanks Mustaqeem.
>>>> 
>>>>hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
>>>> 
>>>> 
>>>>From: Mohammad Mustaqeem <3m...@gmail.com>
>>>>To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>>>Sent: Tuesday, June 11, 2013 10:28 AM
>>>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>>>
>>>>You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
>>>><property>
>>>><name>hadoop.tmp.dir</name>
>>>><value>/app/software/app1</value>
>>>></property>
>>>>"/app/software/app1" will be used as location for storing the hdfs files.
>>>>On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>>>Hi,
>>>>>
>>>>>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>>>>>
>>>>>/usr/home/hadoop
>>>>>
>>>>>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>>>>>
>>>>>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>>>>>
>>>>>Thanks,
>>>>>Raj-- 
>>>>
>>>>With regards --- 
>>>>Mohammad Mustaqeem,
>>>>M.Tech (CSE)
>>>>MNNIT Allahabad
>>>>9026604270
>>>>
>>>>

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

 
But Tariq - /SD1/hadoop_data is in a separate group.
 
My hadoop is in group 'grp1'
Filesystem /SD1 is under group 'grp2'
 
As I have space under SD1, I want to use SD1 for hadoop.
 
so setting permissions like '755' on /SD1/hadoop_data -> will it work?


________________________________
From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
Sent: Friday, June 14, 2013 1:44 PM
Subject: Re: HDFS to a different location other than HADOOP HOME

Change the permissions of /SD1/hadoop_data to 755 and restart the process.
Warm Regards, 
Tariq
cloudfront.blogspot.com

On Fri, Jun 14, 2013 at 11:10 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
I have modified dfs.data.dir from the default value to another value which is outside 'HADOOP_HOME' and it is >/SD1/hadoop_data.
> 
><property>
><name>dfs.data.dir</name>
><value>/SD1/hadoop_data</value>
><description>Where DataNodes store their blocks</description>
></property>
> 
>My data node is not starting after the above change. Can anyone tell whats the issue?
>
>
>From: Sandeep L <sa...@outlook.com>
>To: "user@hadoop.apache.org" <us...@hadoop.apache.org> 
>Sent: Wednesday, June 12, 2013 1:48 AM
>Subject: RE: HDFS to a different location other than HADOOP HOME
>
>Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths. 
>Just try as follows:
><property>
><name>hadoop.tmp.dir</name>
><value>/home1/user1/dir1,/home2/user2/dir2</value>
></property>
>This will allow HDFS to write data into all specified directories.
>From: dontariq@gmail.comDate: Tue, 11 Jun 2013 23:14:08 +0530Subject: Re: HDFS to a different location other than HADOOP HOMETo: user@hadoop.apache.org 
>Thank you Pramod and Shahab.
>Warm Regards, 
>Tariq
>cloudfront.blogspot.com
>
>On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote: 
>http://hadoop.apache.org/docs/stable/hdfs-default.html 
>>dfs.data.dir ${hadoop.tmp.dir}/dfs/data Determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. 
>>On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>Hi Tariq,
>>> 
>>>What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
>>> 
>>>Thanks,
>>>Raj
>>>From: Mohammad Tariq <do...@gmail.com>
>>>To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>>Sent: Tuesday, June 11, 2013 12:49 PM
>>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>>
>>>Hello Raj, 
>>>    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.
>>>Warm Regards, 
>>>Tariq
>>>cloudfront.blogspot.com
>>>On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>> 
>>>>Thanks Mustaqeem.
>>>> 
>>>>hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
>>>> 
>>>> 
>>>>From: Mohammad Mustaqeem <3m...@gmail.com>
>>>>To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>>>Sent: Tuesday, June 11, 2013 10:28 AM
>>>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>>>
>>>>You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
>>>><property>
>>>><name>hadoop.tmp.dir</name>
>>>><value>/app/software/app1</value>
>>>></property>
>>>>"/app/software/app1" will be used as location for storing the hdfs files.
>>>>On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>>>Hi,
>>>>>
>>>>>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>>>>>
>>>>>/usr/home/hadoop
>>>>>
>>>>>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>>>>>
>>>>>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>>>>>
>>>>>Thanks,
>>>>>Raj-- 
>>>>
>>>>With regards --- 
>>>>Mohammad Mustaqeem,
>>>>M.Tech (CSE)
>>>>MNNIT Allahabad
>>>>9026604270
>>>>
>>>>

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Tariq <do...@gmail.com>]

Change the permissions of /SD1/hadoop_data to 755 and restart the process.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Fri, Jun 14, 2013 at 11:10 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> I have modified dfs.data.dir from the default value to another value which
> is outside 'HADOOP_HOME' and it is >/SD1/hadoop_data.
>
> <property>
> <name>dfs.data.dir</name>
> <value>/SD1/hadoop_data</value>
> <description>Where DataNodes store their blocks</description>
> </property>
>
> My data node is not starting after the above change. Can anyone tell whats
> the issue?
>
>   *From:* Sandeep L <sa...@outlook.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>
> *Sent:* Wednesday, June 12, 2013 1:48 AM
> *Subject:* RE: HDFS to a different location other than HADOOP HOME
> **
>  Instead of using *${hadoop.tmp.dir}/dfs/data* you give multiple
> directories with absolute paths.
> Just try as follows:
>  <property>
> <name>hadoop.tmp.dir</name>
> <value>/home1/user1/dir1,/home2/user2/dir2</value>
> </property>
> This will allow HDFS to write data into all specified directories.
> **
>  From: dontariq@gmail.com**Date: Tue, 11 Jun 2013 23:14:08 +0530**Subject:
> Re: HDFS to a different location other than HADOOP HOME**To:
> user@hadoop.apache.org
> ****
> Thank you Pramod and Shahab.
> **
> Warm Regards,
> Tariq
> cloudfront.blogspot.com
> ****
> On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com>wrote:
> **
>
> http://hadoop.apache.org/docs/stable/hdfs-default.html**
>   dfs.data.dir ${hadoop.tmp.dir}/dfs/data Determines where on the local
> filesystem an DFS data node should store its blocks. If this is a
> comma-delimited list of directories, then data will be stored in all named
> directories, typically on different devices. Directories that do not exist
> are ignored.
>  ****
> On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:**
>
>  Hi Tariq,
>
> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
> this value defined. So what is the default value?
>
> Thanks,
> Raj
> **
>   *From:* Mohammad Tariq <do...@gmail.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 12:49 PM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
> **
> Hello Raj,
> **
>     Although the way which Mustaqeem has told is correct, there is more
> appropriate way to do this. Add the "dfs.data.dir" property in your
> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
> its value. The directory pointed by hadoop.tmp.dir also contains the
> metadata and some other temporary files, so it's always better to have a
> dedicated location to store the actual HDFS data.
>  **
> Warm Regards,
> Tariq
> cloudfront.blogspot.com**
> ****
> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:**
>
>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
> **
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>  **
> You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
> **
> ****
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:**
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
> ****
> **
> --
> *With regards ---***
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
> ****
>
>
> **
> ****
>
> **
>
> **
> ****
>

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Tariq <do...@gmail.com>]

Change the permissions of /SD1/hadoop_data to 755 and restart the process.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Fri, Jun 14, 2013 at 11:10 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> I have modified dfs.data.dir from the default value to another value which
> is outside 'HADOOP_HOME' and it is >/SD1/hadoop_data.
>
> <property>
> <name>dfs.data.dir</name>
> <value>/SD1/hadoop_data</value>
> <description>Where DataNodes store their blocks</description>
> </property>
>
> My data node is not starting after the above change. Can anyone tell whats
> the issue?
>
>   *From:* Sandeep L <sa...@outlook.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>
> *Sent:* Wednesday, June 12, 2013 1:48 AM
> *Subject:* RE: HDFS to a different location other than HADOOP HOME
> **
>  Instead of using *${hadoop.tmp.dir}/dfs/data* you give multiple
> directories with absolute paths.
> Just try as follows:
>  <property>
> <name>hadoop.tmp.dir</name>
> <value>/home1/user1/dir1,/home2/user2/dir2</value>
> </property>
> This will allow HDFS to write data into all specified directories.
> **
>  From: dontariq@gmail.com**Date: Tue, 11 Jun 2013 23:14:08 +0530**Subject:
> Re: HDFS to a different location other than HADOOP HOME**To:
> user@hadoop.apache.org
> ****
> Thank you Pramod and Shahab.
> **
> Warm Regards,
> Tariq
> cloudfront.blogspot.com
> ****
> On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com>wrote:
> **
>
> http://hadoop.apache.org/docs/stable/hdfs-default.html**
>   dfs.data.dir ${hadoop.tmp.dir}/dfs/data Determines where on the local
> filesystem an DFS data node should store its blocks. If this is a
> comma-delimited list of directories, then data will be stored in all named
> directories, typically on different devices. Directories that do not exist
> are ignored.
>  ****
> On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:**
>
>  Hi Tariq,
>
> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
> this value defined. So what is the default value?
>
> Thanks,
> Raj
> **
>   *From:* Mohammad Tariq <do...@gmail.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 12:49 PM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
> **
> Hello Raj,
> **
>     Although the way which Mustaqeem has told is correct, there is more
> appropriate way to do this. Add the "dfs.data.dir" property in your
> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
> its value. The directory pointed by hadoop.tmp.dir also contains the
> metadata and some other temporary files, so it's always better to have a
> dedicated location to store the actual HDFS data.
>  **
> Warm Regards,
> Tariq
> cloudfront.blogspot.com**
> ****
> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:**
>
>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
> **
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>  **
> You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
> **
> ****
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:**
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
> ****
> **
> --
> *With regards ---***
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
> ****
>
>
> **
> ****
>
> **
>
> **
> ****
>

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Tariq <do...@gmail.com>]

Change the permissions of /SD1/hadoop_data to 755 and restart the process.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Fri, Jun 14, 2013 at 11:10 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> I have modified dfs.data.dir from the default value to another value which
> is outside 'HADOOP_HOME' and it is >/SD1/hadoop_data.
>
> <property>
> <name>dfs.data.dir</name>
> <value>/SD1/hadoop_data</value>
> <description>Where DataNodes store their blocks</description>
> </property>
>
> My data node is not starting after the above change. Can anyone tell whats
> the issue?
>
>   *From:* Sandeep L <sa...@outlook.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>
> *Sent:* Wednesday, June 12, 2013 1:48 AM
> *Subject:* RE: HDFS to a different location other than HADOOP HOME
> **
>  Instead of using *${hadoop.tmp.dir}/dfs/data* you give multiple
> directories with absolute paths.
> Just try as follows:
>  <property>
> <name>hadoop.tmp.dir</name>
> <value>/home1/user1/dir1,/home2/user2/dir2</value>
> </property>
> This will allow HDFS to write data into all specified directories.
> **
>  From: dontariq@gmail.com**Date: Tue, 11 Jun 2013 23:14:08 +0530**Subject:
> Re: HDFS to a different location other than HADOOP HOME**To:
> user@hadoop.apache.org
> ****
> Thank you Pramod and Shahab.
> **
> Warm Regards,
> Tariq
> cloudfront.blogspot.com
> ****
> On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com>wrote:
> **
>
> http://hadoop.apache.org/docs/stable/hdfs-default.html**
>   dfs.data.dir ${hadoop.tmp.dir}/dfs/data Determines where on the local
> filesystem an DFS data node should store its blocks. If this is a
> comma-delimited list of directories, then data will be stored in all named
> directories, typically on different devices. Directories that do not exist
> are ignored.
>  ****
> On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:**
>
>  Hi Tariq,
>
> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
> this value defined. So what is the default value?
>
> Thanks,
> Raj
> **
>   *From:* Mohammad Tariq <do...@gmail.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 12:49 PM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
> **
> Hello Raj,
> **
>     Although the way which Mustaqeem has told is correct, there is more
> appropriate way to do this. Add the "dfs.data.dir" property in your
> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
> its value. The directory pointed by hadoop.tmp.dir also contains the
> metadata and some other temporary files, so it's always better to have a
> dedicated location to store the actual HDFS data.
>  **
> Warm Regards,
> Tariq
> cloudfront.blogspot.com**
> ****
> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:**
>
>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
> **
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>  **
> You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
> **
> ****
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:**
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
> ****
> **
> --
> *With regards ---***
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
> ****
>
>
> **
> ****
>
> **
>
> **
> ****
>

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Tariq <do...@gmail.com>]

Change the permissions of /SD1/hadoop_data to 755 and restart the process.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Fri, Jun 14, 2013 at 11:10 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> I have modified dfs.data.dir from the default value to another value which
> is outside 'HADOOP_HOME' and it is >/SD1/hadoop_data.
>
> <property>
> <name>dfs.data.dir</name>
> <value>/SD1/hadoop_data</value>
> <description>Where DataNodes store their blocks</description>
> </property>
>
> My data node is not starting after the above change. Can anyone tell whats
> the issue?
>
>   *From:* Sandeep L <sa...@outlook.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>
> *Sent:* Wednesday, June 12, 2013 1:48 AM
> *Subject:* RE: HDFS to a different location other than HADOOP HOME
> **
>  Instead of using *${hadoop.tmp.dir}/dfs/data* you give multiple
> directories with absolute paths.
> Just try as follows:
>  <property>
> <name>hadoop.tmp.dir</name>
> <value>/home1/user1/dir1,/home2/user2/dir2</value>
> </property>
> This will allow HDFS to write data into all specified directories.
> **
>  From: dontariq@gmail.com**Date: Tue, 11 Jun 2013 23:14:08 +0530**Subject:
> Re: HDFS to a different location other than HADOOP HOME**To:
> user@hadoop.apache.org
> ****
> Thank you Pramod and Shahab.
> **
> Warm Regards,
> Tariq
> cloudfront.blogspot.com
> ****
> On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com>wrote:
> **
>
> http://hadoop.apache.org/docs/stable/hdfs-default.html**
>   dfs.data.dir ${hadoop.tmp.dir}/dfs/data Determines where on the local
> filesystem an DFS data node should store its blocks. If this is a
> comma-delimited list of directories, then data will be stored in all named
> directories, typically on different devices. Directories that do not exist
> are ignored.
>  ****
> On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:**
>
>  Hi Tariq,
>
> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
> this value defined. So what is the default value?
>
> Thanks,
> Raj
> **
>   *From:* Mohammad Tariq <do...@gmail.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 12:49 PM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
> **
> Hello Raj,
> **
>     Although the way which Mustaqeem has told is correct, there is more
> appropriate way to do this. Add the "dfs.data.dir" property in your
> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
> its value. The directory pointed by hadoop.tmp.dir also contains the
> metadata and some other temporary files, so it's always better to have a
> dedicated location to store the actual HDFS data.
>  **
> Warm Regards,
> Tariq
> cloudfront.blogspot.com**
> ****
> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:**
>
>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
> **
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>  **
> You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
> **
> ****
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:**
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
> ****
> **
> --
> *With regards ---***
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
> ****
>
>
> **
> ****
>
> **
>
> **
> ****
>

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

I have modified dfs.data.dir from the default value to another value which is outside 'HADOOP_HOME' and it is >/SD1/hadoop_data.
 
<property>
<name>dfs.data.dir</name>
<value>/SD1/hadoop_data</value>
<description>Where DataNodes store their blocks</description>
</property>
 
My data node is not starting after the above change. Can anyone tell whats the issue?


________________________________
From: Sandeep L <sa...@outlook.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org> 
Sent: Wednesday, June 12, 2013 1:48 AM
Subject: RE: HDFS to a different location other than HADOOP HOME

Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths. 
Just try as follows:
<property>
<name>hadoop.tmp.dir</name>
<value>/home1/user1/dir1,/home2/user2/dir2</value>
</property>
This will allow HDFS to write data into all specified directories.

________________________________
From: dontariq@gmail.comDate: Tue, 11 Jun 2013 23:14:08 +0530Subject: Re: HDFS to a different location other than HADOOP HOMETo: user@hadoop.apache.org 
Thank you Pramod and Shahab.
Warm Regards, 
Tariq
cloudfront.blogspot.com

On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote: 
http://hadoop.apache.org/docs/stable/hdfs-default.html 
>dfs.data.dir ${hadoop.tmp.dir}/dfs/data Determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. 
>On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>Hi Tariq,
>> 
>>What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
>> 
>>Thanks,
>>Raj
>>From: Mohammad Tariq <do...@gmail.com>
>>To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>Sent: Tuesday, June 11, 2013 12:49 PM
>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>
>>Hello Raj, 
>>    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.
>>Warm Regards, 
>>Tariq
>>cloudfront.blogspot.com
>>On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>> 
>>>Thanks Mustaqeem.
>>> 
>>>hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
>>> 
>>> 
>>>From: Mohammad Mustaqeem <3m...@gmail.com>
>>>To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>>Sent: Tuesday, June 11, 2013 10:28 AM
>>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>>
>>>You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
>>><property>
>>><name>hadoop.tmp.dir</name>
>>><value>/app/software/app1</value>
>>></property>
>>>"/app/software/app1" will be used as location for storing the hdfs files.
>>>On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>>Hi,
>>>>
>>>>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>>>>
>>>>/usr/home/hadoop
>>>>
>>>>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>>>>
>>>>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>>>>
>>>>Thanks,
>>>>Raj-- 
>>>
>>>With regards --- 
>>>Mohammad Mustaqeem,
>>>M.Tech (CSE)
>>>MNNIT Allahabad
>>>9026604270
>>>
>>>

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

I have modified dfs.data.dir from the default value to another value which is outside 'HADOOP_HOME' and it is >/SD1/hadoop_data.
 
<property>
<name>dfs.data.dir</name>
<value>/SD1/hadoop_data</value>
<description>Where DataNodes store their blocks</description>
</property>
 
My data node is not starting after the above change. Can anyone tell whats the issue?


________________________________
From: Sandeep L <sa...@outlook.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org> 
Sent: Wednesday, June 12, 2013 1:48 AM
Subject: RE: HDFS to a different location other than HADOOP HOME

Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths. 
Just try as follows:
<property>
<name>hadoop.tmp.dir</name>
<value>/home1/user1/dir1,/home2/user2/dir2</value>
</property>
This will allow HDFS to write data into all specified directories.

________________________________
From: dontariq@gmail.comDate: Tue, 11 Jun 2013 23:14:08 +0530Subject: Re: HDFS to a different location other than HADOOP HOMETo: user@hadoop.apache.org 
Thank you Pramod and Shahab.
Warm Regards, 
Tariq
cloudfront.blogspot.com

On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote: 
http://hadoop.apache.org/docs/stable/hdfs-default.html 
>dfs.data.dir ${hadoop.tmp.dir}/dfs/data Determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. 
>On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>Hi Tariq,
>> 
>>What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
>> 
>>Thanks,
>>Raj
>>From: Mohammad Tariq <do...@gmail.com>
>>To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>Sent: Tuesday, June 11, 2013 12:49 PM
>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>
>>Hello Raj, 
>>    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.
>>Warm Regards, 
>>Tariq
>>cloudfront.blogspot.com
>>On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>> 
>>>Thanks Mustaqeem.
>>> 
>>>hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
>>> 
>>> 
>>>From: Mohammad Mustaqeem <3m...@gmail.com>
>>>To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>>Sent: Tuesday, June 11, 2013 10:28 AM
>>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>>
>>>You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
>>><property>
>>><name>hadoop.tmp.dir</name>
>>><value>/app/software/app1</value>
>>></property>
>>>"/app/software/app1" will be used as location for storing the hdfs files.
>>>On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>>Hi,
>>>>
>>>>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>>>>
>>>>/usr/home/hadoop
>>>>
>>>>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>>>>
>>>>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>>>>
>>>>Thanks,
>>>>Raj-- 
>>>
>>>With regards --- 
>>>Mohammad Mustaqeem,
>>>M.Tech (CSE)
>>>MNNIT Allahabad
>>>9026604270
>>>
>>>

RE: HDFS to a different location other than HADOOP HOME

[Sandeep L <sa...@outlook.com>]

Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just try as follows:<property><name>hadoop.data.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This will allow HDFS to write data into all specified directories.
From: sandeepvreddy@outlook.com
To: user@hadoop.apache.org
Subject: RE: HDFS to a different location other than HADOOP HOME
Date: Wed, 12 Jun 2013 11:18:34 +0530




Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just try as follows:<property><name>hadoop.data.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This will allow HDFS to write data into all specified directories.
From: dontariq@gmail.com
Date: Tue, 11 Jun 2013 23:14:08 +0530
Subject: Re: HDFS to a different location other than HADOOP HOME
To: user@hadoop.apache.org

Thank you Pramod and Shahab.Warm Regards,Tariqcloudfront.blogspot.com





On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote:


http://hadoop.apache.org/docs/stable/hdfs-default.html


dfs.data.dir
${hadoop.tmp.dir}/dfs/dataDetermines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored.




On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:



Hi Tariq,
 
What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
 
Thanks,
Raj








From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 12:49 PM
Subject: Re: HDFS to a different location other than HADOOP HOME




Hello Raj,


    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.





Warm Regards,
Tariq
cloudfront.blogspot.com



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:




 
Thanks Mustaqeem.
 
hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
 
 








From: Mohammad Mustaqeem <3m...@gmail.com>
To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 10:28 AM
Subject: Re: HDFS to a different location other than HADOOP HOME






You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 

<property>
<name>hadoop.tmp.dir</name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.





On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:




Hi,
 
I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
 
/usr/home/hadoop
 
I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
 
How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
 
Thanks,
Raj


-- 

With regards ---

Mohammad Mustaqeem,
M.Tech (CSE)
MNNIT Allahabad
9026604270










 		 	   		   		 	   		  

RE: HDFS to a different location other than HADOOP HOME

[Sandeep L <sa...@outlook.com>]

Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just try as follows:<property><name>hadoop.data.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This will allow HDFS to write data into all specified directories.
From: sandeepvreddy@outlook.com
To: user@hadoop.apache.org
Subject: RE: HDFS to a different location other than HADOOP HOME
Date: Wed, 12 Jun 2013 11:18:34 +0530




Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just try as follows:<property><name>hadoop.data.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This will allow HDFS to write data into all specified directories.
From: dontariq@gmail.com
Date: Tue, 11 Jun 2013 23:14:08 +0530
Subject: Re: HDFS to a different location other than HADOOP HOME
To: user@hadoop.apache.org

Thank you Pramod and Shahab.Warm Regards,Tariqcloudfront.blogspot.com





On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote:


http://hadoop.apache.org/docs/stable/hdfs-default.html


dfs.data.dir
${hadoop.tmp.dir}/dfs/dataDetermines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored.




On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:



Hi Tariq,
 
What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
 
Thanks,
Raj








From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 12:49 PM
Subject: Re: HDFS to a different location other than HADOOP HOME




Hello Raj,


    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.





Warm Regards,
Tariq
cloudfront.blogspot.com



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:




 
Thanks Mustaqeem.
 
hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
 
 








From: Mohammad Mustaqeem <3m...@gmail.com>
To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 10:28 AM
Subject: Re: HDFS to a different location other than HADOOP HOME






You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 

<property>
<name>hadoop.tmp.dir</name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.





On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:




Hi,
 
I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
 
/usr/home/hadoop
 
I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
 
How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
 
Thanks,
Raj


-- 

With regards ---

Mohammad Mustaqeem,
M.Tech (CSE)
MNNIT Allahabad
9026604270










 		 	   		   		 	   		  

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

I have modified dfs.data.dir from the default value to another value which is outside 'HADOOP_HOME' and it is >/SD1/hadoop_data.
 
<property>
<name>dfs.data.dir</name>
<value>/SD1/hadoop_data</value>
<description>Where DataNodes store their blocks</description>
</property>
 
My data node is not starting after the above change. Can anyone tell whats the issue?


________________________________
From: Sandeep L <sa...@outlook.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org> 
Sent: Wednesday, June 12, 2013 1:48 AM
Subject: RE: HDFS to a different location other than HADOOP HOME

Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths. 
Just try as follows:
<property>
<name>hadoop.tmp.dir</name>
<value>/home1/user1/dir1,/home2/user2/dir2</value>
</property>
This will allow HDFS to write data into all specified directories.

________________________________
From: dontariq@gmail.comDate: Tue, 11 Jun 2013 23:14:08 +0530Subject: Re: HDFS to a different location other than HADOOP HOMETo: user@hadoop.apache.org 
Thank you Pramod and Shahab.
Warm Regards, 
Tariq
cloudfront.blogspot.com

On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote: 
http://hadoop.apache.org/docs/stable/hdfs-default.html 
>dfs.data.dir ${hadoop.tmp.dir}/dfs/data Determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. 
>On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>Hi Tariq,
>> 
>>What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
>> 
>>Thanks,
>>Raj
>>From: Mohammad Tariq <do...@gmail.com>
>>To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>Sent: Tuesday, June 11, 2013 12:49 PM
>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>
>>Hello Raj, 
>>    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.
>>Warm Regards, 
>>Tariq
>>cloudfront.blogspot.com
>>On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>> 
>>>Thanks Mustaqeem.
>>> 
>>>hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
>>> 
>>> 
>>>From: Mohammad Mustaqeem <3m...@gmail.com>
>>>To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>>Sent: Tuesday, June 11, 2013 10:28 AM
>>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>>
>>>You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
>>><property>
>>><name>hadoop.tmp.dir</name>
>>><value>/app/software/app1</value>
>>></property>
>>>"/app/software/app1" will be used as location for storing the hdfs files.
>>>On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>>Hi,
>>>>
>>>>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>>>>
>>>>/usr/home/hadoop
>>>>
>>>>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>>>>
>>>>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>>>>
>>>>Thanks,
>>>>Raj-- 
>>>
>>>With regards --- 
>>>Mohammad Mustaqeem,
>>>M.Tech (CSE)
>>>MNNIT Allahabad
>>>9026604270
>>>
>>>

RE: HDFS to a different location other than HADOOP HOME

[Sandeep L <sa...@outlook.com>]

Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just try as follows:<property><name>hadoop.data.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This will allow HDFS to write data into all specified directories.
From: sandeepvreddy@outlook.com
To: user@hadoop.apache.org
Subject: RE: HDFS to a different location other than HADOOP HOME
Date: Wed, 12 Jun 2013 11:18:34 +0530




Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just try as follows:<property><name>hadoop.data.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This will allow HDFS to write data into all specified directories.
From: dontariq@gmail.com
Date: Tue, 11 Jun 2013 23:14:08 +0530
Subject: Re: HDFS to a different location other than HADOOP HOME
To: user@hadoop.apache.org

Thank you Pramod and Shahab.Warm Regards,Tariqcloudfront.blogspot.com





On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote:


http://hadoop.apache.org/docs/stable/hdfs-default.html


dfs.data.dir
${hadoop.tmp.dir}/dfs/dataDetermines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored.




On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:



Hi Tariq,
 
What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
 
Thanks,
Raj








From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 12:49 PM
Subject: Re: HDFS to a different location other than HADOOP HOME




Hello Raj,


    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.





Warm Regards,
Tariq
cloudfront.blogspot.com



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:




 
Thanks Mustaqeem.
 
hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
 
 








From: Mohammad Mustaqeem <3m...@gmail.com>
To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 10:28 AM
Subject: Re: HDFS to a different location other than HADOOP HOME






You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 

<property>
<name>hadoop.tmp.dir</name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.





On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:




Hi,
 
I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
 
/usr/home/hadoop
 
I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
 
How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
 
Thanks,
Raj


-- 

With regards ---

Mohammad Mustaqeem,
M.Tech (CSE)
MNNIT Allahabad
9026604270










 		 	   		   		 	   		  

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

I have modified dfs.data.dir from the default value to another value which is outside 'HADOOP_HOME' and it is >/SD1/hadoop_data.
 
<property>
<name>dfs.data.dir</name>
<value>/SD1/hadoop_data</value>
<description>Where DataNodes store their blocks</description>
</property>
 
My data node is not starting after the above change. Can anyone tell whats the issue?


________________________________
From: Sandeep L <sa...@outlook.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org> 
Sent: Wednesday, June 12, 2013 1:48 AM
Subject: RE: HDFS to a different location other than HADOOP HOME

Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths. 
Just try as follows:
<property>
<name>hadoop.tmp.dir</name>
<value>/home1/user1/dir1,/home2/user2/dir2</value>
</property>
This will allow HDFS to write data into all specified directories.

________________________________
From: dontariq@gmail.comDate: Tue, 11 Jun 2013 23:14:08 +0530Subject: Re: HDFS to a different location other than HADOOP HOMETo: user@hadoop.apache.org 
Thank you Pramod and Shahab.
Warm Regards, 
Tariq
cloudfront.blogspot.com

On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote: 
http://hadoop.apache.org/docs/stable/hdfs-default.html 
>dfs.data.dir ${hadoop.tmp.dir}/dfs/data Determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. 
>On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>Hi Tariq,
>> 
>>What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
>> 
>>Thanks,
>>Raj
>>From: Mohammad Tariq <do...@gmail.com>
>>To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>Sent: Tuesday, June 11, 2013 12:49 PM
>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>
>>Hello Raj, 
>>    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.
>>Warm Regards, 
>>Tariq
>>cloudfront.blogspot.com
>>On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>> 
>>>Thanks Mustaqeem.
>>> 
>>>hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
>>> 
>>> 
>>>From: Mohammad Mustaqeem <3m...@gmail.com>
>>>To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>>>Sent: Tuesday, June 11, 2013 10:28 AM
>>>Subject: Re: HDFS to a different location other than HADOOP HOME
>>>
>>>You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
>>><property>
>>><name>hadoop.tmp.dir</name>
>>><value>/app/software/app1</value>
>>></property>
>>>"/app/software/app1" will be used as location for storing the hdfs files.
>>>On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote: 
>>>Hi,
>>>>
>>>>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>>>>
>>>>/usr/home/hadoop
>>>>
>>>>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>>>>
>>>>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>>>>
>>>>Thanks,
>>>>Raj-- 
>>>
>>>With regards --- 
>>>Mohammad Mustaqeem,
>>>M.Tech (CSE)
>>>MNNIT Allahabad
>>>9026604270
>>>
>>>

RE: HDFS to a different location other than HADOOP HOME

[Sandeep L <sa...@outlook.com>]

Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just try as follows:<property><name>hadoop.data.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This will allow HDFS to write data into all specified directories.
From: sandeepvreddy@outlook.com
To: user@hadoop.apache.org
Subject: RE: HDFS to a different location other than HADOOP HOME
Date: Wed, 12 Jun 2013 11:18:34 +0530




Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just try as follows:<property><name>hadoop.data.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This will allow HDFS to write data into all specified directories.
From: dontariq@gmail.com
Date: Tue, 11 Jun 2013 23:14:08 +0530
Subject: Re: HDFS to a different location other than HADOOP HOME
To: user@hadoop.apache.org

Thank you Pramod and Shahab.Warm Regards,Tariqcloudfront.blogspot.com





On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote:


http://hadoop.apache.org/docs/stable/hdfs-default.html


dfs.data.dir
${hadoop.tmp.dir}/dfs/dataDetermines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored.




On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:



Hi Tariq,
 
What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
 
Thanks,
Raj








From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 12:49 PM
Subject: Re: HDFS to a different location other than HADOOP HOME




Hello Raj,


    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.





Warm Regards,
Tariq
cloudfront.blogspot.com



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:




 
Thanks Mustaqeem.
 
hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
 
 








From: Mohammad Mustaqeem <3m...@gmail.com>
To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 10:28 AM
Subject: Re: HDFS to a different location other than HADOOP HOME






You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 

<property>
<name>hadoop.tmp.dir</name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.





On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:




Hi,
 
I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
 
/usr/home/hadoop
 
I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
 
How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
 
Thanks,
Raj


-- 

With regards ---

Mohammad Mustaqeem,
M.Tech (CSE)
MNNIT Allahabad
9026604270










 		 	   		   		 	   		  

RE: HDFS to a different location other than HADOOP HOME

[Sandeep L <sa...@outlook.com>]

Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just try as follows:<property><name>hadoop.tmp.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This will allow HDFS to write data into all specified directories.
From: dontariq@gmail.com
Date: Tue, 11 Jun 2013 23:14:08 +0530
Subject: Re: HDFS to a different location other than HADOOP HOME
To: user@hadoop.apache.org

Thank you Pramod and Shahab.Warm Regards,Tariqcloudfront.blogspot.com





On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote:


http://hadoop.apache.org/docs/stable/hdfs-default.html


dfs.data.dir
${hadoop.tmp.dir}/dfs/dataDetermines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored.




On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:



Hi Tariq,
 
What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
 
Thanks,
Raj








From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 12:49 PM
Subject: Re: HDFS to a different location other than HADOOP HOME




Hello Raj,


    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.





Warm Regards,
Tariq
cloudfront.blogspot.com



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:




 
Thanks Mustaqeem.
 
hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
 
 








From: Mohammad Mustaqeem <3m...@gmail.com>
To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 10:28 AM
Subject: Re: HDFS to a different location other than HADOOP HOME






You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 

<property>
<name>hadoop.tmp.dir</name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.





On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:




Hi,
 
I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
 
/usr/home/hadoop
 
I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
 
How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
 
Thanks,
Raj


-- 

With regards ---

Mohammad Mustaqeem,
M.Tech (CSE)
MNNIT Allahabad
9026604270










 		 	   		  

RE: HDFS to a different location other than HADOOP HOME

[Sandeep L <sa...@outlook.com>]

Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just try as follows:<property><name>hadoop.tmp.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This will allow HDFS to write data into all specified directories.
From: dontariq@gmail.com
Date: Tue, 11 Jun 2013 23:14:08 +0530
Subject: Re: HDFS to a different location other than HADOOP HOME
To: user@hadoop.apache.org

Thank you Pramod and Shahab.Warm Regards,Tariqcloudfront.blogspot.com





On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote:


http://hadoop.apache.org/docs/stable/hdfs-default.html


dfs.data.dir
${hadoop.tmp.dir}/dfs/dataDetermines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored.




On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:



Hi Tariq,
 
What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
 
Thanks,
Raj








From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 12:49 PM
Subject: Re: HDFS to a different location other than HADOOP HOME




Hello Raj,


    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.





Warm Regards,
Tariq
cloudfront.blogspot.com



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:




 
Thanks Mustaqeem.
 
hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
 
 








From: Mohammad Mustaqeem <3m...@gmail.com>
To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 10:28 AM
Subject: Re: HDFS to a different location other than HADOOP HOME






You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 

<property>
<name>hadoop.tmp.dir</name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.





On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:




Hi,
 
I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
 
/usr/home/hadoop
 
I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
 
How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
 
Thanks,
Raj


-- 

With regards ---

Mohammad Mustaqeem,
M.Tech (CSE)
MNNIT Allahabad
9026604270










 		 	   		  

RE: HDFS to a different location other than HADOOP HOME

[Sandeep L <sa...@outlook.com>]

Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just try as follows:<property><name>hadoop.tmp.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This will allow HDFS to write data into all specified directories.
From: dontariq@gmail.com
Date: Tue, 11 Jun 2013 23:14:08 +0530
Subject: Re: HDFS to a different location other than HADOOP HOME
To: user@hadoop.apache.org

Thank you Pramod and Shahab.Warm Regards,Tariqcloudfront.blogspot.com





On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote:


http://hadoop.apache.org/docs/stable/hdfs-default.html


dfs.data.dir
${hadoop.tmp.dir}/dfs/dataDetermines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored.




On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:



Hi Tariq,
 
What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
 
Thanks,
Raj








From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 12:49 PM
Subject: Re: HDFS to a different location other than HADOOP HOME




Hello Raj,


    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.





Warm Regards,
Tariq
cloudfront.blogspot.com



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:




 
Thanks Mustaqeem.
 
hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
 
 








From: Mohammad Mustaqeem <3m...@gmail.com>
To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 10:28 AM
Subject: Re: HDFS to a different location other than HADOOP HOME






You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 

<property>
<name>hadoop.tmp.dir</name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.





On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:




Hi,
 
I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
 
/usr/home/hadoop
 
I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
 
How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
 
Thanks,
Raj


-- 

With regards ---

Mohammad Mustaqeem,
M.Tech (CSE)
MNNIT Allahabad
9026604270










 		 	   		  

RE: HDFS to a different location other than HADOOP HOME

[Sandeep L <sa...@outlook.com>]

Instead of using ${hadoop.tmp.dir}/dfs/data you give multiple directories with absolute paths.Just try as follows:<property><name>hadoop.tmp.dir</name><value>/home1/user1/dir1,/home2/user2/dir2</value></property>This will allow HDFS to write data into all specified directories.
From: dontariq@gmail.com
Date: Tue, 11 Jun 2013 23:14:08 +0530
Subject: Re: HDFS to a different location other than HADOOP HOME
To: user@hadoop.apache.org

Thank you Pramod and Shahab.Warm Regards,Tariqcloudfront.blogspot.com





On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com> wrote:


http://hadoop.apache.org/docs/stable/hdfs-default.html


dfs.data.dir
${hadoop.tmp.dir}/dfs/dataDetermines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored.




On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:



Hi Tariq,
 
What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
 
Thanks,
Raj








From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 12:49 PM
Subject: Re: HDFS to a different location other than HADOOP HOME




Hello Raj,


    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.





Warm Regards,
Tariq
cloudfront.blogspot.com



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:




 
Thanks Mustaqeem.
 
hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
 
 








From: Mohammad Mustaqeem <3m...@gmail.com>
To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 



Sent: Tuesday, June 11, 2013 10:28 AM
Subject: Re: HDFS to a different location other than HADOOP HOME






You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 

<property>
<name>hadoop.tmp.dir</name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.





On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:




Hi,
 
I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
 
/usr/home/hadoop
 
I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
 
How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
 
Thanks,
Raj


-- 

With regards ---

Mohammad Mustaqeem,
M.Tech (CSE)
MNNIT Allahabad
9026604270










 		 	   		  

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Tariq <do...@gmail.com>]

Thank you Pramod and Shahab.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com>wrote:

> http://hadoop.apache.org/docs/stable/hdfs-default.html
> dfs.data.dir ${hadoop.tmp.dir}/dfs/dataDetermines where on the local
> filesystem an DFS data node should store its blocks. If this is a
> comma-delimited list of directories, then data will be stored in all named
> directories, typically on different devices. Directories that do not exist
> are ignored.
>
>
> On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>> Hi Tariq,
>>
>> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
>> this value defined. So what is the default value?
>>
>> Thanks,
>> Raj
>>
>>   *From:* Mohammad Tariq <do...@gmail.com>
>> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
>> hadoopraj@yahoo.com>
>> *Sent:* Tuesday, June 11, 2013 12:49 PM
>> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>>
>>  Hello Raj,
>>
>>     Although the way which Mustaqeem has told is correct, there is more
>> appropriate way to do this. Add the "dfs.data.dir" property in your
>> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
>> its value. The directory pointed by hadoop.tmp.dir also contains the
>> metadata and some other temporary files, so it's always better to have a
>> dedicated location to store the actual HDFS data.
>>
>>  Warm Regards,
>> Tariq
>> cloudfront.blogspot.com
>>
>>
>> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>>
>>
>> Thanks Mustaqeem.
>>
>> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
>> difference in files from the one we create under HADOOP_HOME.
>>
>>
>>
>>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
>> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
>> *Sent:* Tuesday, June 11, 2013 10:28 AM
>> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>>
>>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
>> -
>> <property>
>> <name>hadoop.tmp.dir</name>
>> <value>/app/software/app1</value>
>> </property>
>> "/app/software/app1" will be used as location for storing the hdfs files.
>>
>>
>>
>> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>>
>>  Hi,
>>
>> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
>> directory
>>
>> /usr/home/hadoop
>>
>> I dont have much space on /usr and want to use other
>> accounts/applications storage which are located at /app/software/app1 etc.,
>>
>> How can I use the /app/software/app1 location for my HDFS files and
>> storage. Is it possible? Please advise.
>>
>> Thanks,
>> Raj
>>
>>
>>
>>
>> --
>> *With regards ---*
>> *Mohammad Mustaqeem*,
>> M.Tech (CSE)
>> MNNIT Allahabad
>> 9026604270
>>
>>
>>
>>
>>
>>
>>
>>
>

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Tariq <do...@gmail.com>]

Thank you Pramod and Shahab.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com>wrote:

> http://hadoop.apache.org/docs/stable/hdfs-default.html
> dfs.data.dir ${hadoop.tmp.dir}/dfs/dataDetermines where on the local
> filesystem an DFS data node should store its blocks. If this is a
> comma-delimited list of directories, then data will be stored in all named
> directories, typically on different devices. Directories that do not exist
> are ignored.
>
>
> On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>> Hi Tariq,
>>
>> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
>> this value defined. So what is the default value?
>>
>> Thanks,
>> Raj
>>
>>   *From:* Mohammad Tariq <do...@gmail.com>
>> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
>> hadoopraj@yahoo.com>
>> *Sent:* Tuesday, June 11, 2013 12:49 PM
>> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>>
>>  Hello Raj,
>>
>>     Although the way which Mustaqeem has told is correct, there is more
>> appropriate way to do this. Add the "dfs.data.dir" property in your
>> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
>> its value. The directory pointed by hadoop.tmp.dir also contains the
>> metadata and some other temporary files, so it's always better to have a
>> dedicated location to store the actual HDFS data.
>>
>>  Warm Regards,
>> Tariq
>> cloudfront.blogspot.com
>>
>>
>> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>>
>>
>> Thanks Mustaqeem.
>>
>> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
>> difference in files from the one we create under HADOOP_HOME.
>>
>>
>>
>>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
>> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
>> *Sent:* Tuesday, June 11, 2013 10:28 AM
>> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>>
>>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
>> -
>> <property>
>> <name>hadoop.tmp.dir</name>
>> <value>/app/software/app1</value>
>> </property>
>> "/app/software/app1" will be used as location for storing the hdfs files.
>>
>>
>>
>> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>>
>>  Hi,
>>
>> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
>> directory
>>
>> /usr/home/hadoop
>>
>> I dont have much space on /usr and want to use other
>> accounts/applications storage which are located at /app/software/app1 etc.,
>>
>> How can I use the /app/software/app1 location for my HDFS files and
>> storage. Is it possible? Please advise.
>>
>> Thanks,
>> Raj
>>
>>
>>
>>
>> --
>> *With regards ---*
>> *Mohammad Mustaqeem*,
>> M.Tech (CSE)
>> MNNIT Allahabad
>> 9026604270
>>
>>
>>
>>
>>
>>
>>
>>
>

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Tariq <do...@gmail.com>]

Thank you Pramod and Shahab.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com>wrote:

> http://hadoop.apache.org/docs/stable/hdfs-default.html
> dfs.data.dir ${hadoop.tmp.dir}/dfs/dataDetermines where on the local
> filesystem an DFS data node should store its blocks. If this is a
> comma-delimited list of directories, then data will be stored in all named
> directories, typically on different devices. Directories that do not exist
> are ignored.
>
>
> On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>> Hi Tariq,
>>
>> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
>> this value defined. So what is the default value?
>>
>> Thanks,
>> Raj
>>
>>   *From:* Mohammad Tariq <do...@gmail.com>
>> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
>> hadoopraj@yahoo.com>
>> *Sent:* Tuesday, June 11, 2013 12:49 PM
>> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>>
>>  Hello Raj,
>>
>>     Although the way which Mustaqeem has told is correct, there is more
>> appropriate way to do this. Add the "dfs.data.dir" property in your
>> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
>> its value. The directory pointed by hadoop.tmp.dir also contains the
>> metadata and some other temporary files, so it's always better to have a
>> dedicated location to store the actual HDFS data.
>>
>>  Warm Regards,
>> Tariq
>> cloudfront.blogspot.com
>>
>>
>> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>>
>>
>> Thanks Mustaqeem.
>>
>> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
>> difference in files from the one we create under HADOOP_HOME.
>>
>>
>>
>>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
>> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
>> *Sent:* Tuesday, June 11, 2013 10:28 AM
>> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>>
>>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
>> -
>> <property>
>> <name>hadoop.tmp.dir</name>
>> <value>/app/software/app1</value>
>> </property>
>> "/app/software/app1" will be used as location for storing the hdfs files.
>>
>>
>>
>> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>>
>>  Hi,
>>
>> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
>> directory
>>
>> /usr/home/hadoop
>>
>> I dont have much space on /usr and want to use other
>> accounts/applications storage which are located at /app/software/app1 etc.,
>>
>> How can I use the /app/software/app1 location for my HDFS files and
>> storage. Is it possible? Please advise.
>>
>> Thanks,
>> Raj
>>
>>
>>
>>
>> --
>> *With regards ---*
>> *Mohammad Mustaqeem*,
>> M.Tech (CSE)
>> MNNIT Allahabad
>> 9026604270
>>
>>
>>
>>
>>
>>
>>
>>
>

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Tariq <do...@gmail.com>]

Thank you Pramod and Shahab.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Tue, Jun 11, 2013 at 11:03 PM, Shahab Yunus <sh...@gmail.com>wrote:

> http://hadoop.apache.org/docs/stable/hdfs-default.html
> dfs.data.dir ${hadoop.tmp.dir}/dfs/dataDetermines where on the local
> filesystem an DFS data node should store its blocks. If this is a
> comma-delimited list of directories, then data will be stored in all named
> directories, typically on different devices. Directories that do not exist
> are ignored.
>
>
> On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>> Hi Tariq,
>>
>> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
>> this value defined. So what is the default value?
>>
>> Thanks,
>> Raj
>>
>>   *From:* Mohammad Tariq <do...@gmail.com>
>> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
>> hadoopraj@yahoo.com>
>> *Sent:* Tuesday, June 11, 2013 12:49 PM
>> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>>
>>  Hello Raj,
>>
>>     Although the way which Mustaqeem has told is correct, there is more
>> appropriate way to do this. Add the "dfs.data.dir" property in your
>> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
>> its value. The directory pointed by hadoop.tmp.dir also contains the
>> metadata and some other temporary files, so it's always better to have a
>> dedicated location to store the actual HDFS data.
>>
>>  Warm Regards,
>> Tariq
>> cloudfront.blogspot.com
>>
>>
>> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>>
>>
>> Thanks Mustaqeem.
>>
>> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
>> difference in files from the one we create under HADOOP_HOME.
>>
>>
>>
>>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
>> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
>> *Sent:* Tuesday, June 11, 2013 10:28 AM
>> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>>
>>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
>> -
>> <property>
>> <name>hadoop.tmp.dir</name>
>> <value>/app/software/app1</value>
>> </property>
>> "/app/software/app1" will be used as location for storing the hdfs files.
>>
>>
>>
>> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>>
>>  Hi,
>>
>> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
>> directory
>>
>> /usr/home/hadoop
>>
>> I dont have much space on /usr and want to use other
>> accounts/applications storage which are located at /app/software/app1 etc.,
>>
>> How can I use the /app/software/app1 location for my HDFS files and
>> storage. Is it possible? Please advise.
>>
>> Thanks,
>> Raj
>>
>>
>>
>>
>> --
>> *With regards ---*
>> *Mohammad Mustaqeem*,
>> M.Tech (CSE)
>> MNNIT Allahabad
>> 9026604270
>>
>>
>>
>>
>>
>>
>>
>>
>

Re: HDFS to a different location other than HADOOP HOME

[Shahab Yunus <sh...@gmail.com>]

http://hadoop.apache.org/docs/stable/hdfs-default.html
dfs.data.dir${hadoop.tmp.dir}/dfs/dataDetermines where on the local
filesystem an DFS data node should store its blocks. If this is a
comma-delimited list of directories, then data will be stored in all named
directories, typically on different devices. Directories that do not exist
are ignored.


On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi Tariq,
>
> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
> this value defined. So what is the default value?
>
> Thanks,
> Raj
>
>   *From:* Mohammad Tariq <do...@gmail.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 12:49 PM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  Hello Raj,
>
>     Although the way which Mustaqeem has told is correct, there is more
> appropriate way to do this. Add the "dfs.data.dir" property in your
> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
> its value. The directory pointed by hadoop.tmp.dir also contains the
> metadata and some other temporary files, so it's always better to have a
> dedicated location to store the actual HDFS data.
>
>  Warm Regards,
> Tariq
> cloudfront.blogspot.com
>
>
> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
>
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
> -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
>
>
>
> --
> *With regards ---*
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
>
>
>
>
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Pramod N <np...@gmail.com>]

Hi Raj,
Extract from source suggests the following
<property>
  <name>dfs.data.dir</name>
  <value>${hadoop.tmp.dir}/dfs/data</value>
  <description>Determines where on the local filesystem an DFS data node
  should store its blocks.  If this is a comma-delimited
  list of directories, then data will be stored in all named
  directories, typically on different devices.
  Directories that do not exist are ignored.
  </description>
</property>


You can find the default values here
http://hadoop.apache.org/docs/stable/hdfs-default.html




Pramod N <http://atmachinelearner.blogspot.in>
Bruce Wayne of web
@machinelearner <https://twitter.com/machinelearner>

--


On Tue, Jun 11, 2013 at 10:38 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi Tariq,
>
> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
> this value defined. So what is the default value?
>
> Thanks,
> Raj
>
>   *From:* Mohammad Tariq <do...@gmail.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 12:49 PM
>
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  Hello Raj,
>
>     Although the way which Mustaqeem has told is correct, there is more
> appropriate way to do this. Add the "dfs.data.dir" property in your
> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
> its value. The directory pointed by hadoop.tmp.dir also contains the
> metadata and some other temporary files, so it's always better to have a
> dedicated location to store the actual HDFS data.
>
>  Warm Regards,
> Tariq
> cloudfront.blogspot.com
>
>
> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
>
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
> -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
>
>
>
> --
> *With regards ---*
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
>
>
>
>
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Pramod N <np...@gmail.com>]

Hi Raj,
Extract from source suggests the following
<property>
  <name>dfs.data.dir</name>
  <value>${hadoop.tmp.dir}/dfs/data</value>
  <description>Determines where on the local filesystem an DFS data node
  should store its blocks.  If this is a comma-delimited
  list of directories, then data will be stored in all named
  directories, typically on different devices.
  Directories that do not exist are ignored.
  </description>
</property>


You can find the default values here
http://hadoop.apache.org/docs/stable/hdfs-default.html




Pramod N <http://atmachinelearner.blogspot.in>
Bruce Wayne of web
@machinelearner <https://twitter.com/machinelearner>

--


On Tue, Jun 11, 2013 at 10:38 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi Tariq,
>
> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
> this value defined. So what is the default value?
>
> Thanks,
> Raj
>
>   *From:* Mohammad Tariq <do...@gmail.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 12:49 PM
>
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  Hello Raj,
>
>     Although the way which Mustaqeem has told is correct, there is more
> appropriate way to do this. Add the "dfs.data.dir" property in your
> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
> its value. The directory pointed by hadoop.tmp.dir also contains the
> metadata and some other temporary files, so it's always better to have a
> dedicated location to store the actual HDFS data.
>
>  Warm Regards,
> Tariq
> cloudfront.blogspot.com
>
>
> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
>
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
> -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
>
>
>
> --
> *With regards ---*
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
>
>
>
>
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Shahab Yunus <sh...@gmail.com>]

http://hadoop.apache.org/docs/stable/hdfs-default.html
dfs.data.dir${hadoop.tmp.dir}/dfs/dataDetermines where on the local
filesystem an DFS data node should store its blocks. If this is a
comma-delimited list of directories, then data will be stored in all named
directories, typically on different devices. Directories that do not exist
are ignored.


On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi Tariq,
>
> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
> this value defined. So what is the default value?
>
> Thanks,
> Raj
>
>   *From:* Mohammad Tariq <do...@gmail.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 12:49 PM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  Hello Raj,
>
>     Although the way which Mustaqeem has told is correct, there is more
> appropriate way to do this. Add the "dfs.data.dir" property in your
> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
> its value. The directory pointed by hadoop.tmp.dir also contains the
> metadata and some other temporary files, so it's always better to have a
> dedicated location to store the actual HDFS data.
>
>  Warm Regards,
> Tariq
> cloudfront.blogspot.com
>
>
> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
>
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
> -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
>
>
>
> --
> *With regards ---*
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
>
>
>
>
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Shahab Yunus <sh...@gmail.com>]

http://hadoop.apache.org/docs/stable/hdfs-default.html
dfs.data.dir${hadoop.tmp.dir}/dfs/dataDetermines where on the local
filesystem an DFS data node should store its blocks. If this is a
comma-delimited list of directories, then data will be stored in all named
directories, typically on different devices. Directories that do not exist
are ignored.


On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi Tariq,
>
> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
> this value defined. So what is the default value?
>
> Thanks,
> Raj
>
>   *From:* Mohammad Tariq <do...@gmail.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 12:49 PM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  Hello Raj,
>
>     Although the way which Mustaqeem has told is correct, there is more
> appropriate way to do this. Add the "dfs.data.dir" property in your
> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
> its value. The directory pointed by hadoop.tmp.dir also contains the
> metadata and some other temporary files, so it's always better to have a
> dedicated location to store the actual HDFS data.
>
>  Warm Regards,
> Tariq
> cloudfront.blogspot.com
>
>
> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
>
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
> -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
>
>
>
> --
> *With regards ---*
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
>
>
>
>
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Pramod N <np...@gmail.com>]

Hi Raj,
Extract from source suggests the following
<property>
  <name>dfs.data.dir</name>
  <value>${hadoop.tmp.dir}/dfs/data</value>
  <description>Determines where on the local filesystem an DFS data node
  should store its blocks.  If this is a comma-delimited
  list of directories, then data will be stored in all named
  directories, typically on different devices.
  Directories that do not exist are ignored.
  </description>
</property>


You can find the default values here
http://hadoop.apache.org/docs/stable/hdfs-default.html




Pramod N <http://atmachinelearner.blogspot.in>
Bruce Wayne of web
@machinelearner <https://twitter.com/machinelearner>

--


On Tue, Jun 11, 2013 at 10:38 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi Tariq,
>
> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
> this value defined. So what is the default value?
>
> Thanks,
> Raj
>
>   *From:* Mohammad Tariq <do...@gmail.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 12:49 PM
>
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  Hello Raj,
>
>     Although the way which Mustaqeem has told is correct, there is more
> appropriate way to do this. Add the "dfs.data.dir" property in your
> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
> its value. The directory pointed by hadoop.tmp.dir also contains the
> metadata and some other temporary files, so it's always better to have a
> dedicated location to store the actual HDFS data.
>
>  Warm Regards,
> Tariq
> cloudfront.blogspot.com
>
>
> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
>
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
> -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
>
>
>
> --
> *With regards ---*
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
>
>
>
>
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Shahab Yunus <sh...@gmail.com>]

http://hadoop.apache.org/docs/stable/hdfs-default.html
dfs.data.dir${hadoop.tmp.dir}/dfs/dataDetermines where on the local
filesystem an DFS data node should store its blocks. If this is a
comma-delimited list of directories, then data will be stored in all named
directories, typically on different devices. Directories that do not exist
are ignored.


On Tue, Jun 11, 2013 at 1:08 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi Tariq,
>
> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
> this value defined. So what is the default value?
>
> Thanks,
> Raj
>
>   *From:* Mohammad Tariq <do...@gmail.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 12:49 PM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  Hello Raj,
>
>     Although the way which Mustaqeem has told is correct, there is more
> appropriate way to do this. Add the "dfs.data.dir" property in your
> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
> its value. The directory pointed by hadoop.tmp.dir also contains the
> metadata and some other temporary files, so it's always better to have a
> dedicated location to store the actual HDFS data.
>
>  Warm Regards,
> Tariq
> cloudfront.blogspot.com
>
>
> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
>
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
> -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
>
>
>
> --
> *With regards ---*
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
>
>
>
>
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Pramod N <np...@gmail.com>]

Hi Raj,
Extract from source suggests the following
<property>
  <name>dfs.data.dir</name>
  <value>${hadoop.tmp.dir}/dfs/data</value>
  <description>Determines where on the local filesystem an DFS data node
  should store its blocks.  If this is a comma-delimited
  list of directories, then data will be stored in all named
  directories, typically on different devices.
  Directories that do not exist are ignored.
  </description>
</property>


You can find the default values here
http://hadoop.apache.org/docs/stable/hdfs-default.html




Pramod N <http://atmachinelearner.blogspot.in>
Bruce Wayne of web
@machinelearner <https://twitter.com/machinelearner>

--


On Tue, Jun 11, 2013 at 10:38 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi Tariq,
>
> What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have
> this value defined. So what is the default value?
>
> Thanks,
> Raj
>
>   *From:* Mohammad Tariq <do...@gmail.com>
> *To:* "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 12:49 PM
>
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  Hello Raj,
>
>     Although the way which Mustaqeem has told is correct, there is more
> appropriate way to do this. Add the "dfs.data.dir" property in your
> hdfs-site.xml and give the "path you want to use for HDFS data storage" as
> its value. The directory pointed by hadoop.tmp.dir also contains the
> metadata and some other temporary files, so it's always better to have a
> dedicated location to store the actual HDFS data.
>
>  Warm Regards,
> Tariq
> cloudfront.blogspot.com
>
>
> On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
>
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
> -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
>
>
>
> --
> *With regards ---*
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
>
>
>
>
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

Hi Tariq,
 
What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
 
Thanks,
Raj


________________________________
From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
Sent: Tuesday, June 11, 2013 12:49 PM
Subject: Re: HDFS to a different location other than HADOOP HOME



Hello Raj, 

    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.


Warm Regards, 
Tariq
cloudfront.blogspot.com



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:

 
>Thanks Mustaqeem.
> 
>hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
> 
> 
>
>
>From: Mohammad Mustaqeem <3m...@gmail.com>
>To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>Sent: Tuesday, June 11, 2013 10:28 AM
>Subject: Re: HDFS to a different location other than HADOOP HOME
>
>
>
>You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
><property>
><name>hadoop.tmp.dir</name>
><value>/app/software/app1</value>
></property>
>"/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
>
>
>On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Hi,
>>
>>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>>
>>/usr/home/hadoop
>>
>>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>>
>>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>>
>>Thanks,
>>Raj
>
>
>
>-- 
>
>With regards ---
>
>Mohammad Mustaqeem,
>M.Tech (CSE)
>MNNIT Allahabad
>9026604270
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

Hi Tariq,
 
What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
 
Thanks,
Raj


________________________________
From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
Sent: Tuesday, June 11, 2013 12:49 PM
Subject: Re: HDFS to a different location other than HADOOP HOME



Hello Raj, 

    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.


Warm Regards, 
Tariq
cloudfront.blogspot.com



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:

 
>Thanks Mustaqeem.
> 
>hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
> 
> 
>
>
>From: Mohammad Mustaqeem <3m...@gmail.com>
>To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>Sent: Tuesday, June 11, 2013 10:28 AM
>Subject: Re: HDFS to a different location other than HADOOP HOME
>
>
>
>You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
><property>
><name>hadoop.tmp.dir</name>
><value>/app/software/app1</value>
></property>
>"/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
>
>
>On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Hi,
>>
>>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>>
>>/usr/home/hadoop
>>
>>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>>
>>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>>
>>Thanks,
>>Raj
>
>
>
>-- 
>
>With regards ---
>
>Mohammad Mustaqeem,
>M.Tech (CSE)
>MNNIT Allahabad
>9026604270
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

Hi Tariq,
 
What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
 
Thanks,
Raj


________________________________
From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
Sent: Tuesday, June 11, 2013 12:49 PM
Subject: Re: HDFS to a different location other than HADOOP HOME



Hello Raj, 

    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.


Warm Regards, 
Tariq
cloudfront.blogspot.com



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:

 
>Thanks Mustaqeem.
> 
>hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
> 
> 
>
>
>From: Mohammad Mustaqeem <3m...@gmail.com>
>To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>Sent: Tuesday, June 11, 2013 10:28 AM
>Subject: Re: HDFS to a different location other than HADOOP HOME
>
>
>
>You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
><property>
><name>hadoop.tmp.dir</name>
><value>/app/software/app1</value>
></property>
>"/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
>
>
>On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Hi,
>>
>>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>>
>>/usr/home/hadoop
>>
>>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>>
>>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>>
>>Thanks,
>>Raj
>
>
>
>-- 
>
>With regards ---
>
>Mohammad Mustaqeem,
>M.Tech (CSE)
>MNNIT Allahabad
>9026604270
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

Hi Tariq,
 
What is the default value of dfs.data.dir? My hdfs-site.xml doesnt have this value defined. So what is the default value?
 
Thanks,
Raj


________________________________
From: Mohammad Tariq <do...@gmail.com>
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
Sent: Tuesday, June 11, 2013 12:49 PM
Subject: Re: HDFS to a different location other than HADOOP HOME



Hello Raj, 

    Although the way which Mustaqeem has told is correct, there is more appropriate way to do this. Add the "dfs.data.dir" property in your hdfs-site.xml and give the "path you want to use for HDFS data storage" as its value. The directory pointed by hadoop.tmp.dir also contains the metadata and some other temporary files, so it's always better to have a dedicated location to store the actual HDFS data.


Warm Regards, 
Tariq
cloudfront.blogspot.com



On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:

 
>Thanks Mustaqeem.
> 
>hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
> 
> 
>
>
>From: Mohammad Mustaqeem <3m...@gmail.com>
>To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
>Sent: Tuesday, June 11, 2013 10:28 AM
>Subject: Re: HDFS to a different location other than HADOOP HOME
>
>
>
>You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
><property>
><name>hadoop.tmp.dir</name>
><value>/app/software/app1</value>
></property>
>"/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
>
>
>On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Hi,
>>
>>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>>
>>/usr/home/hadoop
>>
>>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>>
>>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>>
>>Thanks,
>>Raj
>
>
>
>-- 
>
>With regards ---
>
>Mohammad Mustaqeem,
>M.Tech (CSE)
>MNNIT Allahabad
>9026604270
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Tariq <do...@gmail.com>]

Hello Raj,

    Although the way which Mustaqeem has told is correct, there is more
appropriate way to do this. Add the "dfs.data.dir" property in your
hdfs-site.xml and give the "path you want to use for HDFS data storage" as
its value. The directory pointed by hadoop.tmp.dir also contains the
metadata and some other temporary files, so it's always better to have a
dedicated location to store the actual HDFS data.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:

>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
>
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
> -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
>
>
>
> --
> *With regards ---*
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
>
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Tariq <do...@gmail.com>]

Hello Raj,

    Although the way which Mustaqeem has told is correct, there is more
appropriate way to do this. Add the "dfs.data.dir" property in your
hdfs-site.xml and give the "path you want to use for HDFS data storage" as
its value. The directory pointed by hadoop.tmp.dir also contains the
metadata and some other temporary files, so it's always better to have a
dedicated location to store the actual HDFS data.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:

>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
>
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
> -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
>
>
>
> --
> *With regards ---*
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
>
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Tariq <do...@gmail.com>]

Hello Raj,

    Although the way which Mustaqeem has told is correct, there is more
appropriate way to do this. Add the "dfs.data.dir" property in your
hdfs-site.xml and give the "path you want to use for HDFS data storage" as
its value. The directory pointed by hadoop.tmp.dir also contains the
metadata and some other temporary files, so it's always better to have a
dedicated location to store the actual HDFS data.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:

>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
>
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
> -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
>
>
>
> --
> *With regards ---*
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
>
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Tariq <do...@gmail.com>]

Hello Raj,

    Although the way which Mustaqeem has told is correct, there is more
appropriate way to do this. Add the "dfs.data.dir" property in your
hdfs-site.xml and give the "path you want to use for HDFS data storage" as
its value. The directory pointed by hadoop.tmp.dir also contains the
metadata and some other temporary files, so it's always better to have a
dedicated location to store the actual HDFS data.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Tue, Jun 11, 2013 at 8:12 PM, Raj Hadoop <ha...@yahoo.com> wrote:

>
> Thanks Mustaqeem.
>
> hadoop.tmp.dir - Can this store HDFS files? I mean - is there any
> difference in files from the one we create under HADOOP_HOME.
>
>
>
>   *From:* Mohammad Mustaqeem <3m...@gmail.com>
> *To:* user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com>
> *Sent:* Tuesday, June 11, 2013 10:28 AM
> *Subject:* Re: HDFS to a different location other than HADOOP HOME
>
>  You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as
> -
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/app/software/app1</value>
> </property>
> "/app/software/app1" will be used as location for storing the hdfs files.
>
>
>
> On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>  Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>
>
>
>
> --
> *With regards ---*
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad
> 9026604270
>
>
>
>
>

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

 
Thanks Mustaqeem.
 
hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
 
 


________________________________
From: Mohammad Mustaqeem <3m...@gmail.com>
To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
Sent: Tuesday, June 11, 2013 10:28 AM
Subject: Re: HDFS to a different location other than HADOOP HOME



You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
<property>
<name>hadoop.tmp.dir</name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.




On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:

Hi,
>
>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>
>/usr/home/hadoop
>
>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>
>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>
>Thanks,
>Raj


-- 

With regards ---

Mohammad Mustaqeem,
M.Tech (CSE)
MNNIT Allahabad
9026604270

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

 
Thanks Mustaqeem.
 
hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
 
 


________________________________
From: Mohammad Mustaqeem <3m...@gmail.com>
To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
Sent: Tuesday, June 11, 2013 10:28 AM
Subject: Re: HDFS to a different location other than HADOOP HOME



You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
<property>
<name>hadoop.tmp.dir</name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.




On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:

Hi,
>
>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>
>/usr/home/hadoop
>
>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>
>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>
>Thanks,
>Raj


-- 

With regards ---

Mohammad Mustaqeem,
M.Tech (CSE)
MNNIT Allahabad
9026604270

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

 
Thanks Mustaqeem.
 
hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
 
 


________________________________
From: Mohammad Mustaqeem <3m...@gmail.com>
To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
Sent: Tuesday, June 11, 2013 10:28 AM
Subject: Re: HDFS to a different location other than HADOOP HOME



You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
<property>
<name>hadoop.tmp.dir</name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.




On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:

Hi,
>
>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>
>/usr/home/hadoop
>
>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>
>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>
>Thanks,
>Raj


-- 

With regards ---

Mohammad Mustaqeem,
M.Tech (CSE)
MNNIT Allahabad
9026604270

Re: HDFS to a different location other than HADOOP HOME

[Raj Hadoop <ha...@yahoo.com>]

 
Thanks Mustaqeem.
 
hadoop.tmp.dir - Can this store HDFS files? I mean - is there any difference in files from the one we create under HADOOP_HOME.
 
 


________________________________
From: Mohammad Mustaqeem <3m...@gmail.com>
To: user <us...@hadoop.apache.org>; Raj Hadoop <ha...@yahoo.com> 
Sent: Tuesday, June 11, 2013 10:28 AM
Subject: Re: HDFS to a different location other than HADOOP HOME



You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as - 
<property>
<name>hadoop.tmp.dir</name>
<value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.




On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:

Hi,
>
>I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a directory
>
>/usr/home/hadoop
>
>I dont have much space on /usr and want to use other accounts/applications storage which are located at /app/software/app1 etc.,
>
>How can I use the /app/software/app1 location for my HDFS files and storage. Is it possible? Please advise.
>
>Thanks,
>Raj


-- 

With regards ---

Mohammad Mustaqeem,
M.Tech (CSE)
MNNIT Allahabad
9026604270

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Mustaqeem <3m...@gmail.com>]

You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as -
<property>
<name>hadoop.tmp.dir</name>
 <value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.



On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>



-- 
*With regards ---*
*Mohammad Mustaqeem*,
M.Tech (CSE)
MNNIT Allahabad
9026604270

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Mustaqeem <3m...@gmail.com>]

You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as -
<property>
<name>hadoop.tmp.dir</name>
 <value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.



On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>



-- 
*With regards ---*
*Mohammad Mustaqeem*,
M.Tech (CSE)
MNNIT Allahabad
9026604270

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Mustaqeem <3m...@gmail.com>]

You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as -
<property>
<name>hadoop.tmp.dir</name>
 <value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.



On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>



-- 
*With regards ---*
*Mohammad Mustaqeem*,
M.Tech (CSE)
MNNIT Allahabad
9026604270

Re: HDFS to a different location other than HADOOP HOME

[Mohammad Mustaqeem <3m...@gmail.com>]

You can mentioned the "hadoop.tmp.dir" property in the core-site.xml as -
<property>
<name>hadoop.tmp.dir</name>
 <value>/app/software/app1</value>
</property>
"/app/software/app1" will be used as location for storing the hdfs files.



On Tue, Jun 11, 2013 at 7:52 PM, Raj Hadoop <ha...@yahoo.com> wrote:

> Hi,
>
> I have a one node Hadoop cluster for my POC. The HADOOP_HOME is under a
> directory
>
> /usr/home/hadoop
>
> I dont have much space on /usr and want to use other accounts/applications
> storage which are located at /app/software/app1 etc.,
>
> How can I use the /app/software/app1 location for my HDFS files and
> storage. Is it possible? Please advise.
>
> Thanks,
> Raj
>



-- 
*With regards ---*
*Mohammad Mustaqeem*,
M.Tech (CSE)
MNNIT Allahabad
9026604270