You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Tadas Makčinskas <Ta...@bdc.lt> on 2012/12/18 11:51:59 UTC
#of disk partitions on a phisical machine
I have several physical machines with two mounted hard disks each. Now going through partitioning process and not sure should I leave partitions according to the disk size or it’s better to merge them as one?
As I will have just one JT, DN per server not sure how multiple partitions will be handled within Hadoop. Do they perform in such a manner?
Thanks, Tadas
RE: #of disk partitions on a phisical machine
Posted by Tadas Makčinskas <Ta...@bdc.lt>.
will try to configure my machines in that manner
thanks, Tadas
From: Mohammad Tariq [mailto:dontariq@gmail.com]
Sent: 2012.12.18 13:08
To: user@hadoop.apache.org
Subject: Re: #of disk partitions on a phisical machine
Hello Tadas,
It is actually a good option to have multiple disks attached to a machine often referred to as JBOD (just a bunch of disks) configuration. Just have to add the properties as specified my Mr. Nitin.
Best Regards,
Tariq
+91-9741563634
On Tue, Dec 18, 2012 at 4:35 PM, Nitin Pawar <ni...@gmail.com>> wrote:
you can have multiple partitions (multiple directories)
when you setup your hdfs you will need to set
<property>
<name>dfs.data.dir</name>
<value>dir1,
dir2
<final>true</final>
</property
On Tue, Dec 18, 2012 at 4:21 PM, Tadas Makčinskas <Ta...@bdc.lt>> wrote:
I have several physical machines with two mounted hard disks each. Now going through partitioning process and not sure should I leave partitions according to the disk size or it’s better to merge them as one?
As I will have just one JT, DN per server not sure how multiple partitions will be handled within Hadoop. Do they perform in such a manner?
Thanks, Tadas
--
Nitin Pawar
RE: #of disk partitions on a phisical machine
Posted by Tadas Makčinskas <Ta...@bdc.lt>.
will try to configure my machines in that manner
thanks, Tadas
From: Mohammad Tariq [mailto:dontariq@gmail.com]
Sent: 2012.12.18 13:08
To: user@hadoop.apache.org
Subject: Re: #of disk partitions on a phisical machine
Hello Tadas,
It is actually a good option to have multiple disks attached to a machine often referred to as JBOD (just a bunch of disks) configuration. Just have to add the properties as specified my Mr. Nitin.
Best Regards,
Tariq
+91-9741563634
On Tue, Dec 18, 2012 at 4:35 PM, Nitin Pawar <ni...@gmail.com>> wrote:
you can have multiple partitions (multiple directories)
when you setup your hdfs you will need to set
<property>
<name>dfs.data.dir</name>
<value>dir1,
dir2
<final>true</final>
</property
On Tue, Dec 18, 2012 at 4:21 PM, Tadas Makčinskas <Ta...@bdc.lt>> wrote:
I have several physical machines with two mounted hard disks each. Now going through partitioning process and not sure should I leave partitions according to the disk size or it’s better to merge them as one?
As I will have just one JT, DN per server not sure how multiple partitions will be handled within Hadoop. Do they perform in such a manner?
Thanks, Tadas
--
Nitin Pawar
RE: #of disk partitions on a phisical machine
Posted by Tadas Makčinskas <Ta...@bdc.lt>.
will try to configure my machines in that manner
thanks, Tadas
From: Mohammad Tariq [mailto:dontariq@gmail.com]
Sent: 2012.12.18 13:08
To: user@hadoop.apache.org
Subject: Re: #of disk partitions on a phisical machine
Hello Tadas,
It is actually a good option to have multiple disks attached to a machine often referred to as JBOD (just a bunch of disks) configuration. Just have to add the properties as specified my Mr. Nitin.
Best Regards,
Tariq
+91-9741563634
On Tue, Dec 18, 2012 at 4:35 PM, Nitin Pawar <ni...@gmail.com>> wrote:
you can have multiple partitions (multiple directories)
when you setup your hdfs you will need to set
<property>
<name>dfs.data.dir</name>
<value>dir1,
dir2
<final>true</final>
</property
On Tue, Dec 18, 2012 at 4:21 PM, Tadas Makčinskas <Ta...@bdc.lt>> wrote:
I have several physical machines with two mounted hard disks each. Now going through partitioning process and not sure should I leave partitions according to the disk size or it’s better to merge them as one?
As I will have just one JT, DN per server not sure how multiple partitions will be handled within Hadoop. Do they perform in such a manner?
Thanks, Tadas
--
Nitin Pawar
RE: #of disk partitions on a phisical machine
Posted by Tadas Makčinskas <Ta...@bdc.lt>.
will try to configure my machines in that manner
thanks, Tadas
From: Mohammad Tariq [mailto:dontariq@gmail.com]
Sent: 2012.12.18 13:08
To: user@hadoop.apache.org
Subject: Re: #of disk partitions on a phisical machine
Hello Tadas,
It is actually a good option to have multiple disks attached to a machine often referred to as JBOD (just a bunch of disks) configuration. Just have to add the properties as specified my Mr. Nitin.
Best Regards,
Tariq
+91-9741563634
On Tue, Dec 18, 2012 at 4:35 PM, Nitin Pawar <ni...@gmail.com>> wrote:
you can have multiple partitions (multiple directories)
when you setup your hdfs you will need to set
<property>
<name>dfs.data.dir</name>
<value>dir1,
dir2
<final>true</final>
</property
On Tue, Dec 18, 2012 at 4:21 PM, Tadas Makčinskas <Ta...@bdc.lt>> wrote:
I have several physical machines with two mounted hard disks each. Now going through partitioning process and not sure should I leave partitions according to the disk size or it’s better to merge them as one?
As I will have just one JT, DN per server not sure how multiple partitions will be handled within Hadoop. Do they perform in such a manner?
Thanks, Tadas
--
Nitin Pawar
Re: #of disk partitions on a phisical machine
Posted by Mohammad Tariq <do...@gmail.com>.
Hello Tadas,
It is actually a good option to have multiple disks attached to a
machine often referred to as JBOD (just a bunch of disks) configuration.
Just have to add the properties as specified my Mr. Nitin.
Best Regards,
Tariq
+91-9741563634
On Tue, Dec 18, 2012 at 4:35 PM, Nitin Pawar <ni...@gmail.com>wrote:
> you can have multiple partitions (multiple directories)
>
> when you setup your hdfs you will need to set
>
> <property>
> <name>dfs.data.dir</name>
> <value>dir1,
> dir2
> <final>true</final>
> </property
>
>
> On Tue, Dec 18, 2012 at 4:21 PM, Tadas Makčinskas <Tadas.Makcinskas@bdc.lt
> > wrote:
>
>> I have several physical machines with two mounted hard disks each. Now
>> going through partitioning process and not sure should I leave partitions
>> according to the disk size or it’s better to merge them as one?****
>>
>> ** **
>>
>> As I will have just one JT, DN per server not sure how multiple
>> partitions will be handled within Hadoop. Do they perform in such a manner?
>> ****
>>
>> ** **
>>
>> Thanks, Tadas****
>>
>
>
>
> --
> Nitin Pawar
>
>
Re: #of disk partitions on a phisical machine
Posted by Mohammad Tariq <do...@gmail.com>.
Hello Tadas,
It is actually a good option to have multiple disks attached to a
machine often referred to as JBOD (just a bunch of disks) configuration.
Just have to add the properties as specified my Mr. Nitin.
Best Regards,
Tariq
+91-9741563634
On Tue, Dec 18, 2012 at 4:35 PM, Nitin Pawar <ni...@gmail.com>wrote:
> you can have multiple partitions (multiple directories)
>
> when you setup your hdfs you will need to set
>
> <property>
> <name>dfs.data.dir</name>
> <value>dir1,
> dir2
> <final>true</final>
> </property
>
>
> On Tue, Dec 18, 2012 at 4:21 PM, Tadas Makčinskas <Tadas.Makcinskas@bdc.lt
> > wrote:
>
>> I have several physical machines with two mounted hard disks each. Now
>> going through partitioning process and not sure should I leave partitions
>> according to the disk size or it’s better to merge them as one?****
>>
>> ** **
>>
>> As I will have just one JT, DN per server not sure how multiple
>> partitions will be handled within Hadoop. Do they perform in such a manner?
>> ****
>>
>> ** **
>>
>> Thanks, Tadas****
>>
>
>
>
> --
> Nitin Pawar
>
>
Re: #of disk partitions on a phisical machine
Posted by Mohammad Tariq <do...@gmail.com>.
Hello Tadas,
It is actually a good option to have multiple disks attached to a
machine often referred to as JBOD (just a bunch of disks) configuration.
Just have to add the properties as specified my Mr. Nitin.
Best Regards,
Tariq
+91-9741563634
On Tue, Dec 18, 2012 at 4:35 PM, Nitin Pawar <ni...@gmail.com>wrote:
> you can have multiple partitions (multiple directories)
>
> when you setup your hdfs you will need to set
>
> <property>
> <name>dfs.data.dir</name>
> <value>dir1,
> dir2
> <final>true</final>
> </property
>
>
> On Tue, Dec 18, 2012 at 4:21 PM, Tadas Makčinskas <Tadas.Makcinskas@bdc.lt
> > wrote:
>
>> I have several physical machines with two mounted hard disks each. Now
>> going through partitioning process and not sure should I leave partitions
>> according to the disk size or it’s better to merge them as one?****
>>
>> ** **
>>
>> As I will have just one JT, DN per server not sure how multiple
>> partitions will be handled within Hadoop. Do they perform in such a manner?
>> ****
>>
>> ** **
>>
>> Thanks, Tadas****
>>
>
>
>
> --
> Nitin Pawar
>
>
Re: #of disk partitions on a phisical machine
Posted by Mohammad Tariq <do...@gmail.com>.
Hello Tadas,
It is actually a good option to have multiple disks attached to a
machine often referred to as JBOD (just a bunch of disks) configuration.
Just have to add the properties as specified my Mr. Nitin.
Best Regards,
Tariq
+91-9741563634
On Tue, Dec 18, 2012 at 4:35 PM, Nitin Pawar <ni...@gmail.com>wrote:
> you can have multiple partitions (multiple directories)
>
> when you setup your hdfs you will need to set
>
> <property>
> <name>dfs.data.dir</name>
> <value>dir1,
> dir2
> <final>true</final>
> </property
>
>
> On Tue, Dec 18, 2012 at 4:21 PM, Tadas Makčinskas <Tadas.Makcinskas@bdc.lt
> > wrote:
>
>> I have several physical machines with two mounted hard disks each. Now
>> going through partitioning process and not sure should I leave partitions
>> according to the disk size or it’s better to merge them as one?****
>>
>> ** **
>>
>> As I will have just one JT, DN per server not sure how multiple
>> partitions will be handled within Hadoop. Do they perform in such a manner?
>> ****
>>
>> ** **
>>
>> Thanks, Tadas****
>>
>
>
>
> --
> Nitin Pawar
>
>
Re: #of disk partitions on a phisical machine
Posted by Nitin Pawar <ni...@gmail.com>.
you can have multiple partitions (multiple directories)
when you setup your hdfs you will need to set
<property>
<name>dfs.data.dir</name>
<value>dir1,
dir2
<final>true</final>
</property
On Tue, Dec 18, 2012 at 4:21 PM, Tadas Makčinskas
<Ta...@bdc.lt>wrote:
> I have several physical machines with two mounted hard disks each. Now
> going through partitioning process and not sure should I leave partitions
> according to the disk size or it’s better to merge them as one?****
>
> ** **
>
> As I will have just one JT, DN per server not sure how multiple
> partitions will be handled within Hadoop. Do they perform in such a manner?
> ****
>
> ** **
>
> Thanks, Tadas****
>
--
Nitin Pawar
Re: #of disk partitions on a phisical machine
Posted by Nitin Pawar <ni...@gmail.com>.
you can have multiple partitions (multiple directories)
when you setup your hdfs you will need to set
<property>
<name>dfs.data.dir</name>
<value>dir1,
dir2
<final>true</final>
</property
On Tue, Dec 18, 2012 at 4:21 PM, Tadas Makčinskas
<Ta...@bdc.lt>wrote:
> I have several physical machines with two mounted hard disks each. Now
> going through partitioning process and not sure should I leave partitions
> according to the disk size or it’s better to merge them as one?****
>
> ** **
>
> As I will have just one JT, DN per server not sure how multiple
> partitions will be handled within Hadoop. Do they perform in such a manner?
> ****
>
> ** **
>
> Thanks, Tadas****
>
--
Nitin Pawar
Re: #of disk partitions on a phisical machine
Posted by Nitin Pawar <ni...@gmail.com>.
you can have multiple partitions (multiple directories)
when you setup your hdfs you will need to set
<property>
<name>dfs.data.dir</name>
<value>dir1,
dir2
<final>true</final>
</property
On Tue, Dec 18, 2012 at 4:21 PM, Tadas Makčinskas
<Ta...@bdc.lt>wrote:
> I have several physical machines with two mounted hard disks each. Now
> going through partitioning process and not sure should I leave partitions
> according to the disk size or it’s better to merge them as one?****
>
> ** **
>
> As I will have just one JT, DN per server not sure how multiple
> partitions will be handled within Hadoop. Do they perform in such a manner?
> ****
>
> ** **
>
> Thanks, Tadas****
>
--
Nitin Pawar
Re: #of disk partitions on a phisical machine
Posted by Nitin Pawar <ni...@gmail.com>.
you can have multiple partitions (multiple directories)
when you setup your hdfs you will need to set
<property>
<name>dfs.data.dir</name>
<value>dir1,
dir2
<final>true</final>
</property
On Tue, Dec 18, 2012 at 4:21 PM, Tadas Makčinskas
<Ta...@bdc.lt>wrote:
> I have several physical machines with two mounted hard disks each. Now
> going through partitioning process and not sure should I leave partitions
> according to the disk size or it’s better to merge them as one?****
>
> ** **
>
> As I will have just one JT, DN per server not sure how multiple
> partitions will be handled within Hadoop. Do they perform in such a manner?
> ****
>
> ** **
>
> Thanks, Tadas****
>
--
Nitin Pawar