You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by SF Hadoop <sf...@gmail.com> on 2014/10/03 01:12:21 UTC
Block placement without rack aware
What is the block placement policy hadoop follows when rack aware is not
enabled?
Does it just round robin?
Thanks.
RE: Block placement without rack aware
Posted by "Liu, Yi A" <yi...@intel.com>.
It’s still random.
If rack aware is not enabled, all nodes are in “default-rack”, and random nodes are chosen for block replications.
Regards,
Yi Liu
From: SF Hadoop [mailto:sfhadoop@gmail.com]
Sent: Friday, October 03, 2014 7:12 AM
To: user@hadoop.apache.org
Subject: Block placement without rack aware
What is the block placement policy hadoop follows when rack aware is not enabled?
Does it just round robin?
Thanks.
Re: Block placement without rack aware
Posted by SF Hadoop <sf...@gmail.com>.
Thanks for the info. Exactly what I needed.
Cheers.
On Thu, Oct 2, 2014 at 4:21 PM, Pradeep Gollakota <pr...@gmail.com>
wrote:
> It appears to be randomly chosen. I just came across this blog post from
> Lars George about HBase file locality in HDFS
> http://www.larsgeorge.com/2010/05/hbase-file-locality-in-hdfs.html
>
> On Thu, Oct 2, 2014 at 4:12 PM, SF Hadoop <sf...@gmail.com> wrote:
>
>> What is the block placement policy hadoop follows when rack aware is not
>> enabled?
>>
>> Does it just round robin?
>>
>> Thanks.
>>
>
>
Re: Block placement without rack aware
Posted by SF Hadoop <sf...@gmail.com>.
Thanks for the info. Exactly what I needed.
Cheers.
On Thu, Oct 2, 2014 at 4:21 PM, Pradeep Gollakota <pr...@gmail.com>
wrote:
> It appears to be randomly chosen. I just came across this blog post from
> Lars George about HBase file locality in HDFS
> http://www.larsgeorge.com/2010/05/hbase-file-locality-in-hdfs.html
>
> On Thu, Oct 2, 2014 at 4:12 PM, SF Hadoop <sf...@gmail.com> wrote:
>
>> What is the block placement policy hadoop follows when rack aware is not
>> enabled?
>>
>> Does it just round robin?
>>
>> Thanks.
>>
>
>
Re: Block placement without rack aware
Posted by SF Hadoop <sf...@gmail.com>.
Thanks for the info. Exactly what I needed.
Cheers.
On Thu, Oct 2, 2014 at 4:21 PM, Pradeep Gollakota <pr...@gmail.com>
wrote:
> It appears to be randomly chosen. I just came across this blog post from
> Lars George about HBase file locality in HDFS
> http://www.larsgeorge.com/2010/05/hbase-file-locality-in-hdfs.html
>
> On Thu, Oct 2, 2014 at 4:12 PM, SF Hadoop <sf...@gmail.com> wrote:
>
>> What is the block placement policy hadoop follows when rack aware is not
>> enabled?
>>
>> Does it just round robin?
>>
>> Thanks.
>>
>
>
Re: Block placement without rack aware
Posted by SF Hadoop <sf...@gmail.com>.
Thanks for the info. Exactly what I needed.
Cheers.
On Thu, Oct 2, 2014 at 4:21 PM, Pradeep Gollakota <pr...@gmail.com>
wrote:
> It appears to be randomly chosen. I just came across this blog post from
> Lars George about HBase file locality in HDFS
> http://www.larsgeorge.com/2010/05/hbase-file-locality-in-hdfs.html
>
> On Thu, Oct 2, 2014 at 4:12 PM, SF Hadoop <sf...@gmail.com> wrote:
>
>> What is the block placement policy hadoop follows when rack aware is not
>> enabled?
>>
>> Does it just round robin?
>>
>> Thanks.
>>
>
>
Re: Block placement without rack aware
Posted by Pradeep Gollakota <pr...@gmail.com>.
It appears to be randomly chosen. I just came across this blog post from
Lars George about HBase file locality in HDFS
http://www.larsgeorge.com/2010/05/hbase-file-locality-in-hdfs.html
On Thu, Oct 2, 2014 at 4:12 PM, SF Hadoop <sf...@gmail.com> wrote:
> What is the block placement policy hadoop follows when rack aware is not
> enabled?
>
> Does it just round robin?
>
> Thanks.
>
Re: Block placement without rack aware
Posted by Pradeep Gollakota <pr...@gmail.com>.
It appears to be randomly chosen. I just came across this blog post from
Lars George about HBase file locality in HDFS
http://www.larsgeorge.com/2010/05/hbase-file-locality-in-hdfs.html
On Thu, Oct 2, 2014 at 4:12 PM, SF Hadoop <sf...@gmail.com> wrote:
> What is the block placement policy hadoop follows when rack aware is not
> enabled?
>
> Does it just round robin?
>
> Thanks.
>
RE: Block placement without rack aware
Posted by "Liu, Yi A" <yi...@intel.com>.
It’s still random.
If rack aware is not enabled, all nodes are in “default-rack”, and random nodes are chosen for block replications.
Regards,
Yi Liu
From: SF Hadoop [mailto:sfhadoop@gmail.com]
Sent: Friday, October 03, 2014 7:12 AM
To: user@hadoop.apache.org
Subject: Block placement without rack aware
What is the block placement policy hadoop follows when rack aware is not enabled?
Does it just round robin?
Thanks.
Re: Block placement without rack aware
Posted by Pradeep Gollakota <pr...@gmail.com>.
It appears to be randomly chosen. I just came across this blog post from
Lars George about HBase file locality in HDFS
http://www.larsgeorge.com/2010/05/hbase-file-locality-in-hdfs.html
On Thu, Oct 2, 2014 at 4:12 PM, SF Hadoop <sf...@gmail.com> wrote:
> What is the block placement policy hadoop follows when rack aware is not
> enabled?
>
> Does it just round robin?
>
> Thanks.
>
RE: Block placement without rack aware
Posted by "Liu, Yi A" <yi...@intel.com>.
It’s still random.
If rack aware is not enabled, all nodes are in “default-rack”, and random nodes are chosen for block replications.
Regards,
Yi Liu
From: SF Hadoop [mailto:sfhadoop@gmail.com]
Sent: Friday, October 03, 2014 7:12 AM
To: user@hadoop.apache.org
Subject: Block placement without rack aware
What is the block placement policy hadoop follows when rack aware is not enabled?
Does it just round robin?
Thanks.
Re: Block placement without rack aware
Posted by Pradeep Gollakota <pr...@gmail.com>.
It appears to be randomly chosen. I just came across this blog post from
Lars George about HBase file locality in HDFS
http://www.larsgeorge.com/2010/05/hbase-file-locality-in-hdfs.html
On Thu, Oct 2, 2014 at 4:12 PM, SF Hadoop <sf...@gmail.com> wrote:
> What is the block placement policy hadoop follows when rack aware is not
> enabled?
>
> Does it just round robin?
>
> Thanks.
>
RE: Block placement without rack aware
Posted by "Liu, Yi A" <yi...@intel.com>.
It’s still random.
If rack aware is not enabled, all nodes are in “default-rack”, and random nodes are chosen for block replications.
Regards,
Yi Liu
From: SF Hadoop [mailto:sfhadoop@gmail.com]
Sent: Friday, October 03, 2014 7:12 AM
To: user@hadoop.apache.org
Subject: Block placement without rack aware
What is the block placement policy hadoop follows when rack aware is not enabled?
Does it just round robin?
Thanks.