You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Libo Yu <yu...@hotmail.com> on 2014/03/28 02:33:17 UTC
block location
Hi all,
The hadoop blocks of a region may be moved to different region servers (e.g. by
hadoop rebalancer). In such a scenario, is there a way to fix that and move all the
blocks to the region server that hosts the region? Should hadoop rebalancer never
be used when hbase is in use? Thanks.
Libo
RE: block location
Posted by Libo Yu <yu...@hotmail.com>.
Thanks for the answer. If I run the major compaction on a region that only has a single hfile whose
blocks may reside on different data nodes, will major compact occur in this case and recover the
data locality? Thanks.
From: bbeaudreault@hubspot.com
Date: Thu, 27 Mar 2014 21:44:49 -0400
Subject: Re: block location
To: user@hadoop.apache.org
Correct, do not use the hadoop balancer on a cluster serving HBase data. Let HBase handle it at the region level.
To recover locality, you will need to run major compactions of the affected regions or tables. In hbase shell: major_compact 'tablename'
On Thu, Mar 27, 2014 at 9:33 PM, Libo Yu <yu...@hotmail.com> wrote:
Hi all,
The hadoop blocks of a region may be moved to different region servers (e.g. by
hadoop rebalancer). In such a scenario, is there a way to fix that and move all the
blocks to the region server that hosts the region? Should hadoop rebalancer never
be used when hbase is in use? Thanks.
Libo
RE: block location
Posted by Libo Yu <yu...@hotmail.com>.
Thanks for the answer. If I run the major compaction on a region that only has a single hfile whose
blocks may reside on different data nodes, will major compact occur in this case and recover the
data locality? Thanks.
From: bbeaudreault@hubspot.com
Date: Thu, 27 Mar 2014 21:44:49 -0400
Subject: Re: block location
To: user@hadoop.apache.org
Correct, do not use the hadoop balancer on a cluster serving HBase data. Let HBase handle it at the region level.
To recover locality, you will need to run major compactions of the affected regions or tables. In hbase shell: major_compact 'tablename'
On Thu, Mar 27, 2014 at 9:33 PM, Libo Yu <yu...@hotmail.com> wrote:
Hi all,
The hadoop blocks of a region may be moved to different region servers (e.g. by
hadoop rebalancer). In such a scenario, is there a way to fix that and move all the
blocks to the region server that hosts the region? Should hadoop rebalancer never
be used when hbase is in use? Thanks.
Libo
RE: block location
Posted by Libo Yu <yu...@hotmail.com>.
Thanks for the answer. If I run the major compaction on a region that only has a single hfile whose
blocks may reside on different data nodes, will major compact occur in this case and recover the
data locality? Thanks.
From: bbeaudreault@hubspot.com
Date: Thu, 27 Mar 2014 21:44:49 -0400
Subject: Re: block location
To: user@hadoop.apache.org
Correct, do not use the hadoop balancer on a cluster serving HBase data. Let HBase handle it at the region level.
To recover locality, you will need to run major compactions of the affected regions or tables. In hbase shell: major_compact 'tablename'
On Thu, Mar 27, 2014 at 9:33 PM, Libo Yu <yu...@hotmail.com> wrote:
Hi all,
The hadoop blocks of a region may be moved to different region servers (e.g. by
hadoop rebalancer). In such a scenario, is there a way to fix that and move all the
blocks to the region server that hosts the region? Should hadoop rebalancer never
be used when hbase is in use? Thanks.
Libo
RE: block location
Posted by Libo Yu <yu...@hotmail.com>.
Thanks for the answer. If I run the major compaction on a region that only has a single hfile whose
blocks may reside on different data nodes, will major compact occur in this case and recover the
data locality? Thanks.
From: bbeaudreault@hubspot.com
Date: Thu, 27 Mar 2014 21:44:49 -0400
Subject: Re: block location
To: user@hadoop.apache.org
Correct, do not use the hadoop balancer on a cluster serving HBase data. Let HBase handle it at the region level.
To recover locality, you will need to run major compactions of the affected regions or tables. In hbase shell: major_compact 'tablename'
On Thu, Mar 27, 2014 at 9:33 PM, Libo Yu <yu...@hotmail.com> wrote:
Hi all,
The hadoop blocks of a region may be moved to different region servers (e.g. by
hadoop rebalancer). In such a scenario, is there a way to fix that and move all the
blocks to the region server that hosts the region? Should hadoop rebalancer never
be used when hbase is in use? Thanks.
Libo
Re: block location
Posted by Bryan Beaudreault <bb...@hubspot.com>.
Correct, do not use the hadoop balancer on a cluster serving HBase data.
Let HBase handle it at the region level.
To recover locality, you will need to run major compactions of the affected
regions or tables. In hbase shell: major_compact 'tablename'
On Thu, Mar 27, 2014 at 9:33 PM, Libo Yu <yu...@hotmail.com> wrote:
> Hi all,
>
> The hadoop blocks of a region may be moved to different region servers
> (e.g. by
> hadoop rebalancer). In such a scenario, is there a way to fix that and
> move all the
> blocks to the region server that hosts the region? Should hadoop
> rebalancer never
> be used when hbase is in use? Thanks.
>
> Libo
>
Re: block location
Posted by Bryan Beaudreault <bb...@hubspot.com>.
Correct, do not use the hadoop balancer on a cluster serving HBase data.
Let HBase handle it at the region level.
To recover locality, you will need to run major compactions of the affected
regions or tables. In hbase shell: major_compact 'tablename'
On Thu, Mar 27, 2014 at 9:33 PM, Libo Yu <yu...@hotmail.com> wrote:
> Hi all,
>
> The hadoop blocks of a region may be moved to different region servers
> (e.g. by
> hadoop rebalancer). In such a scenario, is there a way to fix that and
> move all the
> blocks to the region server that hosts the region? Should hadoop
> rebalancer never
> be used when hbase is in use? Thanks.
>
> Libo
>
Re: block location
Posted by Bryan Beaudreault <bb...@hubspot.com>.
Correct, do not use the hadoop balancer on a cluster serving HBase data.
Let HBase handle it at the region level.
To recover locality, you will need to run major compactions of the affected
regions or tables. In hbase shell: major_compact 'tablename'
On Thu, Mar 27, 2014 at 9:33 PM, Libo Yu <yu...@hotmail.com> wrote:
> Hi all,
>
> The hadoop blocks of a region may be moved to different region servers
> (e.g. by
> hadoop rebalancer). In such a scenario, is there a way to fix that and
> move all the
> blocks to the region server that hosts the region? Should hadoop
> rebalancer never
> be used when hbase is in use? Thanks.
>
> Libo
>
Re: block location
Posted by Bryan Beaudreault <bb...@hubspot.com>.
Correct, do not use the hadoop balancer on a cluster serving HBase data.
Let HBase handle it at the region level.
To recover locality, you will need to run major compactions of the affected
regions or tables. In hbase shell: major_compact 'tablename'
On Thu, Mar 27, 2014 at 9:33 PM, Libo Yu <yu...@hotmail.com> wrote:
> Hi all,
>
> The hadoop blocks of a region may be moved to different region servers
> (e.g. by
> hadoop rebalancer). In such a scenario, is there a way to fix that and
> move all the
> blocks to the region server that hosts the region? Should hadoop
> rebalancer never
> be used when hbase is in use? Thanks.
>
> Libo
>