You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by sa...@hotmail.com on 2010/03/10 12:31:22 UTC
Tables Miss after Adding New Slave
Hi, everyone. I set up a hadoop cluster with 3 nodes: one mater and two slaves. Recently I want to add a new node as a slave to it. After configuration, the HDFS and HBase work, however, I found some tables in HBase previously disappear. I browse hbase directory in HDFS and found directories of the missing tables. Does anyone encounter the same situations or is there someone can help me to recover these tables? thanks!
Best Wishes!
_____________________________________________________________
刘祥龙 Liu Xianglong
Re: Tables Miss after Adding New Slave
Posted by sa...@hotmail.com.
Thanks Stack. It is very helpful for my future use.
Xianglong
--------------------------------------------------
From: "Stack" <st...@duboce.net>
Sent: Wednesday, March 10, 2010 11:59 PM
To: <hb...@hadoop.apache.org>
Subject: Re: Tables Miss after Adding New Slave
> 2010/3/10 <sa...@hotmail.com>:
>> Hi, everyone. I set up a hadoop cluster with 3 nodes: one mater and two
>> slaves. Recently I want to add a new node as a slave to it. After
>> configuration, the HDFS and HBase work, however, I found some tables in
>> HBase previously disappear. I browse hbase directory in HDFS and found
>> directories of the missing tables. Does anyone encounter the same
>> situations or is there someone can help me to recover these tables?
>> thanks!
>>
>
> Perhaps the node carrying the .META. region -- the catalog table that
> has table info -- was killed before it had time to flush its edits so
> added table edits were lost?
>
> You could playing with the ./bin/add_table.rb script. See the head of
> the script for how to use it. This should restore your tables by
> reading the content of the filesystem adding back the missing edits to
> .META..
>
> In future, be careful how you close down your cluster. You could try
> flushing .META. first before running shutdown by doing the following
> in the shell:
>
> hbase> flush ".META."
>
> St.Ack
>
Re: Tables Miss after Adding New Slave
Posted by Stack <st...@duboce.net>.
No need to restart hbase. Just start up pertinent services on added
node. For example start datanode and then then start regionserver
daemons as follows:
> ${HADOOP_HOME}/bin/hadoop-daemon.sh start datanode
> ${HBASE_HOME}./bin/hbase-daemon.sh start regionserver
St.Ack
On Wed, Mar 10, 2010 at 10:28 PM, <sa...@hotmail.com> wrote:
> Hi, Stack. I have another question: what should I do if I want to add a new
> node to hadoop/hbase cluster as I described in previous letter. Is it OK
> that I configure the new node, add it into hadoop slaves and into hbase
> regionservers and then restart Hadoop/Hbase? What else should I pay
> attention to? Thanks!
>
> Xianglong
> --------------------------------------------------
> From: "Stack" <st...@duboce.net>
> Sent: Wednesday, March 10, 2010 11:59 PM
> To: <hb...@hadoop.apache.org>
> Subject: Re: Tables Miss after Adding New Slave
>
>> 2010/3/10 <sa...@hotmail.com>:
>>>
>>> Hi, everyone. I set up a hadoop cluster with 3 nodes: one mater and two
>>> slaves. Recently I want to add a new node as a slave to it. After
>>> configuration, the HDFS and HBase work, however, I found some tables in
>>> HBase previously disappear. I browse hbase directory in HDFS and found
>>> directories of the missing tables. Does anyone encounter the same situations
>>> or is there someone can help me to recover these tables? thanks!
>>>
>>
>> Perhaps the node carrying the .META. region -- the catalog table that
>> has table info -- was killed before it had time to flush its edits so
>> added table edits were lost?
>>
>> You could playing with the ./bin/add_table.rb script. See the head of
>> the script for how to use it. This should restore your tables by
>> reading the content of the filesystem adding back the missing edits to
>> .META..
>>
>> In future, be careful how you close down your cluster. You could try
>> flushing .META. first before running shutdown by doing the following
>> in the shell:
>>
>> hbase> flush ".META."
>>
>> St.Ack
>>
>
Re: Tables Miss after Adding New Slave
Posted by sa...@hotmail.com.
Hi, Stack. I have another question: what should I do if I want to add a new
node to hadoop/hbase cluster as I described in previous letter. Is it OK
that I configure the new node, add it into hadoop slaves and into hbase
regionservers and then restart Hadoop/Hbase? What else should I pay
attention to? Thanks!
Xianglong
--------------------------------------------------
From: "Stack" <st...@duboce.net>
Sent: Wednesday, March 10, 2010 11:59 PM
To: <hb...@hadoop.apache.org>
Subject: Re: Tables Miss after Adding New Slave
> 2010/3/10 <sa...@hotmail.com>:
>> Hi, everyone. I set up a hadoop cluster with 3 nodes: one mater and two
>> slaves. Recently I want to add a new node as a slave to it. After
>> configuration, the HDFS and HBase work, however, I found some tables in
>> HBase previously disappear. I browse hbase directory in HDFS and found
>> directories of the missing tables. Does anyone encounter the same
>> situations or is there someone can help me to recover these tables?
>> thanks!
>>
>
> Perhaps the node carrying the .META. region -- the catalog table that
> has table info -- was killed before it had time to flush its edits so
> added table edits were lost?
>
> You could playing with the ./bin/add_table.rb script. See the head of
> the script for how to use it. This should restore your tables by
> reading the content of the filesystem adding back the missing edits to
> .META..
>
> In future, be careful how you close down your cluster. You could try
> flushing .META. first before running shutdown by doing the following
> in the shell:
>
> hbase> flush ".META."
>
> St.Ack
>
Re: Tables Miss after Adding New Slave
Posted by sa...@hotmail.com.
Hi, Stack. I use the similar way to datanode:
"${HADOOP_HOME}/bin/hadoop-daemon.sh start tasktracker". It works! Thanks a
lot!
Xianglong
--------------------------------------------------
From: <sa...@hotmail.com>
Sent: Thursday, March 25, 2010 10:53 AM
To: <hb...@hadoop.apache.org>
Subject: Re: Tables Miss after Adding New Slave
> Hi, Stack. Last time you told me how to start the new added datanode and
> regionserver and I followed your suggestions. It works well. But another
> question, I saw that tasktracker was not started. So how should I run
> tasktracker in the new added node? Thanks a lot!
>
> Xianglong
>
> --------------------------------------------------
> From: "Stack" <st...@duboce.net>
> Sent: Wednesday, March 10, 2010 11:59 PM
> To: <hb...@hadoop.apache.org>
> Subject: Re: Tables Miss after Adding New Slave
>
>> 2010/3/10 <sa...@hotmail.com>:
>>> Hi, everyone. I set up a hadoop cluster with 3 nodes: one mater and two
>>> slaves. Recently I want to add a new node as a slave to it. After
>>> configuration, the HDFS and HBase work, however, I found some tables in
>>> HBase previously disappear. I browse hbase directory in HDFS and found
>>> directories of the missing tables. Does anyone encounter the same
>>> situations or is there someone can help me to recover these tables?
>>> thanks!
>>>
>>
>> Perhaps the node carrying the .META. region -- the catalog table that
>> has table info -- was killed before it had time to flush its edits so
>> added table edits were lost?
>>
>> You could playing with the ./bin/add_table.rb script. See the head of
>> the script for how to use it. This should restore your tables by
>> reading the content of the filesystem adding back the missing edits to
>> .META..
>>
>> In future, be careful how you close down your cluster. You could try
>> flushing .META. first before running shutdown by doing the following
>> in the shell:
>>
>> hbase> flush ".META."
>>
>> St.Ack
>>
>
Re: Tables Miss after Adding New Slave
Posted by sa...@hotmail.com.
Hi, Stack. Last time you told me how to start the new added datanode and
regionserver and I followed your suggestions. It works well. But another
question, I saw that tasktracker was not started. So how should I run
tasktracker in the new added node? Thanks a lot!
Xianglong
--------------------------------------------------
From: "Stack" <st...@duboce.net>
Sent: Wednesday, March 10, 2010 11:59 PM
To: <hb...@hadoop.apache.org>
Subject: Re: Tables Miss after Adding New Slave
> 2010/3/10 <sa...@hotmail.com>:
>> Hi, everyone. I set up a hadoop cluster with 3 nodes: one mater and two
>> slaves. Recently I want to add a new node as a slave to it. After
>> configuration, the HDFS and HBase work, however, I found some tables in
>> HBase previously disappear. I browse hbase directory in HDFS and found
>> directories of the missing tables. Does anyone encounter the same
>> situations or is there someone can help me to recover these tables?
>> thanks!
>>
>
> Perhaps the node carrying the .META. region -- the catalog table that
> has table info -- was killed before it had time to flush its edits so
> added table edits were lost?
>
> You could playing with the ./bin/add_table.rb script. See the head of
> the script for how to use it. This should restore your tables by
> reading the content of the filesystem adding back the missing edits to
> .META..
>
> In future, be careful how you close down your cluster. You could try
> flushing .META. first before running shutdown by doing the following
> in the shell:
>
> hbase> flush ".META."
>
> St.Ack
>
Re: Tables Miss after Adding New Slave
Posted by Stack <st...@duboce.net>.
2010/3/10 <sa...@hotmail.com>:
> Hi, everyone. I set up a hadoop cluster with 3 nodes: one mater and two slaves. Recently I want to add a new node as a slave to it. After configuration, the HDFS and HBase work, however, I found some tables in HBase previously disappear. I browse hbase directory in HDFS and found directories of the missing tables. Does anyone encounter the same situations or is there someone can help me to recover these tables? thanks!
>
Perhaps the node carrying the .META. region -- the catalog table that
has table info -- was killed before it had time to flush its edits so
added table edits were lost?
You could playing with the ./bin/add_table.rb script. See the head of
the script for how to use it. This should restore your tables by
reading the content of the filesystem adding back the missing edits to
.META..
In future, be careful how you close down your cluster. You could try
flushing .META. first before running shutdown by doing the following
in the shell:
hbase> flush ".META."
St.Ack