You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Venkateswara Rao Dokku <dv...@gmail.com> on 2012/09/18 12:41:21 UTC

Hbase Clustering

Hi,
      I am new to Hbase & I wanted to Cluster Hbase on 2 nodes. I put one
of my nodes as hadoop-namenodeas well as hbase-master & the other node as
hadoop-datanode1 as well as hbase-region-server1. I started hadoop cluster
as well as Hbase on the name-node side. They started fine. But when I try
to create tabes in Hbase shell I got the following error.

hbase(main):001:0> create 't1','f1'

ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7 times

Here is some help for this command:
Create table; pass table name, a dictionary of specifications per
column family, and optionally a dictionary of table configuration.
Dictionaries are described below in the GENERAL NOTES section.
Examples:

  hbase> create 't1', {NAME => 'f1', VERSIONS => 5}
  hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME => 'f3'}
  hbase> # The above in shorthand would be the following:
  hbase> create 't1', 'f1', 'f2', 'f3'
  hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL => 2592000,
BLOCKCACHE => true}
  hbase> create 't1', 'f1', {SPLITS => ['10', '20', '30', '40']}
  hbase> create 't1', 'f1', {SPLITS_FILE => 'splits.txt'}

But I could see HMaster running with Jps. The below given are the processes
running on the name-node & datanode.
*NameNode:*
*
*
11578 HMaster
11476 HQuorumPeer
10921 TaskTracker
10246 NameNode
12430 Main
10746 JobTracker
12538 Jps
11798 HRegionServer
10618 SecondaryNameNode
10433 DataNode

*DataNode:*
*
*
2202 NC
10772 Jps
10495 TaskTracker
2112 -- process information unavailable
10697 HRegionServer
10331 DataNode

Could You please let me know whats wrong with my approach of creating
tables. Thanks for replying

P.S: forgot to mention I am using hadoop-0.20.2 & hbase-0.92.1 versions. So
to avoid version mismatches I copied the hadoop Jar file in hadoop
installation directory into habse/lib/ in all the cluster nodes.


--
Thanks & Regards,

Venkateswara Rao Dokku

Re: Hbase Clustering

Posted by Peter Zhang <ha...@gmail.com>.
Could you use base-master,hadoop-namenode for your config when ref hostname.

oc-PowerEdge-R610, it's localhost hostname,It's may be the cause issue.

--  
Peter Zhang
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)


On 2012年9月21日Friday at 下午2:09, Venkateswara Rao Dokku wrote:

> I have that entry in the /etc/hosts files. The /etc/hosts files are as
> given below.
>  
> *Master:*
> 127.0.0.1 localhost
> 127.0.1.1 oc-PowerEdge-R610
> 10.2.32.48 hbase-master hadoop-namenode
> 10.240.13.64 hbase-regionserver1 hadoop-datanode1
> #10.240.13.133 hadoop-datanode1
> # The following lines are desirable for IPv6 capable hosts
> ::1 ip6-localhost ip6-loopback
> fe00::0 ip6-localnet
> ff00::0 ip6-mcastprefix
> ff02::1 ip6-allnodes
> ff02::2 ip6-allrouters
>  
> *Slave:*
> 127.0.0.1 localhost
> 127.0.1.1 venkat-System-Product-Name
> 10.2.32.48 hbase-master hadoop-namenode
> 10.240.13.40 hbase-regionserver1 hadoop-datanode1
> # The following lines are desirable for IPv6 capable hosts
> ::1 ip6-localhost ip6-loopback
> fe00::0 ip6-localnet
> ff00::0 ip6-mcastprefix
> ff02::1 ip6-allnodes
> ff02::2 ip6-allrouters
>  
>  
>  
> On Fri, Sep 21, 2012 at 11:30 AM, Monish r <monishsvce@gmail.com (mailto:monishsvce@gmail.com)> wrote:
>  
> > Hi,
> > From the region server log , i can see that region server cannot resolve
> > the host name *oc-PowerEdge-R610 , *check if u have entry for this
> > hostname*
> > *in */etc/hosts *file.
> >  
> > 2012-09-20 17:18:39,966 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer: Attempting connect
> > to Master server at oc-PowerEdge-R610,60000,1348136566220
> > 2012-09-20 17:18:39,966 WARN
> > org.apache.hadoop.hbase.regionserver.HRegionServer: Unable to connect
> > to master. Retrying. Error was:
> > java.net.UnknownHostException: unknown host:* oc-PowerEdge-R610*
> >  
> >  
> >  
> > On Thu, Sep 20, 2012 at 5:49 PM, Venkateswara Rao Dokku <
> > dvrao.584@gmail.com (mailto:dvrao.584@gmail.com)
> > > wrote:
> >  
> >  
> > >  
> > > please find the attached master & slave hbase logs.
> > >  
> > > > On Thu, Sep 20, 2012 at 5:14 PM, Monish r <monishsvce@gmail.com (mailto:monishsvce@gmail.com)> wrote:
> > > >  
> > > > > Hi,
> > > > > From the *jps* status i can see that u have started region server in
> > > > > both
> > > > > the servers
> > > > >  
> > > > > *NameNode:*
> > > > >  
> > > > > 11578 HMaster
> > > > > 11476 HQuorumPeer
> > > > > 10921 TaskTracker
> > > > > 10246 NameNode
> > > > > 12430 Main
> > > > > 10746 JobTracker
> > > > > 12538 Jps
> > > > > 11798 *HRegionServer*
> > > > >  
> > > > > 10618 SecondaryNameNode
> > > > > 10433 DataNode
> > > > >  
> > > > > *DataNode:*
> > > > > 2202 NC
> > > > > 10772 Jps
> > > > > 10495 TaskTracker
> > > > > 2112 -- process information unavailable
> > > > > 10697 *HRegionServer*
> > > > >  
> > > > > 10331 DataNode
> > > > >  
> > > > > From the log i can see that hbase master has only one region server in
> > > > > its
> > > > > list and it is not access able.
> > > > >  
> > > > > 2012-09-18 23:59:13,841 DEBUG
> > > > > org.apache.hadoop.hbase.master.AssignmentManager: No previous
> > > > > transition plan was found (or we are ignoring an existing plan) for
> > > > > -ROOT-,,0.70236052 so generated a random one; hri=-ROOT-,,0.70236052,
> > > > > src=, dest=localhost,60020,1347968702214; 1 *(online=1, exclude=0)
> > > > > available servers *
> > > > >  
> > > > > 2012-09-18 23:59:13,841 INFO org.apache.hadoop.ipc.HBaseRPC: Server at
> > > > > *localhost/127.0.0.1:60020 could not be reached after 1 tries, giving
> > > > > up.*
> > > > >  
> > > > >  
> > > > >  
> > > > > The problem may be with u r cluster set up , check the region server
> > logs
> > > > > and see if they are alive , u cannot rely on jps
> > > > > and tell for sure the process is up , since it can go down after u r
> > > > > look
> > > > > up.
> > > > >  
> > > > > Check u r region server logs , if u still have issues , post the region
> > > > > server logs in paste bin and reply.
> > > > >  
> > > > > Regards,
> > > > > R.Monish
> > > > >  
> > > > >  
> > > > > *
> > > > >  
> > > > > *
> > > > >  
> > > > >  
> > > > >  
> > > > > On Thu, Sep 20, 2012 at 10:03 AM, Venkateswara Rao Dokku <
> > > > > dvrao.584@gmail.com (mailto:dvrao.584@gmail.com)> wrote:
> > > > >  
> > > > > >  
> > > > > >  
> > > > > > On Tue, Sep 18, 2012 at 10:43 PM, Jean-Daniel Cryans <
> > > > > jdcryans@apache.org (mailto:jdcryans@apache.org)>wrote:
> > > > > >  
> > > > > > > What's in the master's log?
> > > > > > >  
> > > > > > > J-D
> > > > > > > Please find the attached master logs.
> > > > > > >  
> > > > > > > On Tue, Sep 18, 2012 at 3:41 AM, Venkateswara Rao Dokku
> > > > > > > <dvrao.584@gmail.com (mailto:dvrao.584@gmail.com)> wrote:
> > > > > > > > Hi,
> > > > > > > > I am new to Hbase & I wanted to Cluster Hbase on 2 nodes. I
> > > > > > > >  
> > > > > > >  
> > > > > > >  
> > > > > >  
> > > > > >  
> > > > >  
> > > > > put
> > > > > > > one
> > > > > > > > of my nodes as hadoop-namenodeas well as hbase-master & the other
> > > > > > >  
> > > > > > >  
> > > > > >  
> > > > >  
> > > > > node
> > > > > > > as
> > > > > > > > hadoop-datanode1 as well as hbase-region-server1. I started hadoop
> > > > > > >  
> > > > > > > cluster
> > > > > > > > as well as Hbase on the name-node side. They started fine. But
> > > > > > >  
> > > > > > >  
> > > > > >  
> > > > >  
> > > > >  
> > > >  
> > >  
> >  
> > when
> > > > > I
> > > > > > > try
> > > > > > > > to create tabes in Hbase shell I got the following error.
> > > > > > > >  
> > > > > > > > hbase(main):001:0> create 't1','f1'
> > > > > > > >  
> > > > > > > > ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried
> > 7
> > > > > > > times
> > > > > > > >  
> > > > > > > > Here is some help for this command:
> > > > > > > > Create table; pass table name, a dictionary of specifications per
> > > > > > > > column family, and optionally a dictionary of table configuration.
> > > > > > > > Dictionaries are described below in the GENERAL NOTES section.
> > > > > > > > Examples:
> > > > > > > >  
> > > > > > > > hbase> create 't1', {NAME => 'f1', VERSIONS => 5}
> > > > > > > > hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME =>
> > > > > > > >  
> > > > > > >  
> > > > > > >  
> > > > > >  
> > > > >  
> > > >  
> > >  
> >  
> > 'f3'}
> > > > > > > > hbase> # The above in shorthand would be the following:
> > > > > > > > hbase> create 't1', 'f1', 'f2', 'f3'
> > > > > > > > hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL =>
> > > > > > > >  
> > > > > > >  
> > > > > >  
> > > > >  
> > > >  
> > >  
> >  
> > 2592000,
> > > > > > > > BLOCKCACHE => true}
> > > > > > > > hbase> create 't1', 'f1', {SPLITS => ['10', '20', '30', '40']}
> > > > > > > > hbase> create 't1', 'f1', {SPLITS_FILE => 'splits.txt'}
> > > > > > > >  
> > > > > > > > But I could see HMaster running with Jps. The below given are the
> > > > > > > processes
> > > > > > > > running on the name-node & datanode.
> > > > > > > > *NameNode:*
> > > > > > > > *
> > > > > > > > *
> > > > > > > > 11578 HMaster
> > > > > > > > 11476 HQuorumPeer
> > > > > > > > 10921 TaskTracker
> > > > > > > > 10246 NameNode
> > > > > > > > 12430 Main
> > > > > > > > 10746 JobTracker
> > > > > > > > 12538 Jps
> > > > > > > > 11798 HRegionServer
> > > > > > > > 10618 SecondaryNameNode
> > > > > > > > 10433 DataNode
> > > > > > > >  
> > > > > > > > *DataNode:*
> > > > > > > > *
> > > > > > > > *
> > > > > > > > 2202 NC
> > > > > > > > 10772 Jps
> > > > > > > > 10495 TaskTracker
> > > > > > > > 2112 -- process information unavailable
> > > > > > > > 10697 HRegionServer
> > > > > > > > 10331 DataNode
> > > > > > > >  
> > > > > > > > Could You please let me know whats wrong with my approach of
> > > > > creating
> > > > > > > > tables. Thanks for replying
> > > > > > > >  
> > > > > > > > P.S: forgot to mention I am using hadoop-0.20.2 & hbase-0.92.1
> > > > > > > versions. So
> > > > > > > > to avoid version mismatches I copied the hadoop Jar file in hadoop
> > > > > > > > installation directory into habse/lib/ in all the cluster nodes.
> > > > > > > >  
> > > > > > > >  
> > > > > > > > --
> > > > > > > > Thanks & Regards,
> > > > > > > >  
> > > > > > > > Venkateswara Rao Dokku
> > > > > >  
> > > > > >  
> > > > > >  
> > > > > > --
> > > > > > Thanks & Regards,
> > > > > > Venkateswara Rao Dokku,
> > > > > > Software Engineer,One Convergence Devices Pvt Ltd.,
> > > > > > Jubille Hills,Hyderabad.
> > > > > >  
> > > > >  
> > > > >  
> > > >  
> > > >  
> > > >  
> > > >  
> > > > --
> > > > Thanks & Regards,
> > > > Venkateswara Rao Dokku,
> > > > Software Engineer,One Convergence Devices Pvt Ltd.,
> > > > Jubille Hills,Hyderabad.
> > > >  
> > >  
> > >  
> > >  
> > > --
> > > Thanks & Regards,
> > > Venkateswara Rao Dokku,
> > > Software Engineer,One Convergence Devices Pvt Ltd.,
> > > Jubille Hills,Hyderabad.
> > >  
> >  
> >  
>  
>  
>  
>  
> --  
> Thanks & Regards,
> Venkateswara Rao Dokku,
> Software Engineer,One Convergence Devices Pvt Ltd.,
> Jubille Hills,Hyderabad.
>  
>  



Re: Hbase Clustering

Posted by Venkateswara Rao Dokku <dv...@gmail.com>.
I have that entry in the /etc/hosts files. The /etc/hosts files are as
given below.

*Master:*
127.0.0.1       localhost
127.0.1.1       oc-PowerEdge-R610
10.2.32.48  hbase-master hadoop-namenode
10.240.13.64 hbase-regionserver1  hadoop-datanode1
#10.240.13.133 hadoop-datanode1
# The following lines are desirable for IPv6 capable hosts
::1     ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters

*Slave:*
127.0.0.1       localhost
127.0.1.1       venkat-System-Product-Name
10.2.32.48  hbase-master hadoop-namenode
10.240.13.40 hbase-regionserver1  hadoop-datanode1
# The following lines are desirable for IPv6 capable hosts
::1     ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters



On Fri, Sep 21, 2012 at 11:30 AM, Monish r <mo...@gmail.com> wrote:

> Hi,
> From the region server log , i can see that region server cannot resolve
> the host name *oc-PowerEdge-R610 , *check if u have entry for this
> hostname*
> *in */etc/hosts *file.
>
> 2012-09-20 17:18:39,966 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer: Attempting connect
> to Master server at oc-PowerEdge-R610,60000,1348136566220
> 2012-09-20 17:18:39,966 WARN
> org.apache.hadoop.hbase.regionserver.HRegionServer: Unable to connect
> to master. Retrying. Error was:
> java.net.UnknownHostException: unknown host:* oc-PowerEdge-R610*
>
>
>
> On Thu, Sep 20, 2012 at 5:49 PM, Venkateswara Rao Dokku <
> dvrao.584@gmail.com
> > wrote:
>
> >
> > please find the attached master & slave hbase logs.
> >
> >> On Thu, Sep 20, 2012 at 5:14 PM, Monish r <mo...@gmail.com> wrote:
> >>
> >>> Hi,
> >>> From the *jps* status i can see that  u have started region server in
> >>> both
> >>> the servers
> >>>
> >>> *NameNode:*
> >>>
> >>> 11578 HMaster
> >>> 11476 HQuorumPeer
> >>> 10921 TaskTracker
> >>> 10246 NameNode
> >>> 12430 Main
> >>> 10746 JobTracker
> >>> 12538 Jps
> >>> 11798 *HRegionServer*
> >>>
> >>> 10618 SecondaryNameNode
> >>> 10433 DataNode
> >>>
> >>> *DataNode:*
> >>> 2202 NC
> >>> 10772 Jps
> >>> 10495 TaskTracker
> >>> 2112 -- process information unavailable
> >>> 10697 *HRegionServer*
> >>>
> >>> 10331 DataNode
> >>>
> >>> From the log i can see that hbase master has only one region server in
> >>> its
> >>> list and it is not access able.
> >>>
> >>> 2012-09-18 23:59:13,841 DEBUG
> >>> org.apache.hadoop.hbase.master.AssignmentManager: No previous
> >>> transition plan was found (or we are ignoring an existing plan) for
> >>> -ROOT-,,0.70236052 so generated a random one; hri=-ROOT-,,0.70236052,
> >>> src=, dest=localhost,60020,1347968702214; 1 *(online=1, exclude=0)
> >>> available servers *
> >>>
> >>> 2012-09-18 23:59:13,841 INFO org.apache.hadoop.ipc.HBaseRPC: Server at
> >>> *localhost/127.0.0.1:60020 could not be reached after 1 tries, giving
> >>> up.*
> >>>
> >>>
> >>>
> >>> The problem may be with u r cluster set up , check the region server
> logs
> >>> and see if they are alive , u cannot rely on jps
> >>> and tell for sure the process is up , since it can go down after u r
> >>>  look
> >>> up.
> >>>
> >>> Check u r region server logs , if u still have issues , post the region
> >>> server logs in paste bin and reply.
> >>>
> >>> Regards,
> >>> R.Monish
> >>>
> >>>
> >>> *
> >>>
> >>> *
> >>>
> >>>
> >>>
> >>> On Thu, Sep 20, 2012 at 10:03 AM, Venkateswara Rao Dokku <
> >>> dvrao.584@gmail.com> wrote:
> >>>
> >>> >
> >>> >
> >>> > On Tue, Sep 18, 2012 at 10:43 PM, Jean-Daniel Cryans <
> >>> jdcryans@apache.org>wrote:
> >>> >
> >>> >> What's in the master's log?
> >>> >>
> >>> >> J-D
> >>> >> Please find the attached master logs.
> >>> >>
> >>> >> On Tue, Sep 18, 2012 at 3:41 AM, Venkateswara Rao Dokku
> >>> >> <dv...@gmail.com> wrote:
> >>> >> > Hi,
> >>> >> >       I am new to Hbase & I wanted to Cluster Hbase on 2 nodes. I
> >>> put
> >>> >> one
> >>> >> > of my nodes as hadoop-namenodeas well as hbase-master & the other
> >>> node
> >>> >> as
> >>> >> > hadoop-datanode1 as well as hbase-region-server1. I started hadoop
> >>> >> cluster
> >>> >> > as well as Hbase on the name-node side. They started fine. But
> when
> >>> I
> >>> >> try
> >>> >> > to create tabes in Hbase shell I got the following error.
> >>> >> >
> >>> >> > hbase(main):001:0> create 't1','f1'
> >>> >> >
> >>> >> > ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried
> 7
> >>> >> times
> >>> >> >
> >>> >> > Here is some help for this command:
> >>> >> > Create table; pass table name, a dictionary of specifications per
> >>> >> > column family, and optionally a dictionary of table configuration.
> >>> >> > Dictionaries are described below in the GENERAL NOTES section.
> >>> >> > Examples:
> >>> >> >
> >>> >> >   hbase> create 't1', {NAME => 'f1', VERSIONS => 5}
> >>> >> >   hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME =>
> 'f3'}
> >>> >> >   hbase> # The above in shorthand would be the following:
> >>> >> >   hbase> create 't1', 'f1', 'f2', 'f3'
> >>> >> >   hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL =>
> 2592000,
> >>> >> > BLOCKCACHE => true}
> >>> >> >   hbase> create 't1', 'f1', {SPLITS => ['10', '20', '30', '40']}
> >>> >> >   hbase> create 't1', 'f1', {SPLITS_FILE => 'splits.txt'}
> >>> >> >
> >>> >> > But I could see HMaster running with Jps. The below given are the
> >>> >> processes
> >>> >> > running on the name-node & datanode.
> >>> >> > *NameNode:*
> >>> >> > *
> >>> >> > *
> >>> >> > 11578 HMaster
> >>> >> > 11476 HQuorumPeer
> >>> >> > 10921 TaskTracker
> >>> >> > 10246 NameNode
> >>> >> > 12430 Main
> >>> >> > 10746 JobTracker
> >>> >> > 12538 Jps
> >>> >> > 11798 HRegionServer
> >>> >> > 10618 SecondaryNameNode
> >>> >> > 10433 DataNode
> >>> >> >
> >>> >> > *DataNode:*
> >>> >> > *
> >>> >> > *
> >>> >> > 2202 NC
> >>> >> > 10772 Jps
> >>> >> > 10495 TaskTracker
> >>> >> > 2112 -- process information unavailable
> >>> >> > 10697 HRegionServer
> >>> >> > 10331 DataNode
> >>> >> >
> >>> >> > Could You please let me know whats wrong with my approach of
> >>> creating
> >>> >> > tables. Thanks for replying
> >>> >> >
> >>> >> > P.S: forgot to mention I am using hadoop-0.20.2 & hbase-0.92.1
> >>> >> versions. So
> >>> >> > to avoid version mismatches I copied the hadoop Jar file in hadoop
> >>> >> > installation directory into habse/lib/ in all the cluster nodes.
> >>> >> >
> >>> >> >
> >>> >> > --
> >>> >> > Thanks & Regards,
> >>> >> >
> >>> >> > Venkateswara Rao Dokku
> >>> >>
> >>> >
> >>> >
> >>> >
> >>> > --
> >>> > Thanks & Regards,
> >>> > Venkateswara Rao Dokku,
> >>> > Software Engineer,One Convergence Devices Pvt Ltd.,
> >>> > Jubille Hills,Hyderabad.
> >>> >
> >>> >
> >>>
> >>
> >>
> >>
> >> --
> >> Thanks & Regards,
> >> Venkateswara Rao Dokku,
> >> Software Engineer,One Convergence Devices Pvt Ltd.,
> >> Jubille Hills,Hyderabad.
> >>
> >>
> >
> >
> > --
> > Thanks & Regards,
> > Venkateswara Rao Dokku,
> > Software Engineer,One Convergence Devices Pvt Ltd.,
> > Jubille Hills,Hyderabad.
> >
> >
>



-- 
Thanks & Regards,
Venkateswara Rao Dokku,
Software Engineer,One Convergence Devices Pvt Ltd.,
Jubille Hills,Hyderabad.

Re: Hbase Clustering

Posted by Monish r <mo...@gmail.com>.
Hi,
>From the region server log , i can see that region server cannot resolve
the host name *oc-PowerEdge-R610 , *check if u have entry for this hostname*
*in */etc/hosts *file.

2012-09-20 17:18:39,966 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: Attempting connect
to Master server at oc-PowerEdge-R610,60000,1348136566220
2012-09-20 17:18:39,966 WARN
org.apache.hadoop.hbase.regionserver.HRegionServer: Unable to connect
to master. Retrying. Error was:
java.net.UnknownHostException: unknown host:* oc-PowerEdge-R610*



On Thu, Sep 20, 2012 at 5:49 PM, Venkateswara Rao Dokku <dvrao.584@gmail.com
> wrote:

>
> please find the attached master & slave hbase logs.
>
>> On Thu, Sep 20, 2012 at 5:14 PM, Monish r <mo...@gmail.com> wrote:
>>
>>> Hi,
>>> From the *jps* status i can see that  u have started region server in
>>> both
>>> the servers
>>>
>>> *NameNode:*
>>>
>>> 11578 HMaster
>>> 11476 HQuorumPeer
>>> 10921 TaskTracker
>>> 10246 NameNode
>>> 12430 Main
>>> 10746 JobTracker
>>> 12538 Jps
>>> 11798 *HRegionServer*
>>>
>>> 10618 SecondaryNameNode
>>> 10433 DataNode
>>>
>>> *DataNode:*
>>> 2202 NC
>>> 10772 Jps
>>> 10495 TaskTracker
>>> 2112 -- process information unavailable
>>> 10697 *HRegionServer*
>>>
>>> 10331 DataNode
>>>
>>> From the log i can see that hbase master has only one region server in
>>> its
>>> list and it is not access able.
>>>
>>> 2012-09-18 23:59:13,841 DEBUG
>>> org.apache.hadoop.hbase.master.AssignmentManager: No previous
>>> transition plan was found (or we are ignoring an existing plan) for
>>> -ROOT-,,0.70236052 so generated a random one; hri=-ROOT-,,0.70236052,
>>> src=, dest=localhost,60020,1347968702214; 1 *(online=1, exclude=0)
>>> available servers *
>>>
>>> 2012-09-18 23:59:13,841 INFO org.apache.hadoop.ipc.HBaseRPC: Server at
>>> *localhost/127.0.0.1:60020 could not be reached after 1 tries, giving
>>> up.*
>>>
>>>
>>>
>>> The problem may be with u r cluster set up , check the region server logs
>>> and see if they are alive , u cannot rely on jps
>>> and tell for sure the process is up , since it can go down after u r
>>>  look
>>> up.
>>>
>>> Check u r region server logs , if u still have issues , post the region
>>> server logs in paste bin and reply.
>>>
>>> Regards,
>>> R.Monish
>>>
>>>
>>> *
>>>
>>> *
>>>
>>>
>>>
>>> On Thu, Sep 20, 2012 at 10:03 AM, Venkateswara Rao Dokku <
>>> dvrao.584@gmail.com> wrote:
>>>
>>> >
>>> >
>>> > On Tue, Sep 18, 2012 at 10:43 PM, Jean-Daniel Cryans <
>>> jdcryans@apache.org>wrote:
>>> >
>>> >> What's in the master's log?
>>> >>
>>> >> J-D
>>> >> Please find the attached master logs.
>>> >>
>>> >> On Tue, Sep 18, 2012 at 3:41 AM, Venkateswara Rao Dokku
>>> >> <dv...@gmail.com> wrote:
>>> >> > Hi,
>>> >> >       I am new to Hbase & I wanted to Cluster Hbase on 2 nodes. I
>>> put
>>> >> one
>>> >> > of my nodes as hadoop-namenodeas well as hbase-master & the other
>>> node
>>> >> as
>>> >> > hadoop-datanode1 as well as hbase-region-server1. I started hadoop
>>> >> cluster
>>> >> > as well as Hbase on the name-node side. They started fine. But when
>>> I
>>> >> try
>>> >> > to create tabes in Hbase shell I got the following error.
>>> >> >
>>> >> > hbase(main):001:0> create 't1','f1'
>>> >> >
>>> >> > ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7
>>> >> times
>>> >> >
>>> >> > Here is some help for this command:
>>> >> > Create table; pass table name, a dictionary of specifications per
>>> >> > column family, and optionally a dictionary of table configuration.
>>> >> > Dictionaries are described below in the GENERAL NOTES section.
>>> >> > Examples:
>>> >> >
>>> >> >   hbase> create 't1', {NAME => 'f1', VERSIONS => 5}
>>> >> >   hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME => 'f3'}
>>> >> >   hbase> # The above in shorthand would be the following:
>>> >> >   hbase> create 't1', 'f1', 'f2', 'f3'
>>> >> >   hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL => 2592000,
>>> >> > BLOCKCACHE => true}
>>> >> >   hbase> create 't1', 'f1', {SPLITS => ['10', '20', '30', '40']}
>>> >> >   hbase> create 't1', 'f1', {SPLITS_FILE => 'splits.txt'}
>>> >> >
>>> >> > But I could see HMaster running with Jps. The below given are the
>>> >> processes
>>> >> > running on the name-node & datanode.
>>> >> > *NameNode:*
>>> >> > *
>>> >> > *
>>> >> > 11578 HMaster
>>> >> > 11476 HQuorumPeer
>>> >> > 10921 TaskTracker
>>> >> > 10246 NameNode
>>> >> > 12430 Main
>>> >> > 10746 JobTracker
>>> >> > 12538 Jps
>>> >> > 11798 HRegionServer
>>> >> > 10618 SecondaryNameNode
>>> >> > 10433 DataNode
>>> >> >
>>> >> > *DataNode:*
>>> >> > *
>>> >> > *
>>> >> > 2202 NC
>>> >> > 10772 Jps
>>> >> > 10495 TaskTracker
>>> >> > 2112 -- process information unavailable
>>> >> > 10697 HRegionServer
>>> >> > 10331 DataNode
>>> >> >
>>> >> > Could You please let me know whats wrong with my approach of
>>> creating
>>> >> > tables. Thanks for replying
>>> >> >
>>> >> > P.S: forgot to mention I am using hadoop-0.20.2 & hbase-0.92.1
>>> >> versions. So
>>> >> > to avoid version mismatches I copied the hadoop Jar file in hadoop
>>> >> > installation directory into habse/lib/ in all the cluster nodes.
>>> >> >
>>> >> >
>>> >> > --
>>> >> > Thanks & Regards,
>>> >> >
>>> >> > Venkateswara Rao Dokku
>>> >>
>>> >
>>> >
>>> >
>>> > --
>>> > Thanks & Regards,
>>> > Venkateswara Rao Dokku,
>>> > Software Engineer,One Convergence Devices Pvt Ltd.,
>>> > Jubille Hills,Hyderabad.
>>> >
>>> >
>>>
>>
>>
>>
>> --
>> Thanks & Regards,
>> Venkateswara Rao Dokku,
>> Software Engineer,One Convergence Devices Pvt Ltd.,
>> Jubille Hills,Hyderabad.
>>
>>
>
>
> --
> Thanks & Regards,
> Venkateswara Rao Dokku,
> Software Engineer,One Convergence Devices Pvt Ltd.,
> Jubille Hills,Hyderabad.
>
>

Re: Hbase Clustering

Posted by Venkateswara Rao Dokku <dv...@gmail.com>.
please find the attached master & slave hbase logs.

> On Thu, Sep 20, 2012 at 5:14 PM, Monish r <mo...@gmail.com> wrote:
>
>> Hi,
>> From the *jps* status i can see that  u have started region server in both
>> the servers
>>
>> *NameNode:*
>> 11578 HMaster
>> 11476 HQuorumPeer
>> 10921 TaskTracker
>> 10246 NameNode
>> 12430 Main
>> 10746 JobTracker
>> 12538 Jps
>> 11798 *HRegionServer*
>> 10618 SecondaryNameNode
>> 10433 DataNode
>>
>> *DataNode:*
>> 2202 NC
>> 10772 Jps
>> 10495 TaskTracker
>> 2112 -- process information unavailable
>> 10697 *HRegionServer*
>> 10331 DataNode
>>
>> From the log i can see that hbase master has only one region server in its
>> list and it is not access able.
>>
>> 2012-09-18 23:59:13,841 DEBUG
>> org.apache.hadoop.hbase.master.AssignmentManager: No previous
>> transition plan was found (or we are ignoring an existing plan) for
>> -ROOT-,,0.70236052 so generated a random one; hri=-ROOT-,,0.70236052,
>> src=, dest=localhost,60020,1347968702214; 1 *(online=1, exclude=0)
>> available servers *
>>
>> 2012-09-18 23:59:13,841 INFO org.apache.hadoop.ipc.HBaseRPC: Server at
>> *localhost/127.0.0.1:60020 could not be reached after 1 tries, giving
>> up.*
>>
>>
>> The problem may be with u r cluster set up , check the region server logs
>> and see if they are alive , u cannot rely on jps
>> and tell for sure the process is up , since it can go down after u r  look
>> up.
>>
>> Check u r region server logs , if u still have issues , post the region
>> server logs in paste bin and reply.
>>
>> Regards,
>> R.Monish
>>
>>
>> *
>> *
>>
>>
>>
>> On Thu, Sep 20, 2012 at 10:03 AM, Venkateswara Rao Dokku <
>> dvrao.584@gmail.com> wrote:
>>
>> >
>> >
>> > On Tue, Sep 18, 2012 at 10:43 PM, Jean-Daniel Cryans <
>> jdcryans@apache.org>wrote:
>> >
>> >> What's in the master's log?
>> >>
>> >> J-D
>> >> Please find the attached master logs.
>> >>
>> >> On Tue, Sep 18, 2012 at 3:41 AM, Venkateswara Rao Dokku
>> >> <dv...@gmail.com> wrote:
>> >> > Hi,
>> >> >       I am new to Hbase & I wanted to Cluster Hbase on 2 nodes. I put
>> >> one
>> >> > of my nodes as hadoop-namenodeas well as hbase-master & the other
>> node
>> >> as
>> >> > hadoop-datanode1 as well as hbase-region-server1. I started hadoop
>> >> cluster
>> >> > as well as Hbase on the name-node side. They started fine. But when I
>> >> try
>> >> > to create tabes in Hbase shell I got the following error.
>> >> >
>> >> > hbase(main):001:0> create 't1','f1'
>> >> >
>> >> > ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7
>> >> times
>> >> >
>> >> > Here is some help for this command:
>> >> > Create table; pass table name, a dictionary of specifications per
>> >> > column family, and optionally a dictionary of table configuration.
>> >> > Dictionaries are described below in the GENERAL NOTES section.
>> >> > Examples:
>> >> >
>> >> >   hbase> create 't1', {NAME => 'f1', VERSIONS => 5}
>> >> >   hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME => 'f3'}
>> >> >   hbase> # The above in shorthand would be the following:
>> >> >   hbase> create 't1', 'f1', 'f2', 'f3'
>> >> >   hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL => 2592000,
>> >> > BLOCKCACHE => true}
>> >> >   hbase> create 't1', 'f1', {SPLITS => ['10', '20', '30', '40']}
>> >> >   hbase> create 't1', 'f1', {SPLITS_FILE => 'splits.txt'}
>> >> >
>> >> > But I could see HMaster running with Jps. The below given are the
>> >> processes
>> >> > running on the name-node & datanode.
>> >> > *NameNode:*
>> >> > *
>> >> > *
>> >> > 11578 HMaster
>> >> > 11476 HQuorumPeer
>> >> > 10921 TaskTracker
>> >> > 10246 NameNode
>> >> > 12430 Main
>> >> > 10746 JobTracker
>> >> > 12538 Jps
>> >> > 11798 HRegionServer
>> >> > 10618 SecondaryNameNode
>> >> > 10433 DataNode
>> >> >
>> >> > *DataNode:*
>> >> > *
>> >> > *
>> >> > 2202 NC
>> >> > 10772 Jps
>> >> > 10495 TaskTracker
>> >> > 2112 -- process information unavailable
>> >> > 10697 HRegionServer
>> >> > 10331 DataNode
>> >> >
>> >> > Could You please let me know whats wrong with my approach of creating
>> >> > tables. Thanks for replying
>> >> >
>> >> > P.S: forgot to mention I am using hadoop-0.20.2 & hbase-0.92.1
>> >> versions. So
>> >> > to avoid version mismatches I copied the hadoop Jar file in hadoop
>> >> > installation directory into habse/lib/ in all the cluster nodes.
>> >> >
>> >> >
>> >> > --
>> >> > Thanks & Regards,
>> >> >
>> >> > Venkateswara Rao Dokku
>> >>
>> >
>> >
>> >
>> > --
>> > Thanks & Regards,
>> > Venkateswara Rao Dokku,
>> > Software Engineer,One Convergence Devices Pvt Ltd.,
>> > Jubille Hills,Hyderabad.
>> >
>> >
>>
>
>
>
> --
> Thanks & Regards,
> Venkateswara Rao Dokku,
> Software Engineer,One Convergence Devices Pvt Ltd.,
> Jubille Hills,Hyderabad.
>
>


-- 
Thanks & Regards,
Venkateswara Rao Dokku,
Software Engineer,One Convergence Devices Pvt Ltd.,
Jubille Hills,Hyderabad.

Re: Hbase Clustering

Posted by Monish r <mo...@gmail.com>.
Hi,
>From the *jps* status i can see that  u have started region server in both
the servers

*NameNode:*
11578 HMaster
11476 HQuorumPeer
10921 TaskTracker
10246 NameNode
12430 Main
10746 JobTracker
12538 Jps
11798 *HRegionServer*
10618 SecondaryNameNode
10433 DataNode

*DataNode:*
2202 NC
10772 Jps
10495 TaskTracker
2112 -- process information unavailable
10697 *HRegionServer*
10331 DataNode

>From the log i can see that hbase master has only one region server in its
list and it is not access able.

2012-09-18 23:59:13,841 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: No previous
transition plan was found (or we are ignoring an existing plan) for
-ROOT-,,0.70236052 so generated a random one; hri=-ROOT-,,0.70236052,
src=, dest=localhost,60020,1347968702214; 1 *(online=1, exclude=0)
available servers *

2012-09-18 23:59:13,841 INFO org.apache.hadoop.ipc.HBaseRPC: Server at
*localhost/127.0.0.1:60020 could not be reached after 1 tries, giving
up.*


The problem may be with u r cluster set up , check the region server logs
and see if they are alive , u cannot rely on jps
and tell for sure the process is up , since it can go down after u r  look
up.

Check u r region server logs , if u still have issues , post the region
server logs in paste bin and reply.

Regards,
R.Monish


*
*



On Thu, Sep 20, 2012 at 10:03 AM, Venkateswara Rao Dokku <
dvrao.584@gmail.com> wrote:

>
>
> On Tue, Sep 18, 2012 at 10:43 PM, Jean-Daniel Cryans <jd...@apache.org>wrote:
>
>> What's in the master's log?
>>
>> J-D
>> Please find the attached master logs.
>>
>> On Tue, Sep 18, 2012 at 3:41 AM, Venkateswara Rao Dokku
>> <dv...@gmail.com> wrote:
>> > Hi,
>> >       I am new to Hbase & I wanted to Cluster Hbase on 2 nodes. I put
>> one
>> > of my nodes as hadoop-namenodeas well as hbase-master & the other node
>> as
>> > hadoop-datanode1 as well as hbase-region-server1. I started hadoop
>> cluster
>> > as well as Hbase on the name-node side. They started fine. But when I
>> try
>> > to create tabes in Hbase shell I got the following error.
>> >
>> > hbase(main):001:0> create 't1','f1'
>> >
>> > ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7
>> times
>> >
>> > Here is some help for this command:
>> > Create table; pass table name, a dictionary of specifications per
>> > column family, and optionally a dictionary of table configuration.
>> > Dictionaries are described below in the GENERAL NOTES section.
>> > Examples:
>> >
>> >   hbase> create 't1', {NAME => 'f1', VERSIONS => 5}
>> >   hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME => 'f3'}
>> >   hbase> # The above in shorthand would be the following:
>> >   hbase> create 't1', 'f1', 'f2', 'f3'
>> >   hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL => 2592000,
>> > BLOCKCACHE => true}
>> >   hbase> create 't1', 'f1', {SPLITS => ['10', '20', '30', '40']}
>> >   hbase> create 't1', 'f1', {SPLITS_FILE => 'splits.txt'}
>> >
>> > But I could see HMaster running with Jps. The below given are the
>> processes
>> > running on the name-node & datanode.
>> > *NameNode:*
>> > *
>> > *
>> > 11578 HMaster
>> > 11476 HQuorumPeer
>> > 10921 TaskTracker
>> > 10246 NameNode
>> > 12430 Main
>> > 10746 JobTracker
>> > 12538 Jps
>> > 11798 HRegionServer
>> > 10618 SecondaryNameNode
>> > 10433 DataNode
>> >
>> > *DataNode:*
>> > *
>> > *
>> > 2202 NC
>> > 10772 Jps
>> > 10495 TaskTracker
>> > 2112 -- process information unavailable
>> > 10697 HRegionServer
>> > 10331 DataNode
>> >
>> > Could You please let me know whats wrong with my approach of creating
>> > tables. Thanks for replying
>> >
>> > P.S: forgot to mention I am using hadoop-0.20.2 & hbase-0.92.1
>> versions. So
>> > to avoid version mismatches I copied the hadoop Jar file in hadoop
>> > installation directory into habse/lib/ in all the cluster nodes.
>> >
>> >
>> > --
>> > Thanks & Regards,
>> >
>> > Venkateswara Rao Dokku
>>
>
>
>
> --
> Thanks & Regards,
> Venkateswara Rao Dokku,
> Software Engineer,One Convergence Devices Pvt Ltd.,
> Jubille Hills,Hyderabad.
>
>

Re: Hbase Clustering

Posted by Venkateswara Rao Dokku <dv...@gmail.com>.
On Tue, Sep 18, 2012 at 10:43 PM, Jean-Daniel Cryans <jd...@apache.org>wrote:

> What's in the master's log?
>
> J-D
> Please find the attached master logs.
> On Tue, Sep 18, 2012 at 3:41 AM, Venkateswara Rao Dokku
> <dv...@gmail.com> wrote:
> > Hi,
> >       I am new to Hbase & I wanted to Cluster Hbase on 2 nodes. I put one
> > of my nodes as hadoop-namenodeas well as hbase-master & the other node as
> > hadoop-datanode1 as well as hbase-region-server1. I started hadoop
> cluster
> > as well as Hbase on the name-node side. They started fine. But when I try
> > to create tabes in Hbase shell I got the following error.
> >
> > hbase(main):001:0> create 't1','f1'
> >
> > ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7 times
> >
> > Here is some help for this command:
> > Create table; pass table name, a dictionary of specifications per
> > column family, and optionally a dictionary of table configuration.
> > Dictionaries are described below in the GENERAL NOTES section.
> > Examples:
> >
> >   hbase> create 't1', {NAME => 'f1', VERSIONS => 5}
> >   hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME => 'f3'}
> >   hbase> # The above in shorthand would be the following:
> >   hbase> create 't1', 'f1', 'f2', 'f3'
> >   hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL => 2592000,
> > BLOCKCACHE => true}
> >   hbase> create 't1', 'f1', {SPLITS => ['10', '20', '30', '40']}
> >   hbase> create 't1', 'f1', {SPLITS_FILE => 'splits.txt'}
> >
> > But I could see HMaster running with Jps. The below given are the
> processes
> > running on the name-node & datanode.
> > *NameNode:*
> > *
> > *
> > 11578 HMaster
> > 11476 HQuorumPeer
> > 10921 TaskTracker
> > 10246 NameNode
> > 12430 Main
> > 10746 JobTracker
> > 12538 Jps
> > 11798 HRegionServer
> > 10618 SecondaryNameNode
> > 10433 DataNode
> >
> > *DataNode:*
> > *
> > *
> > 2202 NC
> > 10772 Jps
> > 10495 TaskTracker
> > 2112 -- process information unavailable
> > 10697 HRegionServer
> > 10331 DataNode
> >
> > Could You please let me know whats wrong with my approach of creating
> > tables. Thanks for replying
> >
> > P.S: forgot to mention I am using hadoop-0.20.2 & hbase-0.92.1 versions.
> So
> > to avoid version mismatches I copied the hadoop Jar file in hadoop
> > installation directory into habse/lib/ in all the cluster nodes.
> >
> >
> > --
> > Thanks & Regards,
> >
> > Venkateswara Rao Dokku
>



-- 
Thanks & Regards,
Venkateswara Rao Dokku,
Software Engineer,One Convergence Devices Pvt Ltd.,
Jubille Hills,Hyderabad.

Re: Hbase Clustering

Posted by Jean-Daniel Cryans <jd...@apache.org>.
What's in the master's log?

J-D

On Tue, Sep 18, 2012 at 3:41 AM, Venkateswara Rao Dokku
<dv...@gmail.com> wrote:
> Hi,
>       I am new to Hbase & I wanted to Cluster Hbase on 2 nodes. I put one
> of my nodes as hadoop-namenodeas well as hbase-master & the other node as
> hadoop-datanode1 as well as hbase-region-server1. I started hadoop cluster
> as well as Hbase on the name-node side. They started fine. But when I try
> to create tabes in Hbase shell I got the following error.
>
> hbase(main):001:0> create 't1','f1'
>
> ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7 times
>
> Here is some help for this command:
> Create table; pass table name, a dictionary of specifications per
> column family, and optionally a dictionary of table configuration.
> Dictionaries are described below in the GENERAL NOTES section.
> Examples:
>
>   hbase> create 't1', {NAME => 'f1', VERSIONS => 5}
>   hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME => 'f3'}
>   hbase> # The above in shorthand would be the following:
>   hbase> create 't1', 'f1', 'f2', 'f3'
>   hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL => 2592000,
> BLOCKCACHE => true}
>   hbase> create 't1', 'f1', {SPLITS => ['10', '20', '30', '40']}
>   hbase> create 't1', 'f1', {SPLITS_FILE => 'splits.txt'}
>
> But I could see HMaster running with Jps. The below given are the processes
> running on the name-node & datanode.
> *NameNode:*
> *
> *
> 11578 HMaster
> 11476 HQuorumPeer
> 10921 TaskTracker
> 10246 NameNode
> 12430 Main
> 10746 JobTracker
> 12538 Jps
> 11798 HRegionServer
> 10618 SecondaryNameNode
> 10433 DataNode
>
> *DataNode:*
> *
> *
> 2202 NC
> 10772 Jps
> 10495 TaskTracker
> 2112 -- process information unavailable
> 10697 HRegionServer
> 10331 DataNode
>
> Could You please let me know whats wrong with my approach of creating
> tables. Thanks for replying
>
> P.S: forgot to mention I am using hadoop-0.20.2 & hbase-0.92.1 versions. So
> to avoid version mismatches I copied the hadoop Jar file in hadoop
> installation directory into habse/lib/ in all the cluster nodes.
>
>
> --
> Thanks & Regards,
>
> Venkateswara Rao Dokku