You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Vinay Mehta <vi...@gmail.com> on 2013/08/15 09:15:09 UTC
hbase.cluster.distributed property in hbase-site.xml
Hi,
I am newbie to Hbase and Hadoop.
I am trying to configure Hbase and Hadoop in pseudo distributed mode.
I have few questions.
1) what should hbase.cluster.distributed be set to in hbase-site.xml for
pseudo distributed mode.
Is it false for stanalone mode and true for both pseudo distributed and
fully distributed mode ?
2) As i have single machine which will hosts all daemons of hadoop and
hbase what should be the ideal cpu and memory configuration ?
Thanks for your time.
Regards,
Vinay
Re: hbase.cluster.distributed property in hbase-site.xml
Posted by Ted Yu <yu...@gmail.com>.
Vinay:
>From hbase-common/src/main/resources/hbase-default.xml off of trunk:
<description>The mode the cluster will be in. Possible values are
false for standalone mode and true for distributed mode. If
false, startup will run all HBase and ZooKeeper daemons together
in the one JVM.</description>
Hope the above clarifies.
On Thu, Aug 15, 2013 at 6:32 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:
> Hi Vinay,
>
> I'm not 100% sure but I think the key is ZooKeeper...
>
> <description>The mode the cluster will be in. Possible values are
> false: standalone and pseudo-distributed setups with managed
> Zookeeper
> true: fully-distributed with unmanaged Zookeeper Quorum (see
> hbase-env.sh)
> </description>
>
> On my side, I have an external ZK, so I have put this as true even if I'm
> pseudo-distributed since I want to handle ZK myself. But if you want a
> Pseudo-Distributed mode and you want to let HBase manage ZK, then you need
> to put it at false.
>
> If you put it at true, then you have to specify the qorum property too.
>
> My understanding.
>
> JM
>
> 2013/8/15 Vinay Mehta <vi...@gmail.com>
>
> > Hi Ted/Jean
> > Can you help in understanding conflicting statements in official
> reference
> > guide as i mentioned above ?
> >
> >
> > On Thu, Aug 15, 2013 at 6:51 PM, Ted Yu <yu...@gmail.com> wrote:
> >
> > > Vinay:
> > > In http://hbase.apache.org/book.html , take a look at 14.3.1.2.
> > Hardware
> > >
> > >
> > > On Thu, Aug 15, 2013 at 4:47 AM, Jean-Marc Spaggiari <
> > > jean-marc@spaggiari.org> wrote:
> > >
> > > > If you want want to run the application but no MR jobs, small CPU is
> > > > enought. If you want to inject big load and run big jobs, will
> require
> > > big
> > > > CPU...
> > > >
> > > > JM
> > > >
> > > > 2013/8/15 Vinay Mehta <vi...@gmail.com>
> > > >
> > > > > Hi,
> > > > > Thanks Jean.
> > > > > I will take care of your advice in future.
> > > > > What about CPU configuration ?
> > > > >
> > > > >
> > > > > On Thu, Aug 15, 2013 at 4:51 PM, Jean-Marc Spaggiari <
> > > > > jean-marc@spaggiari.org> wrote:
> > > > >
> > > > > > Hi Vinay,
> > > > > >
> > > > > > 2 things.
> > > > > >
> > > > > > First, you should not expect the list to be available 24/7 to
> reply
> > > to
> > > > > your
> > > > > > questions in less that 2 hours. People here are all voloneers
> from
> > > the
> > > > > > community, and something, they mightnot have the time, or might
> be
> > > > > > sleeping, or might not know, or anything else.
> > > > > >
> > > > > > Second, here is what you need to setup for a pseudo-distributed
> > node.
> > > > > don't
> > > > > > forget that you need at least 16GB on this node if you want it to
> > > work
> > > > > > correctly.
> > > > > >
> > > > > > <configuration>
> > > > > > <property>
> > > > > > <name>hbase.rootdir</name>
> > > > > > <value>hdfs://hbasetest:9000/hbase</value>
> > > > > > </property>
> > > > > > <property>
> > > > > > <name>hbase.cluster.distributed</name>
> > > > > > <value>true</value>
> > > > > > </property>
> > > > > > <property>
> > > > > > <name>hbase.zookeeper.quorum</name>
> > > > > > <value>hbasetest</value>
> > > > > > </property>
> > > > > > </configuration>
> > > > > >
> > > > > > In this mode, I start Hadoop and ZooKeeper manually.
> > > > > >
> > > > > > JM
> > > > > >
> > > > > > 2013/8/15 Vinay Mehta <vi...@gmail.com>
> > > > > >
> > > > > > > Some one please reply.
> > > > > > > I am asking this as at one place in official reference guide
> its
> > > > > > mentioned
> > > > > > > as true as show below :-
> > > > > > >
> > > > > > > 2.2.2.1.1. Pseudo-distributed Configuration File
> > > > > > >
> > > > > > > Below is a sample pseudo-distributed file for the node
> > > > > > h-24-30.example.com
> > > > > > > .
> > > > > > > hbase-site.xml
> > > > > > >
> > > > > > > <configuration>
> > > > > > > ...* <property>
> > > > > > > <name>hbase.rootdir</name>
> > > > > > > <value>hdfs://h-24-30.sfo.stumble.net:8020/hbase</value>
> > > > > > > </property>
> > > > > > > <property>
> > > > > > > <name>hbase.cluster.distributed</name>
> > > > > > > <value>true</value> </property>*
> > > > > > >
> > > > > > >
> > > > > > > Where as at another place in same file its mentioned as
> > > > > > >
> > > > > > > 2.4.1.1. hbase-site.xml
> > > > > > >
> > > > > > > <?xml version="1.0"?>
> > > > > > > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> > > > > > > <configuration>
> > > > > > > .....
> > > > > > > * <property>
> > > > > > > <name>hbase.cluster.distributed</name>
> > > > > > > <value>true</value>
> > > > > > > <description>The mode the cluster will be in. Possible
> values
> > > are
> > > > > > > false: standalone and pseudo-distributed setups with
> > managed
> > > > > > > Zookeeper
> > > > > > > true: fully-distributed with unmanaged Zookeeper Quorum
> > (see
> > > > > > > hbase-env.sh)
> > > > > > > </description>
> > > > > > > </property>*
> > > > > > > </configuration>
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > So its contradictory and hence i am confused. :(
> > > > > > > Also As i have single machine which will hosts all daemons of
> > > hadoop
> > > > > and
> > > > > > > hbase what should be the ideal cpu and memory configuration ?
> > > > > > >
> > > > > > > Regards,
> > > > > > > Vinay
> > > > > > >
> > > > > > > On Thu, Aug 15, 2013 at 12:45 PM, Vinay Mehta <
> > > > vinay.p.mehta@gmail.com
> > > > > > > >wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > > I am newbie to Hbase and Hadoop.
> > > > > > > > I am trying to configure Hbase and Hadoop in pseudo
> distributed
> > > > mode.
> > > > > > > > I have few questions.
> > > > > > > >
> > > > > > > > 1) what should hbase.cluster.distributed be set to in
> > > > hbase-site.xml
> > > > > > for
> > > > > > > > pseudo distributed mode.
> > > > > > > > Is it false for stanalone mode and true for both pseudo
> > > distributed
> > > > > and
> > > > > > > > fully distributed mode ?
> > > > > > > >
> > > > > > > > 2) As i have single machine which will hosts all daemons of
> > > hadoop
> > > > > and
> > > > > > > > hbase what should be the ideal cpu and memory configuration ?
> > > > > > > >
> > > > > > > > Thanks for your time.
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > > Vinay
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: hbase.cluster.distributed property in hbase-site.xml
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Vinay,
I'm not 100% sure but I think the key is ZooKeeper...
<description>The mode the cluster will be in. Possible values are
false: standalone and pseudo-distributed setups with managed Zookeeper
true: fully-distributed with unmanaged Zookeeper Quorum (see
hbase-env.sh)
</description>
On my side, I have an external ZK, so I have put this as true even if I'm
pseudo-distributed since I want to handle ZK myself. But if you want a
Pseudo-Distributed mode and you want to let HBase manage ZK, then you need
to put it at false.
If you put it at true, then you have to specify the qorum property too.
My understanding.
JM
2013/8/15 Vinay Mehta <vi...@gmail.com>
> Hi Ted/Jean
> Can you help in understanding conflicting statements in official reference
> guide as i mentioned above ?
>
>
> On Thu, Aug 15, 2013 at 6:51 PM, Ted Yu <yu...@gmail.com> wrote:
>
> > Vinay:
> > In http://hbase.apache.org/book.html , take a look at 14.3.1.2.
> Hardware
> >
> >
> > On Thu, Aug 15, 2013 at 4:47 AM, Jean-Marc Spaggiari <
> > jean-marc@spaggiari.org> wrote:
> >
> > > If you want want to run the application but no MR jobs, small CPU is
> > > enought. If you want to inject big load and run big jobs, will require
> > big
> > > CPU...
> > >
> > > JM
> > >
> > > 2013/8/15 Vinay Mehta <vi...@gmail.com>
> > >
> > > > Hi,
> > > > Thanks Jean.
> > > > I will take care of your advice in future.
> > > > What about CPU configuration ?
> > > >
> > > >
> > > > On Thu, Aug 15, 2013 at 4:51 PM, Jean-Marc Spaggiari <
> > > > jean-marc@spaggiari.org> wrote:
> > > >
> > > > > Hi Vinay,
> > > > >
> > > > > 2 things.
> > > > >
> > > > > First, you should not expect the list to be available 24/7 to reply
> > to
> > > > your
> > > > > questions in less that 2 hours. People here are all voloneers from
> > the
> > > > > community, and something, they mightnot have the time, or might be
> > > > > sleeping, or might not know, or anything else.
> > > > >
> > > > > Second, here is what you need to setup for a pseudo-distributed
> node.
> > > > don't
> > > > > forget that you need at least 16GB on this node if you want it to
> > work
> > > > > correctly.
> > > > >
> > > > > <configuration>
> > > > > <property>
> > > > > <name>hbase.rootdir</name>
> > > > > <value>hdfs://hbasetest:9000/hbase</value>
> > > > > </property>
> > > > > <property>
> > > > > <name>hbase.cluster.distributed</name>
> > > > > <value>true</value>
> > > > > </property>
> > > > > <property>
> > > > > <name>hbase.zookeeper.quorum</name>
> > > > > <value>hbasetest</value>
> > > > > </property>
> > > > > </configuration>
> > > > >
> > > > > In this mode, I start Hadoop and ZooKeeper manually.
> > > > >
> > > > > JM
> > > > >
> > > > > 2013/8/15 Vinay Mehta <vi...@gmail.com>
> > > > >
> > > > > > Some one please reply.
> > > > > > I am asking this as at one place in official reference guide its
> > > > > mentioned
> > > > > > as true as show below :-
> > > > > >
> > > > > > 2.2.2.1.1. Pseudo-distributed Configuration File
> > > > > >
> > > > > > Below is a sample pseudo-distributed file for the node
> > > > > h-24-30.example.com
> > > > > > .
> > > > > > hbase-site.xml
> > > > > >
> > > > > > <configuration>
> > > > > > ...* <property>
> > > > > > <name>hbase.rootdir</name>
> > > > > > <value>hdfs://h-24-30.sfo.stumble.net:8020/hbase</value>
> > > > > > </property>
> > > > > > <property>
> > > > > > <name>hbase.cluster.distributed</name>
> > > > > > <value>true</value> </property>*
> > > > > >
> > > > > >
> > > > > > Where as at another place in same file its mentioned as
> > > > > >
> > > > > > 2.4.1.1. hbase-site.xml
> > > > > >
> > > > > > <?xml version="1.0"?>
> > > > > > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> > > > > > <configuration>
> > > > > > .....
> > > > > > * <property>
> > > > > > <name>hbase.cluster.distributed</name>
> > > > > > <value>true</value>
> > > > > > <description>The mode the cluster will be in. Possible values
> > are
> > > > > > false: standalone and pseudo-distributed setups with
> managed
> > > > > > Zookeeper
> > > > > > true: fully-distributed with unmanaged Zookeeper Quorum
> (see
> > > > > > hbase-env.sh)
> > > > > > </description>
> > > > > > </property>*
> > > > > > </configuration>
> > > > > >
> > > > > >
> > > > > >
> > > > > > So its contradictory and hence i am confused. :(
> > > > > > Also As i have single machine which will hosts all daemons of
> > hadoop
> > > > and
> > > > > > hbase what should be the ideal cpu and memory configuration ?
> > > > > >
> > > > > > Regards,
> > > > > > Vinay
> > > > > >
> > > > > > On Thu, Aug 15, 2013 at 12:45 PM, Vinay Mehta <
> > > vinay.p.mehta@gmail.com
> > > > > > >wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > > I am newbie to Hbase and Hadoop.
> > > > > > > I am trying to configure Hbase and Hadoop in pseudo distributed
> > > mode.
> > > > > > > I have few questions.
> > > > > > >
> > > > > > > 1) what should hbase.cluster.distributed be set to in
> > > hbase-site.xml
> > > > > for
> > > > > > > pseudo distributed mode.
> > > > > > > Is it false for stanalone mode and true for both pseudo
> > distributed
> > > > and
> > > > > > > fully distributed mode ?
> > > > > > >
> > > > > > > 2) As i have single machine which will hosts all daemons of
> > hadoop
> > > > and
> > > > > > > hbase what should be the ideal cpu and memory configuration ?
> > > > > > >
> > > > > > > Thanks for your time.
> > > > > > >
> > > > > > > Regards,
> > > > > > > Vinay
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: hbase.cluster.distributed property in hbase-site.xml
Posted by Vinay Mehta <vi...@gmail.com>.
Hi Ted/Jean
Can you help in understanding conflicting statements in official reference
guide as i mentioned above ?
On Thu, Aug 15, 2013 at 6:51 PM, Ted Yu <yu...@gmail.com> wrote:
> Vinay:
> In http://hbase.apache.org/book.html , take a look at 14.3.1.2. Hardware
>
>
> On Thu, Aug 15, 2013 at 4:47 AM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > If you want want to run the application but no MR jobs, small CPU is
> > enought. If you want to inject big load and run big jobs, will require
> big
> > CPU...
> >
> > JM
> >
> > 2013/8/15 Vinay Mehta <vi...@gmail.com>
> >
> > > Hi,
> > > Thanks Jean.
> > > I will take care of your advice in future.
> > > What about CPU configuration ?
> > >
> > >
> > > On Thu, Aug 15, 2013 at 4:51 PM, Jean-Marc Spaggiari <
> > > jean-marc@spaggiari.org> wrote:
> > >
> > > > Hi Vinay,
> > > >
> > > > 2 things.
> > > >
> > > > First, you should not expect the list to be available 24/7 to reply
> to
> > > your
> > > > questions in less that 2 hours. People here are all voloneers from
> the
> > > > community, and something, they mightnot have the time, or might be
> > > > sleeping, or might not know, or anything else.
> > > >
> > > > Second, here is what you need to setup for a pseudo-distributed node.
> > > don't
> > > > forget that you need at least 16GB on this node if you want it to
> work
> > > > correctly.
> > > >
> > > > <configuration>
> > > > <property>
> > > > <name>hbase.rootdir</name>
> > > > <value>hdfs://hbasetest:9000/hbase</value>
> > > > </property>
> > > > <property>
> > > > <name>hbase.cluster.distributed</name>
> > > > <value>true</value>
> > > > </property>
> > > > <property>
> > > > <name>hbase.zookeeper.quorum</name>
> > > > <value>hbasetest</value>
> > > > </property>
> > > > </configuration>
> > > >
> > > > In this mode, I start Hadoop and ZooKeeper manually.
> > > >
> > > > JM
> > > >
> > > > 2013/8/15 Vinay Mehta <vi...@gmail.com>
> > > >
> > > > > Some one please reply.
> > > > > I am asking this as at one place in official reference guide its
> > > > mentioned
> > > > > as true as show below :-
> > > > >
> > > > > 2.2.2.1.1. Pseudo-distributed Configuration File
> > > > >
> > > > > Below is a sample pseudo-distributed file for the node
> > > > h-24-30.example.com
> > > > > .
> > > > > hbase-site.xml
> > > > >
> > > > > <configuration>
> > > > > ...* <property>
> > > > > <name>hbase.rootdir</name>
> > > > > <value>hdfs://h-24-30.sfo.stumble.net:8020/hbase</value>
> > > > > </property>
> > > > > <property>
> > > > > <name>hbase.cluster.distributed</name>
> > > > > <value>true</value> </property>*
> > > > >
> > > > >
> > > > > Where as at another place in same file its mentioned as
> > > > >
> > > > > 2.4.1.1. hbase-site.xml
> > > > >
> > > > > <?xml version="1.0"?>
> > > > > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> > > > > <configuration>
> > > > > .....
> > > > > * <property>
> > > > > <name>hbase.cluster.distributed</name>
> > > > > <value>true</value>
> > > > > <description>The mode the cluster will be in. Possible values
> are
> > > > > false: standalone and pseudo-distributed setups with managed
> > > > > Zookeeper
> > > > > true: fully-distributed with unmanaged Zookeeper Quorum (see
> > > > > hbase-env.sh)
> > > > > </description>
> > > > > </property>*
> > > > > </configuration>
> > > > >
> > > > >
> > > > >
> > > > > So its contradictory and hence i am confused. :(
> > > > > Also As i have single machine which will hosts all daemons of
> hadoop
> > > and
> > > > > hbase what should be the ideal cpu and memory configuration ?
> > > > >
> > > > > Regards,
> > > > > Vinay
> > > > >
> > > > > On Thu, Aug 15, 2013 at 12:45 PM, Vinay Mehta <
> > vinay.p.mehta@gmail.com
> > > > > >wrote:
> > > > >
> > > > > > Hi,
> > > > > > I am newbie to Hbase and Hadoop.
> > > > > > I am trying to configure Hbase and Hadoop in pseudo distributed
> > mode.
> > > > > > I have few questions.
> > > > > >
> > > > > > 1) what should hbase.cluster.distributed be set to in
> > hbase-site.xml
> > > > for
> > > > > > pseudo distributed mode.
> > > > > > Is it false for stanalone mode and true for both pseudo
> distributed
> > > and
> > > > > > fully distributed mode ?
> > > > > >
> > > > > > 2) As i have single machine which will hosts all daemons of
> hadoop
> > > and
> > > > > > hbase what should be the ideal cpu and memory configuration ?
> > > > > >
> > > > > > Thanks for your time.
> > > > > >
> > > > > > Regards,
> > > > > > Vinay
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: hbase.cluster.distributed property in hbase-site.xml
Posted by Ted Yu <yu...@gmail.com>.
Vinay:
In http://hbase.apache.org/book.html , take a look at 14.3.1.2. Hardware
On Thu, Aug 15, 2013 at 4:47 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:
> If you want want to run the application but no MR jobs, small CPU is
> enought. If you want to inject big load and run big jobs, will require big
> CPU...
>
> JM
>
> 2013/8/15 Vinay Mehta <vi...@gmail.com>
>
> > Hi,
> > Thanks Jean.
> > I will take care of your advice in future.
> > What about CPU configuration ?
> >
> >
> > On Thu, Aug 15, 2013 at 4:51 PM, Jean-Marc Spaggiari <
> > jean-marc@spaggiari.org> wrote:
> >
> > > Hi Vinay,
> > >
> > > 2 things.
> > >
> > > First, you should not expect the list to be available 24/7 to reply to
> > your
> > > questions in less that 2 hours. People here are all voloneers from the
> > > community, and something, they mightnot have the time, or might be
> > > sleeping, or might not know, or anything else.
> > >
> > > Second, here is what you need to setup for a pseudo-distributed node.
> > don't
> > > forget that you need at least 16GB on this node if you want it to work
> > > correctly.
> > >
> > > <configuration>
> > > <property>
> > > <name>hbase.rootdir</name>
> > > <value>hdfs://hbasetest:9000/hbase</value>
> > > </property>
> > > <property>
> > > <name>hbase.cluster.distributed</name>
> > > <value>true</value>
> > > </property>
> > > <property>
> > > <name>hbase.zookeeper.quorum</name>
> > > <value>hbasetest</value>
> > > </property>
> > > </configuration>
> > >
> > > In this mode, I start Hadoop and ZooKeeper manually.
> > >
> > > JM
> > >
> > > 2013/8/15 Vinay Mehta <vi...@gmail.com>
> > >
> > > > Some one please reply.
> > > > I am asking this as at one place in official reference guide its
> > > mentioned
> > > > as true as show below :-
> > > >
> > > > 2.2.2.1.1. Pseudo-distributed Configuration File
> > > >
> > > > Below is a sample pseudo-distributed file for the node
> > > h-24-30.example.com
> > > > .
> > > > hbase-site.xml
> > > >
> > > > <configuration>
> > > > ...* <property>
> > > > <name>hbase.rootdir</name>
> > > > <value>hdfs://h-24-30.sfo.stumble.net:8020/hbase</value>
> > > > </property>
> > > > <property>
> > > > <name>hbase.cluster.distributed</name>
> > > > <value>true</value> </property>*
> > > >
> > > >
> > > > Where as at another place in same file its mentioned as
> > > >
> > > > 2.4.1.1. hbase-site.xml
> > > >
> > > > <?xml version="1.0"?>
> > > > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> > > > <configuration>
> > > > .....
> > > > * <property>
> > > > <name>hbase.cluster.distributed</name>
> > > > <value>true</value>
> > > > <description>The mode the cluster will be in. Possible values are
> > > > false: standalone and pseudo-distributed setups with managed
> > > > Zookeeper
> > > > true: fully-distributed with unmanaged Zookeeper Quorum (see
> > > > hbase-env.sh)
> > > > </description>
> > > > </property>*
> > > > </configuration>
> > > >
> > > >
> > > >
> > > > So its contradictory and hence i am confused. :(
> > > > Also As i have single machine which will hosts all daemons of hadoop
> > and
> > > > hbase what should be the ideal cpu and memory configuration ?
> > > >
> > > > Regards,
> > > > Vinay
> > > >
> > > > On Thu, Aug 15, 2013 at 12:45 PM, Vinay Mehta <
> vinay.p.mehta@gmail.com
> > > > >wrote:
> > > >
> > > > > Hi,
> > > > > I am newbie to Hbase and Hadoop.
> > > > > I am trying to configure Hbase and Hadoop in pseudo distributed
> mode.
> > > > > I have few questions.
> > > > >
> > > > > 1) what should hbase.cluster.distributed be set to in
> hbase-site.xml
> > > for
> > > > > pseudo distributed mode.
> > > > > Is it false for stanalone mode and true for both pseudo distributed
> > and
> > > > > fully distributed mode ?
> > > > >
> > > > > 2) As i have single machine which will hosts all daemons of hadoop
> > and
> > > > > hbase what should be the ideal cpu and memory configuration ?
> > > > >
> > > > > Thanks for your time.
> > > > >
> > > > > Regards,
> > > > > Vinay
> > > > >
> > > >
> > >
> >
>
Re: hbase.cluster.distributed property in hbase-site.xml
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
If you want want to run the application but no MR jobs, small CPU is
enought. If you want to inject big load and run big jobs, will require big
CPU...
JM
2013/8/15 Vinay Mehta <vi...@gmail.com>
> Hi,
> Thanks Jean.
> I will take care of your advice in future.
> What about CPU configuration ?
>
>
> On Thu, Aug 15, 2013 at 4:51 PM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > Hi Vinay,
> >
> > 2 things.
> >
> > First, you should not expect the list to be available 24/7 to reply to
> your
> > questions in less that 2 hours. People here are all voloneers from the
> > community, and something, they mightnot have the time, or might be
> > sleeping, or might not know, or anything else.
> >
> > Second, here is what you need to setup for a pseudo-distributed node.
> don't
> > forget that you need at least 16GB on this node if you want it to work
> > correctly.
> >
> > <configuration>
> > <property>
> > <name>hbase.rootdir</name>
> > <value>hdfs://hbasetest:9000/hbase</value>
> > </property>
> > <property>
> > <name>hbase.cluster.distributed</name>
> > <value>true</value>
> > </property>
> > <property>
> > <name>hbase.zookeeper.quorum</name>
> > <value>hbasetest</value>
> > </property>
> > </configuration>
> >
> > In this mode, I start Hadoop and ZooKeeper manually.
> >
> > JM
> >
> > 2013/8/15 Vinay Mehta <vi...@gmail.com>
> >
> > > Some one please reply.
> > > I am asking this as at one place in official reference guide its
> > mentioned
> > > as true as show below :-
> > >
> > > 2.2.2.1.1. Pseudo-distributed Configuration File
> > >
> > > Below is a sample pseudo-distributed file for the node
> > h-24-30.example.com
> > > .
> > > hbase-site.xml
> > >
> > > <configuration>
> > > ...* <property>
> > > <name>hbase.rootdir</name>
> > > <value>hdfs://h-24-30.sfo.stumble.net:8020/hbase</value>
> > > </property>
> > > <property>
> > > <name>hbase.cluster.distributed</name>
> > > <value>true</value> </property>*
> > >
> > >
> > > Where as at another place in same file its mentioned as
> > >
> > > 2.4.1.1. hbase-site.xml
> > >
> > > <?xml version="1.0"?>
> > > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> > > <configuration>
> > > .....
> > > * <property>
> > > <name>hbase.cluster.distributed</name>
> > > <value>true</value>
> > > <description>The mode the cluster will be in. Possible values are
> > > false: standalone and pseudo-distributed setups with managed
> > > Zookeeper
> > > true: fully-distributed with unmanaged Zookeeper Quorum (see
> > > hbase-env.sh)
> > > </description>
> > > </property>*
> > > </configuration>
> > >
> > >
> > >
> > > So its contradictory and hence i am confused. :(
> > > Also As i have single machine which will hosts all daemons of hadoop
> and
> > > hbase what should be the ideal cpu and memory configuration ?
> > >
> > > Regards,
> > > Vinay
> > >
> > > On Thu, Aug 15, 2013 at 12:45 PM, Vinay Mehta <vinay.p.mehta@gmail.com
> > > >wrote:
> > >
> > > > Hi,
> > > > I am newbie to Hbase and Hadoop.
> > > > I am trying to configure Hbase and Hadoop in pseudo distributed mode.
> > > > I have few questions.
> > > >
> > > > 1) what should hbase.cluster.distributed be set to in hbase-site.xml
> > for
> > > > pseudo distributed mode.
> > > > Is it false for stanalone mode and true for both pseudo distributed
> and
> > > > fully distributed mode ?
> > > >
> > > > 2) As i have single machine which will hosts all daemons of hadoop
> and
> > > > hbase what should be the ideal cpu and memory configuration ?
> > > >
> > > > Thanks for your time.
> > > >
> > > > Regards,
> > > > Vinay
> > > >
> > >
> >
>
Re: hbase.cluster.distributed property in hbase-site.xml
Posted by Vinay Mehta <vi...@gmail.com>.
Hi,
Thanks Jean.
I will take care of your advice in future.
What about CPU configuration ?
On Thu, Aug 15, 2013 at 4:51 PM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:
> Hi Vinay,
>
> 2 things.
>
> First, you should not expect the list to be available 24/7 to reply to your
> questions in less that 2 hours. People here are all voloneers from the
> community, and something, they mightnot have the time, or might be
> sleeping, or might not know, or anything else.
>
> Second, here is what you need to setup for a pseudo-distributed node. don't
> forget that you need at least 16GB on this node if you want it to work
> correctly.
>
> <configuration>
> <property>
> <name>hbase.rootdir</name>
> <value>hdfs://hbasetest:9000/hbase</value>
> </property>
> <property>
> <name>hbase.cluster.distributed</name>
> <value>true</value>
> </property>
> <property>
> <name>hbase.zookeeper.quorum</name>
> <value>hbasetest</value>
> </property>
> </configuration>
>
> In this mode, I start Hadoop and ZooKeeper manually.
>
> JM
>
> 2013/8/15 Vinay Mehta <vi...@gmail.com>
>
> > Some one please reply.
> > I am asking this as at one place in official reference guide its
> mentioned
> > as true as show below :-
> >
> > 2.2.2.1.1. Pseudo-distributed Configuration File
> >
> > Below is a sample pseudo-distributed file for the node
> h-24-30.example.com
> > .
> > hbase-site.xml
> >
> > <configuration>
> > ...* <property>
> > <name>hbase.rootdir</name>
> > <value>hdfs://h-24-30.sfo.stumble.net:8020/hbase</value>
> > </property>
> > <property>
> > <name>hbase.cluster.distributed</name>
> > <value>true</value> </property>*
> >
> >
> > Where as at another place in same file its mentioned as
> >
> > 2.4.1.1. hbase-site.xml
> >
> > <?xml version="1.0"?>
> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> > <configuration>
> > .....
> > * <property>
> > <name>hbase.cluster.distributed</name>
> > <value>true</value>
> > <description>The mode the cluster will be in. Possible values are
> > false: standalone and pseudo-distributed setups with managed
> > Zookeeper
> > true: fully-distributed with unmanaged Zookeeper Quorum (see
> > hbase-env.sh)
> > </description>
> > </property>*
> > </configuration>
> >
> >
> >
> > So its contradictory and hence i am confused. :(
> > Also As i have single machine which will hosts all daemons of hadoop and
> > hbase what should be the ideal cpu and memory configuration ?
> >
> > Regards,
> > Vinay
> >
> > On Thu, Aug 15, 2013 at 12:45 PM, Vinay Mehta <vinay.p.mehta@gmail.com
> > >wrote:
> >
> > > Hi,
> > > I am newbie to Hbase and Hadoop.
> > > I am trying to configure Hbase and Hadoop in pseudo distributed mode.
> > > I have few questions.
> > >
> > > 1) what should hbase.cluster.distributed be set to in hbase-site.xml
> for
> > > pseudo distributed mode.
> > > Is it false for stanalone mode and true for both pseudo distributed and
> > > fully distributed mode ?
> > >
> > > 2) As i have single machine which will hosts all daemons of hadoop and
> > > hbase what should be the ideal cpu and memory configuration ?
> > >
> > > Thanks for your time.
> > >
> > > Regards,
> > > Vinay
> > >
> >
>
Re: hbase.cluster.distributed property in hbase-site.xml
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Vinay,
2 things.
First, you should not expect the list to be available 24/7 to reply to your
questions in less that 2 hours. People here are all voloneers from the
community, and something, they mightnot have the time, or might be
sleeping, or might not know, or anything else.
Second, here is what you need to setup for a pseudo-distributed node. don't
forget that you need at least 16GB on this node if you want it to work
correctly.
<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://hbasetest:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>hbasetest</value>
</property>
</configuration>
In this mode, I start Hadoop and ZooKeeper manually.
JM
2013/8/15 Vinay Mehta <vi...@gmail.com>
> Some one please reply.
> I am asking this as at one place in official reference guide its mentioned
> as true as show below :-
>
> 2.2.2.1.1. Pseudo-distributed Configuration File
>
> Below is a sample pseudo-distributed file for the node h-24-30.example.com
> .
> hbase-site.xml
>
> <configuration>
> ...* <property>
> <name>hbase.rootdir</name>
> <value>hdfs://h-24-30.sfo.stumble.net:8020/hbase</value>
> </property>
> <property>
> <name>hbase.cluster.distributed</name>
> <value>true</value> </property>*
>
>
> Where as at another place in same file its mentioned as
>
> 2.4.1.1. hbase-site.xml
>
> <?xml version="1.0"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <configuration>
> .....
> * <property>
> <name>hbase.cluster.distributed</name>
> <value>true</value>
> <description>The mode the cluster will be in. Possible values are
> false: standalone and pseudo-distributed setups with managed
> Zookeeper
> true: fully-distributed with unmanaged Zookeeper Quorum (see
> hbase-env.sh)
> </description>
> </property>*
> </configuration>
>
>
>
> So its contradictory and hence i am confused. :(
> Also As i have single machine which will hosts all daemons of hadoop and
> hbase what should be the ideal cpu and memory configuration ?
>
> Regards,
> Vinay
>
> On Thu, Aug 15, 2013 at 12:45 PM, Vinay Mehta <vinay.p.mehta@gmail.com
> >wrote:
>
> > Hi,
> > I am newbie to Hbase and Hadoop.
> > I am trying to configure Hbase and Hadoop in pseudo distributed mode.
> > I have few questions.
> >
> > 1) what should hbase.cluster.distributed be set to in hbase-site.xml for
> > pseudo distributed mode.
> > Is it false for stanalone mode and true for both pseudo distributed and
> > fully distributed mode ?
> >
> > 2) As i have single machine which will hosts all daemons of hadoop and
> > hbase what should be the ideal cpu and memory configuration ?
> >
> > Thanks for your time.
> >
> > Regards,
> > Vinay
> >
>
Re: hbase.cluster.distributed property in hbase-site.xml
Posted by Vinay Mehta <vi...@gmail.com>.
Some one please reply.
I am asking this as at one place in official reference guide its mentioned
as true as show below :-
2.2.2.1.1. Pseudo-distributed Configuration File
Below is a sample pseudo-distributed file for the node h-24-30.example.com.
hbase-site.xml
<configuration>
...* <property>
<name>hbase.rootdir</name>
<value>hdfs://h-24-30.sfo.stumble.net:8020/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value> </property>*
Where as at another place in same file its mentioned as
2.4.1.1. hbase-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
.....
* <property>
<name>hbase.cluster.distributed</name>
<value>true</value>
<description>The mode the cluster will be in. Possible values are
false: standalone and pseudo-distributed setups with managed Zookeeper
true: fully-distributed with unmanaged Zookeeper Quorum (see hbase-env.sh)
</description>
</property>*
</configuration>
So its contradictory and hence i am confused. :(
Also As i have single machine which will hosts all daemons of hadoop and
hbase what should be the ideal cpu and memory configuration ?
Regards,
Vinay
On Thu, Aug 15, 2013 at 12:45 PM, Vinay Mehta <vi...@gmail.com>wrote:
> Hi,
> I am newbie to Hbase and Hadoop.
> I am trying to configure Hbase and Hadoop in pseudo distributed mode.
> I have few questions.
>
> 1) what should hbase.cluster.distributed be set to in hbase-site.xml for
> pseudo distributed mode.
> Is it false for stanalone mode and true for both pseudo distributed and
> fully distributed mode ?
>
> 2) As i have single machine which will hosts all daemons of hadoop and
> hbase what should be the ideal cpu and memory configuration ?
>
> Thanks for your time.
>
> Regards,
> Vinay
>