You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by stack <st...@duboce.net> on 2009/06/17 07:23:20 UTC
[ANN] HBase 0.20.0-alpha available for download
An alpha version of HBase 0.20.0 is available for download at:
http://people.apache.org/~stack/hbase-0.20.0-alpha/
We are making this release available to preview what is coming in HBase
0.20.0. In short, 0.20.0 is about performance and high-availability. Also,
a new, richer API has been added and the old deprecated. Here is a list of
almost 300 issues addressed so far in 0.20.0: http://tinyurl.com/ntvheo
This alpha release contains known bugs. See http://tinyurl.com/kvfsft for
the current list. In particular, this alpha release is without a migration
script to bring your 0.19.x era data forward to work on hbase 0.20.0. A
working, well-tested migration script will be in place before we cut the
first HBase 0.20.0 release candidate some time in the next week or so.
After download, please take the time to review the 0.20.0 'Getting Started'
also available here:
http://people.apache.org/~stack/hbase-0.20.0-alpha/docs/api/overview-summary.html#overview_description.
HBase 0.20.0 has new dependencies, in particular it now depends on
ZooKeeper. With ZooKeeper in the mix a few core HBase configurations have
been removed and replaced with ZooKeeper configurations instead.
Also of note, HBase 0.20.0 will include "Stargate", an improved REST
connector for HBase. The old, bundled REST connector will be deprecated.
Stargate is implemented using the Jersey framework. It includes protobuf
encoding support, has caching proxy awareness, supports batching for
scanners and updates, and in general has the goal of enabling Web scale
storage systems (a la S3) backed by HBase. Currently its only available up
on github, http://github.com/macdiesel/stargate/tree/master. It will be
added to a new contrib directory before we cut a release candidate.
Please let us know if you have difficulty with the install, if you find the
documentation missing or, if you trip over bugs hbasing.
Yours,
The HBasistas
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by llpind <so...@hotmail.com>.
Opps missed that bit. Okay, thanks Ryan.
Ryan Rawson wrote:
>
> In the original email:
>
> " In particular, this alpha release is without a migration
> script to bring your 0.19.x era data forward to work on hbase 0.20.0. "
>
> There is no migration for 0.19.x datafiles yet. That is due for the RC a
> few weeks away.
>
> If you can reload your data, that'd be best for now.
>
> Good luck!
> -ryan
>
> On Wed, Jun 17, 2009 at 2:34 PM, llpind <so...@hotmail.com> wrote:
>
>>
>> Sweet thanks stack. I'll be upgrading as well. My client program takes
>> far
>> too long to simply open a scanner. This problem appears to have been
>> addressed in .20 (https://issues.apache.org/jira/browse/HBASE-1118).
>>
>> In order to skip reloading the data I do the following:
>>
>> 1. Shutdown hadoop/hbase .19 versions.
>> 2. Move files and unpack per machine.
>> 3. Follow the fully dist. instructions provided w/zookeeper modify
>> config
>> files.
>> 4. Run: ${HBASE_DIR}/bin/hbase migrate
>> 5. Start new version of Hadoop/Hbase
>>
>> Making sure this will pick up all my existing tables?
>>
>> Thanks.
>>
>> --
>> View this message in context:
>> http://www.nabble.com/-ANN--HBase-0.20.0-alpha-available-for-download-tp24067200p24082507.html
>> Sent from the HBase User mailing list archive at Nabble.com.
>>
>>
>
>
--
View this message in context: http://www.nabble.com/-ANN--HBase-0.20.0-alpha-available-for-download-tp24067200p24082666.html
Sent from the HBase User mailing list archive at Nabble.com.
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by Ryan Rawson <ry...@gmail.com>.
In the original email:
" In particular, this alpha release is without a migration
script to bring your 0.19.x era data forward to work on hbase 0.20.0. "
There is no migration for 0.19.x datafiles yet. That is due for the RC a
few weeks away.
If you can reload your data, that'd be best for now.
Good luck!
-ryan
On Wed, Jun 17, 2009 at 2:34 PM, llpind <so...@hotmail.com> wrote:
>
> Sweet thanks stack. I'll be upgrading as well. My client program takes
> far
> too long to simply open a scanner. This problem appears to have been
> addressed in .20 (https://issues.apache.org/jira/browse/HBASE-1118).
>
> In order to skip reloading the data I do the following:
>
> 1. Shutdown hadoop/hbase .19 versions.
> 2. Move files and unpack per machine.
> 3. Follow the fully dist. instructions provided w/zookeeper modify config
> files.
> 4. Run: ${HBASE_DIR}/bin/hbase migrate
> 5. Start new version of Hadoop/Hbase
>
> Making sure this will pick up all my existing tables?
>
> Thanks.
>
> --
> View this message in context:
> http://www.nabble.com/-ANN--HBase-0.20.0-alpha-available-for-download-tp24067200p24082507.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
>
RE: [ANN] HBase 0.20.0-alpha available for download
Posted by "Jim Kellerman (POWERSET)" <Ji...@microsoft.com>.
You cannot run HBase 0.20 with data from 0.19. The on-disk format
has changed. A migration tool will be available for the release
candidate. Right now, if you want to use 0.20, you have to load
data into a new hbase instance (under a different top-level
directory)
---
Jim Kellerman, Powerset (Live Search, Microsoft Corporation)
> -----Original Message-----
> From: llpind [mailto:sonny_heer@hotmail.com]
> Sent: Thursday, June 18, 2009 9:34 AM
> To: hbase-user@hadoop.apache.org
> Subject: Re: [ANN] HBase 0.20.0-alpha available for download
>
>
> Yeah, we did have an issue with that before. After help from here,
> and some
> thought into the schema, we changed the hbase schema a bit.
>
> Now I have a scanner which iterates over, lets say ~2000 records,
> and has an
> inner scanner which needs to change based on a value from the outter
> scanner
> (essentially a nested for loop). Performance is the issue here, I
> was able
> to track it down to opening a scanner. It appears HBASE-1118
> addresses this
> issue. Is this correct?
>
> Also if someone could point me to what I'm doing wrong with Hadoop
> 0.20.0
> setup. I'm able to start my master server, but none of the slave
> nodes come
> up (unless I list the master as the slave). They all have the
> following
> error on start up:
>
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG: host = slave1/192.168.0.234
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 0.20.0
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.20 -r
> 763504;
> compiled by 'ndaley' on Thu Apr 9 05:18:40 UTC 2009
> ************************************************************/
> 2009-06-18 09:06:49,369 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode:
> java.lang.NullPointerException
> at
> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:134)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.
> java:156)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.
> java:160)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNo
> de.java:246)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java
> :216)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNod
> e.java:1283)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(
> DataNode.java:1238)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataN
> ode.java:1246)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1
> 368)
>
> 2009-06-18 09:06:49,370 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
>
>
> After searching a bit, seems people have this problem when they
> forget to
> set df.default.name, but i've got it set in core-site.xml:
>
> <property>
> <name>fs.default.name</name>
> <value>hdfs://master:54310</value>
> <description>The name of the default file system. A URI whose
> scheme and authority determine the FileSystem implementation.
> The
> uri's scheme determines the config property (fs.SCHEME.impl)
> naming
> the FileSystem implementation class. The uri's authority is used
> to
> determine the host, port, etc. for a filesystem.</description>
> </property>
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/data/hadoop-0.20.0-${user.name}</value>
> <description>A base for other temporary directories.</description>
> </property>
>
>
> Could the .19 install be messing something up? Thanks
>
> stack-3 wrote:
> >
> > On Wed, Jun 17, 2009 at 2:34 PM, llpind <so...@hotmail.com>
> wrote:
> >
> >>
> >> Sweet thanks stack. I'll be upgrading as well. My client
> program takes
> >> far
> >> too long to simply open a scanner. This problem appears to have
> been
> >> addressed in .20 (https://issues.apache.org/jira/browse/HBASE-
> 1118).
> >
> >
> >
> > Or was it HBASE-867?
> > St.Ack
> >
> >
>
> --
> View this message in context: http://www.nabble.com/-ANN--HBase-
> 0.20.0-alpha-available-for-download-tp24067200p24095308.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by stack <st...@duboce.net>.
On Thu, Jun 18, 2009 at 9:20 PM, llpind <so...@hotmail.com> wrote:
>
>
> "Though not recommended, it can be convenient having HBase continue to
> manage ZooKeeper even when in distributed mode "
>
> This made it seem like this part was only if you don't want HBase to manage
> ZooKeeper. but if you didn't want HBase to manage zookeeper, then you
> didn't need to do this step, and only needed to modify the hbase env file,
> but thats not true completely in a dist. environment. This caused me to
> reconfig other things, which caused other problems etc. but i eventually
> got it going.
>
OK. Thanks for the feedback. I had another hack on it to try and make that
section clearer. Lets see if others trip in the same way.
>
> I'm really happy with the support HBase forum provides here, you guys do a
> really good job.
We like compliments.
>
>
> I hope .20 solves our performance issues with the scanners. When i get a
> bit of time, I will try to dive into the HBase code and try to help out as
> well. Will keep you posted. :)
>
>
Please do.
St.Ack
>
>
>
> stack-3 wrote:
> >
> > On Thu, Jun 18, 2009 at 2:35 PM, llpind <so...@hotmail.com> wrote:
> >
> >>
> >> Thanks I did finally get it going, but only when I moved to a different
> >> master box. Kind of weird. must have been something quirky in my
> >> config.
> >
> >
> > Can you figure what it was?
> >
> >
> >
> >>
> >> when I start HBase .20, everything appears to start up. But I cant
> >> access
> >> the Web UI, and when i do stop-hbase.sh it just hangs with "stopping
> >> master...........".
> >
> >
> >
> > The webui not coming up would seem to indicate hbase is not coming up.
> > Whats in your master log? Are .META. and -ROOT- regions being deployed?
> >
> >
> >
> >> In the quick start it says to start zookeeper, do we
> >> manually have to start zookeeper each time? How do I start zookeeper?
> >> Do
> >> we need explicitly shut it down each time as well? thanks.
> >
> >
> >
> > If you do a process listing, do you see zookeeper?
> >
> > HBase will run an instance for you unless you make a change in
> > hbase-env.sh.
> >
> > Is you hbase distributed? Have you configured zoo.cfg as per the
> 'Getting
> > Started'?
> >
> > St.Ack
> >
> >
>
> --
> View this message in context:
> http://www.nabble.com/-ANN--HBase-0.20.0-alpha-available-for-download-tp24067200p24105292.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
>
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by llpind <so...@hotmail.com>.
Stack thanks for your response. I finally did get it figured out. Zookeeper
was not showing up in the process list. The quick start was a bit
misleading (at least to me). Here is where I got confused:
"Though not recommended, it can be convenient having HBase continue to
manage ZooKeeper even when in distributed mode "
This made it seem like this part was only if you don't want HBase to manage
ZooKeeper. but if you didn't want HBase to manage zookeeper, then you
didn't need to do this step, and only needed to modify the hbase env file,
but thats not true completely in a dist. environment. This caused me to
reconfig other things, which caused other problems etc. but i eventually
got it going.
I'm really happy with the support HBase forum provides here, you guys do a
really good job.
I hope .20 solves our performance issues with the scanners. When i get a
bit of time, I will try to dive into the HBase code and try to help out as
well. Will keep you posted. :)
stack-3 wrote:
>
> On Thu, Jun 18, 2009 at 2:35 PM, llpind <so...@hotmail.com> wrote:
>
>>
>> Thanks I did finally get it going, but only when I moved to a different
>> master box. Kind of weird. must have been something quirky in my
>> config.
>
>
> Can you figure what it was?
>
>
>
>>
>> when I start HBase .20, everything appears to start up. But I cant
>> access
>> the Web UI, and when i do stop-hbase.sh it just hangs with "stopping
>> master...........".
>
>
>
> The webui not coming up would seem to indicate hbase is not coming up.
> Whats in your master log? Are .META. and -ROOT- regions being deployed?
>
>
>
>> In the quick start it says to start zookeeper, do we
>> manually have to start zookeeper each time? How do I start zookeeper?
>> Do
>> we need explicitly shut it down each time as well? thanks.
>
>
>
> If you do a process listing, do you see zookeeper?
>
> HBase will run an instance for you unless you make a change in
> hbase-env.sh.
>
> Is you hbase distributed? Have you configured zoo.cfg as per the 'Getting
> Started'?
>
> St.Ack
>
>
--
View this message in context: http://www.nabble.com/-ANN--HBase-0.20.0-alpha-available-for-download-tp24067200p24105292.html
Sent from the HBase User mailing list archive at Nabble.com.
Re: Use of versions in transaction and replication strategies
Posted by Andrew Purtell <ap...@apache.org>.
Hi Brian,
One discussion I am aware of related to replication. The question was should there be effort put into edit conflict resolution by tracking the causal ordering of edits, e.g. by way of using vector clocks or similar techniques, or is that even necessary given Bigtable's inherent multiversioning. Either technique pushes the task of conflict resolution up to the client, but the latter is "inline" with Bigtable's data model and conventional API, and the implementation effort is therefore lower and the complexity of the resulting replication model is more simple, an important consideration (easier to demonstrate correctness, etc.). It is true that if clients are setting the timestamp dimension to user defined values, then an edit on one cluster may conflict with an edit written to another, with the conflict "resolved" from the client perspective as if by arbitrary coin toss.
- Andy
________________________________
From: "Brian.Levine@nokia.com" <Br...@nokia.com>
To: hbase-user@hadoop.apache.org
Sent: Sunday, June 21, 2009 9:30:39 AM
Subject: Use of versions in transaction and replication strategies
Hi all,
Not too long ago their were some discussions related to implementing transactions and/or replication strategies that made use of column versions. I can't remember whether the discussions happened in this forum or in one or more Jira tickets. Regardless, my question is whether there will indeed be a reliance on cell versions to implement either of these features. I ask because currently, the API allows the caller to decide what value is used for the version stamp. It doesn't have to be a timestamp. In fact, some folks have talked about not even using versions as versions, but rather as an additional data dimension.
So my question really boils down to whether HBase would need to restrict the use of versions if versions were indeed used to implement transactions and/or replication.
Thanks.
-brian
Use of versions in transaction and replication strategies
Posted by Br...@nokia.com.
Hi all,
Not too long ago their were some discussions related to implementing transactions and/or replication strategies that made use of column versions. I can't remember whether the discussions happened in this forum or in one or more Jira tickets. Regardless, my question is whether there will indeed be a reliance on cell versions to implement either of these features. I ask because currently, the API allows the caller to decide what value is used for the version stamp. It doesn't have to be a timestamp. In fact, some folks have talked about not even using versions as versions, but rather as an additional data dimension.
So my question really boils down to whether HBase would need to restrict the use of versions if versions were indeed used to implement transactions and/or replication.
Thanks.
-brian
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by stack <st...@duboce.net>.
On Thu, Jun 18, 2009 at 2:35 PM, llpind <so...@hotmail.com> wrote:
>
> Thanks I did finally get it going, but only when I moved to a different
> master box. Kind of weird. must have been something quirky in my config.
Can you figure what it was?
>
> when I start HBase .20, everything appears to start up. But I cant access
> the Web UI, and when i do stop-hbase.sh it just hangs with "stopping
> master...........".
The webui not coming up would seem to indicate hbase is not coming up.
Whats in your master log? Are .META. and -ROOT- regions being deployed?
> In the quick start it says to start zookeeper, do we
> manually have to start zookeeper each time? How do I start zookeeper? Do
> we need explicitly shut it down each time as well? thanks.
If you do a process listing, do you see zookeeper?
HBase will run an instance for you unless you make a change in hbase-env.sh.
Is you hbase distributed? Have you configured zoo.cfg as per the 'Getting
Started'?
St.Ack
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by llpind <so...@hotmail.com>.
Thanks I did finally get it going, but only when I moved to a different
master box. Kind of weird. must have been something quirky in my config.
when I start HBase .20, everything appears to start up. But I cant access
the Web UI, and when i do stop-hbase.sh it just hangs with "stopping
master...........". In the quick start it says to start zookeeper, do we
manually have to start zookeeper each time? How do I start zookeeper? Do
we need explicitly shut it down each time as well? thanks.
--
View this message in context: http://www.nabble.com/-ANN--HBase-0.20.0-alpha-available-for-download-tp24067200p24099666.html
Sent from the HBase User mailing list archive at Nabble.com.
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by stack <st...@duboce.net>.
On Thu, Jun 18, 2009 at 9:33 AM, llpind <so...@hotmail.com> wrote:
>
> Yeah, we did have an issue with that before. After help from here, and
> some
> thought into the schema, we changed the hbase schema a bit.
>
> Now I have a scanner which iterates over, lets say ~2000 records, and has
> an
> inner scanner which needs to change based on a value from the outter
> scanner
> (essentially a nested for loop). Performance is the issue here, I was able
> to track it down to opening a scanner. It appears HBASE-1118 addresses
> this
> issue. Is this correct?
Yes. Are you on 0.19.x?
Look at the source. Looks like you have bogus address for the datanode to
bind to.
Does master resolve properly?
St.Ack
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by llpind <so...@hotmail.com>.
Yeah, we did have an issue with that before. After help from here, and some
thought into the schema, we changed the hbase schema a bit.
Now I have a scanner which iterates over, lets say ~2000 records, and has an
inner scanner which needs to change based on a value from the outter scanner
(essentially a nested for loop). Performance is the issue here, I was able
to track it down to opening a scanner. It appears HBASE-1118 addresses this
issue. Is this correct?
Also if someone could point me to what I'm doing wrong with Hadoop 0.20.0
setup. I'm able to start my master server, but none of the slave nodes come
up (unless I list the master as the slave). They all have the following
error on start up:
STARTUP_MSG: Starting DataNode
STARTUP_MSG: host = slave1/192.168.0.234
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.0
STARTUP_MSG: build =
https://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.20 -r 763504;
compiled by 'ndaley' on Thu Apr 9 05:18:40 UTC 2009
************************************************************/
2009-06-18 09:06:49,369 ERROR
org.apache.hadoop.hdfs.server.datanode.DataNode:
java.lang.NullPointerException
at
org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:134)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:156)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:160)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:246)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:216)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1283)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1238)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1246)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1368)
2009-06-18 09:06:49,370 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
After searching a bit, seems people have this problem when they forget to
set df.default.name, but i've got it set in core-site.xml:
<property>
<name>fs.default.name</name>
<value>hdfs://master:54310</value>
<description>The name of the default file system. A URI whose
scheme and authority determine the FileSystem implementation. The
uri's scheme determines the config property (fs.SCHEME.impl) naming
the FileSystem implementation class. The uri's authority is used to
determine the host, port, etc. for a filesystem.</description>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/data/hadoop-0.20.0-${user.name}</value>
<description>A base for other temporary directories.</description>
</property>
Could the .19 install be messing something up? Thanks
stack-3 wrote:
>
> On Wed, Jun 17, 2009 at 2:34 PM, llpind <so...@hotmail.com> wrote:
>
>>
>> Sweet thanks stack. I'll be upgrading as well. My client program takes
>> far
>> too long to simply open a scanner. This problem appears to have been
>> addressed in .20 (https://issues.apache.org/jira/browse/HBASE-1118).
>
>
>
> Or was it HBASE-867?
> St.Ack
>
>
--
View this message in context: http://www.nabble.com/-ANN--HBase-0.20.0-alpha-available-for-download-tp24067200p24095308.html
Sent from the HBase User mailing list archive at Nabble.com.
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by stack <st...@duboce.net>.
On Wed, Jun 17, 2009 at 2:34 PM, llpind <so...@hotmail.com> wrote:
>
> Sweet thanks stack. I'll be upgrading as well. My client program takes
> far
> too long to simply open a scanner. This problem appears to have been
> addressed in .20 (https://issues.apache.org/jira/browse/HBASE-1118).
Or was it HBASE-867?
St.Ack
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by llpind <so...@hotmail.com>.
Sweet thanks stack. I'll be upgrading as well. My client program takes far
too long to simply open a scanner. This problem appears to have been
addressed in .20 (https://issues.apache.org/jira/browse/HBASE-1118).
In order to skip reloading the data I do the following:
1. Shutdown hadoop/hbase .19 versions.
2. Move files and unpack per machine.
3. Follow the fully dist. instructions provided w/zookeeper modify config
files.
4. Run: ${HBASE_DIR}/bin/hbase migrate
5. Start new version of Hadoop/Hbase
Making sure this will pick up all my existing tables?
Thanks.
--
View this message in context: http://www.nabble.com/-ANN--HBase-0.20.0-alpha-available-for-download-tp24067200p24082507.html
Sent from the HBase User mailing list archive at Nabble.com.
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by Bradford Stephens <br...@gmail.com>.
Oh sweet. This will be a most excellent party.
On Tue, Jun 16, 2009 at 10:23 PM, stack<st...@duboce.net> wrote:
> An alpha version of HBase 0.20.0 is available for download at:
>
> http://people.apache.org/~stack/hbase-0.20.0-alpha/
>
> We are making this release available to preview what is coming in HBase
> 0.20.0. In short, 0.20.0 is about performance and high-availability. Also,
> a new, richer API has been added and the old deprecated. Here is a list of
> almost 300 issues addressed so far in 0.20.0: http://tinyurl.com/ntvheo
>
> This alpha release contains known bugs. See http://tinyurl.com/kvfsft for
> the current list. In particular, this alpha release is without a migration
> script to bring your 0.19.x era data forward to work on hbase 0.20.0. A
> working, well-tested migration script will be in place before we cut the
> first HBase 0.20.0 release candidate some time in the next week or so.
>
> After download, please take the time to review the 0.20.0 'Getting Started'
> also available here:
> http://people.apache.org/~stack/hbase-0.20.0-alpha/docs/api/overview-summary.html#overview_description.
> HBase 0.20.0 has new dependencies, in particular it now depends on
> ZooKeeper. With ZooKeeper in the mix a few core HBase configurations have
> been removed and replaced with ZooKeeper configurations instead.
>
> Also of note, HBase 0.20.0 will include "Stargate", an improved REST
> connector for HBase. The old, bundled REST connector will be deprecated.
> Stargate is implemented using the Jersey framework. It includes protobuf
> encoding support, has caching proxy awareness, supports batching for
> scanners and updates, and in general has the goal of enabling Web scale
> storage systems (a la S3) backed by HBase. Currently its only available up
> on github, http://github.com/macdiesel/stargate/tree/master. It will be
> added to a new contrib directory before we cut a release candidate.
>
> Please let us know if you have difficulty with the install, if you find the
> documentation missing or, if you trip over bugs hbasing.
>
> Yours,
> The HBasistas
>
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by Jean-Daniel Cryans <jd...@apache.org>.
If you follow the "Getting Started" link that Stack gave, in the
"Requirements" section, you can see that this version of HBase will only run
on Hadoop 0.20
J-D
On Wed, Jun 17, 2009 at 7:32 AM, jason hadoop <ja...@gmail.com>wrote:
> Is there a requirement for hadoop 0.20 for HBase 0.20?
>
>
> On Wed, Jun 17, 2009 at 1:44 AM, Andrew Purtell <ap...@apache.org>
> wrote:
>
> > Minor correction/addition: "Stargate" is undergoing shared development in
> > two github trees:
> > http://github.com/macdiesel/stargate/tree/master
> > http://github.com/apurtell/stargate/tree/master
> > The github network view can show which branch is leading at any point in
> > time:
> > http://github.com/apurtell/stargate/network
> >
> > - Andy
> >
> >
> >
> >
> > ________________________________
> > From: stack <st...@duboce.net>
> > To: hbase-user@hadoop.apache.org; core-user@hadoop.apache.org
> > Sent: Tuesday, June 16, 2009 10:23:20 PM
> > Subject: [ANN] HBase 0.20.0-alpha available for download
> >
> > An alpha version of HBase 0.20.0 is available for download at:
> >
> > http://people.apache.org/~stack/hbase-0.20.0-alpha/<http://people.apache.org/%7Estack/hbase-0.20.0-alpha/>
> <http://people.apache.org/%7Estack/hbase-0.20.0-alpha/>
> >
> > We are making this release available to preview what is coming in HBase
> > 0.20.0. In short, 0.20.0 is about performance and high-availability.
> > Also,
> > a new, richer API has been added and the old deprecated. Here is a list
> of
> > almost 300 issues addressed so far in 0.20.0: http://tinyurl.com/ntvheo
> >
> > This alpha release contains known bugs. See http://tinyurl.com/kvfsftfor
> > the current list. In particular, this alpha release is without a
> migration
> > script to bring your 0.19.x era data forward to work on hbase 0.20.0. A
> > working, well-tested migration script will be in place before we cut the
> > first HBase 0.20.0 release candidate some time in the next week or so.
> >
> > After download, please take the time to review the 0.20.0 'Getting
> Started'
> > also available here:
> >
> >
> http://people.apache.org/~stack/hbase-0.20.0-alpha/docs/api/overview-summary.html#overview_description<http://people.apache.org/%7Estack/hbase-0.20.0-alpha/docs/api/overview-summary.html#overview_description>
> <
> http://people.apache.org/%7Estack/hbase-0.20.0-alpha/docs/api/overview-summary.html#overview_description
> >
> > .
> > HBase 0.20.0 has new dependencies, in particular it now depends on
> > ZooKeeper. With ZooKeeper in the mix a few core HBase configurations
> have
> > been removed and replaced with ZooKeeper configurations instead.
> >
> > Also of note, HBase 0.20.0 will include "Stargate", an improved REST
> > connector for HBase. The old, bundled REST connector will be deprecated.
> > Stargate is implemented using the Jersey framework. It includes protobuf
> > encoding support, has caching proxy awareness, supports batching for
> > scanners and updates, and in general has the goal of enabling Web scale
> > storage systems (a la S3) backed by HBase. Currently its only available
> up
> > on github, http://github.com/macdiesel/stargate/tree/master. It will be
> > added to a new contrib directory before we cut a release candidate.
> >
> > Please let us know if you have difficulty with the install, if you find
> the
> > documentation missing or, if you trip over bugs hbasing.
> >
> > Yours,
> > The HBasistas
> >
> >
> >
> >
> >
>
>
>
> --
> Pro Hadoop, a book to guide you from beginner to hadoop mastery,
> http://www.amazon.com/dp/1430219424?tag=jewlerymall
> www.prohadoopbook.com a community for Hadoop Professionals
>
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by jason hadoop <ja...@gmail.com>.
Is there a requirement for hadoop 0.20 for HBase 0.20?
On Wed, Jun 17, 2009 at 1:44 AM, Andrew Purtell <ap...@apache.org> wrote:
> Minor correction/addition: "Stargate" is undergoing shared development in
> two github trees:
> http://github.com/macdiesel/stargate/tree/master
> http://github.com/apurtell/stargate/tree/master
> The github network view can show which branch is leading at any point in
> time:
> http://github.com/apurtell/stargate/network
>
> - Andy
>
>
>
>
> ________________________________
> From: stack <st...@duboce.net>
> To: hbase-user@hadoop.apache.org; core-user@hadoop.apache.org
> Sent: Tuesday, June 16, 2009 10:23:20 PM
> Subject: [ANN] HBase 0.20.0-alpha available for download
>
> An alpha version of HBase 0.20.0 is available for download at:
>
> http://people.apache.org/~stack/hbase-0.20.0-alpha/<http://people.apache.org/%7Estack/hbase-0.20.0-alpha/>
>
> We are making this release available to preview what is coming in HBase
> 0.20.0. In short, 0.20.0 is about performance and high-availability.
> Also,
> a new, richer API has been added and the old deprecated. Here is a list of
> almost 300 issues addressed so far in 0.20.0: http://tinyurl.com/ntvheo
>
> This alpha release contains known bugs. See http://tinyurl.com/kvfsft for
> the current list. In particular, this alpha release is without a migration
> script to bring your 0.19.x era data forward to work on hbase 0.20.0. A
> working, well-tested migration script will be in place before we cut the
> first HBase 0.20.0 release candidate some time in the next week or so.
>
> After download, please take the time to review the 0.20.0 'Getting Started'
> also available here:
>
> http://people.apache.org/~stack/hbase-0.20.0-alpha/docs/api/overview-summary.html#overview_description<http://people.apache.org/%7Estack/hbase-0.20.0-alpha/docs/api/overview-summary.html#overview_description>
> .
> HBase 0.20.0 has new dependencies, in particular it now depends on
> ZooKeeper. With ZooKeeper in the mix a few core HBase configurations have
> been removed and replaced with ZooKeeper configurations instead.
>
> Also of note, HBase 0.20.0 will include "Stargate", an improved REST
> connector for HBase. The old, bundled REST connector will be deprecated.
> Stargate is implemented using the Jersey framework. It includes protobuf
> encoding support, has caching proxy awareness, supports batching for
> scanners and updates, and in general has the goal of enabling Web scale
> storage systems (a la S3) backed by HBase. Currently its only available up
> on github, http://github.com/macdiesel/stargate/tree/master. It will be
> added to a new contrib directory before we cut a release candidate.
>
> Please let us know if you have difficulty with the install, if you find the
> documentation missing or, if you trip over bugs hbasing.
>
> Yours,
> The HBasistas
>
>
>
>
>
--
Pro Hadoop, a book to guide you from beginner to hadoop mastery,
http://www.amazon.com/dp/1430219424?tag=jewlerymall
www.prohadoopbook.com a community for Hadoop Professionals
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by Andrew Purtell <ap...@apache.org>.
Minor correction/addition: "Stargate" is undergoing shared development in two github trees:
http://github.com/macdiesel/stargate/tree/master
http://github.com/apurtell/stargate/tree/master
The github network view can show which branch is leading at any point in time:
http://github.com/apurtell/stargate/network
- Andy
________________________________
From: stack <st...@duboce.net>
To: hbase-user@hadoop.apache.org; core-user@hadoop.apache.org
Sent: Tuesday, June 16, 2009 10:23:20 PM
Subject: [ANN] HBase 0.20.0-alpha available for download
An alpha version of HBase 0.20.0 is available for download at:
http://people.apache.org/~stack/hbase-0.20.0-alpha/
We are making this release available to preview what is coming in HBase
0.20.0. In short, 0.20.0 is about performance and high-availability. Also,
a new, richer API has been added and the old deprecated. Here is a list of
almost 300 issues addressed so far in 0.20.0: http://tinyurl.com/ntvheo
This alpha release contains known bugs. See http://tinyurl.com/kvfsft for
the current list. In particular, this alpha release is without a migration
script to bring your 0.19.x era data forward to work on hbase 0.20.0. A
working, well-tested migration script will be in place before we cut the
first HBase 0.20.0 release candidate some time in the next week or so.
After download, please take the time to review the 0.20.0 'Getting Started'
also available here:
http://people.apache.org/~stack/hbase-0.20.0-alpha/docs/api/overview-summary.html#overview_description.
HBase 0.20.0 has new dependencies, in particular it now depends on
ZooKeeper. With ZooKeeper in the mix a few core HBase configurations have
been removed and replaced with ZooKeeper configurations instead.
Also of note, HBase 0.20.0 will include "Stargate", an improved REST
connector for HBase. The old, bundled REST connector will be deprecated.
Stargate is implemented using the Jersey framework. It includes protobuf
encoding support, has caching proxy awareness, supports batching for
scanners and updates, and in general has the goal of enabling Web scale
storage systems (a la S3) backed by HBase. Currently its only available up
on github, http://github.com/macdiesel/stargate/tree/master. It will be
added to a new contrib directory before we cut a release candidate.
Please let us know if you have difficulty with the install, if you find the
documentation missing or, if you trip over bugs hbasing.
Yours,
The HBasistas
Re: [ANN] HBase 0.20.0-alpha available for download
Posted by Bradford Stephens <br...@gmail.com>.
Oh sweet. This will be a most excellent party.
On Tue, Jun 16, 2009 at 10:23 PM, stack<st...@duboce.net> wrote:
> An alpha version of HBase 0.20.0 is available for download at:
>
> http://people.apache.org/~stack/hbase-0.20.0-alpha/
>
> We are making this release available to preview what is coming in HBase
> 0.20.0. In short, 0.20.0 is about performance and high-availability. Also,
> a new, richer API has been added and the old deprecated. Here is a list of
> almost 300 issues addressed so far in 0.20.0: http://tinyurl.com/ntvheo
>
> This alpha release contains known bugs. See http://tinyurl.com/kvfsft for
> the current list. In particular, this alpha release is without a migration
> script to bring your 0.19.x era data forward to work on hbase 0.20.0. A
> working, well-tested migration script will be in place before we cut the
> first HBase 0.20.0 release candidate some time in the next week or so.
>
> After download, please take the time to review the 0.20.0 'Getting Started'
> also available here:
> http://people.apache.org/~stack/hbase-0.20.0-alpha/docs/api/overview-summary.html#overview_description.
> HBase 0.20.0 has new dependencies, in particular it now depends on
> ZooKeeper. With ZooKeeper in the mix a few core HBase configurations have
> been removed and replaced with ZooKeeper configurations instead.
>
> Also of note, HBase 0.20.0 will include "Stargate", an improved REST
> connector for HBase. The old, bundled REST connector will be deprecated.
> Stargate is implemented using the Jersey framework. It includes protobuf
> encoding support, has caching proxy awareness, supports batching for
> scanners and updates, and in general has the goal of enabling Web scale
> storage systems (a la S3) backed by HBase. Currently its only available up
> on github, http://github.com/macdiesel/stargate/tree/master. It will be
> added to a new contrib directory before we cut a release candidate.
>
> Please let us know if you have difficulty with the install, if you find the
> documentation missing or, if you trip over bugs hbasing.
>
> Yours,
> The HBasistas
>