You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Billy <sa...@pearsonwholesale.com> on 2007/11/17 17:18:08 UTC
hbase feature question
I was looking over the bigtable pdf again to make sure that's where I read
this, but there setup allows Column Families to be removed from the database
in garbage collection. Is this a feature that will be added to hbase?
Basically it allows you to set a max ttl for a column row. I can see where
this would be useful for nutch and other apps in crawling.
Example storing links from z page pointing to x page if not updated by y
time it gets removed form the dataset. keeps from having the scan the whole
dataset to remove stale data.
Billy
Re: hbase feature question
Posted by Billy <sa...@pearsonwholesale.com>.
Thanks add here
https://issues.apache.org/jira/browse/HADOOP-2222
Billy
"Jim Kellerman" <ji...@powerset.com> wrote in
message
news:84E2AE771361E9419DD0EFBD31F09C4D4BC608EB31@EXVMBX015-1.exch015.msoutlookonline.net...
Currently, HBase supports specifying a maximum number of versions to
keep. Older versions are removed during compaction.
However, we do not currently support a TTL for columns. Please enter
a Jira using the component contrib/hbase and request a feature improvement.
Thanks.
---
Jim Kellerman, Senior Engineer; Powerset
> -----Original Message-----
> From: news [mailto:news@ger.gmane.org] On Behalf
> Of Billy
> Sent: Saturday, November 17, 2007 8:18 AM
> To: hadoop-user@lucene.apache.org
> Subject: hbase feature question
>
> I was looking over the bigtable pdf again to make sure that's
> where I read this, but there setup allows Column Families to
> be removed from the database in garbage collection. Is this
> a feature that will be added to hbase?
>
> Basically it allows you to set a max ttl for a column row. I
> can see where this would be useful for nutch and other apps
> in crawling.
> Example storing links from z page pointing to x page if not
> updated by y time it gets removed form the dataset. keeps
> from having the scan the whole dataset to remove stale data.
>
> Billy
>
>
>
>
RE: hbase feature question
Posted by Jim Kellerman <ji...@powerset.com>.
Currently, HBase supports specifying a maximum number of versions to
keep. Older versions are removed during compaction.
However, we do not currently support a TTL for columns. Please enter
a Jira using the component contrib/hbase and request a feature improvement.
Thanks.
---
Jim Kellerman, Senior Engineer; Powerset
> -----Original Message-----
> From: news [mailto:news@ger.gmane.org] On Behalf Of Billy
> Sent: Saturday, November 17, 2007 8:18 AM
> To: hadoop-user@lucene.apache.org
> Subject: hbase feature question
>
> I was looking over the bigtable pdf again to make sure that's
> where I read this, but there setup allows Column Families to
> be removed from the database in garbage collection. Is this
> a feature that will be added to hbase?
>
> Basically it allows you to set a max ttl for a column row. I
> can see where this would be useful for nutch and other apps
> in crawling.
> Example storing links from z page pointing to x page if not
> updated by y time it gets removed form the dataset. keeps
> from having the scan the whole dataset to remove stale data.
>
> Billy
>
>
>
>