GEO GIS support?

[Joe Stein <ch...@allthingshadoop.com>]

Does HBase have any GEO GIS support in being able to calculate and
conditional on distance for the long/lat condition entered?

If not has anyone done this with HBase even if not built in somewhere?

/*
Joe Stein
http://www.linkedin.com/in/charmalloc
Twitter: @allthingshadoop
*/

Re: GEO GIS support?

[Tim Robertson <ti...@gmail.com>]

Hi,

To my knowledge, there is nothing built in so you would have to build
and maintain the spatial index yourself.

If you are only doing a distance query, you might consider keeping a
column containing something like a geohash
(http://en.wikipedia.org/wiki/Geohash) and then build a secondary
index using that, so that you can efficiently pull features by
proximity (read the limitations section on the wiki though.  C-squares
is a similar algorithm).  You are not going to get close to the
functionality offered by something like PostGIS, but you will be able
to work around things like a proximity search while still handling
huge data quite easily I would have thought.

I have played with geohash and hbase but only for quick tests -
nothing I can point at...

Hope this helps,
Tim

On Sat, Jun 26, 2010 at 3:35 PM, Joe Stein
<ch...@allthingshadoop.com> wrote:
> Does HBase have any GEO GIS support in being able to calculate and
> conditional on distance for the long/lat condition entered?
>
> If not has anyone done this with HBase even if not built in somewhere?
>
> /*
> Joe Stein
> http://www.linkedin.com/in/charmalloc
> Twitter: @allthingshadoop
> */
>

Re: GEO GIS support?

[Steven Noels <st...@outerthought.org>]

On Tue, Jul 6, 2010 at 4:39 AM, Wade Arnold <wa...@t8webware.com>wrote:


> The main drawback is I have no been able to seemlessy use Hbase as my
> storage engine for SOLR. I still end up moving data in and out of the
> SOLR shards.
>

That's what will be part of Lily, also using M/R for larger batch loading.
We won't store SOLR indexes in HBase though, rather provide an automated
event-based updating mechanism for SOLR indexes, using the RowLog/WAL stuff
we released two weeks ago.

Cheers,

Steven.
-- 
Steven Noels                            http://outerthought.org/
Open Source Content Applications
Makers of Kauri, Daisy CMS and Lily

Re: GEO GIS support?

[Wade Arnold <wa...@t8webware.com>]

+1 for using a geohash for geo-location queries. IE lat/long what
around me. I have done this with geohash and then using a range scan
with a column filter for category type and it performed very well.

Geo Spatial is another beast as you need more information than a
single key. Like Steven I am currently using Solr and the experimental
SOLR-773 in order to create the indexes. This is working very well.
The main drawback is I have no been able to seemlessy use Hbase as my
storage engine for SOLR. I still end up moving data in and out of the
SOLR shards. Maybe someone else on this list has that figured out and
I could write a tutorial on how to do geo-location and geo-spacial in
HBase.
https://issues.apache.org/jira/browse/SOLR-773

Wade



On Sat, Jun 26, 2010 at 10:11 AM, Steven Noels <st...@outerthought.org> wrote:
> On Sat, Jun 26, 2010 at 3:35 PM, Joe Stein
> <ch...@allthingshadoop.com>wrote:
>
>> Does HBase have any GEO GIS support in being able to calculate and
>> conditional on distance for the long/lat condition entered?
>>
>> If not has anyone done this with HBase even if not built in somewhere?
>>
>
>
> We're planning to support lat/long/alt as a base type in Lily (our content
> repository built on top HBase), but felt comfortable with offloading queries
> to SOLR which offers some geosearch support - but I understand your question
> is not so much about querying but calculations instead?
>
> HBase doesn't offer much in terms of base types itself.
>
> Best,
>
> Steven.
> --
> Steven Noels                            http://outerthought.org/
> Open Source Content Applications
> Makers of Kauri, Daisy CMS and Lily
>

Re: GEO GIS support?

[Steven Noels <st...@outerthought.org>]

On Sat, Jun 26, 2010 at 3:35 PM, Joe Stein
<ch...@allthingshadoop.com>wrote:

> Does HBase have any GEO GIS support in being able to calculate and
> conditional on distance for the long/lat condition entered?
>
> If not has anyone done this with HBase even if not built in somewhere?
>


We're planning to support lat/long/alt as a base type in Lily (our content
repository built on top HBase), but felt comfortable with offloading queries
to SOLR which offers some geosearch support - but I understand your question
is not so much about querying but calculations instead?

HBase doesn't offer much in terms of base types itself.

Best,

Steven.
-- 
Steven Noels                            http://outerthought.org/
Open Source Content Applications
Makers of Kauri, Daisy CMS and Lily