You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by tim robertson <ti...@gmail.com> on 2009/08/14 18:46:25 UTC
Informal Meetup - San Fran area 6,7,8 September?
Hi All,
I'm going to be in the San Fran area the 6,7,8 September and would
love the chance to meet with some of the HBase users, developers if
anyone is interested?
I work with a Global Biodiversity Information network (GBIF) that has
several thousand databases publishing data using well defined XML
standards. We crawl and build an index of this information that
currently resides in Mysql, and has 180million records in each of the
2 largest tables; and we are outgrowing mysql. We already use Hadoop
to do various processes, but are about to try HBase as the backend
store after doing various tests recently. We are not a huge cluster
(16 nodes) but I think we are a nice case study, and because we are
able to document openly and freely it could be something to reference
from the HBase wikis. We are building search indexes, running
statistical reports, annotating records (geocoding, quality control)
creating maps (e.g. tile layers) etc so the output is technically
quite interesting and the data is used for all kinds of scientific
analysis. All our code is open source.
We are a small team (3-4 developers) so would very much like the
opportunity to pick the brains of others. We are keen to help improve
HBase as well; probably more in the testing capacity than committing
due to our workloads, but will do whatever we can.
Cheers,
Tim
Re: Informal Meetup - San Fran area 6,7,8 September?
Posted by tim robertson <ti...@gmail.com>.
Thanks Stack,
Around 14:00 it is then. Markus and one (possibly 2) colleagues from
Berkeley and myself will be coming.
Cheers,
Tim
On Mon, Sep 7, 2009 at 1:35 PM, stack<st...@duboce.net> wrote:
> Thats where you'll find me. Come at 2pm or come at 12pm if you want to eat
> (its hit and miss).
> St.Ack
>
> On Sun, Sep 6, 2009 at 11:10 PM, tim robertson <ti...@gmail.com>wrote:
>
>> Thanks Stack,
>>
>> Are we able to come to your place at all? Is it 475 Brannan St? Fred
>> Z also contacted me and said Tuesday would work for him as well.
>>
>>
>> Cheers
>>
>> Tim
>>
>>
>>
>> On Sat, Sep 5, 2009 at 8:54 PM, stack<st...@duboce.net> wrote:
>> > I'm game. Late afternoon is better. Let me see if can get other SFers
>> to
>> > show up. Bring your dataset.
>> > St.Ack
>> >
>> > On Sat, Sep 5, 2009 at 5:51 PM, tim robertson <timrobertson100@gmail.com
>> >wrote:
>> >
>> >> Is anyone available for an informal meetup? Markus and I are in SF
>> >> leaving Wednesday morning. We have stuff to do but can be pretty
>> >> flexible with times etc.
>> >>
>> >> Tuesday late afternoon / early evening perhaps?
>> >>
>> >> Cheers,
>> >>
>> >> Tim
>> >>
>> >> On Fri, Aug 14, 2009 at 10:04 PM, stack<st...@duboce.net> wrote:
>> >> > I'm game only you are arriving at bad time Tim. Thats labor day w/e.
>> >> > Fellas won't be around (generally). They'll be out in the desert
>> covered
>> >> in
>> >> > dust dancing around giant dolls. So, 8th is probably the day you'll
>> >> catch
>> >> > most of the SF crew. Just FYI. Can help you w/ places to go np.
>> >> > St.Ack
>> >> >
>> >> >
>> >> > On Fri, Aug 14, 2009 at 9:46 AM, tim robertson <
>> >> timrobertson100@gmail.com>wrote:
>> >> >
>> >> >> Hi All,
>> >> >>
>> >> >> I'm going to be in the San Fran area the 6,7,8 September and would
>> >> >> love the chance to meet with some of the HBase users, developers if
>> >> >> anyone is interested?
>> >> >>
>> >> >> I work with a Global Biodiversity Information network (GBIF) that has
>> >> >> several thousand databases publishing data using well defined XML
>> >> >> standards. We crawl and build an index of this information that
>> >> >> currently resides in Mysql, and has 180million records in each of the
>> >> >> 2 largest tables; and we are outgrowing mysql. We already use Hadoop
>> >> >> to do various processes, but are about to try HBase as the backend
>> >> >> store after doing various tests recently. We are not a huge cluster
>> >> >> (16 nodes) but I think we are a nice case study, and because we are
>> >> >> able to document openly and freely it could be something to reference
>> >> >> from the HBase wikis. We are building search indexes, running
>> >> >> statistical reports, annotating records (geocoding, quality control)
>> >> >> creating maps (e.g. tile layers) etc so the output is technically
>> >> >> quite interesting and the data is used for all kinds of scientific
>> >> >> analysis. All our code is open source.
>> >> >>
>> >> >> We are a small team (3-4 developers) so would very much like the
>> >> >> opportunity to pick the brains of others. We are keen to help
>> improve
>> >> >> HBase as well; probably more in the testing capacity than committing
>> >> >> due to our workloads, but will do whatever we can.
>> >> >>
>> >> >> Cheers,
>> >> >>
>> >> >> Tim
>> >> >>
>> >> >
>> >>
>> >
>>
>
Re: Informal Meetup - San Fran area 6,7,8 September?
Posted by stack <st...@duboce.net>.
Thats where you'll find me. Come at 2pm or come at 12pm if you want to eat
(its hit and miss).
St.Ack
On Sun, Sep 6, 2009 at 11:10 PM, tim robertson <ti...@gmail.com>wrote:
> Thanks Stack,
>
> Are we able to come to your place at all? Is it 475 Brannan St? Fred
> Z also contacted me and said Tuesday would work for him as well.
>
>
> Cheers
>
> Tim
>
>
>
> On Sat, Sep 5, 2009 at 8:54 PM, stack<st...@duboce.net> wrote:
> > I'm game. Late afternoon is better. Let me see if can get other SFers
> to
> > show up. Bring your dataset.
> > St.Ack
> >
> > On Sat, Sep 5, 2009 at 5:51 PM, tim robertson <timrobertson100@gmail.com
> >wrote:
> >
> >> Is anyone available for an informal meetup? Markus and I are in SF
> >> leaving Wednesday morning. We have stuff to do but can be pretty
> >> flexible with times etc.
> >>
> >> Tuesday late afternoon / early evening perhaps?
> >>
> >> Cheers,
> >>
> >> Tim
> >>
> >> On Fri, Aug 14, 2009 at 10:04 PM, stack<st...@duboce.net> wrote:
> >> > I'm game only you are arriving at bad time Tim. Thats labor day w/e.
> >> > Fellas won't be around (generally). They'll be out in the desert
> covered
> >> in
> >> > dust dancing around giant dolls. So, 8th is probably the day you'll
> >> catch
> >> > most of the SF crew. Just FYI. Can help you w/ places to go np.
> >> > St.Ack
> >> >
> >> >
> >> > On Fri, Aug 14, 2009 at 9:46 AM, tim robertson <
> >> timrobertson100@gmail.com>wrote:
> >> >
> >> >> Hi All,
> >> >>
> >> >> I'm going to be in the San Fran area the 6,7,8 September and would
> >> >> love the chance to meet with some of the HBase users, developers if
> >> >> anyone is interested?
> >> >>
> >> >> I work with a Global Biodiversity Information network (GBIF) that has
> >> >> several thousand databases publishing data using well defined XML
> >> >> standards. We crawl and build an index of this information that
> >> >> currently resides in Mysql, and has 180million records in each of the
> >> >> 2 largest tables; and we are outgrowing mysql. We already use Hadoop
> >> >> to do various processes, but are about to try HBase as the backend
> >> >> store after doing various tests recently. We are not a huge cluster
> >> >> (16 nodes) but I think we are a nice case study, and because we are
> >> >> able to document openly and freely it could be something to reference
> >> >> from the HBase wikis. We are building search indexes, running
> >> >> statistical reports, annotating records (geocoding, quality control)
> >> >> creating maps (e.g. tile layers) etc so the output is technically
> >> >> quite interesting and the data is used for all kinds of scientific
> >> >> analysis. All our code is open source.
> >> >>
> >> >> We are a small team (3-4 developers) so would very much like the
> >> >> opportunity to pick the brains of others. We are keen to help
> improve
> >> >> HBase as well; probably more in the testing capacity than committing
> >> >> due to our workloads, but will do whatever we can.
> >> >>
> >> >> Cheers,
> >> >>
> >> >> Tim
> >> >>
> >> >
> >>
> >
>
Re: Informal Meetup - San Fran area 6,7,8 September?
Posted by tim robertson <ti...@gmail.com>.
Thanks Stack,
Are we able to come to your place at all? Is it 475 Brannan St? Fred
Z also contacted me and said Tuesday would work for him as well.
Cheers
Tim
On Sat, Sep 5, 2009 at 8:54 PM, stack<st...@duboce.net> wrote:
> I'm game. Late afternoon is better. Let me see if can get other SFers to
> show up. Bring your dataset.
> St.Ack
>
> On Sat, Sep 5, 2009 at 5:51 PM, tim robertson <ti...@gmail.com>wrote:
>
>> Is anyone available for an informal meetup? Markus and I are in SF
>> leaving Wednesday morning. We have stuff to do but can be pretty
>> flexible with times etc.
>>
>> Tuesday late afternoon / early evening perhaps?
>>
>> Cheers,
>>
>> Tim
>>
>> On Fri, Aug 14, 2009 at 10:04 PM, stack<st...@duboce.net> wrote:
>> > I'm game only you are arriving at bad time Tim. Thats labor day w/e.
>> > Fellas won't be around (generally). They'll be out in the desert covered
>> in
>> > dust dancing around giant dolls. So, 8th is probably the day you'll
>> catch
>> > most of the SF crew. Just FYI. Can help you w/ places to go np.
>> > St.Ack
>> >
>> >
>> > On Fri, Aug 14, 2009 at 9:46 AM, tim robertson <
>> timrobertson100@gmail.com>wrote:
>> >
>> >> Hi All,
>> >>
>> >> I'm going to be in the San Fran area the 6,7,8 September and would
>> >> love the chance to meet with some of the HBase users, developers if
>> >> anyone is interested?
>> >>
>> >> I work with a Global Biodiversity Information network (GBIF) that has
>> >> several thousand databases publishing data using well defined XML
>> >> standards. We crawl and build an index of this information that
>> >> currently resides in Mysql, and has 180million records in each of the
>> >> 2 largest tables; and we are outgrowing mysql. We already use Hadoop
>> >> to do various processes, but are about to try HBase as the backend
>> >> store after doing various tests recently. We are not a huge cluster
>> >> (16 nodes) but I think we are a nice case study, and because we are
>> >> able to document openly and freely it could be something to reference
>> >> from the HBase wikis. We are building search indexes, running
>> >> statistical reports, annotating records (geocoding, quality control)
>> >> creating maps (e.g. tile layers) etc so the output is technically
>> >> quite interesting and the data is used for all kinds of scientific
>> >> analysis. All our code is open source.
>> >>
>> >> We are a small team (3-4 developers) so would very much like the
>> >> opportunity to pick the brains of others. We are keen to help improve
>> >> HBase as well; probably more in the testing capacity than committing
>> >> due to our workloads, but will do whatever we can.
>> >>
>> >> Cheers,
>> >>
>> >> Tim
>> >>
>> >
>>
>
Re: Informal Meetup - San Fran area 6,7,8 September?
Posted by stack <st...@duboce.net>.
I'm game. Late afternoon is better. Let me see if can get other SFers to
show up. Bring your dataset.
St.Ack
On Sat, Sep 5, 2009 at 5:51 PM, tim robertson <ti...@gmail.com>wrote:
> Is anyone available for an informal meetup? Markus and I are in SF
> leaving Wednesday morning. We have stuff to do but can be pretty
> flexible with times etc.
>
> Tuesday late afternoon / early evening perhaps?
>
> Cheers,
>
> Tim
>
> On Fri, Aug 14, 2009 at 10:04 PM, stack<st...@duboce.net> wrote:
> > I'm game only you are arriving at bad time Tim. Thats labor day w/e.
> > Fellas won't be around (generally). They'll be out in the desert covered
> in
> > dust dancing around giant dolls. So, 8th is probably the day you'll
> catch
> > most of the SF crew. Just FYI. Can help you w/ places to go np.
> > St.Ack
> >
> >
> > On Fri, Aug 14, 2009 at 9:46 AM, tim robertson <
> timrobertson100@gmail.com>wrote:
> >
> >> Hi All,
> >>
> >> I'm going to be in the San Fran area the 6,7,8 September and would
> >> love the chance to meet with some of the HBase users, developers if
> >> anyone is interested?
> >>
> >> I work with a Global Biodiversity Information network (GBIF) that has
> >> several thousand databases publishing data using well defined XML
> >> standards. We crawl and build an index of this information that
> >> currently resides in Mysql, and has 180million records in each of the
> >> 2 largest tables; and we are outgrowing mysql. We already use Hadoop
> >> to do various processes, but are about to try HBase as the backend
> >> store after doing various tests recently. We are not a huge cluster
> >> (16 nodes) but I think we are a nice case study, and because we are
> >> able to document openly and freely it could be something to reference
> >> from the HBase wikis. We are building search indexes, running
> >> statistical reports, annotating records (geocoding, quality control)
> >> creating maps (e.g. tile layers) etc so the output is technically
> >> quite interesting and the data is used for all kinds of scientific
> >> analysis. All our code is open source.
> >>
> >> We are a small team (3-4 developers) so would very much like the
> >> opportunity to pick the brains of others. We are keen to help improve
> >> HBase as well; probably more in the testing capacity than committing
> >> due to our workloads, but will do whatever we can.
> >>
> >> Cheers,
> >>
> >> Tim
> >>
> >
>
Re: Informal Meetup - San Fran area 6,7,8 September?
Posted by tim robertson <ti...@gmail.com>.
Is anyone available for an informal meetup? Markus and I are in SF
leaving Wednesday morning. We have stuff to do but can be pretty
flexible with times etc.
Tuesday late afternoon / early evening perhaps?
Cheers,
Tim
On Fri, Aug 14, 2009 at 10:04 PM, stack<st...@duboce.net> wrote:
> I'm game only you are arriving at bad time Tim. Thats labor day w/e.
> Fellas won't be around (generally). They'll be out in the desert covered in
> dust dancing around giant dolls. So, 8th is probably the day you'll catch
> most of the SF crew. Just FYI. Can help you w/ places to go np.
> St.Ack
>
>
> On Fri, Aug 14, 2009 at 9:46 AM, tim robertson <ti...@gmail.com>wrote:
>
>> Hi All,
>>
>> I'm going to be in the San Fran area the 6,7,8 September and would
>> love the chance to meet with some of the HBase users, developers if
>> anyone is interested?
>>
>> I work with a Global Biodiversity Information network (GBIF) that has
>> several thousand databases publishing data using well defined XML
>> standards. We crawl and build an index of this information that
>> currently resides in Mysql, and has 180million records in each of the
>> 2 largest tables; and we are outgrowing mysql. We already use Hadoop
>> to do various processes, but are about to try HBase as the backend
>> store after doing various tests recently. We are not a huge cluster
>> (16 nodes) but I think we are a nice case study, and because we are
>> able to document openly and freely it could be something to reference
>> from the HBase wikis. We are building search indexes, running
>> statistical reports, annotating records (geocoding, quality control)
>> creating maps (e.g. tile layers) etc so the output is technically
>> quite interesting and the data is used for all kinds of scientific
>> analysis. All our code is open source.
>>
>> We are a small team (3-4 developers) so would very much like the
>> opportunity to pick the brains of others. We are keen to help improve
>> HBase as well; probably more in the testing capacity than committing
>> due to our workloads, but will do whatever we can.
>>
>> Cheers,
>>
>> Tim
>>
>
Re: Informal Meetup - San Fran area 6,7,8 September?
Posted by stack <st...@duboce.net>.
I'm game only you are arriving at bad time Tim. Thats labor day w/e.
Fellas won't be around (generally). They'll be out in the desert covered in
dust dancing around giant dolls. So, 8th is probably the day you'll catch
most of the SF crew. Just FYI. Can help you w/ places to go np.
St.Ack
On Fri, Aug 14, 2009 at 9:46 AM, tim robertson <ti...@gmail.com>wrote:
> Hi All,
>
> I'm going to be in the San Fran area the 6,7,8 September and would
> love the chance to meet with some of the HBase users, developers if
> anyone is interested?
>
> I work with a Global Biodiversity Information network (GBIF) that has
> several thousand databases publishing data using well defined XML
> standards. We crawl and build an index of this information that
> currently resides in Mysql, and has 180million records in each of the
> 2 largest tables; and we are outgrowing mysql. We already use Hadoop
> to do various processes, but are about to try HBase as the backend
> store after doing various tests recently. We are not a huge cluster
> (16 nodes) but I think we are a nice case study, and because we are
> able to document openly and freely it could be something to reference
> from the HBase wikis. We are building search indexes, running
> statistical reports, annotating records (geocoding, quality control)
> creating maps (e.g. tile layers) etc so the output is technically
> quite interesting and the data is used for all kinds of scientific
> analysis. All our code is open source.
>
> We are a small team (3-4 developers) so would very much like the
> opportunity to pick the brains of others. We are keen to help improve
> HBase as well; probably more in the testing capacity than committing
> due to our workloads, but will do whatever we can.
>
> Cheers,
>
> Tim
>