You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Jack Levin <ma...@gmail.com> on 2011/06/08 02:07:37 UTC
tech. talk at imageshack/yfrog
Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
and serve about 200ml images from HBASE. The stats of our are:
60 Region Servers running HBASE
Configured Capacity : 517.44 TB
DFS Used : 286.93 TB
Table count: 1,000
Average file size: 500KB
I am doing this mostly to bring our dev. and QA teams up to speed, but
we would have open doors as well, and will serve Pizza. So, if anyone
is interested, RSVP to me. This should happen in next 2-3 weeks. (We
are in South Bay, Los Gatos CA).
-Jack
Re: tech. talk at imageshack/yfrog
Posted by Jack Levin <ma...@gmail.com>.
AFAIK, there was no recording of the talk.
-jack
On Fri, Jul 1, 2011 at 9:06 AM, Dave Viner <da...@vinertech.com> wrote:
> Hi Jack,
>
> This looks like a great presentation. Very interesting slides. Was there
> video of the talk that will be posted?
>
> Thanks
> Dave Viner
>
>
> On Thu, Jun 30, 2011 at 9:57 PM, Ravi Veeramachaneni <
> ravi.veeramachaneni@gmail.com> wrote:
>
>> Very interesting use case which is similar to ours. Though we use
>> HBase for all other purposes, we are looking at alternatives for image
>> storing. I'm very interested to look at your implementation
>> (presentation and possibly video).
>>
>> Ravi
>>
>> On Thursday, June 30, 2011, Mark Kerzner <ma...@gmail.com> wrote:
>> > Thank you, looks very interesting.
>> >
>> > Mark
>> >
>> > On Thu, Jun 30, 2011 at 11:29 PM, Jack Levin <ma...@gmail.com> wrote:
>> >
>> >> http://www.slideshare.net/jacque74/hug-hbase-presentation
>> >>
>> >> My presentation posted on slideshare, from todays talk. FYI.
>> >>
>> >> Best,
>> >>
>> >> -Jack
>> >>
>> >> On Fri, Jun 10, 2011 at 3:11 PM, Jack Levin <ma...@gmail.com> wrote:
>> >> > Yep. I'd do HUG, its probably larger building/room anyway :).
>> >> >
>> >> > -Jack
>> >> >
>> >> > On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans
>> >> > <jd...@apache.org> wrote:
>> >> >> Would you like to transform this into a HUG? See
>> >> >> http://www.meetup.com/hbaseusergroup/
>> >> >>
>> >> >> J-D
>> >> >>
>> >> >> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <ma...@gmail.com>
>> wrote:
>> >> >>> Hey Guys, I plan to do a tech talk here at ImageShack, on how we
>> store
>> >> >>> and serve about 200ml images from HBASE. The stats of our are:
>> >> >>>
>> >> >>> 60 Region Servers running HBASE
>> >> >>> Configured Capacity : 517.44 TB
>> >> >>> DFS Used : 286.93 TB
>> >> >>> Table count: 1,000
>> >> >>> Average file size: 500KB
>> >> >>>
>> >> >>> I am doing this mostly to bring our dev. and QA teams up to speed,
>> but
>> >> >>> we would have open doors as well, and will serve Pizza. So, if
>> anyone
>> >> >>> is interested, RSVP to me. This should happen in next 2-3 weeks.
>> (We
>> >> >>> are in South Bay, Los Gatos CA).
>> >> >>>
>> >> >>> -Jack
>> >> >>>
>> >> >>
>> >> >
>> >>
>> >
>>
>
Re: tech. talk at imageshack/yfrog
Posted by Dave Viner <da...@vinertech.com>.
Hi Jack,
This looks like a great presentation. Very interesting slides. Was there
video of the talk that will be posted?
Thanks
Dave Viner
On Thu, Jun 30, 2011 at 9:57 PM, Ravi Veeramachaneni <
ravi.veeramachaneni@gmail.com> wrote:
> Very interesting use case which is similar to ours. Though we use
> HBase for all other purposes, we are looking at alternatives for image
> storing. I'm very interested to look at your implementation
> (presentation and possibly video).
>
> Ravi
>
> On Thursday, June 30, 2011, Mark Kerzner <ma...@gmail.com> wrote:
> > Thank you, looks very interesting.
> >
> > Mark
> >
> > On Thu, Jun 30, 2011 at 11:29 PM, Jack Levin <ma...@gmail.com> wrote:
> >
> >> http://www.slideshare.net/jacque74/hug-hbase-presentation
> >>
> >> My presentation posted on slideshare, from todays talk. FYI.
> >>
> >> Best,
> >>
> >> -Jack
> >>
> >> On Fri, Jun 10, 2011 at 3:11 PM, Jack Levin <ma...@gmail.com> wrote:
> >> > Yep. I'd do HUG, its probably larger building/room anyway :).
> >> >
> >> > -Jack
> >> >
> >> > On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans
> >> > <jd...@apache.org> wrote:
> >> >> Would you like to transform this into a HUG? See
> >> >> http://www.meetup.com/hbaseusergroup/
> >> >>
> >> >> J-D
> >> >>
> >> >> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <ma...@gmail.com>
> wrote:
> >> >>> Hey Guys, I plan to do a tech talk here at ImageShack, on how we
> store
> >> >>> and serve about 200ml images from HBASE. The stats of our are:
> >> >>>
> >> >>> 60 Region Servers running HBASE
> >> >>> Configured Capacity : 517.44 TB
> >> >>> DFS Used : 286.93 TB
> >> >>> Table count: 1,000
> >> >>> Average file size: 500KB
> >> >>>
> >> >>> I am doing this mostly to bring our dev. and QA teams up to speed,
> but
> >> >>> we would have open doors as well, and will serve Pizza. So, if
> anyone
> >> >>> is interested, RSVP to me. This should happen in next 2-3 weeks.
> (We
> >> >>> are in South Bay, Los Gatos CA).
> >> >>>
> >> >>> -Jack
> >> >>>
> >> >>
> >> >
> >>
> >
>
Re: tech. talk at imageshack/yfrog
Posted by Ravi Veeramachaneni <ra...@gmail.com>.
Very interesting use case which is similar to ours. Though we use
HBase for all other purposes, we are looking at alternatives for image
storing. I'm very interested to look at your implementation
(presentation and possibly video).
Ravi
On Thursday, June 30, 2011, Mark Kerzner <ma...@gmail.com> wrote:
> Thank you, looks very interesting.
>
> Mark
>
> On Thu, Jun 30, 2011 at 11:29 PM, Jack Levin <ma...@gmail.com> wrote:
>
>> http://www.slideshare.net/jacque74/hug-hbase-presentation
>>
>> My presentation posted on slideshare, from todays talk. FYI.
>>
>> Best,
>>
>> -Jack
>>
>> On Fri, Jun 10, 2011 at 3:11 PM, Jack Levin <ma...@gmail.com> wrote:
>> > Yep. I'd do HUG, its probably larger building/room anyway :).
>> >
>> > -Jack
>> >
>> > On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans
>> > <jd...@apache.org> wrote:
>> >> Would you like to transform this into a HUG? See
>> >> http://www.meetup.com/hbaseusergroup/
>> >>
>> >> J-D
>> >>
>> >> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <ma...@gmail.com> wrote:
>> >>> Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
>> >>> and serve about 200ml images from HBASE. The stats of our are:
>> >>>
>> >>> 60 Region Servers running HBASE
>> >>> Configured Capacity : 517.44 TB
>> >>> DFS Used : 286.93 TB
>> >>> Table count: 1,000
>> >>> Average file size: 500KB
>> >>>
>> >>> I am doing this mostly to bring our dev. and QA teams up to speed, but
>> >>> we would have open doors as well, and will serve Pizza. So, if anyone
>> >>> is interested, RSVP to me. This should happen in next 2-3 weeks. (We
>> >>> are in South Bay, Los Gatos CA).
>> >>>
>> >>> -Jack
>> >>>
>> >>
>> >
>>
>
Re: tech. talk at imageshack/yfrog
Posted by Mark Kerzner <ma...@gmail.com>.
Thank you, looks very interesting.
Mark
On Thu, Jun 30, 2011 at 11:29 PM, Jack Levin <ma...@gmail.com> wrote:
> http://www.slideshare.net/jacque74/hug-hbase-presentation
>
> My presentation posted on slideshare, from todays talk. FYI.
>
> Best,
>
> -Jack
>
> On Fri, Jun 10, 2011 at 3:11 PM, Jack Levin <ma...@gmail.com> wrote:
> > Yep. I'd do HUG, its probably larger building/room anyway :).
> >
> > -Jack
> >
> > On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans
> > <jd...@apache.org> wrote:
> >> Would you like to transform this into a HUG? See
> >> http://www.meetup.com/hbaseusergroup/
> >>
> >> J-D
> >>
> >> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <ma...@gmail.com> wrote:
> >>> Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
> >>> and serve about 200ml images from HBASE. The stats of our are:
> >>>
> >>> 60 Region Servers running HBASE
> >>> Configured Capacity : 517.44 TB
> >>> DFS Used : 286.93 TB
> >>> Table count: 1,000
> >>> Average file size: 500KB
> >>>
> >>> I am doing this mostly to bring our dev. and QA teams up to speed, but
> >>> we would have open doors as well, and will serve Pizza. So, if anyone
> >>> is interested, RSVP to me. This should happen in next 2-3 weeks. (We
> >>> are in South Bay, Los Gatos CA).
> >>>
> >>> -Jack
> >>>
> >>
> >
>
Re: tech. talk at imageshack/yfrog
Posted by Jack Levin <ma...@gmail.com>.
http://www.slideshare.net/jacque74/hug-hbase-presentation
My presentation posted on slideshare, from todays talk. FYI.
Best,
-Jack
On Fri, Jun 10, 2011 at 3:11 PM, Jack Levin <ma...@gmail.com> wrote:
> Yep. I'd do HUG, its probably larger building/room anyway :).
>
> -Jack
>
> On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans
> <jd...@apache.org> wrote:
>> Would you like to transform this into a HUG? See
>> http://www.meetup.com/hbaseusergroup/
>>
>> J-D
>>
>> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <ma...@gmail.com> wrote:
>>> Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
>>> and serve about 200ml images from HBASE. The stats of our are:
>>>
>>> 60 Region Servers running HBASE
>>> Configured Capacity : 517.44 TB
>>> DFS Used : 286.93 TB
>>> Table count: 1,000
>>> Average file size: 500KB
>>>
>>> I am doing this mostly to bring our dev. and QA teams up to speed, but
>>> we would have open doors as well, and will serve Pizza. So, if anyone
>>> is interested, RSVP to me. This should happen in next 2-3 weeks. (We
>>> are in South Bay, Los Gatos CA).
>>>
>>> -Jack
>>>
>>
>
Re: tech. talk at imageshack/yfrog
Posted by Jack Levin <ma...@gmail.com>.
Yep. I'd do HUG, its probably larger building/room anyway :).
-Jack
On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans
<jd...@apache.org> wrote:
> Would you like to transform this into a HUG? See
> http://www.meetup.com/hbaseusergroup/
>
> J-D
>
> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <ma...@gmail.com> wrote:
>> Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
>> and serve about 200ml images from HBASE. The stats of our are:
>>
>> 60 Region Servers running HBASE
>> Configured Capacity : 517.44 TB
>> DFS Used : 286.93 TB
>> Table count: 1,000
>> Average file size: 500KB
>>
>> I am doing this mostly to bring our dev. and QA teams up to speed, but
>> we would have open doors as well, and will serve Pizza. So, if anyone
>> is interested, RSVP to me. This should happen in next 2-3 weeks. (We
>> are in South Bay, Los Gatos CA).
>>
>> -Jack
>>
>
Re: tech. talk at imageshack/yfrog
Posted by Dave Viner <da...@vinertech.com>.
Would love to see the video and slides form this... sounds super
interesting.
On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans <jd...@apache.org>wrote:
> Would you like to transform this into a HUG? See
> http://www.meetup.com/hbaseusergroup/
>
> J-D
>
> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <ma...@gmail.com> wrote:
> > Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
> > and serve about 200ml images from HBASE. The stats of our are:
> >
> > 60 Region Servers running HBASE
> > Configured Capacity : 517.44 TB
> > DFS Used : 286.93 TB
> > Table count: 1,000
> > Average file size: 500KB
> >
> > I am doing this mostly to bring our dev. and QA teams up to speed, but
> > we would have open doors as well, and will serve Pizza. So, if anyone
> > is interested, RSVP to me. This should happen in next 2-3 weeks. (We
> > are in South Bay, Los Gatos CA).
> >
> > -Jack
> >
>
Re: tech. talk at imageshack/yfrog
Posted by Jean-Daniel Cryans <jd...@apache.org>.
Would you like to transform this into a HUG? See
http://www.meetup.com/hbaseusergroup/
J-D
On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <ma...@gmail.com> wrote:
> Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
> and serve about 200ml images from HBASE. The stats of our are:
>
> 60 Region Servers running HBASE
> Configured Capacity : 517.44 TB
> DFS Used : 286.93 TB
> Table count: 1,000
> Average file size: 500KB
>
> I am doing this mostly to bring our dev. and QA teams up to speed, but
> we would have open doors as well, and will serve Pizza. So, if anyone
> is interested, RSVP to me. This should happen in next 2-3 weeks. (We
> are in South Bay, Los Gatos CA).
>
> -Jack
>
Re: tech. talk at imageshack/yfrog
Posted by Himanshu Vashishtha <hv...@cs.ualberta.ca>.
+1 to Matt's opinion (if possible?).
I am interested in your use case, sounds very impressive by the stats you
gave. You said 1000 tables?
Looking forward to see what optimizations/config tweaks you had to do to
cope up with your read/write requirements.
Thanks,
Himanshu
On Wed, Jun 8, 2011 at 8:57 AM, Matt Davies <ma...@mattdavies.net> wrote:
> If it is possible I think any slides or even a video would be very
> interesting to some of us that can't travel. I, for one, would love to hear
> how you do it.
>
> Thanks!
>
> On Tue, Jun 7, 2011 at 6:07 PM, Jack Levin <ma...@gmail.com> wrote:
>
> > Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
> > and serve about 200ml images from HBASE. The stats of our are:
> >
> > 60 Region Servers running HBASE
> > Configured Capacity : 517.44 TB
> > DFS Used : 286.93 TB
> > Table count: 1,000
> > Average file size: 500KB
> >
> > I am doing this mostly to bring our dev. and QA teams up to speed, but
> > we would have open doors as well, and will serve Pizza. So, if anyone
> > is interested, RSVP to me. This should happen in next 2-3 weeks. (We
> > are in South Bay, Los Gatos CA).
> >
> > -Jack
> >
>
Re: tech. talk at imageshack/yfrog
Posted by Matt Davies <ma...@mattdavies.net>.
If it is possible I think any slides or even a video would be very
interesting to some of us that can't travel. I, for one, would love to hear
how you do it.
Thanks!
On Tue, Jun 7, 2011 at 6:07 PM, Jack Levin <ma...@gmail.com> wrote:
> Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
> and serve about 200ml images from HBASE. The stats of our are:
>
> 60 Region Servers running HBASE
> Configured Capacity : 517.44 TB
> DFS Used : 286.93 TB
> Table count: 1,000
> Average file size: 500KB
>
> I am doing this mostly to bring our dev. and QA teams up to speed, but
> we would have open doors as well, and will serve Pizza. So, if anyone
> is interested, RSVP to me. This should happen in next 2-3 weeks. (We
> are in South Bay, Los Gatos CA).
>
> -Jack
>