You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by S Ahmed <sa...@gmail.com> on 2012/05/17 15:39:04 UTC
understanding the code base, patterns, threading, etc.
Greetings,
Other than reading the the source code, google papers, seda, etc. how does
someone get solid understanding of the code base?
Are there any high-level (or low level!) diagrams of sort that go over the
various components of hbase? (various read/write stages, gossip, etc.)
I'm guessing this is wishful thinking but I thought I'd ask :)
Re: understanding the code base, patterns, threading, etc.
Posted by Andrew Purtell <ap...@apache.org>.
I'd also recommend Lars George's excellent "HBase The Definitive
Guide". It will give you a good conceptual foundation and an
understanding of how the API works. Then when you are tracing code
paths in the internals that act in service to the API, they will make
more sense.
On Thu, May 17, 2012 at 4:45 PM, S Ahmed <sa...@gmail.com> wrote:
> I was afraid you were going to say that :)
>
> Looking forward to the vidoes!
>
> On Thu, May 17, 2012 at 9:44 AM, Ian Varley <iv...@salesforce.com> wrote:
>
>> Well, the first answer is always the same: read the code! :)
>>
>> Of course, sometimes it's difficult to get the high level concepts quickly
>> that way (even with good docs, like the HBase code generally has). So I'd
>> recommend seeing the upcoming talk by committer Lars Hofhansl at HBaseCon
>> on Tuesday--that's exactly what it's about! It's called "HBase Internals".
>>
>> If you're not attending, I'm sure they'll post slides (and maybe video?)
>> afterwards.
>>
>> Ian
>>
>> On May 17, 2012, at 8:39 AM, S Ahmed wrote:
>>
>> > Greetings,
>> >
>> > Other than reading the the source code, google papers, seda, etc. how
>> does
>> > someone get solid understanding of the code base?
>> >
>> > Are there any high-level (or low level!) diagrams of sort that go over
>> the
>> > various components of hbase? (various read/write stages, gossip, etc.)
>> >
>> > I'm guessing this is wishful thinking but I thought I'd ask :)
>>
>>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet
Hein (via Tom White)
Re: understanding the code base, patterns, threading, etc.
Posted by S Ahmed <sa...@gmail.com>.
I was afraid you were going to say that :)
Looking forward to the vidoes!
On Thu, May 17, 2012 at 9:44 AM, Ian Varley <iv...@salesforce.com> wrote:
> Well, the first answer is always the same: read the code! :)
>
> Of course, sometimes it's difficult to get the high level concepts quickly
> that way (even with good docs, like the HBase code generally has). So I'd
> recommend seeing the upcoming talk by committer Lars Hofhansl at HBaseCon
> on Tuesday--that's exactly what it's about! It's called "HBase Internals".
>
> If you're not attending, I'm sure they'll post slides (and maybe video?)
> afterwards.
>
> Ian
>
> On May 17, 2012, at 8:39 AM, S Ahmed wrote:
>
> > Greetings,
> >
> > Other than reading the the source code, google papers, seda, etc. how
> does
> > someone get solid understanding of the code base?
> >
> > Are there any high-level (or low level!) diagrams of sort that go over
> the
> > various components of hbase? (various read/write stages, gossip, etc.)
> >
> > I'm guessing this is wishful thinking but I thought I'd ask :)
>
>
Re: understanding the code base, patterns, threading, etc.
Posted by S Ahmed <sa...@gmail.com>.
Great, I think out of all of them only like 1 of them works:
http://www.hbasecon.com/tracks/development/
On Sat, Dec 1, 2012 at 10:27 PM, Jonathan Hsieh <jo...@cloudera.com> wrote:
> Ooh -- sorry about that -- let me contact the folks to fix that problem.
>
> Jon.
>
> On Sat, Dec 1, 2012 at 6:36 PM, S Ahmed <sa...@gmail.com> wrote:
>
> > Thanks but the video link goes to a page with no video?
> >
> >
> > On Sat, Dec 1, 2012 at 9:10 PM, Jonathan Hsieh <jo...@cloudera.com> wrote:
> >
> > > Hey S,
> > >
> > > Video and ppt on this link.
> > > http://www.hbasecon.com/sessions/learning-hbase-internals/
> > >
> > > Jon.
> > >
> > > On Sat, Dec 1, 2012 at 6:07 PM, S Ahmed <sa...@gmail.com> wrote:
> > >
> > > > It's been a while I know, but is that talk online somewhere?
> > > >
> > > > On Thu, May 17, 2012 at 9:44 AM, Ian Varley <iv...@salesforce.com>
> > > > wrote:
> > > >
> > > > > Lars Hofhansl
> > > >
> > >
> > >
> > >
> > > --
> > > // Jonathan Hsieh (shay)
> > > // Software Engineer, Cloudera
> > > // jon@cloudera.com
> > >
> >
>
>
>
> --
> // Jonathan Hsieh (shay)
> // Software Engineer, Cloudera
> // jon@cloudera.com
>
Re: understanding the code base, patterns, threading, etc.
Posted by Jonathan Hsieh <jo...@cloudera.com>.
Ooh -- sorry about that -- let me contact the folks to fix that problem.
Jon.
On Sat, Dec 1, 2012 at 6:36 PM, S Ahmed <sa...@gmail.com> wrote:
> Thanks but the video link goes to a page with no video?
>
>
> On Sat, Dec 1, 2012 at 9:10 PM, Jonathan Hsieh <jo...@cloudera.com> wrote:
>
> > Hey S,
> >
> > Video and ppt on this link.
> > http://www.hbasecon.com/sessions/learning-hbase-internals/
> >
> > Jon.
> >
> > On Sat, Dec 1, 2012 at 6:07 PM, S Ahmed <sa...@gmail.com> wrote:
> >
> > > It's been a while I know, but is that talk online somewhere?
> > >
> > > On Thu, May 17, 2012 at 9:44 AM, Ian Varley <iv...@salesforce.com>
> > > wrote:
> > >
> > > > Lars Hofhansl
> > >
> >
> >
> >
> > --
> > // Jonathan Hsieh (shay)
> > // Software Engineer, Cloudera
> > // jon@cloudera.com
> >
>
--
// Jonathan Hsieh (shay)
// Software Engineer, Cloudera
// jon@cloudera.com
Re: understanding the code base, patterns, threading, etc.
Posted by S Ahmed <sa...@gmail.com>.
Thanks but the video link goes to a page with no video?
On Sat, Dec 1, 2012 at 9:10 PM, Jonathan Hsieh <jo...@cloudera.com> wrote:
> Hey S,
>
> Video and ppt on this link.
> http://www.hbasecon.com/sessions/learning-hbase-internals/
>
> Jon.
>
> On Sat, Dec 1, 2012 at 6:07 PM, S Ahmed <sa...@gmail.com> wrote:
>
> > It's been a while I know, but is that talk online somewhere?
> >
> > On Thu, May 17, 2012 at 9:44 AM, Ian Varley <iv...@salesforce.com>
> > wrote:
> >
> > > Lars Hofhansl
> >
>
>
>
> --
> // Jonathan Hsieh (shay)
> // Software Engineer, Cloudera
> // jon@cloudera.com
>
Re: understanding the code base, patterns, threading, etc.
Posted by Jonathan Hsieh <jo...@cloudera.com>.
Hey S,
Video and ppt on this link.
http://www.hbasecon.com/sessions/learning-hbase-internals/
Jon.
On Sat, Dec 1, 2012 at 6:07 PM, S Ahmed <sa...@gmail.com> wrote:
> It's been a while I know, but is that talk online somewhere?
>
> On Thu, May 17, 2012 at 9:44 AM, Ian Varley <iv...@salesforce.com>
> wrote:
>
> > Lars Hofhansl
>
--
// Jonathan Hsieh (shay)
// Software Engineer, Cloudera
// jon@cloudera.com
Re: understanding the code base, patterns, threading, etc.
Posted by S Ahmed <sa...@gmail.com>.
It's been a while I know, but is that talk online somewhere?
On Thu, May 17, 2012 at 9:44 AM, Ian Varley <iv...@salesforce.com> wrote:
> Lars Hofhansl
Re: understanding the code base, patterns, threading, etc.
Posted by Ian Varley <iv...@salesforce.com>.
Well, the first answer is always the same: read the code! :)
Of course, sometimes it's difficult to get the high level concepts quickly that way (even with good docs, like the HBase code generally has). So I'd recommend seeing the upcoming talk by committer Lars Hofhansl at HBaseCon on Tuesday--that's exactly what it's about! It's called "HBase Internals".
If you're not attending, I'm sure they'll post slides (and maybe video?) afterwards.
Ian
On May 17, 2012, at 8:39 AM, S Ahmed wrote:
> Greetings,
>
> Other than reading the the source code, google papers, seda, etc. how does
> someone get solid understanding of the code base?
>
> Are there any high-level (or low level!) diagrams of sort that go over the
> various components of hbase? (various read/write stages, gossip, etc.)
>
> I'm guessing this is wishful thinking but I thought I'd ask :)