You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Ahmad Humayun <ah...@gmail.com> on 2008/07/02 07:41:59 UTC
Re: Start point for source code
more than glad, that you ppl are finding it helpful :)
On Tue, Jul 1, 2008 at 1:30 AM, Sangmin Lee <sa...@gmail.com> wrote:
> thank you for sharing your valuable doc.
>
> -sangmin
>
> On Tue, Jun 24, 2008 at 7:02 AM, Ahmad Humayun <ah...@gmail.com>
> wrote:
>
> > When we were looking into Hadoop code....we attempted to make a doc out
> of
> > it....you might want to check it out:
> > http://suraj.lums.edu.pk/~ahmadh/resources/docs/hadoop_call_trace.doc<http://suraj.lums.edu.pk/%7Eahmadh/resources/docs/hadoop_call_trace.doc>
> <http://suraj.lums.edu.pk/%7Eahmadh/resources/docs/hadoop_call_trace.doc>
> >
> > regards,
> >
> > On Tue, Jun 24, 2008 at 3:09 PM, Naama Kraus <na...@gmail.com>
> wrote:
> >
> > > Hi,
> > >
> > > Could you please also specify starting points for getting into the map
> > > reduce code ?
> > >
> > > Thanks, Naama
> > >
> > > On Mon, Jun 23, 2008 at 10:40 PM, lohit <lo...@yahoo.com> wrote:
> > >
> > > > Following any hadoop dfs related commands to see what code path it
> > takes
> > > > would be a good start.
> > > > Bulk of hdfs code in org.apache.hadoop.dfs package.
> > > > org.apache.hadoop.fs has generic interface/apis, especially
> > > FileSystem.java
> > > > You could follow that and check DistributedFileSystem.java which
> > > > implements/overrides FileSystem apis
> > > > DFSClient.java should be a good start for hdfs client end code.
> > > > On the server side NameNode.java would be a good start. Similarly
> > > > DataNode.java for Data nodes.
> > > >
> > > > Thanks,
> > > > Lohit
> > > >
> > > > ----- Original Message ----
> > > > From: Sangmin Lee <sa...@gmail.com>
> > > > To: core-dev@hadoop.apache.org
> > > > Sent: Monday, June 23, 2008 12:32:17 PM
> > > > Subject: Start point for source code
> > > >
> > > > Hi all,
> > > >
> > > > I'm a novice for hadoop code and want to hack hdfs code.
> > > > Can any body point me to the startpoint ?
> > > >
> > > > I appreciate your help in advance.
> > > >
> > > > Cheers,
> > > > Sangmin
> > > >
> > > >
> > >
> > >
> > > --
> > > oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00
> > oo
> > > 00 oo 00 oo
> > > "If you want your children to be intelligent, read them fairy tales. If
> > you
> > > want them to be more intelligent, read them more fairy tales." (Albert
> > > Einstein)
> > >
> >
> >
> >
> > --
> > Ahmad Humayun
> > Research Assistant
> > Computer Science Dpt., LUMS
> > http://suraj.lums.edu.pk/~ahmadh <http://suraj.lums.edu.pk/%7Eahmadh> <
> http://suraj.lums.edu.pk/%7Eahmadh>
> > +92 321 4457315
> >
>
--
Ahmad Humayun
Research Assistant
Computer Science Dpt., LUMS
http://suraj.lums.edu.pk/~ahmadh
+92 321 4457315
Re: Start point for source code
Posted by Naama Kraus <na...@gmail.com>.
Another great source to get a picture of what is going on is Owen's
presentation
http://wiki.apache.org/hadoop-data/attachments/HadoopPresentations/attachments/HadoopMapReduceArch.pdf
Naama
On Wed, Jul 2, 2008 at 8:41 AM, Ahmad Humayun <ah...@gmail.com> wrote:
> more than glad, that you ppl are finding it helpful :)
>
> On Tue, Jul 1, 2008 at 1:30 AM, Sangmin Lee <sa...@gmail.com> wrote:
>
> > thank you for sharing your valuable doc.
> >
> > -sangmin
> >
> > On Tue, Jun 24, 2008 at 7:02 AM, Ahmad Humayun <ah...@gmail.com>
> > wrote:
> >
> > > When we were looking into Hadoop code....we attempted to make a doc out
> > of
> > > it....you might want to check it out:
> > > http://suraj.lums.edu.pk/~ahmadh/resources/docs/hadoop_call_trace.doc<http://suraj.lums.edu.pk/%7Eahmadh/resources/docs/hadoop_call_trace.doc>
> <http://suraj.lums.edu.pk/%7Eahmadh/resources/docs/hadoop_call_trace.doc>
> > <http://suraj.lums.edu.pk/%7Eahmadh/resources/docs/hadoop_call_trace.doc
> >
> > >
> > > regards,
> > >
> > > On Tue, Jun 24, 2008 at 3:09 PM, Naama Kraus <na...@gmail.com>
> > wrote:
> > >
> > > > Hi,
> > > >
> > > > Could you please also specify starting points for getting into the
> map
> > > > reduce code ?
> > > >
> > > > Thanks, Naama
> > > >
> > > > On Mon, Jun 23, 2008 at 10:40 PM, lohit <lo...@yahoo.com> wrote:
> > > >
> > > > > Following any hadoop dfs related commands to see what code path it
> > > takes
> > > > > would be a good start.
> > > > > Bulk of hdfs code in org.apache.hadoop.dfs package.
> > > > > org.apache.hadoop.fs has generic interface/apis, especially
> > > > FileSystem.java
> > > > > You could follow that and check DistributedFileSystem.java which
> > > > > implements/overrides FileSystem apis
> > > > > DFSClient.java should be a good start for hdfs client end code.
> > > > > On the server side NameNode.java would be a good start. Similarly
> > > > > DataNode.java for Data nodes.
> > > > >
> > > > > Thanks,
> > > > > Lohit
> > > > >
> > > > > ----- Original Message ----
> > > > > From: Sangmin Lee <sa...@gmail.com>
> > > > > To: core-dev@hadoop.apache.org
> > > > > Sent: Monday, June 23, 2008 12:32:17 PM
> > > > > Subject: Start point for source code
> > > > >
> > > > > Hi all,
> > > > >
> > > > > I'm a novice for hadoop code and want to hack hdfs code.
> > > > > Can any body point me to the startpoint ?
> > > > >
> > > > > I appreciate your help in advance.
> > > > >
> > > > > Cheers,
> > > > > Sangmin
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo
> 00
> > > oo
> > > > 00 oo 00 oo
> > > > "If you want your children to be intelligent, read them fairy tales.
> If
> > > you
> > > > want them to be more intelligent, read them more fairy tales."
> (Albert
> > > > Einstein)
> > > >
> > >
> > >
> > >
> > > --
> > > Ahmad Humayun
> > > Research Assistant
> > > Computer Science Dpt., LUMS
> > > http://suraj.lums.edu.pk/~ahmadh <http://suraj.lums.edu.pk/%7Eahmadh><
> http://suraj.lums.edu.pk/%7Eahmadh> <
> > http://suraj.lums.edu.pk/%7Eahmadh>
> > > +92 321 4457315
> > >
> >
>
>
>
> --
> Ahmad Humayun
> Research Assistant
> Computer Science Dpt., LUMS
> http://suraj.lums.edu.pk/~ahmadh <http://suraj.lums.edu.pk/%7Eahmadh>
> +92 321 4457315
>
--
oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo
00 oo 00 oo
"If you want your children to be intelligent, read them fairy tales. If you
want them to be more intelligent, read them more fairy tales." (Albert
Einstein)