Re: Hadoop HDFS project

[Aditya Sharma <ad...@apache.org>]

Hello Vinay,

Welcome to the Apache ecosystem! Glad to know that you want to contribute
to Apache Hadoop HDFS.

As I am not part of the Apache Hadoop community, I may not be able to help
you with the technical aspect, but I would definitely be able to guide you
on how you could get the help you need.

Here are some of the documents that may help you contribute:

Hadoop Contributor Guide
https://cwiki.apache.org/confluence/x/FCFPBQ

How to Contribute to Apache Hadoop
https://cwiki.apache.org/confluence/x/iwQwB

Here are the open issues, you could pick from:
https://issues.apache.org/jira/browse/HDFS-16799?jql=project%20%3D%20HDFS%20AND%20status%20%3D%20Open%20AND%20resolution%20%3D%20Unresolved%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC

Mailing list is a primary forum for communication, so if you’d like to
contribute to HDFS please do subscribe to the HDFS developer mailing list.
The HDFS developer mailing list is: hdfs-dev@hadoop.apache.org.
How to subscribe?
1. Send an empty mail (Subject: Subscribe) to
hdfs-dev-subscribe@hadoop.apache.org
2. You will receive a confirmation mail, just reply to confirm

Feel free to ask your queries on the mailing list.

I am looping in the HDFS developer mailing list, so that anyone from the
community could come forward and help you.

HTH

Thanks and Regards,
Aditya Sharma


On Wed, Oct 12, 2022 at 3:42 PM Vinay Kv <vi...@gmail.com> wrote:

> Hi Aditya/Priya,
> I am Vinay, I have around 9 years of experience in software development.
>
> I am looking to understand the code of HDFS so that I can contribute in
> the future.
>
> I am reaching out to you guys to see if there is any head start I can use,
> in terms of where to start and how to approach.
>
> Any starting point or any document to start will help a lot for me to pick
> up.
>
> Thanks in advance for your help.
>
> PS:
> Got your contact when I was going through the confluence of Hadoop
>
> --
> Regards,
> Vinay
>
>
>

Re: Hadoop HDFS project

[Aditya Sharma <ad...@apache.org>]

Hello Vinay,

Yes, you are not subscribed yet, your mail has not reached the mailing list.
https://lists.apache.org/thread/xd0yy0dgf22lxdb4wysc3k0coyhc3wnx

> I sent an email to Subscribe, but i didn't get any response.
Please check All emails or Spam folder. I tried the same and got a response
mail with the title "confirm subscribe to hdfs-dev@hadoop.apache.org".


Thanks and Regards,
Aditya Sharma


On Mon, Oct 17, 2022 at 6:47 PM Vinay Kv <vi...@gmail.com> wrote:

> Hi Aditya,
> Thanks a lot for the reply.
> I sent an email to Subscribe, but i didn't get any response.
>
> I went through the contribution guide and successfully set up the hadoop
> project on my local IDE.
>
> I went through the way to create a build, submit patches, and how to
> release to understand the release flow.
>
> @hdfs-dev@hadoop.apache.org <hd...@hadoop.apache.org>
>
> One thing I am struggling to understand is how we test the code in terms
> of functionality?
> How to contribute documents talks about existing unit test cases that have
> to pass, and new test cases we will create if we are adding new
> functionality.
> My understanding from this is we have to do a functionality test, the only
> way is to create a build and then test it. We cannot run the code without
> creating a build.
>
> What is the best way to understand the code flow of HDFS?
> I usually trigger a functionality, and debug the code to understand the
> flow. Is there a way to debug a code to understand the flow and understand
> the fixes.
> Or is there any other way to understand the code flow?
> Unit tests utilise mini HDFS clusters, can we use it to understand the
> flow?
>
> For example:
> if I have to understand the Namenode edit log functionality. I started
> with the NameNode class, went through the Java doc, realised a few more
> classes it is using and I am going through them.
> But this approach is 1. taking time 2. i might be wrong in understanding
> the doc OR doc might not have updated!
>
> Sorry if I have asked any lame questions. And Thank you in Advance for
> your replies, time and patience.
>
> Thanks,
> Vinay
>
> On Thu, 13 Oct 2022 at 11:42, Aditya Sharma <ad...@apache.org>
> wrote:
>
>> Hello Vinay,
>>
>> Welcome to the Apache ecosystem! Glad to know that you want to contribute
>> to Apache Hadoop HDFS.
>>
>> As I am not part of the Apache Hadoop community, I may not be able to
>> help you with the technical aspect, but I would definitely be able to guide
>> you on how you could get the help you need.
>>
>> Here are some of the documents that may help you contribute:
>>
>> Hadoop Contributor Guide
>> https://cwiki.apache.org/confluence/x/FCFPBQ
>>
>> How to Contribute to Apache Hadoop
>> https://cwiki.apache.org/confluence/x/iwQwB
>>
>> Here are the open issues, you could pick from:
>>
>> https://issues.apache.org/jira/browse/HDFS-16799?jql=project%20%3D%20HDFS%20AND%20status%20%3D%20Open%20AND%20resolution%20%3D%20Unresolved%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC
>>
>> Mailing list is a primary forum for communication, so if you’d like to
>> contribute to HDFS please do subscribe to the HDFS developer mailing list.
>> The HDFS developer mailing list is: hdfs-dev@hadoop.apache.org.
>> How to subscribe?
>> 1. Send an empty mail (Subject: Subscribe) to
>> hdfs-dev-subscribe@hadoop.apache.org
>> 2. You will receive a confirmation mail, just reply to confirm
>>
>> Feel free to ask your queries on the mailing list.
>>
>> I am looping in the HDFS developer mailing list, so that anyone from the
>> community could come forward and help you.
>>
>> HTH
>>
>> Thanks and Regards,
>> Aditya Sharma
>>
>>
>> On Wed, Oct 12, 2022 at 3:42 PM Vinay Kv <vi...@gmail.com> wrote:
>>
>>> Hi Aditya/Priya,
>>> I am Vinay, I have around 9 years of experience in software development.
>>>
>>> I am looking to understand the code of HDFS so that I can contribute in
>>> the future.
>>>
>>> I am reaching out to you guys to see if there is any head start I can
>>> use, in terms of where to start and how to approach.
>>>
>>> Any starting point or any document to start will help a lot for me to
>>> pick up.
>>>
>>> Thanks in advance for your help.
>>>
>>> PS:
>>> Got your contact when I was going through the confluence of Hadoop
>>>
>>> --
>>> Regards,
>>> Vinay
>>>
>>>
>>>
>>
>
> --
> Regards,
> Vinay.K.V
>
>
>