You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by Arun C Murthy <ac...@yahoo-inc.com> on 2011/03/21 19:30:17 UTC

Developing on MAPREDUCE-279

Folks,

  We are very happy to have pushed MR-279 to the MR-279 dev-branch  
where we look forward to collaborating with everyone.

  This work is only partially complete. We plan to continue its  
development in the branch and do so in an aggressive manner - we want  
to get it done!

  Since it's a dev branch you will see us push aggressively and do a  
large number of commits, even daily. This is commit then review on the  
branch (e.g. see 'When to Commit a Change' in http://httpd.apache.org/dev/guidelines.html) 
.

  We plan to use more of mapreduce-dev@/wiki and less of jira to  
coordinate. We'll send out email statuses to allow everyone to track,  
maybe even use the wiki to maintain todo lists. We'll learn as it  
goes, make changes to the dev process as appropriate.

  Everyone is welcome to contribute, we'd love that! Just be aware  
we'll be moving fast. Thus, you'll need to watch the branch. Please  
shout out if you are interested in specific areas to let others know;  
they could be anything - dev, code-reviews, build, docs, qa etc.

  The horses for specific courses as you contribute:
  # MapReduce ApplicationMaster - Sharad & Vinod
     * Availability - Sharad
  # RM - Arun & Mahadev
    * Scheduler - Arun & Mahadev
    * ApplicationsManager & Availability - Mahadev
  # NodeManager - Chris & Vinod
  # Security - Vinod

thanks,
Arun

Re: Developing on MAPREDUCE-279

Posted by Arun C Murthy <ac...@yahoo-inc.com>.
Thanks for all the offers to help, it's greatly appreciated!

I've started a wiki for this project: http://wiki.apache.org/hadoop/NextGenMapReduce 
.

I've also put a preliminary TODO list in http://wiki.apache.org/hadoop/NextGenMapReduceTrack 
  to help track development and people working on it. We'll expand  
them soon... meanwhile there are some preliminary *TBD* items there  
for people to jump right in.

thanks,
Arun


On Mar 21, 2011, at 11:30 AM, Arun C Murthy wrote:

> Folks,
>
>  We are very happy to have pushed MR-279 to the MR-279 dev-branch
> where we look forward to collaborating with everyone.
>
>  This work is only partially complete. We plan to continue its
> development in the branch and do so in an aggressive manner - we want
> to get it done!
>
>  Since it's a dev branch you will see us push aggressively and do a
> large number of commits, even daily. This is commit then review on the
> branch (e.g. see 'When to Commit a Change' in http://httpd.apache.org/dev/guidelines.html)
> .
>
>  We plan to use more of mapreduce-dev@/wiki and less of jira to
> coordinate. We'll send out email statuses to allow everyone to track,
> maybe even use the wiki to maintain todo lists. We'll learn as it
> goes, make changes to the dev process as appropriate.
>
>  Everyone is welcome to contribute, we'd love that! Just be aware
> we'll be moving fast. Thus, you'll need to watch the branch. Please
> shout out if you are interested in specific areas to let others know;
> they could be anything - dev, code-reviews, build, docs, qa etc.
>
>  The horses for specific courses as you contribute:
>  # MapReduce ApplicationMaster - Sharad & Vinod
>     * Availability - Sharad
>  # RM - Arun & Mahadev
>    * Scheduler - Arun & Mahadev
>    * ApplicationsManager & Availability - Mahadev
>  # NodeManager - Chris & Vinod
>  # Security - Vinod
>
> thanks,
> Arun


Re: Developing on MAPREDUCE-279

Posted by Denny Ye <de...@gmail.com>.
hi Arun,
    I would like to join into *Scheduler* development or some cases related
with it .
    Is there have any documents about *Scheduler* in new MR architecture?
thanks!

Regards
-- Denny Ye

On Tue, Mar 22, 2011 at 11:17 AM, Deepak Sharma <de...@gmail.com>wrote:

> Hi Arun
> I am interested to work in the Hadoop development.
> Please let me know if i can start with it.
>
> Thanks
> Deepak
>
> On Tue, Mar 22, 2011 at 12:00 AM, Arun C Murthy <ac...@yahoo-inc.com> wrote:
>
> > Folks,
> >
> >  We are very happy to have pushed MR-279 to the MR-279 dev-branch where
> we
> > look forward to collaborating with everyone.
> >
> >  This work is only partially complete. We plan to continue its
> development
> > in the branch and do so in an aggressive manner - we want to get it done!
> >
> >  Since it's a dev branch you will see us push aggressively and do a large
> > number of commits, even daily. This is commit then review on the branch
> > (e.g. see 'When to Commit a Change' in
> > http://httpd.apache.org/dev/guidelines.html).
> >
> >  We plan to use more of mapreduce-dev@/wiki and less of jira to
> > coordinate. We'll send out email statuses to allow everyone to track,
> maybe
> > even use the wiki to maintain todo lists. We'll learn as it goes, make
> > changes to the dev process as appropriate.
> >
> >  Everyone is welcome to contribute, we'd love that! Just be aware we'll
> be
> > moving fast. Thus, you'll need to watch the branch. Please shout out if
> you
> > are interested in specific areas to let others know; they could be
> anything
> > - dev, code-reviews, build, docs, qa etc.
> >
> >  The horses for specific courses as you contribute:
> >  # MapReduce ApplicationMaster - Sharad & Vinod
> >    * Availability - Sharad
> >  # RM - Arun & Mahadev
> >   * Scheduler - Arun & Mahadev
> >   * ApplicationsManager & Availability - Mahadev
> >  # NodeManager - Chris & Vinod
> >  # Security - Vinod
> >
> > thanks,
> > Arun
>
>
>
>
> --
> Deepak Sharma
> http://www.linkedin.com/in/rikindia
>

Re: Developing on MAPREDUCE-279

Posted by Deepak Sharma <de...@gmail.com>.
Hi Arun
I am interested to work in the Hadoop development.
Please let me know if i can start with it.

Thanks
Deepak

On Tue, Mar 22, 2011 at 12:00 AM, Arun C Murthy <ac...@yahoo-inc.com> wrote:

> Folks,
>
>  We are very happy to have pushed MR-279 to the MR-279 dev-branch where we
> look forward to collaborating with everyone.
>
>  This work is only partially complete. We plan to continue its development
> in the branch and do so in an aggressive manner - we want to get it done!
>
>  Since it's a dev branch you will see us push aggressively and do a large
> number of commits, even daily. This is commit then review on the branch
> (e.g. see 'When to Commit a Change' in
> http://httpd.apache.org/dev/guidelines.html).
>
>  We plan to use more of mapreduce-dev@/wiki and less of jira to
> coordinate. We'll send out email statuses to allow everyone to track, maybe
> even use the wiki to maintain todo lists. We'll learn as it goes, make
> changes to the dev process as appropriate.
>
>  Everyone is welcome to contribute, we'd love that! Just be aware we'll be
> moving fast. Thus, you'll need to watch the branch. Please shout out if you
> are interested in specific areas to let others know; they could be anything
> - dev, code-reviews, build, docs, qa etc.
>
>  The horses for specific courses as you contribute:
>  # MapReduce ApplicationMaster - Sharad & Vinod
>    * Availability - Sharad
>  # RM - Arun & Mahadev
>   * Scheduler - Arun & Mahadev
>   * ApplicationsManager & Availability - Mahadev
>  # NodeManager - Chris & Vinod
>  # Security - Vinod
>
> thanks,
> Arun




-- 
Deepak Sharma
http://www.linkedin.com/in/rikindia