Hadoop TLP?

[Doug Cutting <cu...@apache.org>]

I think it is time that we make Hadoop a top level project (TLP) at 
Apache, hadoop.apache.org, leaving our current home as a Lucene 
subproject.  HBase could become a sub-project, as could Pig (now 
incubating) and perhaps others.

Hadoop, unlike all other Lucene subprojects, does not use Lucene.  Its 
community has considerably less overlap with other Lucene subprojects 
than the rest. It also is beginning to have subproject-like things of 
its own, like HBase, pushing the boundaries of subproject management.

Many members of the Lucene PMC have little familiarity with the Hadoop 
community.  For example, HBase might like to nominate a new committer, 
but a majority of the Lucene PMC would find it difficult to evaluate 
this candidate, since they do not follow HBase development.  It would be 
better if such discussions could be made by a PMC that had 
representation from and broad familiarity with HBase.

Diversity is an issue with Hadoop becoming a TLP.  The majority of 
Hadoop committers are employed by Yahoo!.  But I think we can construct 
an initial PMC that is diverse enough to overcome this, with perhaps 
three folks from Yahoo!, two from Powerset, and three or four 
independent folks, so that Yahoo! does not have a majority on the PMC.

Would other members of the Hadoop community support this move?

Thanks,

Doug

Re: Hadoop TLP?

[Doug Cutting <cu...@apache.org>]

Konstantin Shvachko wrote:
> Is there a link for diversity regulations on apache site?

There is for exiting the incubator:

http://incubator.apache.org/incubation/Incubation_Policy.html#Graduating+from+the+Incubator

That states: "The project is not highly dependent on any single 
contributor (there are at least 3 legally independent committers and 
there is no single company or entity that is vital to the success of the 
project)".

These are generally understood to also apply to subprojects becoming 
TLPs.  The letter of the law is thus "3 legally independent committers", 
which Hadoop meets, but the spirit is more difficult to interpret.  I 
think, if Y! were to cease its contributions to Hadoop that the project 
would survive.  It would develop more slowly, especially at first, but I 
think it would survive.

Doug

Re: Hadoop TLP?

[Konstantin Shvachko <sh...@yahoo-inc.com>]

+1

Is there a link for diversity regulations on apache site?

Doug Cutting wrote:
> I think it is time that we make Hadoop a top level project (TLP) at 
> Apache, hadoop.apache.org, leaving our current home as a Lucene 
> subproject.  HBase could become a sub-project, as could Pig (now 
> incubating) and perhaps others.
> 
> Hadoop, unlike all other Lucene subprojects, does not use Lucene.  Its 
> community has considerably less overlap with other Lucene subprojects 
> than the rest. It also is beginning to have subproject-like things of 
> its own, like HBase, pushing the boundaries of subproject management.
> 
> Many members of the Lucene PMC have little familiarity with the Hadoop 
> community.  For example, HBase might like to nominate a new committer, 
> but a majority of the Lucene PMC would find it difficult to evaluate 
> this candidate, since they do not follow HBase development.  It would be 
> better if such discussions could be made by a PMC that had 
> representation from and broad familiarity with HBase.
> 
> Diversity is an issue with Hadoop becoming a TLP.  The majority of 
> Hadoop committers are employed by Yahoo!.  But I think we can construct 
> an initial PMC that is diverse enough to overcome this, with perhaps 
> three folks from Yahoo!, two from Powerset, and three or four 
> independent folks, so that Yahoo! does not have a majority on the PMC.
> 
> Would other members of the Hadoop community support this move?
> 
> Thanks,
> 
> Doug
> 
> 

Re: Hadoop TLP?

[Sanjay Radia <sr...@YAHOO-INC.COM>]

+1

Re: Hadoop TLP?

[stack <st...@duboce.net>]

Doug Cutting wrote:
> I think it is time that we make Hadoop a top level project (TLP) at 
> Apache, hadoop.apache.org, leaving our current home as a Lucene 
> subproject.  HBase could become a sub-project, as could Pig (now 
> incubating) and perhaps others.

+1

Re: Hadoop TLP?

[Dennis Kubes <ku...@apache.org>]

+1

Nigel Daley wrote:
> 
> On Dec 13, 2007, at 3:21 PM, Doug Cutting wrote:
> 
>> I think it is time that we make Hadoop a top level project (TLP) at 
>> Apache
> 
> +1

Re: Hadoop TLP?

[Nigel Daley <nd...@yahoo-inc.com>]

On Dec 13, 2007, at 3:21 PM, Doug Cutting wrote:

> I think it is time that we make Hadoop a top level project (TLP) at  
> Apache

+1

Re: Hadoop TLP?

[Paul Saab <ps...@mu.org>]

+1

On Dec 13, 2007 6:26 PM, Jeff Hammerbacher <je...@gmail.com>
wrote:

> +1
>
> On Dec 13, 2007 6:18 PM, edward yoon <we...@udanax.org> wrote:
>
> >
> > +1
> > ------------------------------
> >
> > B. Regards,
> >
> > Edward yoon @ NHN, corp.
> > Home : http://www.udanax.org
> >
> >
> > > Date: Thu, 13 Dec 2007 15:21:38 -0800
> > > From: cutting@apache.org
> > > To: hadoop-dev@lucene.apache.org
> > > Subject: Hadoop TLP?
> > >
> > > I think it is time that we make Hadoop a top level project (TLP) at
> > > Apache, hadoop.apache.org, leaving our current home as a Lucene
> > > subproject. HBase could become a sub-project, as could Pig (now
> > > incubating) and perhaps others.
> > >
> > > Hadoop, unlike all other Lucene subprojects, does not use Lucene. Its
> > > community has considerably less overlap with other Lucene subprojects
> > > than the rest. It also is beginning to have subproject-like things of
> > > its own, like HBase, pushing the boundaries of subproject management.
> > >
> > > Many members of the Lucene PMC have little familiarity with the Hadoop
> > > community. For example, HBase might like to nominate a new committer,
> > > but a majority of the Lucene PMC would find it difficult to evaluate
> > > this candidate, since they do not follow HBase development. It would
> be
> > > better if such discussions could be made by a PMC that had
> > > representation from and broad familiarity with HBase.
> > >
> > > Diversity is an issue with Hadoop becoming a TLP. The majority of
> > > Hadoop committers are employed by Yahoo!. But I think we can construct
> > > an initial PMC that is diverse enough to overcome this, with perhaps
> > > three folks from Yahoo!, two from Powerset, and three or four
> > > independent folks, so that Yahoo! does not have a majority on the PMC.
> > >
> > > Would other members of the Hadoop community support this move?
> > >
> > > Thanks,
> > >
> > > Doug
> > >
> >
> > _________________________________________________________________
> > Share life as it happens with the new Windows Live.
> >
> >
> http://www.windowslive.com/share.html?ocid=TXT_TAGHM_Wave2_sharelife_122007
>

Re: Hadoop TLP?

[Jeff Hammerbacher <je...@gmail.com>]

+1

On Dec 13, 2007 6:18 PM, edward yoon <we...@udanax.org> wrote:

>
> +1
> ------------------------------
>
> B. Regards,
>
> Edward yoon @ NHN, corp.
> Home : http://www.udanax.org
>
>
> > Date: Thu, 13 Dec 2007 15:21:38 -0800
> > From: cutting@apache.org
> > To: hadoop-dev@lucene.apache.org
> > Subject: Hadoop TLP?
> >
> > I think it is time that we make Hadoop a top level project (TLP) at
> > Apache, hadoop.apache.org, leaving our current home as a Lucene
> > subproject. HBase could become a sub-project, as could Pig (now
> > incubating) and perhaps others.
> >
> > Hadoop, unlike all other Lucene subprojects, does not use Lucene. Its
> > community has considerably less overlap with other Lucene subprojects
> > than the rest. It also is beginning to have subproject-like things of
> > its own, like HBase, pushing the boundaries of subproject management.
> >
> > Many members of the Lucene PMC have little familiarity with the Hadoop
> > community. For example, HBase might like to nominate a new committer,
> > but a majority of the Lucene PMC would find it difficult to evaluate
> > this candidate, since they do not follow HBase development. It would be
> > better if such discussions could be made by a PMC that had
> > representation from and broad familiarity with HBase.
> >
> > Diversity is an issue with Hadoop becoming a TLP. The majority of
> > Hadoop committers are employed by Yahoo!. But I think we can construct
> > an initial PMC that is diverse enough to overcome this, with perhaps
> > three folks from Yahoo!, two from Powerset, and three or four
> > independent folks, so that Yahoo! does not have a majority on the PMC.
> >
> > Would other members of the Hadoop community support this move?
> >
> > Thanks,
> >
> > Doug
> >
>
> _________________________________________________________________
> Share life as it happens with the new Windows Live.
>
> http://www.windowslive.com/share.html?ocid=TXT_TAGHM_Wave2_sharelife_122007

RE: Hadoop TLP?

[edward yoon <we...@udanax.org>]

+1
------------------------------

B. Regards,

Edward yoon @ NHN, corp.
Home : http://www.udanax.org


> Date: Thu, 13 Dec 2007 15:21:38 -0800
> From: cutting@apache.org
> To: hadoop-dev@lucene.apache.org
> Subject: Hadoop TLP?
>
> I think it is time that we make Hadoop a top level project (TLP) at
> Apache, hadoop.apache.org, leaving our current home as a Lucene
> subproject. HBase could become a sub-project, as could Pig (now
> incubating) and perhaps others.
>
> Hadoop, unlike all other Lucene subprojects, does not use Lucene. Its
> community has considerably less overlap with other Lucene subprojects
> than the rest. It also is beginning to have subproject-like things of
> its own, like HBase, pushing the boundaries of subproject management.
>
> Many members of the Lucene PMC have little familiarity with the Hadoop
> community. For example, HBase might like to nominate a new committer,
> but a majority of the Lucene PMC would find it difficult to evaluate
> this candidate, since they do not follow HBase development. It would be
> better if such discussions could be made by a PMC that had
> representation from and broad familiarity with HBase.
>
> Diversity is an issue with Hadoop becoming a TLP. The majority of
> Hadoop committers are employed by Yahoo!. But I think we can construct
> an initial PMC that is diverse enough to overcome this, with perhaps
> three folks from Yahoo!, two from Powerset, and three or four
> independent folks, so that Yahoo! does not have a majority on the PMC.
>
> Would other members of the Hadoop community support this move?
>
> Thanks,
>
> Doug
>

_________________________________________________________________
Share life as it happens with the new Windows Live.
http://www.windowslive.com/share.html?ocid=TXT_TAGHM_Wave2_sharelife_122007

Re: Hadoop TLP?

[Enis Soztutar <en...@gmail.com>]

+1

Tom White wrote:
> +1
>
> On 13/12/2007, Doug Cutting <cu...@apache.org> wrote:
>   
>> I think it is time that we make Hadoop a top level project (TLP) at
>> Apache, hadoop.apache.org, leaving our current home as a Lucene
>> subproject.  HBase could become a sub-project, as could Pig (now
>> incubating) and perhaps others.
>>
>> Hadoop, unlike all other Lucene subprojects, does not use Lucene.  Its
>> community has considerably less overlap with other Lucene subprojects
>> than the rest. It also is beginning to have subproject-like things of
>> its own, like HBase, pushing the boundaries of subproject management.
>>
>> Many members of the Lucene PMC have little familiarity with the Hadoop
>> community.  For example, HBase might like to nominate a new committer,
>> but a majority of the Lucene PMC would find it difficult to evaluate
>> this candidate, since they do not follow HBase development.  It would be
>> better if such discussions could be made by a PMC that had
>> representation from and broad familiarity with HBase.
>>
>> Diversity is an issue with Hadoop becoming a TLP.  The majority of
>> Hadoop committers are employed by Yahoo!.  But I think we can construct
>> an initial PMC that is diverse enough to overcome this, with perhaps
>> three folks from Yahoo!, two from Powerset, and three or four
>> independent folks, so that Yahoo! does not have a majority on the PMC.
>>
>> Would other members of the Hadoop community support this move?
>>
>> Thanks,
>>
>> Doug
>>
>>
>>     
>
>
>   

Re: Hadoop TLP?

[Tom White <to...@gmail.com>]

+1

On 13/12/2007, Doug Cutting <cu...@apache.org> wrote:
> I think it is time that we make Hadoop a top level project (TLP) at
> Apache, hadoop.apache.org, leaving our current home as a Lucene
> subproject.  HBase could become a sub-project, as could Pig (now
> incubating) and perhaps others.
>
> Hadoop, unlike all other Lucene subprojects, does not use Lucene.  Its
> community has considerably less overlap with other Lucene subprojects
> than the rest. It also is beginning to have subproject-like things of
> its own, like HBase, pushing the boundaries of subproject management.
>
> Many members of the Lucene PMC have little familiarity with the Hadoop
> community.  For example, HBase might like to nominate a new committer,
> but a majority of the Lucene PMC would find it difficult to evaluate
> this candidate, since they do not follow HBase development.  It would be
> better if such discussions could be made by a PMC that had
> representation from and broad familiarity with HBase.
>
> Diversity is an issue with Hadoop becoming a TLP.  The majority of
> Hadoop committers are employed by Yahoo!.  But I think we can construct
> an initial PMC that is diverse enough to overcome this, with perhaps
> three folks from Yahoo!, two from Powerset, and three or four
> independent folks, so that Yahoo! does not have a majority on the PMC.
>
> Would other members of the Hadoop community support this move?
>
> Thanks,
>
> Doug
>
>


-- 
Blog: http://problemsworthyofattack.blogspot.com/

RE: Hadoop TLP?

[Jim Kellerman <ji...@powerset.com>]

+1

---
Jim Kellerman, Senior Engineer; Powerset


> -----Original Message-----
> From: Doug Cutting [mailto:cutting@apache.org]
> Sent: Thursday, December 13, 2007 3:22 PM
> To: hadoop-dev@lucene.apache.org
> Subject: Hadoop TLP?
>
> I think it is time that we make Hadoop a top level project
> (TLP) at Apache, hadoop.apache.org, leaving our current home
> as a Lucene subproject.  HBase could become a sub-project, as
> could Pig (now
> incubating) and perhaps others.
>
> Hadoop, unlike all other Lucene subprojects, does not use
> Lucene.  Its community has considerably less overlap with
> other Lucene subprojects than the rest. It also is beginning
> to have subproject-like things of its own, like HBase,
> pushing the boundaries of subproject management.
>
> Many members of the Lucene PMC have little familiarity with
> the Hadoop community.  For example, HBase might like to
> nominate a new committer, but a majority of the Lucene PMC
> would find it difficult to evaluate this candidate, since
> they do not follow HBase development.  It would be better if
> such discussions could be made by a PMC that had
> representation from and broad familiarity with HBase.
>
> Diversity is an issue with Hadoop becoming a TLP.  The
> majority of Hadoop committers are employed by Yahoo!.  But I
> think we can construct an initial PMC that is diverse enough
> to overcome this, with perhaps three folks from Yahoo!, two
> from Powerset, and three or four independent folks, so that
> Yahoo! does not have a majority on the PMC.
>
> Would other members of the Hadoop community support this move?
>
> Thanks,
>
> Doug
>
>

Re: Hadoop TLP?

[Owen O'Malley <oo...@yahoo-inc.com>]

On Dec 13, 2007, at 3:21 PM, Doug Cutting wrote:

> I think it is time that we make Hadoop a top level project (TLP) at  
> Apache

+1

Re: Hadoop TLP?

[Christophe Taton <ch...@gmail.com>]

Doug Cutting wrote:
> I think it is time that we make Hadoop a top level project (TLP) at Apache
+1


Regards