You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@hadoop.apache.org by Adam Berry <am...@yahoo-inc.com> on 2012/09/17 21:34:09 UTC
Spinning out Hadoop Eclipse Tools
Hello all,
I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
If there is agreement on this, how do we go about getting it done?
Thanks,
Adam Berry
Re: Spinning out Hadoop Eclipse Tools
Posted by Marcos Ortiz <ml...@uci.cu>.
A big +1 for this idea.
On 09/17/2012 04:08 PM, Mahadev Konar wrote:
> +1. Great Idea!
>
> mahadev
>
> On Mon, Sep 17, 2012 at 1:01 PM, Robert Evans <ev...@yahoo-inc.com> wrote:
>> I am +1 on this too. I would love to see better tool support for Hadoop.
>>
>> --Bobby
>>
>> On 9/17/12 2:42 PM, "Eli Collins" <el...@cloudera.com> wrote:
>>
>>> Hey Adam,
>>>
>>> That would be awesome. +1
>>>
>>> We've discussed moving the various contrib projects out of Hadoop in
>>> the past, and think it make sense for all the reasons you mention. A
>>> good example of how we've done this was done previously is MRUnit,
>>> now hosted at http://mrunit.apache.org.
>>>
>>> Next steps, if others agree then you can draft a proposal to vote on.
>>> See this thread and jira for an example:
>>> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C774
>>> 05974-6771-4604-926B-976240743F3C@mac.com%3E
>>> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>>>
>>> Thanks,
>>> Eli
>>>
>>> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com>
>>> wrote:
>>>> Hello all,
>>>>
>>>> I'm proposing spinning out the eclipse plugin from the main hadoop
>>>> source into a separate incubating project. I'm willing to commit to this
>>>> effort.
>>>>
>>>> With a separate project, that isn't tied (source wise) to the Hadoop
>>>> source we could make dev tools that could support multiple versions of
>>>> Hadoop from within a single IDE, which would be very helpful when
>>>> migrating jobs or dealing with clusters running different versions.
>>>>
>>>> The current tools seem to support the 0.20 line, and help with
>>>> developing MR jobs, and also have some HDFS tools included. So the early
>>>> work would be to ensure that these features were supported across the
>>>> version space of Hadoop.
>>>>
>>>> Down the line we could also add support for additional tools such as
>>>> MRUnit and other products in the Hadoop ecosystem, to eventually yield a
>>>> one stop project for all dev tools around this space.
>>>>
>>>> If there is agreement on this, how do we go about getting it done?
>>>>
>>>> Thanks,
>>>>
>>>> Adam Berry
> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>
> http://www.uci.cu
> http://www.facebook.com/universidad.uci
> http://www.flickr.com/photos/universidad_uci
--
Marcos Luis OrtÃz Valmaseda
*Data Engineer && Sr. System Administrator at UCI*
about.me/marcosortiz <http://about.me/marcosortiz>
My Blog <http://marcosluis2186.posterous.com>
Tumblr's blog <http://marcosortiz.tumblr.com/>
@marcosluis2186 <http://twitter.com/marcosluis2186>
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
Re: Spinning out Hadoop Eclipse Tools
Posted by Mahadev Konar <ma...@hortonworks.com>.
+1. Great Idea!
mahadev
On Mon, Sep 17, 2012 at 1:01 PM, Robert Evans <ev...@yahoo-inc.com> wrote:
> I am +1 on this too. I would love to see better tool support for Hadoop.
>
> --Bobby
>
> On 9/17/12 2:42 PM, "Eli Collins" <el...@cloudera.com> wrote:
>
>>Hey Adam,
>>
>>That would be awesome. +1
>>
>>We've discussed moving the various contrib projects out of Hadoop in
>>the past, and think it make sense for all the reasons you mention. A
>>good example of how we've done this was done previously is MRUnit,
>>now hosted at http://mrunit.apache.org.
>>
>>Next steps, if others agree then you can draft a proposal to vote on.
>>See this thread and jira for an example:
>>http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C774
>>05974-6771-4604-926B-976240743F3C@mac.com%3E
>>https://issues.apache.org/jira/browse/MAPREDUCE-2430
>>
>>Thanks,
>>Eli
>>
>>On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com>
>>wrote:
>>> Hello all,
>>>
>>> I'm proposing spinning out the eclipse plugin from the main hadoop
>>>source into a separate incubating project. I'm willing to commit to this
>>>effort.
>>>
>>> With a separate project, that isn't tied (source wise) to the Hadoop
>>>source we could make dev tools that could support multiple versions of
>>>Hadoop from within a single IDE, which would be very helpful when
>>>migrating jobs or dealing with clusters running different versions.
>>>
>>> The current tools seem to support the 0.20 line, and help with
>>>developing MR jobs, and also have some HDFS tools included. So the early
>>>work would be to ensure that these features were supported across the
>>>version space of Hadoop.
>>>
>>> Down the line we could also add support for additional tools such as
>>>MRUnit and other products in the Hadoop ecosystem, to eventually yield a
>>>one stop project for all dev tools around this space.
>>>
>>> If there is agreement on this, how do we go about getting it done?
>>>
>>> Thanks,
>>>
>>> Adam Berry
>
Re: Spinning out Hadoop Eclipse Tools
Posted by Chris A Mattmann <ch...@gmail.com>.
Hi Bobby,
The Incubator PMC is comprised of folks who are elected by other
Incubator PMC members and ASF members who request membership
on the Incubator PMC.
Cheers,
Chris
On Oct 1, 2012, at 3:19 PM, Robert Evans wrote:
> Thanks for pointing that out Chris. I am kind of new to the whole
> incubator thing. How would one go about making such a request to be part
> of the IPMC?
>
> --Bobby
>
> On 9/28/12 6:06 PM, "Mattmann, Chris A (388J)"
> <ch...@jpl.nasa.gov> wrote:
>
>> Hi Adam,
>>
>> Thanks. One thing to note that is to be an Incubator podling mentor, the
>> mentor needs
>> to be a member of the IPMC. Typically these are ASF members, but it's not
>> a hard requirement
>> for them to be.
>>
>> Cheers,
>> Chris
>>
>> On Sep 28, 2012, at 3:24 PM, Adam Berry wrote:
>>
>>> Awesome! Thank you Eli!
>>>
>>> And before, I did mean mentor when I said sponsor. Sponsor seems to
>>> normally be the incubator pmc.
>>>
>>> So we have three mentors, which seems to be the normal amount from
>>> digging around the incubation stuff.
>>>
>>> I realize its a big ask, but that just leaves the champion slot open.
>>>
>>> Adam
>>>
>>>
>>> On Sep 28, 2012, at 5:16 PM, Eli Collins wrote:
>>>
>>>> Hey Adam,
>>>>
>>>> I'd be happy to mentor as well.
>>>>
>>>> Thanks,
>>>> Eli
>>>>
>>>> On Fri, Sep 28, 2012 at 3:09 PM, Adam Berry <am...@yahoo-inc.com>
>>>> wrote:
>>>>>
>>>>> So at this point, I definitely have Chris and Bobby who are willing
>>>>> to mentor.
>>>>>
>>>>> Arun, would you be willing to be the third sponsor?
>>>>>
>>>>> And then, could one of you guys take up being the champion?
>>>>>
>>>>> Cheers,
>>>>> Adam
>>>>>
>>>>> On Sep 24, 2012, at 11:51 AM, Chris A Mattmann wrote:
>>>>>
>>>>>> Hi Adam,
>>>>>>
>>>>>> I'd be willing to be a mentor for the project, let me think about
>>>>>> being the Champion :)
>>>>>> Either way, count me on the mentoring team!
>>>>>>
>>>>>> Cheers,
>>>>>> Chris
>>>>>>
>>>>>> On Sep 24, 2012, at 9:06 AM, Adam Berry wrote:
>>>>>>
>>>>>>>
>>>>>>> So, I've been drafting the proposal, and once I have a rough one
>>>>>>> I'll post it here for feedback before taking it to the incubation
>>>>>>> lists.
>>>>>>>
>>>>>>> I've had offers of involvement, which is also great.
>>>>>>>
>>>>>>> @Chris, would you be willing to be the champion for this project
>>>>>>> and also a mentor?
>>>>>>>
>>>>>>> @Everyone, that would leave two mentor slots left to fill, anyone
>>>>>>> else willing to throw their hat in for this? I would like to have
>>>>>>> that information in the proposal as soon as possible.
>>>>>>>
>>>>>>> Cheers,
>>>>>>> Adam
>>>>>>>
>>>>>>>
>>>>>>> On Sep 18, 2012, at 12:17 PM, Adam Berry wrote:
>>>>>>>
>>>>>>>>
>>>>>>>> The positive feedback is really encouraging, so thanks everyone!
>>>>>>>>
>>>>>>>> @Chris, thanks for the links, I will make a start on going through
>>>>>>>> that material and preparing the proposal. Thank you for the offer
>>>>>>>> of help, I'll be taking you up on that.
>>>>>>>>
>>>>>>>> Is there anyone else who is also interested in committing to this?
>>>>>>>>
>>>>>>>> Cheers,
>>>>>>>> Adam
>>>>>>>>
>>>>>>>> On Sep 18, 2012, at 1:03 AM, Eric Baldeschwieler wrote:
>>>>>>>>
>>>>>>>>> +1 to spinning it out and +1 for just starting to work with
>>>>>>>>> incubator as chris outlines.
>>>>>>>>>
>>>>>>>>> Once that is up and the code here can be removed as redundant.
>>>>>>>>> Folks might object to that, but I highly doubt it given this
>>>>>>>>> thread.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Sep 17, 2012, at 6:46 PM, "Mattmann, Chris A (388J)"
>>>>>>>>> <ch...@jpl.nasa.gov> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Adam,
>>>>>>>>>>
>>>>>>>>>> +1 this seems like a great idea!
>>>>>>>>>>
>>>>>>>>>> Here's a guide to creating an Apache Incubator proposal:
>>>>>>>>>>
>>>>>>>>>> http://incubator.apache.org/guides/proposal.html
>>>>>>>>>>
>>>>>>>>>> You'll need 3 ASF members to be your mentors, 1 of which whom
>>>>>>>>>> is willing to be your Champion (the person that takes leadership
>>>>>>>>>> of shepherding you guys through the Incubator).
>>>>>>>>>>
>>>>>>>>>> I'm happy to help out in this effort however I can. I had a
>>>>>>>>>> great experience
>>>>>>>>>> mentoring the MRUnit folks and they have done a great job!
>>>>>>>>>>
>>>>>>>>>> Cheers,
>>>>>>>>>> Chris
>>>>>>>>>>
>>>>>>>>>> On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:
>>>>>>>>>>
>>>>>>>>>>> Hey Adam,
>>>>>>>>>>>
>>>>>>>>>>> That would be awesome. +1
>>>>>>>>>>>
>>>>>>>>>>> We've discussed moving the various contrib projects out of
>>>>>>>>>>> Hadoop in
>>>>>>>>>>> the past, and think it make sense for all the reasons you
>>>>>>>>>>> mention. A
>>>>>>>>>>> good example of how we've done this was done previously is
>>>>>>>>>>> MRUnit,
>>>>>>>>>>> now hosted at http://mrunit.apache.org.
>>>>>>>>>>>
>>>>>>>>>>> Next steps, if others agree then you can draft a proposal to
>>>>>>>>>>> vote on.
>>>>>>>>>>> See this thread and jira for an example:
>>>>>>>>>>>
>>>>>>>>>>> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mb
>>>>>>>>>>> ox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
>>>>>>>>>>> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Eli
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry
>>>>>>>>>>> <am...@yahoo-inc.com> wrote:
>>>>>>>>>>>> Hello all,
>>>>>>>>>>>>
>>>>>>>>>>>> I'm proposing spinning out the eclipse plugin from the main
>>>>>>>>>>>> hadoop source into a separate incubating project. I'm willing
>>>>>>>>>>>> to commit to this effort.
>>>>>>>>>>>>
>>>>>>>>>>>> With a separate project, that isn't tied (source wise) to the
>>>>>>>>>>>> Hadoop source we could make dev tools that could support
>>>>>>>>>>>> multiple versions of Hadoop from within a single IDE, which
>>>>>>>>>>>> would be very helpful when migrating jobs or dealing with
>>>>>>>>>>>> clusters running different versions.
>>>>>>>>>>>>
>>>>>>>>>>>> The current tools seem to support the 0.20 line, and help with
>>>>>>>>>>>> developing MR jobs, and also have some HDFS tools included. So
>>>>>>>>>>>> the early work would be to ensure that these features were
>>>>>>>>>>>> supported across the version space of Hadoop.
>>>>>>>>>>>>
>>>>>>>>>>>> Down the line we could also add support for additional tools
>>>>>>>>>>>> such as MRUnit and other products in the Hadoop ecosystem, to
>>>>>>>>>>>> eventually yield a one stop project for all dev tools around
>>>>>>>>>>>> this space.
>>>>>>>>>>>>
>>>>>>>>>>>> If there is agreement on this, how do we go about getting it
>>>>>>>>>>>> done?
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>
>>>>>>>>>>>> Adam Berry
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>>>> Chris Mattmann, Ph.D.
>>>>>>>>>> Senior Computer Scientist
>>>>>>>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>>>>>>>> Office: 171-266B, Mailstop: 171-246
>>>>>>>>>> Email: chris.a.mattmann@nasa.gov
>>>>>>>>>> WWW: http://sunset.usc.edu/~mattmann/
>>>>>>>>>>
>>>>>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>>>> Adjunct Assistant Professor, Computer Science Department
>>>>>>>>>> University of Southern California, Los Angeles, CA 90089 USA
>>>>>>>>>>
>>>>>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>
>>
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov
>> WWW: http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>
Re: Spinning out Hadoop Eclipse Tools
Posted by Robert Evans <ev...@yahoo-inc.com>.
Thanks for pointing that out Chris. I am kind of new to the whole
incubator thing. How would one go about making such a request to be part
of the IPMC?
--Bobby
On 9/28/12 6:06 PM, "Mattmann, Chris A (388J)"
<ch...@jpl.nasa.gov> wrote:
>Hi Adam,
>
>Thanks. One thing to note that is to be an Incubator podling mentor, the
>mentor needs
>to be a member of the IPMC. Typically these are ASF members, but it's not
>a hard requirement
>for them to be.
>
>Cheers,
>Chris
>
>On Sep 28, 2012, at 3:24 PM, Adam Berry wrote:
>
>> Awesome! Thank you Eli!
>>
>> And before, I did mean mentor when I said sponsor. Sponsor seems to
>>normally be the incubator pmc.
>>
>> So we have three mentors, which seems to be the normal amount from
>>digging around the incubation stuff.
>>
>> I realize its a big ask, but that just leaves the champion slot open.
>>
>> Adam
>>
>>
>> On Sep 28, 2012, at 5:16 PM, Eli Collins wrote:
>>
>>> Hey Adam,
>>>
>>> I'd be happy to mentor as well.
>>>
>>> Thanks,
>>> Eli
>>>
>>> On Fri, Sep 28, 2012 at 3:09 PM, Adam Berry <am...@yahoo-inc.com>
>>>wrote:
>>>>
>>>> So at this point, I definitely have Chris and Bobby who are willing
>>>>to mentor.
>>>>
>>>> Arun, would you be willing to be the third sponsor?
>>>>
>>>> And then, could one of you guys take up being the champion?
>>>>
>>>> Cheers,
>>>> Adam
>>>>
>>>> On Sep 24, 2012, at 11:51 AM, Chris A Mattmann wrote:
>>>>
>>>>> Hi Adam,
>>>>>
>>>>> I'd be willing to be a mentor for the project, let me think about
>>>>>being the Champion :)
>>>>> Either way, count me on the mentoring team!
>>>>>
>>>>> Cheers,
>>>>> Chris
>>>>>
>>>>> On Sep 24, 2012, at 9:06 AM, Adam Berry wrote:
>>>>>
>>>>>>
>>>>>> So, I've been drafting the proposal, and once I have a rough one
>>>>>>I'll post it here for feedback before taking it to the incubation
>>>>>>lists.
>>>>>>
>>>>>> I've had offers of involvement, which is also great.
>>>>>>
>>>>>> @Chris, would you be willing to be the champion for this project
>>>>>>and also a mentor?
>>>>>>
>>>>>> @Everyone, that would leave two mentor slots left to fill, anyone
>>>>>>else willing to throw their hat in for this? I would like to have
>>>>>>that information in the proposal as soon as possible.
>>>>>>
>>>>>> Cheers,
>>>>>> Adam
>>>>>>
>>>>>>
>>>>>> On Sep 18, 2012, at 12:17 PM, Adam Berry wrote:
>>>>>>
>>>>>>>
>>>>>>> The positive feedback is really encouraging, so thanks everyone!
>>>>>>>
>>>>>>> @Chris, thanks for the links, I will make a start on going through
>>>>>>>that material and preparing the proposal. Thank you for the offer
>>>>>>>of help, I'll be taking you up on that.
>>>>>>>
>>>>>>> Is there anyone else who is also interested in committing to this?
>>>>>>>
>>>>>>> Cheers,
>>>>>>> Adam
>>>>>>>
>>>>>>> On Sep 18, 2012, at 1:03 AM, Eric Baldeschwieler wrote:
>>>>>>>
>>>>>>>> +1 to spinning it out and +1 for just starting to work with
>>>>>>>>incubator as chris outlines.
>>>>>>>>
>>>>>>>> Once that is up and the code here can be removed as redundant.
>>>>>>>>Folks might object to that, but I highly doubt it given this
>>>>>>>>thread.
>>>>>>>>
>>>>>>>>
>>>>>>>> On Sep 17, 2012, at 6:46 PM, "Mattmann, Chris A (388J)"
>>>>>>>><ch...@jpl.nasa.gov> wrote:
>>>>>>>>
>>>>>>>>> Hi Adam,
>>>>>>>>>
>>>>>>>>> +1 this seems like a great idea!
>>>>>>>>>
>>>>>>>>> Here's a guide to creating an Apache Incubator proposal:
>>>>>>>>>
>>>>>>>>> http://incubator.apache.org/guides/proposal.html
>>>>>>>>>
>>>>>>>>> You'll need 3 ASF members to be your mentors, 1 of which whom
>>>>>>>>> is willing to be your Champion (the person that takes leadership
>>>>>>>>> of shepherding you guys through the Incubator).
>>>>>>>>>
>>>>>>>>> I'm happy to help out in this effort however I can. I had a
>>>>>>>>>great experience
>>>>>>>>> mentoring the MRUnit folks and they have done a great job!
>>>>>>>>>
>>>>>>>>> Cheers,
>>>>>>>>> Chris
>>>>>>>>>
>>>>>>>>> On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:
>>>>>>>>>
>>>>>>>>>> Hey Adam,
>>>>>>>>>>
>>>>>>>>>> That would be awesome. +1
>>>>>>>>>>
>>>>>>>>>> We've discussed moving the various contrib projects out of
>>>>>>>>>>Hadoop in
>>>>>>>>>> the past, and think it make sense for all the reasons you
>>>>>>>>>>mention. A
>>>>>>>>>> good example of how we've done this was done previously is
>>>>>>>>>>MRUnit,
>>>>>>>>>> now hosted at http://mrunit.apache.org.
>>>>>>>>>>
>>>>>>>>>> Next steps, if others agree then you can draft a proposal to
>>>>>>>>>>vote on.
>>>>>>>>>> See this thread and jira for an example:
>>>>>>>>>>
>>>>>>>>>>http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mb
>>>>>>>>>>ox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
>>>>>>>>>> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Eli
>>>>>>>>>>
>>>>>>>>>> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry
>>>>>>>>>><am...@yahoo-inc.com> wrote:
>>>>>>>>>>> Hello all,
>>>>>>>>>>>
>>>>>>>>>>> I'm proposing spinning out the eclipse plugin from the main
>>>>>>>>>>>hadoop source into a separate incubating project. I'm willing
>>>>>>>>>>>to commit to this effort.
>>>>>>>>>>>
>>>>>>>>>>> With a separate project, that isn't tied (source wise) to the
>>>>>>>>>>>Hadoop source we could make dev tools that could support
>>>>>>>>>>>multiple versions of Hadoop from within a single IDE, which
>>>>>>>>>>>would be very helpful when migrating jobs or dealing with
>>>>>>>>>>>clusters running different versions.
>>>>>>>>>>>
>>>>>>>>>>> The current tools seem to support the 0.20 line, and help with
>>>>>>>>>>>developing MR jobs, and also have some HDFS tools included. So
>>>>>>>>>>>the early work would be to ensure that these features were
>>>>>>>>>>>supported across the version space of Hadoop.
>>>>>>>>>>>
>>>>>>>>>>> Down the line we could also add support for additional tools
>>>>>>>>>>>such as MRUnit and other products in the Hadoop ecosystem, to
>>>>>>>>>>>eventually yield a one stop project for all dev tools around
>>>>>>>>>>>this space.
>>>>>>>>>>>
>>>>>>>>>>> If there is agreement on this, how do we go about getting it
>>>>>>>>>>>done?
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>>
>>>>>>>>>>> Adam Berry
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>>> Chris Mattmann, Ph.D.
>>>>>>>>> Senior Computer Scientist
>>>>>>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>>>>>>> Office: 171-266B, Mailstop: 171-246
>>>>>>>>> Email: chris.a.mattmann@nasa.gov
>>>>>>>>> WWW: http://sunset.usc.edu/~mattmann/
>>>>>>>>>
>>>>>>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>>> Adjunct Assistant Professor, Computer Science Department
>>>>>>>>> University of Southern California, Los Angeles, CA 90089 USA
>>>>>>>>>
>>>>>>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>
>
>
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>Chris Mattmann, Ph.D.
>Senior Computer Scientist
>NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>Office: 171-266B, Mailstop: 171-246
>Email: chris.a.mattmann@nasa.gov
>WWW: http://sunset.usc.edu/~mattmann/
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>Adjunct Assistant Professor, Computer Science Department
>University of Southern California, Los Angeles, CA 90089 USA
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
Re: Spinning out Hadoop Eclipse Tools
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hi Adam,
Thanks. One thing to note that is to be an Incubator podling mentor, the mentor needs
to be a member of the IPMC. Typically these are ASF members, but it's not a hard requirement
for them to be.
Cheers,
Chris
On Sep 28, 2012, at 3:24 PM, Adam Berry wrote:
> Awesome! Thank you Eli!
>
> And before, I did mean mentor when I said sponsor. Sponsor seems to normally be the incubator pmc.
>
> So we have three mentors, which seems to be the normal amount from digging around the incubation stuff.
>
> I realize its a big ask, but that just leaves the champion slot open.
>
> Adam
>
>
> On Sep 28, 2012, at 5:16 PM, Eli Collins wrote:
>
>> Hey Adam,
>>
>> I'd be happy to mentor as well.
>>
>> Thanks,
>> Eli
>>
>> On Fri, Sep 28, 2012 at 3:09 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>>>
>>> So at this point, I definitely have Chris and Bobby who are willing to mentor.
>>>
>>> Arun, would you be willing to be the third sponsor?
>>>
>>> And then, could one of you guys take up being the champion?
>>>
>>> Cheers,
>>> Adam
>>>
>>> On Sep 24, 2012, at 11:51 AM, Chris A Mattmann wrote:
>>>
>>>> Hi Adam,
>>>>
>>>> I'd be willing to be a mentor for the project, let me think about being the Champion :)
>>>> Either way, count me on the mentoring team!
>>>>
>>>> Cheers,
>>>> Chris
>>>>
>>>> On Sep 24, 2012, at 9:06 AM, Adam Berry wrote:
>>>>
>>>>>
>>>>> So, I've been drafting the proposal, and once I have a rough one I'll post it here for feedback before taking it to the incubation lists.
>>>>>
>>>>> I've had offers of involvement, which is also great.
>>>>>
>>>>> @Chris, would you be willing to be the champion for this project and also a mentor?
>>>>>
>>>>> @Everyone, that would leave two mentor slots left to fill, anyone else willing to throw their hat in for this? I would like to have that information in the proposal as soon as possible.
>>>>>
>>>>> Cheers,
>>>>> Adam
>>>>>
>>>>>
>>>>> On Sep 18, 2012, at 12:17 PM, Adam Berry wrote:
>>>>>
>>>>>>
>>>>>> The positive feedback is really encouraging, so thanks everyone!
>>>>>>
>>>>>> @Chris, thanks for the links, I will make a start on going through that material and preparing the proposal. Thank you for the offer of help, I'll be taking you up on that.
>>>>>>
>>>>>> Is there anyone else who is also interested in committing to this?
>>>>>>
>>>>>> Cheers,
>>>>>> Adam
>>>>>>
>>>>>> On Sep 18, 2012, at 1:03 AM, Eric Baldeschwieler wrote:
>>>>>>
>>>>>>> +1 to spinning it out and +1 for just starting to work with incubator as chris outlines.
>>>>>>>
>>>>>>> Once that is up and the code here can be removed as redundant. Folks might object to that, but I highly doubt it given this thread.
>>>>>>>
>>>>>>>
>>>>>>> On Sep 17, 2012, at 6:46 PM, "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov> wrote:
>>>>>>>
>>>>>>>> Hi Adam,
>>>>>>>>
>>>>>>>> +1 this seems like a great idea!
>>>>>>>>
>>>>>>>> Here's a guide to creating an Apache Incubator proposal:
>>>>>>>>
>>>>>>>> http://incubator.apache.org/guides/proposal.html
>>>>>>>>
>>>>>>>> You'll need 3 ASF members to be your mentors, 1 of which whom
>>>>>>>> is willing to be your Champion (the person that takes leadership
>>>>>>>> of shepherding you guys through the Incubator).
>>>>>>>>
>>>>>>>> I'm happy to help out in this effort however I can. I had a great experience
>>>>>>>> mentoring the MRUnit folks and they have done a great job!
>>>>>>>>
>>>>>>>> Cheers,
>>>>>>>> Chris
>>>>>>>>
>>>>>>>> On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:
>>>>>>>>
>>>>>>>>> Hey Adam,
>>>>>>>>>
>>>>>>>>> That would be awesome. +1
>>>>>>>>>
>>>>>>>>> We've discussed moving the various contrib projects out of Hadoop in
>>>>>>>>> the past, and think it make sense for all the reasons you mention. A
>>>>>>>>> good example of how we've done this was done previously is MRUnit,
>>>>>>>>> now hosted at http://mrunit.apache.org.
>>>>>>>>>
>>>>>>>>> Next steps, if others agree then you can draft a proposal to vote on.
>>>>>>>>> See this thread and jira for an example:
>>>>>>>>> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
>>>>>>>>> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Eli
>>>>>>>>>
>>>>>>>>> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>>>>>>>>>> Hello all,
>>>>>>>>>>
>>>>>>>>>> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>>>>>>>>>>
>>>>>>>>>> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>>>>>>>>>>
>>>>>>>>>> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>>>>>>>>>>
>>>>>>>>>> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>>>>>>>>>>
>>>>>>>>>> If there is agreement on this, how do we go about getting it done?
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>>
>>>>>>>>>> Adam Berry
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>> Chris Mattmann, Ph.D.
>>>>>>>> Senior Computer Scientist
>>>>>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>>>>>> Office: 171-266B, Mailstop: 171-246
>>>>>>>> Email: chris.a.mattmann@nasa.gov
>>>>>>>> WWW: http://sunset.usc.edu/~mattmann/
>>>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>> Adjunct Assistant Professor, Computer Science Department
>>>>>>>> University of Southern California, Los Angeles, CA 90089 USA
>>>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: Spinning out Hadoop Eclipse Tools
Posted by Adam Berry <am...@yahoo-inc.com>.
Awesome! Thank you Eli!
And before, I did mean mentor when I said sponsor. Sponsor seems to normally be the incubator pmc.
So we have three mentors, which seems to be the normal amount from digging around the incubation stuff.
I realize its a big ask, but that just leaves the champion slot open.
Adam
On Sep 28, 2012, at 5:16 PM, Eli Collins wrote:
> Hey Adam,
>
> I'd be happy to mentor as well.
>
> Thanks,
> Eli
>
> On Fri, Sep 28, 2012 at 3:09 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>>
>> So at this point, I definitely have Chris and Bobby who are willing to mentor.
>>
>> Arun, would you be willing to be the third sponsor?
>>
>> And then, could one of you guys take up being the champion?
>>
>> Cheers,
>> Adam
>>
>> On Sep 24, 2012, at 11:51 AM, Chris A Mattmann wrote:
>>
>>> Hi Adam,
>>>
>>> I'd be willing to be a mentor for the project, let me think about being the Champion :)
>>> Either way, count me on the mentoring team!
>>>
>>> Cheers,
>>> Chris
>>>
>>> On Sep 24, 2012, at 9:06 AM, Adam Berry wrote:
>>>
>>>>
>>>> So, I've been drafting the proposal, and once I have a rough one I'll post it here for feedback before taking it to the incubation lists.
>>>>
>>>> I've had offers of involvement, which is also great.
>>>>
>>>> @Chris, would you be willing to be the champion for this project and also a mentor?
>>>>
>>>> @Everyone, that would leave two mentor slots left to fill, anyone else willing to throw their hat in for this? I would like to have that information in the proposal as soon as possible.
>>>>
>>>> Cheers,
>>>> Adam
>>>>
>>>>
>>>> On Sep 18, 2012, at 12:17 PM, Adam Berry wrote:
>>>>
>>>>>
>>>>> The positive feedback is really encouraging, so thanks everyone!
>>>>>
>>>>> @Chris, thanks for the links, I will make a start on going through that material and preparing the proposal. Thank you for the offer of help, I'll be taking you up on that.
>>>>>
>>>>> Is there anyone else who is also interested in committing to this?
>>>>>
>>>>> Cheers,
>>>>> Adam
>>>>>
>>>>> On Sep 18, 2012, at 1:03 AM, Eric Baldeschwieler wrote:
>>>>>
>>>>>> +1 to spinning it out and +1 for just starting to work with incubator as chris outlines.
>>>>>>
>>>>>> Once that is up and the code here can be removed as redundant. Folks might object to that, but I highly doubt it given this thread.
>>>>>>
>>>>>>
>>>>>> On Sep 17, 2012, at 6:46 PM, "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov> wrote:
>>>>>>
>>>>>>> Hi Adam,
>>>>>>>
>>>>>>> +1 this seems like a great idea!
>>>>>>>
>>>>>>> Here's a guide to creating an Apache Incubator proposal:
>>>>>>>
>>>>>>> http://incubator.apache.org/guides/proposal.html
>>>>>>>
>>>>>>> You'll need 3 ASF members to be your mentors, 1 of which whom
>>>>>>> is willing to be your Champion (the person that takes leadership
>>>>>>> of shepherding you guys through the Incubator).
>>>>>>>
>>>>>>> I'm happy to help out in this effort however I can. I had a great experience
>>>>>>> mentoring the MRUnit folks and they have done a great job!
>>>>>>>
>>>>>>> Cheers,
>>>>>>> Chris
>>>>>>>
>>>>>>> On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:
>>>>>>>
>>>>>>>> Hey Adam,
>>>>>>>>
>>>>>>>> That would be awesome. +1
>>>>>>>>
>>>>>>>> We've discussed moving the various contrib projects out of Hadoop in
>>>>>>>> the past, and think it make sense for all the reasons you mention. A
>>>>>>>> good example of how we've done this was done previously is MRUnit,
>>>>>>>> now hosted at http://mrunit.apache.org.
>>>>>>>>
>>>>>>>> Next steps, if others agree then you can draft a proposal to vote on.
>>>>>>>> See this thread and jira for an example:
>>>>>>>> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
>>>>>>>> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Eli
>>>>>>>>
>>>>>>>> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>>>>>>>>> Hello all,
>>>>>>>>>
>>>>>>>>> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>>>>>>>>>
>>>>>>>>> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>>>>>>>>>
>>>>>>>>> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>>>>>>>>>
>>>>>>>>> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>>>>>>>>>
>>>>>>>>> If there is agreement on this, how do we go about getting it done?
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>>
>>>>>>>>> Adam Berry
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>> Chris Mattmann, Ph.D.
>>>>>>> Senior Computer Scientist
>>>>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>>>>> Office: 171-266B, Mailstop: 171-246
>>>>>>> Email: chris.a.mattmann@nasa.gov
>>>>>>> WWW: http://sunset.usc.edu/~mattmann/
>>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>> Adjunct Assistant Professor, Computer Science Department
>>>>>>> University of Southern California, Los Angeles, CA 90089 USA
>>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
Re: Spinning out Hadoop Eclipse Tools
Posted by Eli Collins <el...@cloudera.com>.
Hey Adam,
I'd be happy to mentor as well.
Thanks,
Eli
On Fri, Sep 28, 2012 at 3:09 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>
> So at this point, I definitely have Chris and Bobby who are willing to mentor.
>
> Arun, would you be willing to be the third sponsor?
>
> And then, could one of you guys take up being the champion?
>
> Cheers,
> Adam
>
> On Sep 24, 2012, at 11:51 AM, Chris A Mattmann wrote:
>
>> Hi Adam,
>>
>> I'd be willing to be a mentor for the project, let me think about being the Champion :)
>> Either way, count me on the mentoring team!
>>
>> Cheers,
>> Chris
>>
>> On Sep 24, 2012, at 9:06 AM, Adam Berry wrote:
>>
>>>
>>> So, I've been drafting the proposal, and once I have a rough one I'll post it here for feedback before taking it to the incubation lists.
>>>
>>> I've had offers of involvement, which is also great.
>>>
>>> @Chris, would you be willing to be the champion for this project and also a mentor?
>>>
>>> @Everyone, that would leave two mentor slots left to fill, anyone else willing to throw their hat in for this? I would like to have that information in the proposal as soon as possible.
>>>
>>> Cheers,
>>> Adam
>>>
>>>
>>> On Sep 18, 2012, at 12:17 PM, Adam Berry wrote:
>>>
>>>>
>>>> The positive feedback is really encouraging, so thanks everyone!
>>>>
>>>> @Chris, thanks for the links, I will make a start on going through that material and preparing the proposal. Thank you for the offer of help, I'll be taking you up on that.
>>>>
>>>> Is there anyone else who is also interested in committing to this?
>>>>
>>>> Cheers,
>>>> Adam
>>>>
>>>> On Sep 18, 2012, at 1:03 AM, Eric Baldeschwieler wrote:
>>>>
>>>>> +1 to spinning it out and +1 for just starting to work with incubator as chris outlines.
>>>>>
>>>>> Once that is up and the code here can be removed as redundant. Folks might object to that, but I highly doubt it given this thread.
>>>>>
>>>>>
>>>>> On Sep 17, 2012, at 6:46 PM, "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov> wrote:
>>>>>
>>>>>> Hi Adam,
>>>>>>
>>>>>> +1 this seems like a great idea!
>>>>>>
>>>>>> Here's a guide to creating an Apache Incubator proposal:
>>>>>>
>>>>>> http://incubator.apache.org/guides/proposal.html
>>>>>>
>>>>>> You'll need 3 ASF members to be your mentors, 1 of which whom
>>>>>> is willing to be your Champion (the person that takes leadership
>>>>>> of shepherding you guys through the Incubator).
>>>>>>
>>>>>> I'm happy to help out in this effort however I can. I had a great experience
>>>>>> mentoring the MRUnit folks and they have done a great job!
>>>>>>
>>>>>> Cheers,
>>>>>> Chris
>>>>>>
>>>>>> On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:
>>>>>>
>>>>>>> Hey Adam,
>>>>>>>
>>>>>>> That would be awesome. +1
>>>>>>>
>>>>>>> We've discussed moving the various contrib projects out of Hadoop in
>>>>>>> the past, and think it make sense for all the reasons you mention. A
>>>>>>> good example of how we've done this was done previously is MRUnit,
>>>>>>> now hosted at http://mrunit.apache.org.
>>>>>>>
>>>>>>> Next steps, if others agree then you can draft a proposal to vote on.
>>>>>>> See this thread and jira for an example:
>>>>>>> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
>>>>>>> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Eli
>>>>>>>
>>>>>>> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>>>>>>>> Hello all,
>>>>>>>>
>>>>>>>> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>>>>>>>>
>>>>>>>> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>>>>>>>>
>>>>>>>> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>>>>>>>>
>>>>>>>> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>>>>>>>>
>>>>>>>> If there is agreement on this, how do we go about getting it done?
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>>
>>>>>>>> Adam Berry
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>> Chris Mattmann, Ph.D.
>>>>>> Senior Computer Scientist
>>>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>>>> Office: 171-266B, Mailstop: 171-246
>>>>>> Email: chris.a.mattmann@nasa.gov
>>>>>> WWW: http://sunset.usc.edu/~mattmann/
>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>> Adjunct Assistant Professor, Computer Science Department
>>>>>> University of Southern California, Los Angeles, CA 90089 USA
>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: Spinning out Hadoop Eclipse Tools
Posted by Adam Berry <am...@yahoo-inc.com>.
So at this point, I definitely have Chris and Bobby who are willing to mentor.
Arun, would you be willing to be the third sponsor?
And then, could one of you guys take up being the champion?
Cheers,
Adam
On Sep 24, 2012, at 11:51 AM, Chris A Mattmann wrote:
> Hi Adam,
>
> I'd be willing to be a mentor for the project, let me think about being the Champion :)
> Either way, count me on the mentoring team!
>
> Cheers,
> Chris
>
> On Sep 24, 2012, at 9:06 AM, Adam Berry wrote:
>
>>
>> So, I've been drafting the proposal, and once I have a rough one I'll post it here for feedback before taking it to the incubation lists.
>>
>> I've had offers of involvement, which is also great.
>>
>> @Chris, would you be willing to be the champion for this project and also a mentor?
>>
>> @Everyone, that would leave two mentor slots left to fill, anyone else willing to throw their hat in for this? I would like to have that information in the proposal as soon as possible.
>>
>> Cheers,
>> Adam
>>
>>
>> On Sep 18, 2012, at 12:17 PM, Adam Berry wrote:
>>
>>>
>>> The positive feedback is really encouraging, so thanks everyone!
>>>
>>> @Chris, thanks for the links, I will make a start on going through that material and preparing the proposal. Thank you for the offer of help, I'll be taking you up on that.
>>>
>>> Is there anyone else who is also interested in committing to this?
>>>
>>> Cheers,
>>> Adam
>>>
>>> On Sep 18, 2012, at 1:03 AM, Eric Baldeschwieler wrote:
>>>
>>>> +1 to spinning it out and +1 for just starting to work with incubator as chris outlines.
>>>>
>>>> Once that is up and the code here can be removed as redundant. Folks might object to that, but I highly doubt it given this thread.
>>>>
>>>>
>>>> On Sep 17, 2012, at 6:46 PM, "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov> wrote:
>>>>
>>>>> Hi Adam,
>>>>>
>>>>> +1 this seems like a great idea!
>>>>>
>>>>> Here's a guide to creating an Apache Incubator proposal:
>>>>>
>>>>> http://incubator.apache.org/guides/proposal.html
>>>>>
>>>>> You'll need 3 ASF members to be your mentors, 1 of which whom
>>>>> is willing to be your Champion (the person that takes leadership
>>>>> of shepherding you guys through the Incubator).
>>>>>
>>>>> I'm happy to help out in this effort however I can. I had a great experience
>>>>> mentoring the MRUnit folks and they have done a great job!
>>>>>
>>>>> Cheers,
>>>>> Chris
>>>>>
>>>>> On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:
>>>>>
>>>>>> Hey Adam,
>>>>>>
>>>>>> That would be awesome. +1
>>>>>>
>>>>>> We've discussed moving the various contrib projects out of Hadoop in
>>>>>> the past, and think it make sense for all the reasons you mention. A
>>>>>> good example of how we've done this was done previously is MRUnit,
>>>>>> now hosted at http://mrunit.apache.org.
>>>>>>
>>>>>> Next steps, if others agree then you can draft a proposal to vote on.
>>>>>> See this thread and jira for an example:
>>>>>> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
>>>>>> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>>>>>>
>>>>>> Thanks,
>>>>>> Eli
>>>>>>
>>>>>> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>>>>>>> Hello all,
>>>>>>>
>>>>>>> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>>>>>>>
>>>>>>> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>>>>>>>
>>>>>>> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>>>>>>>
>>>>>>> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>>>>>>>
>>>>>>> If there is agreement on this, how do we go about getting it done?
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> Adam Berry
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>> Chris Mattmann, Ph.D.
>>>>> Senior Computer Scientist
>>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>>> Office: 171-266B, Mailstop: 171-246
>>>>> Email: chris.a.mattmann@nasa.gov
>>>>> WWW: http://sunset.usc.edu/~mattmann/
>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>> Adjunct Assistant Professor, Computer Science Department
>>>>> University of Southern California, Los Angeles, CA 90089 USA
>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>
>>>>
>>>
>>
>
Re: Spinning out Hadoop Eclipse Tools
Posted by Chris A Mattmann <ch...@gmail.com>.
Hi Adam,
I'd be willing to be a mentor for the project, let me think about being the Champion :)
Either way, count me on the mentoring team!
Cheers,
Chris
On Sep 24, 2012, at 9:06 AM, Adam Berry wrote:
>
> So, I've been drafting the proposal, and once I have a rough one I'll post it here for feedback before taking it to the incubation lists.
>
> I've had offers of involvement, which is also great.
>
> @Chris, would you be willing to be the champion for this project and also a mentor?
>
> @Everyone, that would leave two mentor slots left to fill, anyone else willing to throw their hat in for this? I would like to have that information in the proposal as soon as possible.
>
> Cheers,
> Adam
>
>
> On Sep 18, 2012, at 12:17 PM, Adam Berry wrote:
>
>>
>> The positive feedback is really encouraging, so thanks everyone!
>>
>> @Chris, thanks for the links, I will make a start on going through that material and preparing the proposal. Thank you for the offer of help, I'll be taking you up on that.
>>
>> Is there anyone else who is also interested in committing to this?
>>
>> Cheers,
>> Adam
>>
>> On Sep 18, 2012, at 1:03 AM, Eric Baldeschwieler wrote:
>>
>>> +1 to spinning it out and +1 for just starting to work with incubator as chris outlines.
>>>
>>> Once that is up and the code here can be removed as redundant. Folks might object to that, but I highly doubt it given this thread.
>>>
>>>
>>> On Sep 17, 2012, at 6:46 PM, "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov> wrote:
>>>
>>>> Hi Adam,
>>>>
>>>> +1 this seems like a great idea!
>>>>
>>>> Here's a guide to creating an Apache Incubator proposal:
>>>>
>>>> http://incubator.apache.org/guides/proposal.html
>>>>
>>>> You'll need 3 ASF members to be your mentors, 1 of which whom
>>>> is willing to be your Champion (the person that takes leadership
>>>> of shepherding you guys through the Incubator).
>>>>
>>>> I'm happy to help out in this effort however I can. I had a great experience
>>>> mentoring the MRUnit folks and they have done a great job!
>>>>
>>>> Cheers,
>>>> Chris
>>>>
>>>> On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:
>>>>
>>>>> Hey Adam,
>>>>>
>>>>> That would be awesome. +1
>>>>>
>>>>> We've discussed moving the various contrib projects out of Hadoop in
>>>>> the past, and think it make sense for all the reasons you mention. A
>>>>> good example of how we've done this was done previously is MRUnit,
>>>>> now hosted at http://mrunit.apache.org.
>>>>>
>>>>> Next steps, if others agree then you can draft a proposal to vote on.
>>>>> See this thread and jira for an example:
>>>>> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
>>>>> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>>>>>
>>>>> Thanks,
>>>>> Eli
>>>>>
>>>>> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>>>>>> Hello all,
>>>>>>
>>>>>> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>>>>>>
>>>>>> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>>>>>>
>>>>>> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>>>>>>
>>>>>> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>>>>>>
>>>>>> If there is agreement on this, how do we go about getting it done?
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Adam Berry
>>>>
>>>>
>>>>
>>>>
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>> Chris Mattmann, Ph.D.
>>>> Senior Computer Scientist
>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>> Office: 171-266B, Mailstop: 171-246
>>>> Email: chris.a.mattmann@nasa.gov
>>>> WWW: http://sunset.usc.edu/~mattmann/
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>> Adjunct Assistant Professor, Computer Science Department
>>>> University of Southern California, Los Angeles, CA 90089 USA
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>
>>>
>>
>
Re: Spinning out Hadoop Eclipse Tools
Posted by Adam Berry <am...@yahoo-inc.com>.
So, I've been drafting the proposal, and once I have a rough one I'll post it here for feedback before taking it to the incubation lists.
I've had offers of involvement, which is also great.
@Chris, would you be willing to be the champion for this project and also a mentor?
@Everyone, that would leave two mentor slots left to fill, anyone else willing to throw their hat in for this? I would like to have that information in the proposal as soon as possible.
Cheers,
Adam
On Sep 18, 2012, at 12:17 PM, Adam Berry wrote:
>
> The positive feedback is really encouraging, so thanks everyone!
>
> @Chris, thanks for the links, I will make a start on going through that material and preparing the proposal. Thank you for the offer of help, I'll be taking you up on that.
>
> Is there anyone else who is also interested in committing to this?
>
> Cheers,
> Adam
>
> On Sep 18, 2012, at 1:03 AM, Eric Baldeschwieler wrote:
>
>> +1 to spinning it out and +1 for just starting to work with incubator as chris outlines.
>>
>> Once that is up and the code here can be removed as redundant. Folks might object to that, but I highly doubt it given this thread.
>>
>>
>> On Sep 17, 2012, at 6:46 PM, "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov> wrote:
>>
>>> Hi Adam,
>>>
>>> +1 this seems like a great idea!
>>>
>>> Here's a guide to creating an Apache Incubator proposal:
>>>
>>> http://incubator.apache.org/guides/proposal.html
>>>
>>> You'll need 3 ASF members to be your mentors, 1 of which whom
>>> is willing to be your Champion (the person that takes leadership
>>> of shepherding you guys through the Incubator).
>>>
>>> I'm happy to help out in this effort however I can. I had a great experience
>>> mentoring the MRUnit folks and they have done a great job!
>>>
>>> Cheers,
>>> Chris
>>>
>>> On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:
>>>
>>>> Hey Adam,
>>>>
>>>> That would be awesome. +1
>>>>
>>>> We've discussed moving the various contrib projects out of Hadoop in
>>>> the past, and think it make sense for all the reasons you mention. A
>>>> good example of how we've done this was done previously is MRUnit,
>>>> now hosted at http://mrunit.apache.org.
>>>>
>>>> Next steps, if others agree then you can draft a proposal to vote on.
>>>> See this thread and jira for an example:
>>>> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
>>>> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>>>>
>>>> Thanks,
>>>> Eli
>>>>
>>>> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>>>>> Hello all,
>>>>>
>>>>> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>>>>>
>>>>> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>>>>>
>>>>> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>>>>>
>>>>> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>>>>>
>>>>> If there is agreement on this, how do we go about getting it done?
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Adam Berry
>>>
>>>
>>>
>>>
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Chris Mattmann, Ph.D.
>>> Senior Computer Scientist
>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>> Office: 171-266B, Mailstop: 171-246
>>> Email: chris.a.mattmann@nasa.gov
>>> WWW: http://sunset.usc.edu/~mattmann/
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Adjunct Assistant Professor, Computer Science Department
>>> University of Southern California, Los Angeles, CA 90089 USA
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>
>>
>
Re: Spinning out Hadoop Eclipse Tools
Posted by Jeffrey Zemerick <je...@mtnfog.com>.
+1 Good idea!
I'm interested in helping to commit more to the project.
Jeff
On Tue, Sep 18, 2012 at 1:17 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>
> The positive feedback is really encouraging, so thanks everyone!
>
> @Chris, thanks for the links, I will make a start on going through that
> material and preparing the proposal. Thank you for the offer of help, I'll
> be taking you up on that.
>
> Is there anyone else who is also interested in committing to this?
>
> Cheers,
> Adam
>
> On Sep 18, 2012, at 1:03 AM, Eric Baldeschwieler wrote:
>
> > +1 to spinning it out and +1 for just starting to work with incubator as
> chris outlines.
> >
> > Once that is up and the code here can be removed as redundant. Folks
> might object to that, but I highly doubt it given this thread.
> >
> >
> > On Sep 17, 2012, at 6:46 PM, "Mattmann, Chris A (388J)" <
> chris.a.mattmann@jpl.nasa.gov> wrote:
> >
> >> Hi Adam,
> >>
> >> +1 this seems like a great idea!
> >>
> >> Here's a guide to creating an Apache Incubator proposal:
> >>
> >> http://incubator.apache.org/guides/proposal.html
> >>
> >> You'll need 3 ASF members to be your mentors, 1 of which whom
> >> is willing to be your Champion (the person that takes leadership
> >> of shepherding you guys through the Incubator).
> >>
> >> I'm happy to help out in this effort however I can. I had a great
> experience
> >> mentoring the MRUnit folks and they have done a great job!
> >>
> >> Cheers,
> >> Chris
> >>
> >> On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:
> >>
> >>> Hey Adam,
> >>>
> >>> That would be awesome. +1
> >>>
> >>> We've discussed moving the various contrib projects out of Hadoop in
> >>> the past, and think it make sense for all the reasons you mention. A
> >>> good example of how we've done this was done previously is MRUnit,
> >>> now hosted at http://mrunit.apache.org.
> >>>
> >>> Next steps, if others agree then you can draft a proposal to vote on.
> >>> See this thread and jira for an example:
> >>>
> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
> >>> https://issues.apache.org/jira/browse/MAPREDUCE-2430
> >>>
> >>> Thanks,
> >>> Eli
> >>>
> >>> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com>
> wrote:
> >>>> Hello all,
> >>>>
> >>>> I'm proposing spinning out the eclipse plugin from the main hadoop
> source into a separate incubating project. I'm willing to commit to this
> effort.
> >>>>
> >>>> With a separate project, that isn't tied (source wise) to the Hadoop
> source we could make dev tools that could support multiple versions of
> Hadoop from within a single IDE, which would be very helpful when migrating
> jobs or dealing with clusters running different versions.
> >>>>
> >>>> The current tools seem to support the 0.20 line, and help with
> developing MR jobs, and also have some HDFS tools included. So the early
> work would be to ensure that these features were supported across the
> version space of Hadoop.
> >>>>
> >>>> Down the line we could also add support for additional tools such as
> MRUnit and other products in the Hadoop ecosystem, to eventually yield a
> one stop project for all dev tools around this space.
> >>>>
> >>>> If there is agreement on this, how do we go about getting it done?
> >>>>
> >>>> Thanks,
> >>>>
> >>>> Adam Berry
> >>
> >>
> >>
> >>
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Chris Mattmann, Ph.D.
> >> Senior Computer Scientist
> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> Office: 171-266B, Mailstop: 171-246
> >> Email: chris.a.mattmann@nasa.gov
> >> WWW: http://sunset.usc.edu/~mattmann/
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Adjunct Assistant Professor, Computer Science Department
> >> University of Southern California, Los Angeles, CA 90089 USA
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>
> >
>
>
Re: Spinning out Hadoop Eclipse Tools
Posted by Adam Berry <am...@yahoo-inc.com>.
The positive feedback is really encouraging, so thanks everyone!
@Chris, thanks for the links, I will make a start on going through that material and preparing the proposal. Thank you for the offer of help, I'll be taking you up on that.
Is there anyone else who is also interested in committing to this?
Cheers,
Adam
On Sep 18, 2012, at 1:03 AM, Eric Baldeschwieler wrote:
> +1 to spinning it out and +1 for just starting to work with incubator as chris outlines.
>
> Once that is up and the code here can be removed as redundant. Folks might object to that, but I highly doubt it given this thread.
>
>
> On Sep 17, 2012, at 6:46 PM, "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov> wrote:
>
>> Hi Adam,
>>
>> +1 this seems like a great idea!
>>
>> Here's a guide to creating an Apache Incubator proposal:
>>
>> http://incubator.apache.org/guides/proposal.html
>>
>> You'll need 3 ASF members to be your mentors, 1 of which whom
>> is willing to be your Champion (the person that takes leadership
>> of shepherding you guys through the Incubator).
>>
>> I'm happy to help out in this effort however I can. I had a great experience
>> mentoring the MRUnit folks and they have done a great job!
>>
>> Cheers,
>> Chris
>>
>> On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:
>>
>>> Hey Adam,
>>>
>>> That would be awesome. +1
>>>
>>> We've discussed moving the various contrib projects out of Hadoop in
>>> the past, and think it make sense for all the reasons you mention. A
>>> good example of how we've done this was done previously is MRUnit,
>>> now hosted at http://mrunit.apache.org.
>>>
>>> Next steps, if others agree then you can draft a proposal to vote on.
>>> See this thread and jira for an example:
>>> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
>>> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>>>
>>> Thanks,
>>> Eli
>>>
>>> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>>>> Hello all,
>>>>
>>>> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>>>>
>>>> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>>>>
>>>> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>>>>
>>>> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>>>>
>>>> If there is agreement on this, how do we go about getting it done?
>>>>
>>>> Thanks,
>>>>
>>>> Adam Berry
>>
>>
>>
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov
>> WWW: http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>
Re: Spinning out Hadoop Eclipse Tools
Posted by Eric Baldeschwieler <er...@hortonworks.com>.
+1 to spinning it out and +1 for just starting to work with incubator as chris outlines.
Once that is up and the code here can be removed as redundant. Folks might object to that, but I highly doubt it given this thread.
On Sep 17, 2012, at 6:46 PM, "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov> wrote:
> Hi Adam,
>
> +1 this seems like a great idea!
>
> Here's a guide to creating an Apache Incubator proposal:
>
> http://incubator.apache.org/guides/proposal.html
>
> You'll need 3 ASF members to be your mentors, 1 of which whom
> is willing to be your Champion (the person that takes leadership
> of shepherding you guys through the Incubator).
>
> I'm happy to help out in this effort however I can. I had a great experience
> mentoring the MRUnit folks and they have done a great job!
>
> Cheers,
> Chris
>
> On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:
>
>> Hey Adam,
>>
>> That would be awesome. +1
>>
>> We've discussed moving the various contrib projects out of Hadoop in
>> the past, and think it make sense for all the reasons you mention. A
>> good example of how we've done this was done previously is MRUnit,
>> now hosted at http://mrunit.apache.org.
>>
>> Next steps, if others agree then you can draft a proposal to vote on.
>> See this thread and jira for an example:
>> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
>> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>>
>> Thanks,
>> Eli
>>
>> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>>> Hello all,
>>>
>>> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>>>
>>> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>>>
>>> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>>>
>>> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>>>
>>> If there is agreement on this, how do we go about getting it done?
>>>
>>> Thanks,
>>>
>>> Adam Berry
>
>
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
Re: Spinning out Hadoop Eclipse Tools
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hi Adam,
+1 this seems like a great idea!
Here's a guide to creating an Apache Incubator proposal:
http://incubator.apache.org/guides/proposal.html
You'll need 3 ASF members to be your mentors, 1 of which whom
is willing to be your Champion (the person that takes leadership
of shepherding you guys through the Incubator).
I'm happy to help out in this effort however I can. I had a great experience
mentoring the MRUnit folks and they have done a great job!
Cheers,
Chris
On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:
> Hey Adam,
>
> That would be awesome. +1
>
> We've discussed moving the various contrib projects out of Hadoop in
> the past, and think it make sense for all the reasons you mention. A
> good example of how we've done this was done previously is MRUnit,
> now hosted at http://mrunit.apache.org.
>
> Next steps, if others agree then you can draft a proposal to vote on.
> See this thread and jira for an example:
> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>
> Thanks,
> Eli
>
> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>> Hello all,
>>
>> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>>
>> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>>
>> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>>
>> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>>
>> If there is agreement on this, how do we go about getting it done?
>>
>> Thanks,
>>
>> Adam Berry
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: Spinning out Hadoop Eclipse Tools
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hi Guys,
Also just to note, it's not absolutely required to VOTE to fork
the Eclipse Tools into a new project within the Incubator, but
it's a nice gesture to show community support.
Just wanted to mention that, for completeness.
Cheers,
Chris
On Sep 17, 2012, at 12:42 PM, Eli Collins wrote:
> Hey Adam,
>
> That would be awesome. +1
>
> We've discussed moving the various contrib projects out of Hadoop in
> the past, and think it make sense for all the reasons you mention. A
> good example of how we've done this was done previously is MRUnit,
> now hosted at http://mrunit.apache.org.
>
> Next steps, if others agree then you can draft a proposal to vote on.
> See this thread and jira for an example:
> http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
> https://issues.apache.org/jira/browse/MAPREDUCE-2430
>
> Thanks,
> Eli
>
> On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com> wrote:
>> Hello all,
>>
>> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>>
>> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>>
>> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>>
>> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>>
>> If there is agreement on this, how do we go about getting it done?
>>
>> Thanks,
>>
>> Adam Berry
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: Spinning out Hadoop Eclipse Tools
Posted by Robert Evans <ev...@yahoo-inc.com>.
I am +1 on this too. I would love to see better tool support for Hadoop.
--Bobby
On 9/17/12 2:42 PM, "Eli Collins" <el...@cloudera.com> wrote:
>Hey Adam,
>
>That would be awesome. +1
>
>We've discussed moving the various contrib projects out of Hadoop in
>the past, and think it make sense for all the reasons you mention. A
>good example of how we've done this was done previously is MRUnit,
>now hosted at http://mrunit.apache.org.
>
>Next steps, if others agree then you can draft a proposal to vote on.
>See this thread and jira for an example:
>http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C774
>05974-6771-4604-926B-976240743F3C@mac.com%3E
>https://issues.apache.org/jira/browse/MAPREDUCE-2430
>
>Thanks,
>Eli
>
>On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com>
>wrote:
>> Hello all,
>>
>> I'm proposing spinning out the eclipse plugin from the main hadoop
>>source into a separate incubating project. I'm willing to commit to this
>>effort.
>>
>> With a separate project, that isn't tied (source wise) to the Hadoop
>>source we could make dev tools that could support multiple versions of
>>Hadoop from within a single IDE, which would be very helpful when
>>migrating jobs or dealing with clusters running different versions.
>>
>> The current tools seem to support the 0.20 line, and help with
>>developing MR jobs, and also have some HDFS tools included. So the early
>>work would be to ensure that these features were supported across the
>>version space of Hadoop.
>>
>> Down the line we could also add support for additional tools such as
>>MRUnit and other products in the Hadoop ecosystem, to eventually yield a
>>one stop project for all dev tools around this space.
>>
>> If there is agreement on this, how do we go about getting it done?
>>
>> Thanks,
>>
>> Adam Berry
Re: Spinning out Hadoop Eclipse Tools
Posted by Eli Collins <el...@cloudera.com>.
Hey Adam,
That would be awesome. +1
We've discussed moving the various contrib projects out of Hadoop in
the past, and think it make sense for all the reasons you mention. A
good example of how we've done this was done previously is MRUnit,
now hosted at http://mrunit.apache.org.
Next steps, if others agree then you can draft a proposal to vote on.
See this thread and jira for an example:
http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3C77405974-6771-4604-926B-976240743F3C@mac.com%3E
https://issues.apache.org/jira/browse/MAPREDUCE-2430
Thanks,
Eli
On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <am...@yahoo-inc.com> wrote:
> Hello all,
>
> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>
> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>
> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>
> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>
> If there is agreement on this, how do we go about getting it done?
>
> Thanks,
>
> Adam Berry
Re: Spinning out Hadoop Eclipse Tools
Posted by Harsh J <ha...@cloudera.com>.
+1, could be much more maintainable this way. Also, we may name the
project non-IDE specific, if we may be adding support for other IDEs
as well (over time).
On Tue, Sep 18, 2012 at 1:04 AM, Adam Berry <am...@yahoo-inc.com> wrote:
> Hello all,
>
> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>
> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>
> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>
> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>
> If there is agreement on this, how do we go about getting it done?
>
> Thanks,
>
> Adam Berry
--
Harsh J
Re: Spinning out Hadoop Eclipse Tools
Posted by Arun C Murthy <ac...@hortonworks.com>.
I think this is a great idea! +1!
It would be great to find a home and community willing to take this forward... I'm assuming others would like to see the same.
We could start a vote to formalize this if necessary.
thanks,
Arun
On Sep 17, 2012, at 12:34 PM, Adam Berry wrote:
> Hello all,
>
> I'm proposing spinning out the eclipse plugin from the main hadoop source into a separate incubating project. I'm willing to commit to this effort.
>
> With a separate project, that isn't tied (source wise) to the Hadoop source we could make dev tools that could support multiple versions of Hadoop from within a single IDE, which would be very helpful when migrating jobs or dealing with clusters running different versions.
>
> The current tools seem to support the 0.20 line, and help with developing MR jobs, and also have some HDFS tools included. So the early work would be to ensure that these features were supported across the version space of Hadoop.
>
> Down the line we could also add support for additional tools such as MRUnit and other products in the Hadoop ecosystem, to eventually yield a one stop project for all dev tools around this space.
>
> If there is agreement on this, how do we go about getting it done?
>
> Thanks,
>
> Adam Berry