You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by Lewis John Mcgibbney <le...@gmail.com> on 2015/02/04 23:42:22 UTC
GSoC 2015
Hi Folks,
Does anyone have any good ideas for GSoC?
Seb mentioned moving Nutch towards Spark so potentially a pluggable runtime
execution engine abstraction?
I am currently working on a lot of security and authentication related work
so I would possibly be tempted to overhaul and improve that aspect of Nutch.
Any other ideas?
Thanks folks
Lewis
--
*Lewis*
Re: GSoC 2015
Posted by Alfonso Nishikawa <al...@gmail.com>.
Hi!
How about the forgotten gora-sql?
Alfonso Nishikawa
2015-02-07 5:20 GMT-01:00 Mattmann, Chris A (3980) <
chris.a.mattmann@jpl.nasa.gov>:
> I am very much for figuring out how to do a Nutch + Spark - +1!
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Chief Architect
> Instrument Software and Science Data Systems Section (398)
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 168-519, Mailstop: 168-527
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Associate Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
>
>
>
>
> -----Original Message-----
> From: Lewis John Mcgibbney <le...@gmail.com>
> Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> Date: Wednesday, February 4, 2015 at 2:42 PM
> To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> Subject: GSoC 2015
>
> >Hi Folks,
> >
> >Does anyone have any good ideas for GSoC?
> >
> >Seb mentioned moving Nutch towards Spark so potentially a pluggable
> >runtime execution engine abstraction?
> >
> >I am currently working on a lot of security and authentication related
> >work so I would possibly be tempted to overhaul and improve that aspect
> >of Nutch.
> >
> >Any other ideas?
> >
> >Thanks folks
> >Lewis
> >
> >--
> >Lewis
> >
> >
> >
> >
> >
> >
> >
> >
>
>
Re: GSoC 2015
Posted by "Mattmann, Chris A (3980)" <ch...@jpl.nasa.gov>.
I am very much for figuring out how to do a Nutch + Spark - +1!
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Chief Architect
Instrument Software and Science Data Systems Section (398)
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 168-519, Mailstop: 168-527
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Associate Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
-----Original Message-----
From: Lewis John Mcgibbney <le...@gmail.com>
Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
Date: Wednesday, February 4, 2015 at 2:42 PM
To: "dev@nutch.apache.org" <de...@nutch.apache.org>
Subject: GSoC 2015
>Hi Folks,
>
>Does anyone have any good ideas for GSoC?
>
>Seb mentioned moving Nutch towards Spark so potentially a pluggable
>runtime execution engine abstraction?
>
>I am currently working on a lot of security and authentication related
>work so I would possibly be tempted to overhaul and improve that aspect
>of Nutch.
>
>Any other ideas?
>
>Thanks folks
>Lewis
>
>--
>Lewis
>
>
>
>
>
>
>
>
Re: GSoC 2015
Posted by feng lu <am...@gmail.com>.
Nutch 1.x also need to upgrade to Hadoop 2.x or just Nutch 2.x
On Fri, Feb 6, 2015 at 3:40 PM, Talat Uyarer <ta...@uyarer.com> wrote:
> Hi Folks,
>
> Hadoop 2 support is ready for Nutch 2.x. I just wait Gora 0.6. My ideas,
>
> Sitemap, Jsoup (HTML5 parser) , RDF Microformats Supports would be good.
>
> Talat
>
>
> 2015-02-05 13:03 GMT+02:00 Markus Jelsma <ma...@openindex.io>:
> > Well, Hadoop 2.x sounds right indeed!
> >
> > -----Original message-----
> > From: Julien Nioche<li...@gmail.com>
> > Sent: Thursday 5th February 2015 1:34
> > To: dev@nutch.apache.org
> > Subject: Re: GSoC 2015
> >
> > Moving to Hadoop 2.x ?
> >
> > On 4 February 2015 at 14:42, Lewis John Mcgibbney <
> lewis.mcgibbney@gmail.com <ma...@gmail.com>> wrote:
> >
> > Hi Folks,
> >
> > Does anyone have any good ideas for GSoC?
> >
> > Seb mentioned moving Nutch towards Spark so potentially a pluggable
> runtime execution engine abstraction?
> >
> > I am currently working on a lot of security and authentication related
> work so I would possibly be tempted to overhaul and improve that aspect of
> Nutch.
> >
> > Any other ideas?
> >
> > Thanks folks
> > Lewis
> >
> > --
> >
> > Lewis
> >
> > --
> >
> > Open Source Solutions for Text Engineering
> >
> > http://digitalpebble.blogspot.com/ <http://digitalpebble.blogspot.com/>
> http://www.digitalpebble.com <http://www.digitalpebble.com>
> > http://twitter.com/digitalpebble <http://twitter.com/digitalpebble>
> >
> >
>
>
>
> --
> Talat UYARER
> Websitesi: http://talat.uyarer.com
> Twitter: http://twitter.com/talatuyarer
> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>
--
Don't Grow Old, Grow Up... :-)
Re: GSoC 2015
Posted by Talat Uyarer <ta...@uyarer.com>.
Hi Folks,
Hadoop 2 support is ready for Nutch 2.x. I just wait Gora 0.6. My ideas,
Sitemap, Jsoup (HTML5 parser) , RDF Microformats Supports would be good.
Talat
2015-02-05 13:03 GMT+02:00 Markus Jelsma <ma...@openindex.io>:
> Well, Hadoop 2.x sounds right indeed!
>
> -----Original message-----
> From: Julien Nioche<li...@gmail.com>
> Sent: Thursday 5th February 2015 1:34
> To: dev@nutch.apache.org
> Subject: Re: GSoC 2015
>
> Moving to Hadoop 2.x ?
>
> On 4 February 2015 at 14:42, Lewis John Mcgibbney <lewis.mcgibbney@gmail.com <ma...@gmail.com>> wrote:
>
> Hi Folks,
>
> Does anyone have any good ideas for GSoC?
>
> Seb mentioned moving Nutch towards Spark so potentially a pluggable runtime execution engine abstraction?
>
> I am currently working on a lot of security and authentication related work so I would possibly be tempted to overhaul and improve that aspect of Nutch.
>
> Any other ideas?
>
> Thanks folks
> Lewis
>
> --
>
> Lewis
>
> --
>
> Open Source Solutions for Text Engineering
>
> http://digitalpebble.blogspot.com/ <http://digitalpebble.blogspot.com/>http://www.digitalpebble.com <http://www.digitalpebble.com>
> http://twitter.com/digitalpebble <http://twitter.com/digitalpebble>
>
>
--
Talat UYARER
Websitesi: http://talat.uyarer.com
Twitter: http://twitter.com/talatuyarer
Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
RE: GSoC 2015
Posted by Markus Jelsma <ma...@openindex.io>.
Well, Hadoop 2.x sounds right indeed!
-----Original message-----
From: Julien Nioche<li...@gmail.com>
Sent: Thursday 5th February 2015 1:34
To: dev@nutch.apache.org
Subject: Re: GSoC 2015
Moving to Hadoop 2.x ?
On 4 February 2015 at 14:42, Lewis John Mcgibbney <lewis.mcgibbney@gmail.com <ma...@gmail.com>> wrote:
Hi Folks,
Does anyone have any good ideas for GSoC?
Seb mentioned moving Nutch towards Spark so potentially a pluggable runtime execution engine abstraction?
I am currently working on a lot of security and authentication related work so I would possibly be tempted to overhaul and improve that aspect of Nutch.
Any other ideas?
Thanks folks
Lewis
--
Lewis
--
Open Source Solutions for Text Engineering
http://digitalpebble.blogspot.com/ <http://digitalpebble.blogspot.com/>http://www.digitalpebble.com <http://www.digitalpebble.com>
http://twitter.com/digitalpebble <http://twitter.com/digitalpebble>
Re: GSoC 2015
Posted by Julien Nioche <li...@gmail.com>.
Moving to Hadoop 2.x ?
On 4 February 2015 at 14:42, Lewis John Mcgibbney <lewis.mcgibbney@gmail.com
> wrote:
> Hi Folks,
> Does anyone have any good ideas for GSoC?
> Seb mentioned moving Nutch towards Spark so potentially a pluggable
> runtime execution engine abstraction?
> I am currently working on a lot of security and authentication related
> work so I would possibly be tempted to overhaul and improve that aspect of
> Nutch.
> Any other ideas?
> Thanks folks
> Lewis
>
> --
> *Lewis*
>
--
Open Source Solutions for Text Engineering
http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble
Re: GSoC 2015
Posted by Aditya Dhulipala <ad...@usc.edu>.
Hi Lewis,
Thanks for the info!
I've been looking at the code you've posted above and trying to get a sense
of what it does.
I'm looking through the imports and I found some schema definitions in
XmlStructFactory & XmlRpcStructFactory make this suitable for transfer
over xml-rpc.
My guess is that this project would be to write .avpr files (Avro files)
that define these file manager structs & then replace all the xml-rpc
(XmlStructFactory & XmlRpcStructFactory) with Avro specific implementations
like this
https://github.com/phunt/avro-rpc-quickstart
I understand what Avro is and how its better than xmlrpc for performance
reasons. I'm interested in reading more about this topic. And in particular
how it affects various components of OODT.
Can you point me in the right direction?
Thanks!
--
Aditya
On Mon, Feb 9, 2015 at 11:27 AM, Lewis John Mcgibbney <
lewis.mcgibbney@gmail.com> wrote:
> Hi Aditya,
> I would suggest that you get to grips with the XmlRpcFileManager [0] to
> begin with within the FileMgr component.
> Is anyone aware of existing documentation for the XMLRPC implementations
> within FileMgr right now?
> Thanks
> Lewis
>
> [0]
>
> https://github.com/apache/oodt/blob/trunk/filemgr/src/main/java/org/apache/oodt/cas/filemgr/system/XmlRpcFileManager.java
>
> On Mon, Feb 9, 2015 at 10:50 AM, Aditya Dhulipala <ad...@usc.edu>
> wrote:
>
> > Hi Lewis,
> >
> > I just read your email about OODT's RPC revamp. I've been reading up on
> > Avro, Thrift and Proto buffers and I'm interested in that area.
> >
> > But I dont really have a guru level understanding of the subject. Can you
> > point me to some documentation on the issue?
> >
> > https://cwiki.apache.org/confluence/display/OODT/Apache+OODT+APIs
> > I found this at the OODT wiki page. But it doesn't really have much info
> > other than these links to the source code.
> >
> > Thanks!
> >
> > --
> > Aditya
> >
> >
> >
> > adi
> >
> > On Mon, Feb 9, 2015 at 9:45 AM, Lewis John Mcgibbney <
> > lewis.mcgibbney@gmail.com> wrote:
> >
> > > Hi Valerie,
> > > Sorry for that
> > > https://www.google-melange.com/gsoc/homepage/google/gsoc2015
> > > "Google Summer of Code is a global program that offers students
> stipends
> > to
> > > write code for open source projects. We have worked with the open
> source
> > > community to identify and fund exciting projects for the upcoming
> > summer."
> > >
> > > On Mon, Feb 9, 2015 at 9:07 AM, Mallder, Valerie <
> > > Valerie.Mallder@jhuapl.edu
> > > > wrote:
> > >
> > > > Since I don't know what GSoC is, I have no good ideas :)
> > > >
> > > >
> > > > Valerie A. Mallder
> > > > New Horizons Deputy Mission System Engineer
> > > > Johns Hopkins University/Applied Physics Laboratory
> > > >
> > > >
> > > > > -----Original Message-----
> > > > > From: Mattmann, Chris A (3980) [mailto:
> chris.a.mattmann@jpl.nasa.gov
> > ]
> > > > > Sent: Saturday, February 07, 2015 1:21 AM
> > > > > To: dev@oodt.apache.org
> > > > > Subject: FW: GSoC 2015
> > > > >
> > > > > We should be thinking about GSoC on OODT, any ideas?
> > > > >
> > > > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > > > +++++
> > > > > Chris Mattmann, Ph.D.
> > > > > Chief Architect
> > > > > Instrument Software and Science Data Systems Section (398) NASA Jet
> > > > > Propulsion Laboratory Pasadena, CA 91109 USA
> > > > > Office: 168-519, Mailstop: 168-527
> > > > > Email: chris.a.mattmann@nasa.gov
> > > > > WWW: http://sunset.usc.edu/~mattmann/
> > > > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > > > +++++
> > > > > Adjunct Associate Professor, Computer Science Department University
> > of
> > > > > Southern California, Los Angeles, CA 90089 USA
> > > > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > > > +++++
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Lewis John Mcgibbney <le...@gmail.com>
> > > > > Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> > > > > Date: Wednesday, February 4, 2015 at 2:42 PM
> > > > > To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> > > > > Subject: GSoC 2015
> > > > >
> > > > > >Hi Folks,
> > > > > >
> > > > > >Does anyone have any good ideas for GSoC?
> > > > > >
> > > > > >Seb mentioned moving Nutch towards Spark so potentially a
> pluggable
> > > > > >runtime execution engine abstraction?
> > > > > >
> > > > > >I am currently working on a lot of security and authentication
> > related
> > > > > >work so I would possibly be tempted to overhaul and improve that
> > > aspect
> > > > > >of Nutch.
> > > > > >
> > > > > >Any other ideas?
> > > > > >
> > > > > >Thanks folks
> > > > > >Lewis
> > > > > >
> > > > > >--
> > > > > >Lewis
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > *Lewis*
> > >
> >
>
>
>
> --
> *Lewis*
>
Re: GSoC 2015
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi Aditya,
I would suggest that you get to grips with the XmlRpcFileManager [0] to
begin with within the FileMgr component.
Is anyone aware of existing documentation for the XMLRPC implementations
within FileMgr right now?
Thanks
Lewis
[0]
https://github.com/apache/oodt/blob/trunk/filemgr/src/main/java/org/apache/oodt/cas/filemgr/system/XmlRpcFileManager.java
On Mon, Feb 9, 2015 at 10:50 AM, Aditya Dhulipala <ad...@usc.edu> wrote:
> Hi Lewis,
>
> I just read your email about OODT's RPC revamp. I've been reading up on
> Avro, Thrift and Proto buffers and I'm interested in that area.
>
> But I dont really have a guru level understanding of the subject. Can you
> point me to some documentation on the issue?
>
> https://cwiki.apache.org/confluence/display/OODT/Apache+OODT+APIs
> I found this at the OODT wiki page. But it doesn't really have much info
> other than these links to the source code.
>
> Thanks!
>
> --
> Aditya
>
>
>
> adi
>
> On Mon, Feb 9, 2015 at 9:45 AM, Lewis John Mcgibbney <
> lewis.mcgibbney@gmail.com> wrote:
>
> > Hi Valerie,
> > Sorry for that
> > https://www.google-melange.com/gsoc/homepage/google/gsoc2015
> > "Google Summer of Code is a global program that offers students stipends
> to
> > write code for open source projects. We have worked with the open source
> > community to identify and fund exciting projects for the upcoming
> summer."
> >
> > On Mon, Feb 9, 2015 at 9:07 AM, Mallder, Valerie <
> > Valerie.Mallder@jhuapl.edu
> > > wrote:
> >
> > > Since I don't know what GSoC is, I have no good ideas :)
> > >
> > >
> > > Valerie A. Mallder
> > > New Horizons Deputy Mission System Engineer
> > > Johns Hopkins University/Applied Physics Laboratory
> > >
> > >
> > > > -----Original Message-----
> > > > From: Mattmann, Chris A (3980) [mailto:chris.a.mattmann@jpl.nasa.gov
> ]
> > > > Sent: Saturday, February 07, 2015 1:21 AM
> > > > To: dev@oodt.apache.org
> > > > Subject: FW: GSoC 2015
> > > >
> > > > We should be thinking about GSoC on OODT, any ideas?
> > > >
> > > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > > +++++
> > > > Chris Mattmann, Ph.D.
> > > > Chief Architect
> > > > Instrument Software and Science Data Systems Section (398) NASA Jet
> > > > Propulsion Laboratory Pasadena, CA 91109 USA
> > > > Office: 168-519, Mailstop: 168-527
> > > > Email: chris.a.mattmann@nasa.gov
> > > > WWW: http://sunset.usc.edu/~mattmann/
> > > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > > +++++
> > > > Adjunct Associate Professor, Computer Science Department University
> of
> > > > Southern California, Los Angeles, CA 90089 USA
> > > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > > +++++
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Lewis John Mcgibbney <le...@gmail.com>
> > > > Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> > > > Date: Wednesday, February 4, 2015 at 2:42 PM
> > > > To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> > > > Subject: GSoC 2015
> > > >
> > > > >Hi Folks,
> > > > >
> > > > >Does anyone have any good ideas for GSoC?
> > > > >
> > > > >Seb mentioned moving Nutch towards Spark so potentially a pluggable
> > > > >runtime execution engine abstraction?
> > > > >
> > > > >I am currently working on a lot of security and authentication
> related
> > > > >work so I would possibly be tempted to overhaul and improve that
> > aspect
> > > > >of Nutch.
> > > > >
> > > > >Any other ideas?
> > > > >
> > > > >Thanks folks
> > > > >Lewis
> > > > >
> > > > >--
> > > > >Lewis
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> >
> >
> > --
> > *Lewis*
> >
>
--
*Lewis*
Re: GSoC 2015
Posted by Aditya Dhulipala <ad...@usc.edu>.
Hi Lewis,
I just read your email about OODT's RPC revamp. I've been reading up on
Avro, Thrift and Proto buffers and I'm interested in that area.
But I dont really have a guru level understanding of the subject. Can you
point me to some documentation on the issue?
https://cwiki.apache.org/confluence/display/OODT/Apache+OODT+APIs
I found this at the OODT wiki page. But it doesn't really have much info
other than these links to the source code.
Thanks!
--
Aditya
adi
On Mon, Feb 9, 2015 at 9:45 AM, Lewis John Mcgibbney <
lewis.mcgibbney@gmail.com> wrote:
> Hi Valerie,
> Sorry for that
> https://www.google-melange.com/gsoc/homepage/google/gsoc2015
> "Google Summer of Code is a global program that offers students stipends to
> write code for open source projects. We have worked with the open source
> community to identify and fund exciting projects for the upcoming summer."
>
> On Mon, Feb 9, 2015 at 9:07 AM, Mallder, Valerie <
> Valerie.Mallder@jhuapl.edu
> > wrote:
>
> > Since I don't know what GSoC is, I have no good ideas :)
> >
> >
> > Valerie A. Mallder
> > New Horizons Deputy Mission System Engineer
> > Johns Hopkins University/Applied Physics Laboratory
> >
> >
> > > -----Original Message-----
> > > From: Mattmann, Chris A (3980) [mailto:chris.a.mattmann@jpl.nasa.gov]
> > > Sent: Saturday, February 07, 2015 1:21 AM
> > > To: dev@oodt.apache.org
> > > Subject: FW: GSoC 2015
> > >
> > > We should be thinking about GSoC on OODT, any ideas?
> > >
> > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > +++++
> > > Chris Mattmann, Ph.D.
> > > Chief Architect
> > > Instrument Software and Science Data Systems Section (398) NASA Jet
> > > Propulsion Laboratory Pasadena, CA 91109 USA
> > > Office: 168-519, Mailstop: 168-527
> > > Email: chris.a.mattmann@nasa.gov
> > > WWW: http://sunset.usc.edu/~mattmann/
> > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > +++++
> > > Adjunct Associate Professor, Computer Science Department University of
> > > Southern California, Los Angeles, CA 90089 USA
> > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > +++++
> > >
> > >
> > >
> > >
> > >
> > >
> > > -----Original Message-----
> > > From: Lewis John Mcgibbney <le...@gmail.com>
> > > Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> > > Date: Wednesday, February 4, 2015 at 2:42 PM
> > > To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> > > Subject: GSoC 2015
> > >
> > > >Hi Folks,
> > > >
> > > >Does anyone have any good ideas for GSoC?
> > > >
> > > >Seb mentioned moving Nutch towards Spark so potentially a pluggable
> > > >runtime execution engine abstraction?
> > > >
> > > >I am currently working on a lot of security and authentication related
> > > >work so I would possibly be tempted to overhaul and improve that
> aspect
> > > >of Nutch.
> > > >
> > > >Any other ideas?
> > > >
> > > >Thanks folks
> > > >Lewis
> > > >
> > > >--
> > > >Lewis
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> >
> >
>
>
> --
> *Lewis*
>
Re: GSoC 2015
Posted by Chris Mattmann <ch...@gmail.com>.
:-) Yep! Send some students this way if you
know any good ones!
------------------------
Chris Mattmann
chris.mattmann@gmail.com
-----Original Message-----
From: "Mallder, Valerie" <Va...@jhuapl.edu>
Reply-To: <de...@oodt.apache.org>
Date: Monday, February 9, 2015 at 11:25 AM
To: "dev@oodt.apache.org" <de...@oodt.apache.org>
Subject: RE: GSoC 2015
>Oh, this sounds so cool. Wish I was a student. If I pretend to be a
>student will you fund me? :)
>
>
>Valerie A. Mallder
>New Horizons Deputy Mission System Engineer
>Johns Hopkins University/Applied Physics Laboratory
>
>
>> -----Original Message-----
>> From: Lewis John Mcgibbney [mailto:lewis.mcgibbney@gmail.com]
>> Sent: Monday, February 09, 2015 12:45 PM
>> To: dev@oodt.apache.org
>> Subject: Re: GSoC 2015
>>
>> Hi Valerie,
>> Sorry for that
>> https://www.google-melange.com/gsoc/homepage/google/gsoc2015
>> "Google Summer of Code is a global program that offers students
>>stipends to
>> write code for open source projects. We have worked with the open source
>> community to identify and fund exciting projects for the upcoming
>>summer."
>>
>> On Mon, Feb 9, 2015 at 9:07 AM, Mallder, Valerie
>><Valerie.Mallder@jhuapl.edu
>> > wrote:
>>
>> > Since I don't know what GSoC is, I have no good ideas :)
>> >
>> >
>> > Valerie A. Mallder
>> > New Horizons Deputy Mission System Engineer Johns Hopkins
>> > University/Applied Physics Laboratory
>> >
>> >
>> > > -----Original Message-----
>> > > From: Mattmann, Chris A (3980)
>> > > [mailto:chris.a.mattmann@jpl.nasa.gov]
>> > > Sent: Saturday, February 07, 2015 1:21 AM
>> > > To: dev@oodt.apache.org
>> > > Subject: FW: GSoC 2015
>> > >
>> > > We should be thinking about GSoC on OODT, any ideas?
>> > >
>> > >
>> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> > > +++++
>> > > Chris Mattmann, Ph.D.
>> > > Chief Architect
>> > > Instrument Software and Science Data Systems Section (398) NASA Jet
>> > > Propulsion Laboratory Pasadena, CA 91109 USA
>> > > Office: 168-519, Mailstop: 168-527
>> > > Email: chris.a.mattmann@nasa.gov
>> > > WWW: http://sunset.usc.edu/~mattmann/
>> > >
>> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> > > +++++
>> > > Adjunct Associate Professor, Computer Science Department University
>> > > of Southern California, Los Angeles, CA 90089 USA
>> > >
>> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> > > +++++
>> > >
>> > >
>> > >
>> > >
>> > >
>> > >
>> > > -----Original Message-----
>> > > From: Lewis John Mcgibbney <le...@gmail.com>
>> > > Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
>> > > Date: Wednesday, February 4, 2015 at 2:42 PM
>> > > To: "dev@nutch.apache.org" <de...@nutch.apache.org>
>> > > Subject: GSoC 2015
>> > >
>> > > >Hi Folks,
>> > > >
>> > > >Does anyone have any good ideas for GSoC?
>> > > >
>> > > >Seb mentioned moving Nutch towards Spark so potentially a pluggable
>> > > >runtime execution engine abstraction?
>> > > >
>> > > >I am currently working on a lot of security and authentication
>> > > >related work so I would possibly be tempted to overhaul and improve
>> > > >that aspect of Nutch.
>> > > >
>> > > >Any other ideas?
>> > > >
>> > > >Thanks folks
>> > > >Lewis
>> > > >
>> > > >--
>> > > >Lewis
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> >
>> >
>>
>>
>> --
>> *Lewis*
RE: GSoC 2015
Posted by "Mallder, Valerie" <Va...@jhuapl.edu>.
Oh, this sounds so cool. Wish I was a student. If I pretend to be a student will you fund me? :)
Valerie A. Mallder
New Horizons Deputy Mission System Engineer
Johns Hopkins University/Applied Physics Laboratory
> -----Original Message-----
> From: Lewis John Mcgibbney [mailto:lewis.mcgibbney@gmail.com]
> Sent: Monday, February 09, 2015 12:45 PM
> To: dev@oodt.apache.org
> Subject: Re: GSoC 2015
>
> Hi Valerie,
> Sorry for that
> https://www.google-melange.com/gsoc/homepage/google/gsoc2015
> "Google Summer of Code is a global program that offers students stipends to
> write code for open source projects. We have worked with the open source
> community to identify and fund exciting projects for the upcoming summer."
>
> On Mon, Feb 9, 2015 at 9:07 AM, Mallder, Valerie <Valerie.Mallder@jhuapl.edu
> > wrote:
>
> > Since I don't know what GSoC is, I have no good ideas :)
> >
> >
> > Valerie A. Mallder
> > New Horizons Deputy Mission System Engineer Johns Hopkins
> > University/Applied Physics Laboratory
> >
> >
> > > -----Original Message-----
> > > From: Mattmann, Chris A (3980)
> > > [mailto:chris.a.mattmann@jpl.nasa.gov]
> > > Sent: Saturday, February 07, 2015 1:21 AM
> > > To: dev@oodt.apache.org
> > > Subject: FW: GSoC 2015
> > >
> > > We should be thinking about GSoC on OODT, any ideas?
> > >
> > >
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > +++++
> > > Chris Mattmann, Ph.D.
> > > Chief Architect
> > > Instrument Software and Science Data Systems Section (398) NASA Jet
> > > Propulsion Laboratory Pasadena, CA 91109 USA
> > > Office: 168-519, Mailstop: 168-527
> > > Email: chris.a.mattmann@nasa.gov
> > > WWW: http://sunset.usc.edu/~mattmann/
> > >
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > +++++
> > > Adjunct Associate Professor, Computer Science Department University
> > > of Southern California, Los Angeles, CA 90089 USA
> > >
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > +++++
> > >
> > >
> > >
> > >
> > >
> > >
> > > -----Original Message-----
> > > From: Lewis John Mcgibbney <le...@gmail.com>
> > > Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> > > Date: Wednesday, February 4, 2015 at 2:42 PM
> > > To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> > > Subject: GSoC 2015
> > >
> > > >Hi Folks,
> > > >
> > > >Does anyone have any good ideas for GSoC?
> > > >
> > > >Seb mentioned moving Nutch towards Spark so potentially a pluggable
> > > >runtime execution engine abstraction?
> > > >
> > > >I am currently working on a lot of security and authentication
> > > >related work so I would possibly be tempted to overhaul and improve
> > > >that aspect of Nutch.
> > > >
> > > >Any other ideas?
> > > >
> > > >Thanks folks
> > > >Lewis
> > > >
> > > >--
> > > >Lewis
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> >
> >
>
>
> --
> *Lewis*
Re: GSoC 2015
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi Valerie,
Sorry for that
https://www.google-melange.com/gsoc/homepage/google/gsoc2015
"Google Summer of Code is a global program that offers students stipends to
write code for open source projects. We have worked with the open source
community to identify and fund exciting projects for the upcoming summer."
On Mon, Feb 9, 2015 at 9:07 AM, Mallder, Valerie <Valerie.Mallder@jhuapl.edu
> wrote:
> Since I don't know what GSoC is, I have no good ideas :)
>
>
> Valerie A. Mallder
> New Horizons Deputy Mission System Engineer
> Johns Hopkins University/Applied Physics Laboratory
>
>
> > -----Original Message-----
> > From: Mattmann, Chris A (3980) [mailto:chris.a.mattmann@jpl.nasa.gov]
> > Sent: Saturday, February 07, 2015 1:21 AM
> > To: dev@oodt.apache.org
> > Subject: FW: GSoC 2015
> >
> > We should be thinking about GSoC on OODT, any ideas?
> >
> > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > +++++
> > Chris Mattmann, Ph.D.
> > Chief Architect
> > Instrument Software and Science Data Systems Section (398) NASA Jet
> > Propulsion Laboratory Pasadena, CA 91109 USA
> > Office: 168-519, Mailstop: 168-527
> > Email: chris.a.mattmann@nasa.gov
> > WWW: http://sunset.usc.edu/~mattmann/
> > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > +++++
> > Adjunct Associate Professor, Computer Science Department University of
> > Southern California, Los Angeles, CA 90089 USA
> > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > +++++
> >
> >
> >
> >
> >
> >
> > -----Original Message-----
> > From: Lewis John Mcgibbney <le...@gmail.com>
> > Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> > Date: Wednesday, February 4, 2015 at 2:42 PM
> > To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> > Subject: GSoC 2015
> >
> > >Hi Folks,
> > >
> > >Does anyone have any good ideas for GSoC?
> > >
> > >Seb mentioned moving Nutch towards Spark so potentially a pluggable
> > >runtime execution engine abstraction?
> > >
> > >I am currently working on a lot of security and authentication related
> > >work so I would possibly be tempted to overhaul and improve that aspect
> > >of Nutch.
> > >
> > >Any other ideas?
> > >
> > >Thanks folks
> > >Lewis
> > >
> > >--
> > >Lewis
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
>
>
--
*Lewis*
RE: GSoC 2015
Posted by "Mallder, Valerie" <Va...@jhuapl.edu>.
Since I don't know what GSoC is, I have no good ideas :)
Valerie A. Mallder
New Horizons Deputy Mission System Engineer
Johns Hopkins University/Applied Physics Laboratory
> -----Original Message-----
> From: Mattmann, Chris A (3980) [mailto:chris.a.mattmann@jpl.nasa.gov]
> Sent: Saturday, February 07, 2015 1:21 AM
> To: dev@oodt.apache.org
> Subject: FW: GSoC 2015
>
> We should be thinking about GSoC on OODT, any ideas?
>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> +++++
> Chris Mattmann, Ph.D.
> Chief Architect
> Instrument Software and Science Data Systems Section (398) NASA Jet
> Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 168-519, Mailstop: 168-527
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> +++++
> Adjunct Associate Professor, Computer Science Department University of
> Southern California, Los Angeles, CA 90089 USA
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> +++++
>
>
>
>
>
>
> -----Original Message-----
> From: Lewis John Mcgibbney <le...@gmail.com>
> Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> Date: Wednesday, February 4, 2015 at 2:42 PM
> To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> Subject: GSoC 2015
>
> >Hi Folks,
> >
> >Does anyone have any good ideas for GSoC?
> >
> >Seb mentioned moving Nutch towards Spark so potentially a pluggable
> >runtime execution engine abstraction?
> >
> >I am currently working on a lot of security and authentication related
> >work so I would possibly be tempted to overhaul and improve that aspect
> >of Nutch.
> >
> >Any other ideas?
> >
> >Thanks folks
> >Lewis
> >
> >--
> >Lewis
> >
> >
> >
> >
> >
> >
> >
> >
Re: GSoC 2015
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi Folks,
OK, we we have two current GSoC 2015 projects ripe for attention and
development.
OODT-658 - Implement Apache Gora as suitable storage abstraction for
Filemgr
OODT-808 -Replace OODT's XMLPRC with Avro's RPC
The latter, IMHO is a game changer. The former a really nice feature which
will provide much more expressive cataloging as part of using the OODT
services.
So now we are looking for
1) Potential mentors... I am willing to go mentor and also back up mentor
for one project
2) People to help promote the projects to the Avro and Gora lists ML's and
any other resources. I will do this.
Thanks
lewis
On Sun, Feb 8, 2015 at 12:04 PM, Mattmann, Chris A (3980) <
chris.a.mattmann@jpl.nasa.gov> wrote:
> aye
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Chief Architect
> Instrument Software and Science Data Systems Section (398)
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 168-519, Mailstop: 168-527
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Associate Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
>
>
>
>
> -----Original Message-----
> From: Lewis John Mcgibbney <le...@gmail.com>
> Reply-To: "dev@oodt.apache.org" <de...@oodt.apache.org>
> Date: Sunday, February 8, 2015 at 11:46 AM
> To: "dev@oodt.apache.org" <de...@oodt.apache.org>
> Subject: Re: GSoC 2015
>
> >OK I'm all over it like Shane McGowan drinking Baileys out of a shoe
> >
> >On Sun, Feb 8, 2015 at 11:40 AM, Chris Mattmann <ma...@apache.org>
> >wrote:
> >
> >> I LOVE both of these projects.
> >>
> >> RE: Gora file manager backend. Please check
> >> I think a JIRA issue exists already, throw up
> >> your patch and then label the issue gsoc2015
> >> and mentor the crap out of it.
> >>
> >> I’d be happy to mentor the Avro one.
> >>
> >> Cheers,
> >> Chris
> >>
> >>
> >>
> >> -----Original Message-----
> >> From: Lewis John Mcgibbney <le...@gmail.com>
> >> Reply-To: <de...@oodt.apache.org>
> >> Date: Sunday, February 8, 2015 at 11:37 AM
> >> To: "dev@oodt.apache.org" <de...@oodt.apache.org>
> >> Subject: Re: FW: GSoC 2015
> >>
> >> >Screw it, I am going to propose the Gora-backed File Manager Catalog.
> >> >I have always been distracted from this task. The problem is that I
> >>have a
> >> >pretty meaty local patch for this already.
> >> >What is the suggested manner with which to progress if some 1/3 of the
> >> >work
> >> >has already been done?
> >> >
> >> >Another suggestion.
> >> >Replace the entire OODT RPCXML codebase with AvroRPC
> >> >http://avro.apache.org/docs/current/spec.html#Protocol+Declaration
> >> >I've been monitoring and using Avro for a good while now. The project
> >>has
> >> >progressed leaps and bounds and I am very keen on it.
> >> >It may be an opportunity for people with a historical perspective on
> >>the
> >> >XMLRPC Server to speak up and state what they think could be improved
> >> >within this code.
> >> >
> >> >Thanks
> >> >Lewis
> >> >
> >> >On Fri, Feb 6, 2015 at 10:20 PM, Mattmann, Chris A (3980) <
> >> >chris.a.mattmann@jpl.nasa.gov> wrote:
> >> >
> >> >> We should be thinking about GSoC on OODT, any ideas?
> >> >>
> >> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> >> Chris Mattmann, Ph.D.
> >> >> Chief Architect
> >> >> Instrument Software and Science Data Systems Section (398)
> >> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> >> Office: 168-519, Mailstop: 168-527
> >> >> Email: chris.a.mattmann@nasa.gov
> >> >> WWW: http://sunset.usc.edu/~mattmann/
> >> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> >> Adjunct Associate Professor, Computer Science Department
> >> >> University of Southern California, Los Angeles, CA 90089 USA
> >> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> -----Original Message-----
> >> >> From: Lewis John Mcgibbney <le...@gmail.com>
> >> >> Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> >> >> Date: Wednesday, February 4, 2015 at 2:42 PM
> >> >> To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> >> >> Subject: GSoC 2015
> >> >>
> >> >> >Hi Folks,
> >> >> >
> >> >> >Does anyone have any good ideas for GSoC?
> >> >> >
> >> >> >Seb mentioned moving Nutch towards Spark so potentially a pluggable
> >> >> >runtime execution engine abstraction?
> >> >> >
> >> >> >I am currently working on a lot of security and authentication
> >>related
> >> >> >work so I would possibly be tempted to overhaul and improve that
> >>aspect
> >> >> >of Nutch.
> >> >> >
> >> >> >Any other ideas?
> >> >> >
> >> >> >Thanks folks
> >> >> >Lewis
> >> >> >
> >> >> >--
> >> >> >Lewis
> >> >> >
> >> >> >
> >> >> >
> >> >> >
> >> >> >
> >> >> >
> >> >> >
> >> >> >
> >> >>
> >> >>
> >> >
> >> >
> >> >--
> >> >*Lewis*
> >>
> >>
> >>
> >
> >
> >--
> >*Lewis*
>
>
--
*Lewis*
Re: GSoC 2015
Posted by "Mattmann, Chris A (3980)" <ch...@jpl.nasa.gov>.
aye
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Chief Architect
Instrument Software and Science Data Systems Section (398)
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 168-519, Mailstop: 168-527
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Associate Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
-----Original Message-----
From: Lewis John Mcgibbney <le...@gmail.com>
Reply-To: "dev@oodt.apache.org" <de...@oodt.apache.org>
Date: Sunday, February 8, 2015 at 11:46 AM
To: "dev@oodt.apache.org" <de...@oodt.apache.org>
Subject: Re: GSoC 2015
>OK I'm all over it like Shane McGowan drinking Baileys out of a shoe
>
>On Sun, Feb 8, 2015 at 11:40 AM, Chris Mattmann <ma...@apache.org>
>wrote:
>
>> I LOVE both of these projects.
>>
>> RE: Gora file manager backend. Please check
>> I think a JIRA issue exists already, throw up
>> your patch and then label the issue gsoc2015
>> and mentor the crap out of it.
>>
>> I’d be happy to mentor the Avro one.
>>
>> Cheers,
>> Chris
>>
>>
>>
>> -----Original Message-----
>> From: Lewis John Mcgibbney <le...@gmail.com>
>> Reply-To: <de...@oodt.apache.org>
>> Date: Sunday, February 8, 2015 at 11:37 AM
>> To: "dev@oodt.apache.org" <de...@oodt.apache.org>
>> Subject: Re: FW: GSoC 2015
>>
>> >Screw it, I am going to propose the Gora-backed File Manager Catalog.
>> >I have always been distracted from this task. The problem is that I
>>have a
>> >pretty meaty local patch for this already.
>> >What is the suggested manner with which to progress if some 1/3 of the
>> >work
>> >has already been done?
>> >
>> >Another suggestion.
>> >Replace the entire OODT RPCXML codebase with AvroRPC
>> >http://avro.apache.org/docs/current/spec.html#Protocol+Declaration
>> >I've been monitoring and using Avro for a good while now. The project
>>has
>> >progressed leaps and bounds and I am very keen on it.
>> >It may be an opportunity for people with a historical perspective on
>>the
>> >XMLRPC Server to speak up and state what they think could be improved
>> >within this code.
>> >
>> >Thanks
>> >Lewis
>> >
>> >On Fri, Feb 6, 2015 at 10:20 PM, Mattmann, Chris A (3980) <
>> >chris.a.mattmann@jpl.nasa.gov> wrote:
>> >
>> >> We should be thinking about GSoC on OODT, any ideas?
>> >>
>> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >> Chris Mattmann, Ph.D.
>> >> Chief Architect
>> >> Instrument Software and Science Data Systems Section (398)
>> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> >> Office: 168-519, Mailstop: 168-527
>> >> Email: chris.a.mattmann@nasa.gov
>> >> WWW: http://sunset.usc.edu/~mattmann/
>> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >> Adjunct Associate Professor, Computer Science Department
>> >> University of Southern California, Los Angeles, CA 90089 USA
>> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >>
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> -----Original Message-----
>> >> From: Lewis John Mcgibbney <le...@gmail.com>
>> >> Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
>> >> Date: Wednesday, February 4, 2015 at 2:42 PM
>> >> To: "dev@nutch.apache.org" <de...@nutch.apache.org>
>> >> Subject: GSoC 2015
>> >>
>> >> >Hi Folks,
>> >> >
>> >> >Does anyone have any good ideas for GSoC?
>> >> >
>> >> >Seb mentioned moving Nutch towards Spark so potentially a pluggable
>> >> >runtime execution engine abstraction?
>> >> >
>> >> >I am currently working on a lot of security and authentication
>>related
>> >> >work so I would possibly be tempted to overhaul and improve that
>>aspect
>> >> >of Nutch.
>> >> >
>> >> >Any other ideas?
>> >> >
>> >> >Thanks folks
>> >> >Lewis
>> >> >
>> >> >--
>> >> >Lewis
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >>
>> >>
>> >
>> >
>> >--
>> >*Lewis*
>>
>>
>>
>
>
>--
>*Lewis*
Re: GSoC 2015
Posted by Lewis John Mcgibbney <le...@gmail.com>.
OK I'm all over it like Shane McGowan drinking Baileys out of a shoe
On Sun, Feb 8, 2015 at 11:40 AM, Chris Mattmann <ma...@apache.org> wrote:
> I LOVE both of these projects.
>
> RE: Gora file manager backend. Please check
> I think a JIRA issue exists already, throw up
> your patch and then label the issue gsoc2015
> and mentor the crap out of it.
>
> I’d be happy to mentor the Avro one.
>
> Cheers,
> Chris
>
>
>
> -----Original Message-----
> From: Lewis John Mcgibbney <le...@gmail.com>
> Reply-To: <de...@oodt.apache.org>
> Date: Sunday, February 8, 2015 at 11:37 AM
> To: "dev@oodt.apache.org" <de...@oodt.apache.org>
> Subject: Re: FW: GSoC 2015
>
> >Screw it, I am going to propose the Gora-backed File Manager Catalog.
> >I have always been distracted from this task. The problem is that I have a
> >pretty meaty local patch for this already.
> >What is the suggested manner with which to progress if some 1/3 of the
> >work
> >has already been done?
> >
> >Another suggestion.
> >Replace the entire OODT RPCXML codebase with AvroRPC
> >http://avro.apache.org/docs/current/spec.html#Protocol+Declaration
> >I've been monitoring and using Avro for a good while now. The project has
> >progressed leaps and bounds and I am very keen on it.
> >It may be an opportunity for people with a historical perspective on the
> >XMLRPC Server to speak up and state what they think could be improved
> >within this code.
> >
> >Thanks
> >Lewis
> >
> >On Fri, Feb 6, 2015 at 10:20 PM, Mattmann, Chris A (3980) <
> >chris.a.mattmann@jpl.nasa.gov> wrote:
> >
> >> We should be thinking about GSoC on OODT, any ideas?
> >>
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Chris Mattmann, Ph.D.
> >> Chief Architect
> >> Instrument Software and Science Data Systems Section (398)
> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> Office: 168-519, Mailstop: 168-527
> >> Email: chris.a.mattmann@nasa.gov
> >> WWW: http://sunset.usc.edu/~mattmann/
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Adjunct Associate Professor, Computer Science Department
> >> University of Southern California, Los Angeles, CA 90089 USA
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>
> >>
> >>
> >>
> >>
> >>
> >> -----Original Message-----
> >> From: Lewis John Mcgibbney <le...@gmail.com>
> >> Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> >> Date: Wednesday, February 4, 2015 at 2:42 PM
> >> To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> >> Subject: GSoC 2015
> >>
> >> >Hi Folks,
> >> >
> >> >Does anyone have any good ideas for GSoC?
> >> >
> >> >Seb mentioned moving Nutch towards Spark so potentially a pluggable
> >> >runtime execution engine abstraction?
> >> >
> >> >I am currently working on a lot of security and authentication related
> >> >work so I would possibly be tempted to overhaul and improve that aspect
> >> >of Nutch.
> >> >
> >> >Any other ideas?
> >> >
> >> >Thanks folks
> >> >Lewis
> >> >
> >> >--
> >> >Lewis
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >>
> >>
> >
> >
> >--
> >*Lewis*
>
>
>
--
*Lewis*
Re: GSoC 2015
Posted by Chris Mattmann <ma...@apache.org>.
I LOVE both of these projects.
RE: Gora file manager backend. Please check
I think a JIRA issue exists already, throw up
your patch and then label the issue gsoc2015
and mentor the crap out of it.
I’d be happy to mentor the Avro one.
Cheers,
Chris
-----Original Message-----
From: Lewis John Mcgibbney <le...@gmail.com>
Reply-To: <de...@oodt.apache.org>
Date: Sunday, February 8, 2015 at 11:37 AM
To: "dev@oodt.apache.org" <de...@oodt.apache.org>
Subject: Re: FW: GSoC 2015
>Screw it, I am going to propose the Gora-backed File Manager Catalog.
>I have always been distracted from this task. The problem is that I have a
>pretty meaty local patch for this already.
>What is the suggested manner with which to progress if some 1/3 of the
>work
>has already been done?
>
>Another suggestion.
>Replace the entire OODT RPCXML codebase with AvroRPC
>http://avro.apache.org/docs/current/spec.html#Protocol+Declaration
>I've been monitoring and using Avro for a good while now. The project has
>progressed leaps and bounds and I am very keen on it.
>It may be an opportunity for people with a historical perspective on the
>XMLRPC Server to speak up and state what they think could be improved
>within this code.
>
>Thanks
>Lewis
>
>On Fri, Feb 6, 2015 at 10:20 PM, Mattmann, Chris A (3980) <
>chris.a.mattmann@jpl.nasa.gov> wrote:
>
>> We should be thinking about GSoC on OODT, any ideas?
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Chief Architect
>> Instrument Software and Science Data Systems Section (398)
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 168-519, Mailstop: 168-527
>> Email: chris.a.mattmann@nasa.gov
>> WWW: http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Associate Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: Lewis John Mcgibbney <le...@gmail.com>
>> Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
>> Date: Wednesday, February 4, 2015 at 2:42 PM
>> To: "dev@nutch.apache.org" <de...@nutch.apache.org>
>> Subject: GSoC 2015
>>
>> >Hi Folks,
>> >
>> >Does anyone have any good ideas for GSoC?
>> >
>> >Seb mentioned moving Nutch towards Spark so potentially a pluggable
>> >runtime execution engine abstraction?
>> >
>> >I am currently working on a lot of security and authentication related
>> >work so I would possibly be tempted to overhaul and improve that aspect
>> >of Nutch.
>> >
>> >Any other ideas?
>> >
>> >Thanks folks
>> >Lewis
>> >
>> >--
>> >Lewis
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>>
>>
>
>
>--
>*Lewis*
Re: FW: GSoC 2015
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Screw it, I am going to propose the Gora-backed File Manager Catalog.
I have always been distracted from this task. The problem is that I have a
pretty meaty local patch for this already.
What is the suggested manner with which to progress if some 1/3 of the work
has already been done?
Another suggestion.
Replace the entire OODT RPCXML codebase with AvroRPC
http://avro.apache.org/docs/current/spec.html#Protocol+Declaration
I've been monitoring and using Avro for a good while now. The project has
progressed leaps and bounds and I am very keen on it.
It may be an opportunity for people with a historical perspective on the
XMLRPC Server to speak up and state what they think could be improved
within this code.
Thanks
Lewis
On Fri, Feb 6, 2015 at 10:20 PM, Mattmann, Chris A (3980) <
chris.a.mattmann@jpl.nasa.gov> wrote:
> We should be thinking about GSoC on OODT, any ideas?
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Chief Architect
> Instrument Software and Science Data Systems Section (398)
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 168-519, Mailstop: 168-527
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Associate Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
>
>
>
>
> -----Original Message-----
> From: Lewis John Mcgibbney <le...@gmail.com>
> Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> Date: Wednesday, February 4, 2015 at 2:42 PM
> To: "dev@nutch.apache.org" <de...@nutch.apache.org>
> Subject: GSoC 2015
>
> >Hi Folks,
> >
> >Does anyone have any good ideas for GSoC?
> >
> >Seb mentioned moving Nutch towards Spark so potentially a pluggable
> >runtime execution engine abstraction?
> >
> >I am currently working on a lot of security and authentication related
> >work so I would possibly be tempted to overhaul and improve that aspect
> >of Nutch.
> >
> >Any other ideas?
> >
> >Thanks folks
> >Lewis
> >
> >--
> >Lewis
> >
> >
> >
> >
> >
> >
> >
> >
>
>
--
*Lewis*
FW: GSoC 2015
Posted by "Mattmann, Chris A (3980)" <ch...@jpl.nasa.gov>.
We should be thinking about GSoC on OODT, any ideas?
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Chief Architect
Instrument Software and Science Data Systems Section (398)
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 168-519, Mailstop: 168-527
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Associate Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
-----Original Message-----
From: Lewis John Mcgibbney <le...@gmail.com>
Reply-To: "dev@nutch.apache.org" <de...@nutch.apache.org>
Date: Wednesday, February 4, 2015 at 2:42 PM
To: "dev@nutch.apache.org" <de...@nutch.apache.org>
Subject: GSoC 2015
>Hi Folks,
>
>Does anyone have any good ideas for GSoC?
>
>Seb mentioned moving Nutch towards Spark so potentially a pluggable
>runtime execution engine abstraction?
>
>I am currently working on a lot of security and authentication related
>work so I would possibly be tempted to overhaul and improve that aspect
>of Nutch.
>
>Any other ideas?
>
>Thanks folks
>Lewis
>
>--
>Lewis
>
>
>
>
>
>
>
>