You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oodt.apache.org by "Mattmann, Chris A (3980)" <ch...@jpl.nasa.gov> on 2014/09/29 18:38:26 UTC
FW: OODT & Apache
Hi All, recently I came up with some answers to questions
about Apache OODT that would likely be useful to the community
so here ya go! :)
(with permission from Jen Cruz to share)
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Chief Architect
Instrument Software and Science Data Systems Section (398)
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 168-519, Mailstop: 168-527
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Associate Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
-----Original Message-----
From: <Mattmann>, Chris Mattmann <Ch...@jpl.nasa.gov>
Date: Monday, September 29, 2014 at 9:31 AM
To: "Cruz, Jennifer W (3980)" <je...@jpl.nasa.gov>
Cc: "Freeborn, Dana J (398J)" <da...@jpl.nasa.gov>, "Cuddy,
David T (398B)" <da...@jpl.nasa.gov>, "Ramirez, Paul M (398J)"
<pa...@jpl.nasa.gov>
Subject: Re: OODT & Apache
>Hi Jennifer,
>
>-----Original Message-----
>
>From: <Cruz>, "Jennifer W (3980)" <je...@jpl.nasa.gov>
>Date: Monday, September 29, 2014 at 9:20 AM
>To: Chris Mattmann <Ch...@jpl.nasa.gov>
>Cc: "Cruz, Jennifer W (3980)" <je...@jpl.nasa.gov>, "Freeborn,
>Dana J (398J)" <da...@jpl.nasa.gov>, "Cuddy, David T (398B)"
><da...@jpl.nasa.gov>
>Subject: OODT & Apache
>
>>Chris,
>>
>>
>>I¹m working on a chart for SMAP feed forward to NISAR & SWOT. I would
>>like to show a little of OODT evolution and ties into flight projects.
>
>Great.
>
>Current list of recent flight projects powered by OODT (Apache and
>otherwise):
>
>OCO-2 - JPL
>NPP Sounder PEATE - JPL
>SMAP - JPL
>CARVE - JPL
>Airborne Snow Observatory - JPL
>JPSS GRAVITE - GSFC
>
>Note that APL is also currently working on infusing OODT into its Deep
>Horizons pipeline.
>
>>
>>
>>What was the timeframe when OODT was available open source/Apache?
>
>See: http://oodt.apache.org/about/history/
>
>(relevant subset)
>
>2005 OODT becomes open source through Open Channel Foundation, but gains
>little traction.
>2007 OODT deployed for the Orbiting Carbon Observatory and Seawinds
>missions. OODT embraces earth science.
>2008 OODT deployed in for National Polar-Orbiting Environmental Satellite
>System. OODT embraces atmospheric science.
>2010 JanuaryApache OODT enters the Apache Incubator.
>2010 November OODT makes it's first official release.
> Apache OODT is voted a Top Level Project.
>2011 February OODT makes it's first Official Release as a Top Level
>Project bringing v0.2 to the community.
>2011 June OODT makes the 0.3 release to the community.
>2012 June OODT makes the 0.4 release to the community.
>2012 December OODT makes the 0.5 release to the community.
>2013 July OODT makes the 0.6 release to the community.
>2014 September OODT makes the 0.7 release to the community.
>
>
>
>>
>>
>>When might a non Java (python??) version be available?
>
>This is an extremely loaded question :) Per Ohloh, rewriting
>OODT¹s core in Java would mean likely replacing 53 man years of effort
>and 200+K SLOC:
>
>https://www.openhub.net/p/oodt/
>
>
>That said, OODT already works very nicely with Python via JCC and
>Pynius and other libraries in Python that can easily make Javacalls some
>even natively. There was a thread earlier on this on the Apache OODT
>lists:
>
>http://s.apache.org/seu
>
>Note that currently Apache Tika which is fully Java, and being
>increasingly
>used to power things (including OODT) like your FICO credit score:
>
>http://goo.gl/31lJxS
>
>has a Java to Python wrapper as tika-python, here:
>
>https://github.com/chrismattmann/tika-python/
>
>It works very nicely. In addition, besides these API and library level
>bindings to OODT via Python, it is extremely easy to simply invoke and
>command OODT via Python via OODT¹s JAX-RS REST services layer. So OODT
>and Python play quite nicely in fact.
>
>
>>Regarding cloud computing, are there any unique capability/upgrades
>>necessary to use the OODT components on the cloud?
>
>Yep, NSF and DARPA are both currently investing to integrate OODT with
>Apache CloudStack and with OpenStack. A prototype exists and was
>constructed
>already by Mike Starch in that area.
>
>JPL and its Big Data R&TD along with DARPA XDATA and NASA ASIT are also
>paying to integrate
>OODT with the Berkeley AMP Lab¹s Data Analytics Stack (BDAS). We have
>patches up
>for review and prototypes ready for people to test as well:
>
>https://issues.apache.org/jira/browse/OODT-698
>
>
>Would you be OK with me sharing the above BTW with the Apache OODT
>community on dev@oodt.apache.org since I compiled the list and it
>would probably be useful :)
>
>HTH!
>
>Cheers,
>Chris
>
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>Chris Mattmann, Ph.D.
>Chief Architect
>Instrument Software and Science Data Systems Section (398)
>NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>Office: 168-519, Mailstop: 168-527
>Email: chris.a.mattmann@nasa.gov
>WWW: http://sunset.usc.edu/~mattmann/
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>Adjunct Associate Professor, Computer Science Department
>University of Southern California, Los Angeles, CA 90089 USA
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
>
Re: OODT & Apache
Posted by Chris Mattmann <ch...@gmail.com>.
Attachment stripped, can you resend
------------------------
Chris Mattmann
chris.mattmann@gmail.com
-----Original Message-----
From: "Hardman, Sean H (398J)" <se...@jpl.nasa.gov>
Reply-To: <de...@oodt.apache.org>
Date: Monday, September 29, 2014 at 11:44 AM
To: "dev@oodt.apache.org" <de...@oodt.apache.org>
Subject: Re: OODT & Apache
>Although a tad outdated, the attached poster shows the timeline from the
>early years.
>
>Sean
>
>On 9/29/14 11:36 AM, "Chris Mattmann" <ma...@apache.org> wrote:
>
>>Awesome, Dan!
>>
>>Here is the timeline file:
>>
>>https://svn.apache.org/repos/asf/oodt/docs/site/
>>
>>https://svn.apache.org/repos/asf/oodt/docs/site/about/history/index.html
>>
>>
>>Once you update the index.html file, you can either:
>>
>>(1) follow this process:
>>https://cwiki.apache.org/confluence/display/OODT/How+to+Publish+the+OODT+
>>W
>>e
>>b+Site
>>
>>to build and publish the site
>>
>>(2) hit me up, or someone else that already has a local copy of the
>>website
>>built and I can push the changes.
>>
>>Cheers,
>>Chris
>>
>>
>>
>>
>>-----Original Message-----
>>From: Dan Crichton <da...@jpl.nasa.gov>
>>Reply-To: <de...@oodt.apache.org>
>>Date: Monday, September 29, 2014 at 11:32 AM
>>To: "dev@oodt.apache.org" <de...@oodt.apache.org>
>>Subject: Re: OODT & Apache
>>
>>>Hi Chris,
>>>
>>>I'll volunteer to update the timeline. I'd like to hit the 2000-2005
>>>era
>>>and also add in airborne instruments, etc.
>>>
>>>Thanks,
>>>Dan
>>>
>>>On 9/29/14 9:38 AM, "Mattmann, Chris A (3980)"
>>><ch...@jpl.nasa.gov> wrote:
>>>
>>>>Hi All, recently I came up with some answers to questions
>>>>about Apache OODT that would likely be useful to the community
>>>>so here ya go! :)
>>>>
>>>>(with permission from Jen Cruz to share)
>>>>
>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>Chris Mattmann, Ph.D.
>>>>Chief Architect
>>>>Instrument Software and Science Data Systems Section (398)
>>>>NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>>Office: 168-519, Mailstop: 168-527
>>>>Email: chris.a.mattmann@nasa.gov
>>>>WWW: http://sunset.usc.edu/~mattmann/
>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>Adjunct Associate Professor, Computer Science Department
>>>>University of Southern California, Los Angeles, CA 90089 USA
>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>-----Original Message-----
>>>>From: <Mattmann>, Chris Mattmann <Ch...@jpl.nasa.gov>
>>>>Date: Monday, September 29, 2014 at 9:31 AM
>>>>To: "Cruz, Jennifer W (3980)" <je...@jpl.nasa.gov>
>>>>Cc: "Freeborn, Dana J (398J)" <da...@jpl.nasa.gov>, "Cuddy,
>>>>David T (398B)" <da...@jpl.nasa.gov>, "Ramirez, Paul M (398J)"
>>>><pa...@jpl.nasa.gov>
>>>>Subject: Re: OODT & Apache
>>>>
>>>>>Hi Jennifer,
>>>>>
>>>>>-----Original Message-----
>>>>>
>>>>>From: <Cruz>, "Jennifer W (3980)" <je...@jpl.nasa.gov>
>>>>>Date: Monday, September 29, 2014 at 9:20 AM
>>>>>To: Chris Mattmann <Ch...@jpl.nasa.gov>
>>>>>Cc: "Cruz, Jennifer W (3980)" <je...@jpl.nasa.gov>,
>>>>>"Freeborn,
>>>>>Dana J (398J)" <da...@jpl.nasa.gov>, "Cuddy, David T (398B)"
>>>>><da...@jpl.nasa.gov>
>>>>>Subject: OODT & Apache
>>>>>
>>>>>>Chris,
>>>>>>
>>>>>>
>>>>>>I¹m working on a chart for SMAP feed forward to NISAR & SWOT. I
>>>>>>would
>>>>>>like to show a little of OODT evolution and ties into flight
>>>>>>projects.
>>>>>
>>>>>Great.
>>>>>
>>>>>Current list of recent flight projects powered by OODT (Apache and
>>>>>otherwise):
>>>>>
>>>>>OCO-2 - JPL
>>>>>NPP Sounder PEATE - JPL
>>>>>SMAP - JPL
>>>>>CARVE - JPL
>>>>>Airborne Snow Observatory - JPL
>>>>>JPSS GRAVITE - GSFC
>>>>>
>>>>>Note that APL is also currently working on infusing OODT into its Deep
>>>>>Horizons pipeline.
>>>>>
>>>>>>
>>>>>>
>>>>>>What was the timeframe when OODT was available open source/Apache?
>>>>>
>>>>>See: http://oodt.apache.org/about/history/
>>>>>
>>>>>(relevant subset)
>>>>>
>>>>>2005 OODT becomes open source through Open Channel Foundation, but
>>>>>gains
>>>>>little traction.
>>>>>2007 OODT deployed for the Orbiting Carbon Observatory and Seawinds
>>>>>missions. OODT embraces earth science.
>>>>>2008 OODT deployed in for National Polar-Orbiting Environmental
>>>>>Satellite
>>>>>System. OODT embraces atmospheric science.
>>>>>2010 JanuaryApache OODT enters the Apache Incubator.
>>>>>2010 November OODT makes it's first official release.
>>>>> Apache OODT is voted a Top Level Project.
>>>>>2011 February OODT makes it's first Official Release as a Top Level
>>>>>Project bringing v0.2 to the community.
>>>>>2011 June OODT makes the 0.3 release to the community.
>>>>>2012 June OODT makes the 0.4 release to the community.
>>>>>2012 December OODT makes the 0.5 release to the community.
>>>>>2013 July OODT makes the 0.6 release to the community.
>>>>>2014 September OODT makes the 0.7 release to the community.
>>>>>
>>>>>
>>>>>
>>>>>>
>>>>>>
>>>>>>When might a non Java (python??) version be available?
>>>>>
>>>>>This is an extremely loaded question :) Per Ohloh, rewriting
>>>>>OODT¹s core in Java would mean likely replacing 53 man years of effort
>>>>>and 200+K SLOC:
>>>>>
>>>>>https://www.openhub.net/p/oodt/
>>>>>
>>>>>
>>>>>That said, OODT already works very nicely with Python via JCC and
>>>>>Pynius and other libraries in Python that can easily make Javacalls
>>>>>some
>>>>>even natively. There was a thread earlier on this on the Apache OODT
>>>>>lists:
>>>>>
>>>>>http://s.apache.org/seu
>>>>>
>>>>>Note that currently Apache Tika which is fully Java, and being
>>>>>increasingly
>>>>>used to power things (including OODT) like your FICO credit score:
>>>>>
>>>>>http://goo.gl/31lJxS
>>>>>
>>>>>has a Java to Python wrapper as tika-python, here:
>>>>>
>>>>>https://github.com/chrismattmann/tika-python/
>>>>>
>>>>>It works very nicely. In addition, besides these API and library level
>>>>>bindings to OODT via Python, it is extremely easy to simply invoke and
>>>>>command OODT via Python via OODT¹s JAX-RS REST services layer. So OODT
>>>>>and Python play quite nicely in fact.
>>>>>
>>>>>
>>>>>>Regarding cloud computing, are there any unique capability/upgrades
>>>>>>necessary to use the OODT components on the cloud?
>>>>>
>>>>>Yep, NSF and DARPA are both currently investing to integrate OODT with
>>>>>Apache CloudStack and with OpenStack. A prototype exists and was
>>>>>constructed
>>>>>already by Mike Starch in that area.
>>>>>
>>>>>JPL and its Big Data R&TD along with DARPA XDATA and NASA ASIT are
>>>>>also
>>>>>paying to integrate
>>>>>OODT with the Berkeley AMP Lab¹s Data Analytics Stack (BDAS). We have
>>>>>patches up
>>>>>for review and prototypes ready for people to test as well:
>>>>>
>>>>>https://issues.apache.org/jira/browse/OODT-698
>>>>>
>>>>>
>>>>>Would you be OK with me sharing the above BTW with the Apache OODT
>>>>>community on dev@oodt.apache.org since I compiled the list and it
>>>>>would probably be useful :)
>>>>>
>>>>>HTH!
>>>>>
>>>>>Cheers,
>>>>>Chris
>>>>>
>>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>Chris Mattmann, Ph.D.
>>>>>Chief Architect
>>>>>Instrument Software and Science Data Systems Section (398)
>>>>>NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>>>Office: 168-519, Mailstop: 168-527
>>>>>Email: chris.a.mattmann@nasa.gov
>>>>>WWW: http://sunset.usc.edu/~mattmann/
>>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>Adjunct Associate Professor, Computer Science Department
>>>>>University of Southern California, Los Angeles, CA 90089 USA
>>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>>
>
Re: OODT & Apache
Posted by "Hardman, Sean H (398J)" <se...@jpl.nasa.gov>.
Although a tad outdated, the attached poster shows the timeline from the
early years.
Sean
On 9/29/14 11:36 AM, "Chris Mattmann" <ma...@apache.org> wrote:
>Awesome, Dan!
>
>Here is the timeline file:
>
>https://svn.apache.org/repos/asf/oodt/docs/site/
>
>https://svn.apache.org/repos/asf/oodt/docs/site/about/history/index.html
>
>
>Once you update the index.html file, you can either:
>
>(1) follow this process:
>https://cwiki.apache.org/confluence/display/OODT/How+to+Publish+the+OODT+W
>e
>b+Site
>
>to build and publish the site
>
>(2) hit me up, or someone else that already has a local copy of the
>website
>built and I can push the changes.
>
>Cheers,
>Chris
>
>
>
>
>-----Original Message-----
>From: Dan Crichton <da...@jpl.nasa.gov>
>Reply-To: <de...@oodt.apache.org>
>Date: Monday, September 29, 2014 at 11:32 AM
>To: "dev@oodt.apache.org" <de...@oodt.apache.org>
>Subject: Re: OODT & Apache
>
>>Hi Chris,
>>
>>I'll volunteer to update the timeline. I'd like to hit the 2000-2005 era
>>and also add in airborne instruments, etc.
>>
>>Thanks,
>>Dan
>>
>>On 9/29/14 9:38 AM, "Mattmann, Chris A (3980)"
>><ch...@jpl.nasa.gov> wrote:
>>
>>>Hi All, recently I came up with some answers to questions
>>>about Apache OODT that would likely be useful to the community
>>>so here ya go! :)
>>>
>>>(with permission from Jen Cruz to share)
>>>
>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>Chris Mattmann, Ph.D.
>>>Chief Architect
>>>Instrument Software and Science Data Systems Section (398)
>>>NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>Office: 168-519, Mailstop: 168-527
>>>Email: chris.a.mattmann@nasa.gov
>>>WWW: http://sunset.usc.edu/~mattmann/
>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>Adjunct Associate Professor, Computer Science Department
>>>University of Southern California, Los Angeles, CA 90089 USA
>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>
>>>
>>>
>>>
>>>
>>>
>>>-----Original Message-----
>>>From: <Mattmann>, Chris Mattmann <Ch...@jpl.nasa.gov>
>>>Date: Monday, September 29, 2014 at 9:31 AM
>>>To: "Cruz, Jennifer W (3980)" <je...@jpl.nasa.gov>
>>>Cc: "Freeborn, Dana J (398J)" <da...@jpl.nasa.gov>, "Cuddy,
>>>David T (398B)" <da...@jpl.nasa.gov>, "Ramirez, Paul M (398J)"
>>><pa...@jpl.nasa.gov>
>>>Subject: Re: OODT & Apache
>>>
>>>>Hi Jennifer,
>>>>
>>>>-----Original Message-----
>>>>
>>>>From: <Cruz>, "Jennifer W (3980)" <je...@jpl.nasa.gov>
>>>>Date: Monday, September 29, 2014 at 9:20 AM
>>>>To: Chris Mattmann <Ch...@jpl.nasa.gov>
>>>>Cc: "Cruz, Jennifer W (3980)" <je...@jpl.nasa.gov>,
>>>>"Freeborn,
>>>>Dana J (398J)" <da...@jpl.nasa.gov>, "Cuddy, David T (398B)"
>>>><da...@jpl.nasa.gov>
>>>>Subject: OODT & Apache
>>>>
>>>>>Chris,
>>>>>
>>>>>
>>>>>I¹m working on a chart for SMAP feed forward to NISAR & SWOT. I would
>>>>>like to show a little of OODT evolution and ties into flight projects.
>>>>
>>>>Great.
>>>>
>>>>Current list of recent flight projects powered by OODT (Apache and
>>>>otherwise):
>>>>
>>>>OCO-2 - JPL
>>>>NPP Sounder PEATE - JPL
>>>>SMAP - JPL
>>>>CARVE - JPL
>>>>Airborne Snow Observatory - JPL
>>>>JPSS GRAVITE - GSFC
>>>>
>>>>Note that APL is also currently working on infusing OODT into its Deep
>>>>Horizons pipeline.
>>>>
>>>>>
>>>>>
>>>>>What was the timeframe when OODT was available open source/Apache?
>>>>
>>>>See: http://oodt.apache.org/about/history/
>>>>
>>>>(relevant subset)
>>>>
>>>>2005 OODT becomes open source through Open Channel Foundation, but
>>>>gains
>>>>little traction.
>>>>2007 OODT deployed for the Orbiting Carbon Observatory and Seawinds
>>>>missions. OODT embraces earth science.
>>>>2008 OODT deployed in for National Polar-Orbiting Environmental
>>>>Satellite
>>>>System. OODT embraces atmospheric science.
>>>>2010 JanuaryApache OODT enters the Apache Incubator.
>>>>2010 November OODT makes it's first official release.
>>>> Apache OODT is voted a Top Level Project.
>>>>2011 February OODT makes it's first Official Release as a Top Level
>>>>Project bringing v0.2 to the community.
>>>>2011 June OODT makes the 0.3 release to the community.
>>>>2012 June OODT makes the 0.4 release to the community.
>>>>2012 December OODT makes the 0.5 release to the community.
>>>>2013 July OODT makes the 0.6 release to the community.
>>>>2014 September OODT makes the 0.7 release to the community.
>>>>
>>>>
>>>>
>>>>>
>>>>>
>>>>>When might a non Java (python??) version be available?
>>>>
>>>>This is an extremely loaded question :) Per Ohloh, rewriting
>>>>OODT¹s core in Java would mean likely replacing 53 man years of effort
>>>>and 200+K SLOC:
>>>>
>>>>https://www.openhub.net/p/oodt/
>>>>
>>>>
>>>>That said, OODT already works very nicely with Python via JCC and
>>>>Pynius and other libraries in Python that can easily make Javacalls
>>>>some
>>>>even natively. There was a thread earlier on this on the Apache OODT
>>>>lists:
>>>>
>>>>http://s.apache.org/seu
>>>>
>>>>Note that currently Apache Tika which is fully Java, and being
>>>>increasingly
>>>>used to power things (including OODT) like your FICO credit score:
>>>>
>>>>http://goo.gl/31lJxS
>>>>
>>>>has a Java to Python wrapper as tika-python, here:
>>>>
>>>>https://github.com/chrismattmann/tika-python/
>>>>
>>>>It works very nicely. In addition, besides these API and library level
>>>>bindings to OODT via Python, it is extremely easy to simply invoke and
>>>>command OODT via Python via OODT¹s JAX-RS REST services layer. So OODT
>>>>and Python play quite nicely in fact.
>>>>
>>>>
>>>>>Regarding cloud computing, are there any unique capability/upgrades
>>>>>necessary to use the OODT components on the cloud?
>>>>
>>>>Yep, NSF and DARPA are both currently investing to integrate OODT with
>>>>Apache CloudStack and with OpenStack. A prototype exists and was
>>>>constructed
>>>>already by Mike Starch in that area.
>>>>
>>>>JPL and its Big Data R&TD along with DARPA XDATA and NASA ASIT are also
>>>>paying to integrate
>>>>OODT with the Berkeley AMP Lab¹s Data Analytics Stack (BDAS). We have
>>>>patches up
>>>>for review and prototypes ready for people to test as well:
>>>>
>>>>https://issues.apache.org/jira/browse/OODT-698
>>>>
>>>>
>>>>Would you be OK with me sharing the above BTW with the Apache OODT
>>>>community on dev@oodt.apache.org since I compiled the list and it
>>>>would probably be useful :)
>>>>
>>>>HTH!
>>>>
>>>>Cheers,
>>>>Chris
>>>>
>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>Chris Mattmann, Ph.D.
>>>>Chief Architect
>>>>Instrument Software and Science Data Systems Section (398)
>>>>NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>>Office: 168-519, Mailstop: 168-527
>>>>Email: chris.a.mattmann@nasa.gov
>>>>WWW: http://sunset.usc.edu/~mattmann/
>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>Adjunct Associate Professor, Computer Science Department
>>>>University of Southern California, Los Angeles, CA 90089 USA
>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>
>>>>
>>>>
>>>
>>
>
>
Re: OODT & Apache
Posted by Chris Mattmann <ma...@apache.org>.
Awesome, Dan!
Here is the timeline file:
https://svn.apache.org/repos/asf/oodt/docs/site/
https://svn.apache.org/repos/asf/oodt/docs/site/about/history/index.html
Once you update the index.html file, you can either:
(1) follow this process:
https://cwiki.apache.org/confluence/display/OODT/How+to+Publish+the+OODT+We
b+Site
to build and publish the site
(2) hit me up, or someone else that already has a local copy of the website
built and I can push the changes.
Cheers,
Chris
-----Original Message-----
From: Dan Crichton <da...@jpl.nasa.gov>
Reply-To: <de...@oodt.apache.org>
Date: Monday, September 29, 2014 at 11:32 AM
To: "dev@oodt.apache.org" <de...@oodt.apache.org>
Subject: Re: OODT & Apache
>Hi Chris,
>
>I'll volunteer to update the timeline. I'd like to hit the 2000-2005 era
>and also add in airborne instruments, etc.
>
>Thanks,
>Dan
>
>On 9/29/14 9:38 AM, "Mattmann, Chris A (3980)"
><ch...@jpl.nasa.gov> wrote:
>
>>Hi All, recently I came up with some answers to questions
>>about Apache OODT that would likely be useful to the community
>>so here ya go! :)
>>
>>(with permission from Jen Cruz to share)
>>
>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>Chris Mattmann, Ph.D.
>>Chief Architect
>>Instrument Software and Science Data Systems Section (398)
>>NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>Office: 168-519, Mailstop: 168-527
>>Email: chris.a.mattmann@nasa.gov
>>WWW: http://sunset.usc.edu/~mattmann/
>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>Adjunct Associate Professor, Computer Science Department
>>University of Southern California, Los Angeles, CA 90089 USA
>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>>
>>
>>
>>
>>
>>-----Original Message-----
>>From: <Mattmann>, Chris Mattmann <Ch...@jpl.nasa.gov>
>>Date: Monday, September 29, 2014 at 9:31 AM
>>To: "Cruz, Jennifer W (3980)" <je...@jpl.nasa.gov>
>>Cc: "Freeborn, Dana J (398J)" <da...@jpl.nasa.gov>, "Cuddy,
>>David T (398B)" <da...@jpl.nasa.gov>, "Ramirez, Paul M (398J)"
>><pa...@jpl.nasa.gov>
>>Subject: Re: OODT & Apache
>>
>>>Hi Jennifer,
>>>
>>>-----Original Message-----
>>>
>>>From: <Cruz>, "Jennifer W (3980)" <je...@jpl.nasa.gov>
>>>Date: Monday, September 29, 2014 at 9:20 AM
>>>To: Chris Mattmann <Ch...@jpl.nasa.gov>
>>>Cc: "Cruz, Jennifer W (3980)" <je...@jpl.nasa.gov>, "Freeborn,
>>>Dana J (398J)" <da...@jpl.nasa.gov>, "Cuddy, David T (398B)"
>>><da...@jpl.nasa.gov>
>>>Subject: OODT & Apache
>>>
>>>>Chris,
>>>>
>>>>
>>>>I¹m working on a chart for SMAP feed forward to NISAR & SWOT. I would
>>>>like to show a little of OODT evolution and ties into flight projects.
>>>
>>>Great.
>>>
>>>Current list of recent flight projects powered by OODT (Apache and
>>>otherwise):
>>>
>>>OCO-2 - JPL
>>>NPP Sounder PEATE - JPL
>>>SMAP - JPL
>>>CARVE - JPL
>>>Airborne Snow Observatory - JPL
>>>JPSS GRAVITE - GSFC
>>>
>>>Note that APL is also currently working on infusing OODT into its Deep
>>>Horizons pipeline.
>>>
>>>>
>>>>
>>>>What was the timeframe when OODT was available open source/Apache?
>>>
>>>See: http://oodt.apache.org/about/history/
>>>
>>>(relevant subset)
>>>
>>>2005 OODT becomes open source through Open Channel Foundation, but gains
>>>little traction.
>>>2007 OODT deployed for the Orbiting Carbon Observatory and Seawinds
>>>missions. OODT embraces earth science.
>>>2008 OODT deployed in for National Polar-Orbiting Environmental
>>>Satellite
>>>System. OODT embraces atmospheric science.
>>>2010 JanuaryApache OODT enters the Apache Incubator.
>>>2010 November OODT makes it's first official release.
>>> Apache OODT is voted a Top Level Project.
>>>2011 February OODT makes it's first Official Release as a Top Level
>>>Project bringing v0.2 to the community.
>>>2011 June OODT makes the 0.3 release to the community.
>>>2012 June OODT makes the 0.4 release to the community.
>>>2012 December OODT makes the 0.5 release to the community.
>>>2013 July OODT makes the 0.6 release to the community.
>>>2014 September OODT makes the 0.7 release to the community.
>>>
>>>
>>>
>>>>
>>>>
>>>>When might a non Java (python??) version be available?
>>>
>>>This is an extremely loaded question :) Per Ohloh, rewriting
>>>OODT¹s core in Java would mean likely replacing 53 man years of effort
>>>and 200+K SLOC:
>>>
>>>https://www.openhub.net/p/oodt/
>>>
>>>
>>>That said, OODT already works very nicely with Python via JCC and
>>>Pynius and other libraries in Python that can easily make Javacalls some
>>>even natively. There was a thread earlier on this on the Apache OODT
>>>lists:
>>>
>>>http://s.apache.org/seu
>>>
>>>Note that currently Apache Tika which is fully Java, and being
>>>increasingly
>>>used to power things (including OODT) like your FICO credit score:
>>>
>>>http://goo.gl/31lJxS
>>>
>>>has a Java to Python wrapper as tika-python, here:
>>>
>>>https://github.com/chrismattmann/tika-python/
>>>
>>>It works very nicely. In addition, besides these API and library level
>>>bindings to OODT via Python, it is extremely easy to simply invoke and
>>>command OODT via Python via OODT¹s JAX-RS REST services layer. So OODT
>>>and Python play quite nicely in fact.
>>>
>>>
>>>>Regarding cloud computing, are there any unique capability/upgrades
>>>>necessary to use the OODT components on the cloud?
>>>
>>>Yep, NSF and DARPA are both currently investing to integrate OODT with
>>>Apache CloudStack and with OpenStack. A prototype exists and was
>>>constructed
>>>already by Mike Starch in that area.
>>>
>>>JPL and its Big Data R&TD along with DARPA XDATA and NASA ASIT are also
>>>paying to integrate
>>>OODT with the Berkeley AMP Lab¹s Data Analytics Stack (BDAS). We have
>>>patches up
>>>for review and prototypes ready for people to test as well:
>>>
>>>https://issues.apache.org/jira/browse/OODT-698
>>>
>>>
>>>Would you be OK with me sharing the above BTW with the Apache OODT
>>>community on dev@oodt.apache.org since I compiled the list and it
>>>would probably be useful :)
>>>
>>>HTH!
>>>
>>>Cheers,
>>>Chris
>>>
>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>Chris Mattmann, Ph.D.
>>>Chief Architect
>>>Instrument Software and Science Data Systems Section (398)
>>>NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>Office: 168-519, Mailstop: 168-527
>>>Email: chris.a.mattmann@nasa.gov
>>>WWW: http://sunset.usc.edu/~mattmann/
>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>Adjunct Associate Professor, Computer Science Department
>>>University of Southern California, Los Angeles, CA 90089 USA
>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>
>>>
>>>
>>
>
Re: OODT & Apache
Posted by "Crichton, Daniel J (3902)" <da...@jpl.nasa.gov>.
Hi Chris,
I'll volunteer to update the timeline. I'd like to hit the 2000-2005 era
and also add in airborne instruments, etc.
Thanks,
Dan
On 9/29/14 9:38 AM, "Mattmann, Chris A (3980)"
<ch...@jpl.nasa.gov> wrote:
>Hi All, recently I came up with some answers to questions
>about Apache OODT that would likely be useful to the community
>so here ya go! :)
>
>(with permission from Jen Cruz to share)
>
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>Chris Mattmann, Ph.D.
>Chief Architect
>Instrument Software and Science Data Systems Section (398)
>NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>Office: 168-519, Mailstop: 168-527
>Email: chris.a.mattmann@nasa.gov
>WWW: http://sunset.usc.edu/~mattmann/
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>Adjunct Associate Professor, Computer Science Department
>University of Southern California, Los Angeles, CA 90089 USA
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
>
>
>
>
>-----Original Message-----
>From: <Mattmann>, Chris Mattmann <Ch...@jpl.nasa.gov>
>Date: Monday, September 29, 2014 at 9:31 AM
>To: "Cruz, Jennifer W (3980)" <je...@jpl.nasa.gov>
>Cc: "Freeborn, Dana J (398J)" <da...@jpl.nasa.gov>, "Cuddy,
>David T (398B)" <da...@jpl.nasa.gov>, "Ramirez, Paul M (398J)"
><pa...@jpl.nasa.gov>
>Subject: Re: OODT & Apache
>
>>Hi Jennifer,
>>
>>-----Original Message-----
>>
>>From: <Cruz>, "Jennifer W (3980)" <je...@jpl.nasa.gov>
>>Date: Monday, September 29, 2014 at 9:20 AM
>>To: Chris Mattmann <Ch...@jpl.nasa.gov>
>>Cc: "Cruz, Jennifer W (3980)" <je...@jpl.nasa.gov>, "Freeborn,
>>Dana J (398J)" <da...@jpl.nasa.gov>, "Cuddy, David T (398B)"
>><da...@jpl.nasa.gov>
>>Subject: OODT & Apache
>>
>>>Chris,
>>>
>>>
>>>I¹m working on a chart for SMAP feed forward to NISAR & SWOT. I would
>>>like to show a little of OODT evolution and ties into flight projects.
>>
>>Great.
>>
>>Current list of recent flight projects powered by OODT (Apache and
>>otherwise):
>>
>>OCO-2 - JPL
>>NPP Sounder PEATE - JPL
>>SMAP - JPL
>>CARVE - JPL
>>Airborne Snow Observatory - JPL
>>JPSS GRAVITE - GSFC
>>
>>Note that APL is also currently working on infusing OODT into its Deep
>>Horizons pipeline.
>>
>>>
>>>
>>>What was the timeframe when OODT was available open source/Apache?
>>
>>See: http://oodt.apache.org/about/history/
>>
>>(relevant subset)
>>
>>2005 OODT becomes open source through Open Channel Foundation, but gains
>>little traction.
>>2007 OODT deployed for the Orbiting Carbon Observatory and Seawinds
>>missions. OODT embraces earth science.
>>2008 OODT deployed in for National Polar-Orbiting Environmental Satellite
>>System. OODT embraces atmospheric science.
>>2010 JanuaryApache OODT enters the Apache Incubator.
>>2010 November OODT makes it's first official release.
>> Apache OODT is voted a Top Level Project.
>>2011 February OODT makes it's first Official Release as a Top Level
>>Project bringing v0.2 to the community.
>>2011 June OODT makes the 0.3 release to the community.
>>2012 June OODT makes the 0.4 release to the community.
>>2012 December OODT makes the 0.5 release to the community.
>>2013 July OODT makes the 0.6 release to the community.
>>2014 September OODT makes the 0.7 release to the community.
>>
>>
>>
>>>
>>>
>>>When might a non Java (python??) version be available?
>>
>>This is an extremely loaded question :) Per Ohloh, rewriting
>>OODT¹s core in Java would mean likely replacing 53 man years of effort
>>and 200+K SLOC:
>>
>>https://www.openhub.net/p/oodt/
>>
>>
>>That said, OODT already works very nicely with Python via JCC and
>>Pynius and other libraries in Python that can easily make Javacalls some
>>even natively. There was a thread earlier on this on the Apache OODT
>>lists:
>>
>>http://s.apache.org/seu
>>
>>Note that currently Apache Tika which is fully Java, and being
>>increasingly
>>used to power things (including OODT) like your FICO credit score:
>>
>>http://goo.gl/31lJxS
>>
>>has a Java to Python wrapper as tika-python, here:
>>
>>https://github.com/chrismattmann/tika-python/
>>
>>It works very nicely. In addition, besides these API and library level
>>bindings to OODT via Python, it is extremely easy to simply invoke and
>>command OODT via Python via OODT¹s JAX-RS REST services layer. So OODT
>>and Python play quite nicely in fact.
>>
>>
>>>Regarding cloud computing, are there any unique capability/upgrades
>>>necessary to use the OODT components on the cloud?
>>
>>Yep, NSF and DARPA are both currently investing to integrate OODT with
>>Apache CloudStack and with OpenStack. A prototype exists and was
>>constructed
>>already by Mike Starch in that area.
>>
>>JPL and its Big Data R&TD along with DARPA XDATA and NASA ASIT are also
>>paying to integrate
>>OODT with the Berkeley AMP Lab¹s Data Analytics Stack (BDAS). We have
>>patches up
>>for review and prototypes ready for people to test as well:
>>
>>https://issues.apache.org/jira/browse/OODT-698
>>
>>
>>Would you be OK with me sharing the above BTW with the Apache OODT
>>community on dev@oodt.apache.org since I compiled the list and it
>>would probably be useful :)
>>
>>HTH!
>>
>>Cheers,
>>Chris
>>
>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>Chris Mattmann, Ph.D.
>>Chief Architect
>>Instrument Software and Science Data Systems Section (398)
>>NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>Office: 168-519, Mailstop: 168-527
>>Email: chris.a.mattmann@nasa.gov
>>WWW: http://sunset.usc.edu/~mattmann/
>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>Adjunct Associate Professor, Computer Science Department
>>University of Southern California, Los Angeles, CA 90089 USA
>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>>
>>
>