You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oodt.apache.org by B W <b....@gmail.com> on 2012/01/11 22:26:12 UTC
Transition away from CORBA
What was the time frame and difficulty in transitioning away from
CORBA in the messaging connector for Query Servlet dependency
injection?
BW
Re: Metadata Registry Service
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hi BW,
On Jan 14, 2012, at 9:41 PM, B W wrote:
> The CAS component a metadata registry, but, this is for Metadata to Product
> registry right?
Yep in a way you could think of the CAS (the "File Manager" specifically) of
populating a Metadata Registry, one geared towards File Cataloging. So,
the metadata is highly related to building up what I would call a "File Catalog".
>
> What we are talking about in this thread regarding the registry would be
> useful for say: caching queries and respect product index(s) that matched
> some metadata, synonymous with the common data dictionary, in a custom data
> dictionary for an external data repository.
Yes, the idea is that the Registry we're talking about here is an ebXML type of
registry, useful for operating in the ebXML schema and interface [1].
Cheers,
Chris
[1] http://www.ebxml.org/
>
> On Fri, Jan 13, 2012 at 5:39 PM, Mattmann, Chris A (388J) <
> chris.a.mattmann@jpl.nasa.gov> wrote:
>
>> Hey Sean,
>>
>> Super +1, sounds awesome and looking forward to it.
>>
>> Cheers,
>> Chris
>>
>> On Jan 13, 2012, at 1:54 PM, Hardman, Sean H (388J) wrote:
>>
>>> Hey Chris et al,
>>>
>>> My plan is to submit the Registry Service as another component under the
>>> OODT umbrella. This process will probably not start until late summer or
>>> early fall of this year due to the PDS delivery schedule. I want to make
>>> sure that we have satisfied all of the PDS requirements for the software
>>> before we turn it over to the open source world. For those interested in
>> a
>>> little more information regarding the software, albeit a tad PDS-centric,
>>> we presented a poster [1] at the AGU Fall meeting last year (last month).
>>>
>>> Sean (The Other Sean) Hardman
>>>
>>> [1]
>>>
>> http://eposters.agu.org/abstracts/a-model-driven-science-data-product-regis
>>> tration-service
>>>
>>>
>>> On 1/12/12 8:22 PM, "Mattmann, Chris A (388J)"
>>> <ch...@jpl.nasa.gov> wrote:
>>>
>>>> Hey Sean,
>>>>
>>>>>
>>>>> The ebXML model is one of the least egregious for a registry that I've
>>>>> seen, and believe me, I've seen some nasty ones. But what makes JPL's
>>>>> implementation so compelling is its JSON-esque and ReST-ful based API,
>>>>> which, as far as I can tell, is totally original within the ebXML &
>>>>> OASIS worlds.
>>>>>
>>>>> Normally I turn my nose up to heavy-handed models with entrenched APIs,
>>>>> but the singular achievement of JPL is to make the ebXML model, which
>>>>> conceptually isn't byzantine, actually usable, approachable, and
>>>>> extendable.
>>>>
>>>> Super +1.
>>>>
>>>>>
>>>>> Is there any hope we can get JPL, Caltech, and NASA to give it up to
>>>>> become part of OODT? Or its own Incubator project?
>>>>
>>>> I think Hardman is working on it, he can feel free to comment (or not)
>>>> here ^_^
>>>>
>>>> Cheers,
>>>> Chris
>>>>
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>> Chris Mattmann, Ph.D.
>>>> Senior Computer Scientist
>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>> Office: 171-266B, Mailstop: 171-246
>>>> Email: chris.a.mattmann@nasa.gov
>>>> WWW: http://sunset.usc.edu/~mattmann/
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>> Adjunct Assistant Professor, Computer Science Department
>>>> University of Southern California, Los Angeles, CA 90089 USA
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>
>>>
>>
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov
>> WWW: http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>>
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: Metadata Registry Service
Posted by B W <b....@gmail.com>.
The CAS component a metadata registry, but, this is for Metadata to Product
registry right?
What we are talking about in this thread regarding the registry would be
useful for say: caching queries and respect product index(s) that matched
some metadata, synonymous with the common data dictionary, in a custom data
dictionary for an external data repository.
Right?
On Fri, Jan 13, 2012 at 5:39 PM, Mattmann, Chris A (388J) <
chris.a.mattmann@jpl.nasa.gov> wrote:
> Hey Sean,
>
> Super +1, sounds awesome and looking forward to it.
>
> Cheers,
> Chris
>
> On Jan 13, 2012, at 1:54 PM, Hardman, Sean H (388J) wrote:
>
> > Hey Chris et al,
> >
> > My plan is to submit the Registry Service as another component under the
> > OODT umbrella. This process will probably not start until late summer or
> > early fall of this year due to the PDS delivery schedule. I want to make
> > sure that we have satisfied all of the PDS requirements for the software
> > before we turn it over to the open source world. For those interested in
> a
> > little more information regarding the software, albeit a tad PDS-centric,
> > we presented a poster [1] at the AGU Fall meeting last year (last month).
> >
> > Sean (The Other Sean) Hardman
> >
> > [1]
> >
> http://eposters.agu.org/abstracts/a-model-driven-science-data-product-regis
> > tration-service
> >
> >
> > On 1/12/12 8:22 PM, "Mattmann, Chris A (388J)"
> > <ch...@jpl.nasa.gov> wrote:
> >
> >> Hey Sean,
> >>
> >>>
> >>> The ebXML model is one of the least egregious for a registry that I've
> >>> seen, and believe me, I've seen some nasty ones. But what makes JPL's
> >>> implementation so compelling is its JSON-esque and ReST-ful based API,
> >>> which, as far as I can tell, is totally original within the ebXML &
> >>> OASIS worlds.
> >>>
> >>> Normally I turn my nose up to heavy-handed models with entrenched APIs,
> >>> but the singular achievement of JPL is to make the ebXML model, which
> >>> conceptually isn't byzantine, actually usable, approachable, and
> >>> extendable.
> >>
> >> Super +1.
> >>
> >>>
> >>> Is there any hope we can get JPL, Caltech, and NASA to give it up to
> >>> become part of OODT? Or its own Incubator project?
> >>
> >> I think Hardman is working on it, he can feel free to comment (or not)
> >> here ^_^
> >>
> >> Cheers,
> >> Chris
> >>
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Chris Mattmann, Ph.D.
> >> Senior Computer Scientist
> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> Office: 171-266B, Mailstop: 171-246
> >> Email: chris.a.mattmann@nasa.gov
> >> WWW: http://sunset.usc.edu/~mattmann/
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Adjunct Assistant Professor, Computer Science Department
> >> University of Southern California, Los Angeles, CA 90089 USA
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>
> >
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
Re: Metadata Registry Service
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hey Sean,
Super +1, sounds awesome and looking forward to it.
Cheers,
Chris
On Jan 13, 2012, at 1:54 PM, Hardman, Sean H (388J) wrote:
> Hey Chris et al,
>
> My plan is to submit the Registry Service as another component under the
> OODT umbrella. This process will probably not start until late summer or
> early fall of this year due to the PDS delivery schedule. I want to make
> sure that we have satisfied all of the PDS requirements for the software
> before we turn it over to the open source world. For those interested in a
> little more information regarding the software, albeit a tad PDS-centric,
> we presented a poster [1] at the AGU Fall meeting last year (last month).
>
> Sean (The Other Sean) Hardman
>
> [1]
> http://eposters.agu.org/abstracts/a-model-driven-science-data-product-regis
> tration-service
>
>
> On 1/12/12 8:22 PM, "Mattmann, Chris A (388J)"
> <ch...@jpl.nasa.gov> wrote:
>
>> Hey Sean,
>>
>>>
>>> The ebXML model is one of the least egregious for a registry that I've
>>> seen, and believe me, I've seen some nasty ones. But what makes JPL's
>>> implementation so compelling is its JSON-esque and ReST-ful based API,
>>> which, as far as I can tell, is totally original within the ebXML &
>>> OASIS worlds.
>>>
>>> Normally I turn my nose up to heavy-handed models with entrenched APIs,
>>> but the singular achievement of JPL is to make the ebXML model, which
>>> conceptually isn't byzantine, actually usable, approachable, and
>>> extendable.
>>
>> Super +1.
>>
>>>
>>> Is there any hope we can get JPL, Caltech, and NASA to give it up to
>>> become part of OODT? Or its own Incubator project?
>>
>> I think Hardman is working on it, he can feel free to comment (or not)
>> here ^_^
>>
>> Cheers,
>> Chris
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov
>> WWW: http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: Metadata Registry Service
Posted by "Hardman, Sean H (388J)" <se...@jpl.nasa.gov>.
Hey Chris et al,
My plan is to submit the Registry Service as another component under the
OODT umbrella. This process will probably not start until late summer or
early fall of this year due to the PDS delivery schedule. I want to make
sure that we have satisfied all of the PDS requirements for the software
before we turn it over to the open source world. For those interested in a
little more information regarding the software, albeit a tad PDS-centric,
we presented a poster [1] at the AGU Fall meeting last year (last month).
Sean (The Other Sean) Hardman
[1]
http://eposters.agu.org/abstracts/a-model-driven-science-data-product-regis
tration-service
On 1/12/12 8:22 PM, "Mattmann, Chris A (388J)"
<ch...@jpl.nasa.gov> wrote:
>Hey Sean,
>
>>
>> The ebXML model is one of the least egregious for a registry that I've
>>seen, and believe me, I've seen some nasty ones. But what makes JPL's
>>implementation so compelling is its JSON-esque and ReST-ful based API,
>>which, as far as I can tell, is totally original within the ebXML &
>>OASIS worlds.
>>
>> Normally I turn my nose up to heavy-handed models with entrenched APIs,
>>but the singular achievement of JPL is to make the ebXML model, which
>>conceptually isn't byzantine, actually usable, approachable, and
>>extendable.
>
>Super +1.
>
>>
>> Is there any hope we can get JPL, Caltech, and NASA to give it up to
>>become part of OODT? Or its own Incubator project?
>
>I think Hardman is working on it, he can feel free to comment (or not)
>here ^_^
>
>Cheers,
>Chris
>
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>Chris Mattmann, Ph.D.
>Senior Computer Scientist
>NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>Office: 171-266B, Mailstop: 171-246
>Email: chris.a.mattmann@nasa.gov
>WWW: http://sunset.usc.edu/~mattmann/
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>Adjunct Assistant Professor, Computer Science Department
>University of Southern California, Los Angeles, CA 90089 USA
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
Re: Metadata Registry Service
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hey Sean,
>
> The ebXML model is one of the least egregious for a registry that I've seen, and believe me, I've seen some nasty ones. But what makes JPL's implementation so compelling is its JSON-esque and ReST-ful based API, which, as far as I can tell, is totally original within the ebXML & OASIS worlds.
>
> Normally I turn my nose up to heavy-handed models with entrenched APIs, but the singular achievement of JPL is to make the ebXML model, which conceptually isn't byzantine, actually usable, approachable, and extendable.
Super +1.
>
> Is there any hope we can get JPL, Caltech, and NASA to give it up to become part of OODT? Or its own Incubator project?
I think Hardman is working on it, he can feel free to comment (or not) here ^_^
Cheers,
Chris
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: Metadata Registry Service
Posted by Sean Kelly <ke...@apache.org>.
> I've been developing client-side applications for that registry in Python (thank heavens) for the International Planetary Data Alliance [1] and it's been really smooth-sailing.
Footnote forgotten:
[1] http://planetarydata.org/
Better?
Sorry about that, folks!
Re: Metadata Registry Service
Posted by Sean Kelly <ke...@apache.org>.
> At one point before coming to Apache, we had a metadata registry service at JPL
> as part of the OODT components but it fell out of maintenance and out of sync
> with the current code base. Since then NASA's Planetary Data System (PDS) has been
> building an ebXML compliant registry and a JAX-RS based implementation that
> makes a lot more sense. I know that the PDS folks are currently working to figure out
> how to contribute the code to the ASF.
I've been developing client-side applications for that registry in Python (thank heavens) for the International Planetary Data Alliance [1] and it's been really smooth-sailing.
The ebXML model is one of the least egregious for a registry that I've seen, and believe me, I've seen some nasty ones. But what makes JPL's implementation so compelling is its JSON-esque and ReST-ful based API, which, as far as I can tell, is totally original within the ebXML & OASIS worlds.
Normally I turn my nose up to heavy-handed models with entrenched APIs, but the singular achievement of JPL is to make the ebXML model, which conceptually isn't byzantine, actually usable, approachable, and extendable.
Is there any hope we can get JPL, Caltech, and NASA to give it up to become part of OODT? Or its own Incubator project?
Fingers crossed!
--
Sean Kelly
Member, Apache Software Foundation
Re: Metadata Registry Service
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hi BW,
At one point before coming to Apache, we had a metadata registry service at JPL
as part of the OODT components but it fell out of maintenance and out of sync
with the current code base. Since then NASA's Planetary Data System (PDS) has been
building an ebXML compliant registry and a JAX-RS based implementation that
makes a lot more sense. I know that the PDS folks are currently working to figure out
how to contribute the code to the ASF.
At the time that the Metadata Registry Service existed some years ago, some major
components of it were:
1. File Manager Validation Layer (to perform element validation and to store element
definitions)
2. Algorithm element validation (based on types)
3. For registration of data product metadata/registry entries
HTH!
Cheers,
Chris
On Jan 12, 2012, at 7:26 AM, B W wrote:
> Does the Metadata Registry Service plug-in to the message layer via a handler?
>
> BW
>
> On Jan 11, 2012, at 2:15 PM, "Mattmann, Chris A (388J)"
> <ch...@jpl.nasa.gov> wrote:
>
>> Hi BW,
>>
>> Thanks for your question. It took us about a weekend to perform the transition
>> originally back in the 2001-2002 timeframe, when we moved over from CORBA
>> to Java's Remote Method Invocation (RMI) mainly due to the clean separation
>> of concerns in our messaging layer and between it and the other components
>> (query server, profile, and product server) and the rest of the information integration
>> code in OODT.
>>
>> As for the rest of the system since then we've since transitioned away from RMI
>> for the most part and use XML-RPC and REST/HTTP as the main communication
>> forms, with similar transition times, and good results.
>>
>> HTH!
>>
>> Cheers,
>> Chris
>>
>> On Jan 11, 2012, at 1:26 PM, B W wrote:
>>
>>> What was the time frame and difficulty in transitioning away from
>>> CORBA in the messaging connector for Query Servlet dependency
>>> injection?
>>>
>>> BW
>>
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov
>> WWW: http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: Metadata Registry Service
Posted by B W <b....@gmail.com>.
Does the Metadata Registry Service plug-in to the message layer via a handler?
BW
On Jan 11, 2012, at 2:15 PM, "Mattmann, Chris A (388J)"
<ch...@jpl.nasa.gov> wrote:
> Hi BW,
>
> Thanks for your question. It took us about a weekend to perform the transition
> originally back in the 2001-2002 timeframe, when we moved over from CORBA
> to Java's Remote Method Invocation (RMI) mainly due to the clean separation
> of concerns in our messaging layer and between it and the other components
> (query server, profile, and product server) and the rest of the information integration
> code in OODT.
>
> As for the rest of the system since then we've since transitioned away from RMI
> for the most part and use XML-RPC and REST/HTTP as the main communication
> forms, with similar transition times, and good results.
>
> HTH!
>
> Cheers,
> Chris
>
> On Jan 11, 2012, at 1:26 PM, B W wrote:
>
>> What was the time frame and difficulty in transitioning away from
>> CORBA in the messaging connector for Query Servlet dependency
>> injection?
>>
>> BW
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
Re: Transition away from CORBA
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hi BW,
Thanks for your question. It took us about a weekend to perform the transition
originally back in the 2001-2002 timeframe, when we moved over from CORBA
to Java's Remote Method Invocation (RMI) mainly due to the clean separation
of concerns in our messaging layer and between it and the other components
(query server, profile, and product server) and the rest of the information integration
code in OODT.
As for the rest of the system since then we've since transitioned away from RMI
for the most part and use XML-RPC and REST/HTTP as the main communication
forms, with similar transition times, and good results.
HTH!
Cheers,
Chris
On Jan 11, 2012, at 1:26 PM, B W wrote:
> What was the time frame and difficulty in transitioning away from
> CORBA in the messaging connector for Query Servlet dependency
> injection?
>
> BW
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++