You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oodt.apache.org by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov> on 2011/05/18 04:45:53 UTC
Updated RADIX web page data dir
Hey Guys,
FYI: https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
I updated the page to propose a:
/data
/archive
/staging
/work
/met
/failed_ingest_files
Dir structure for RADIX to more closely match our existing OODT deployments.
Cheers,
Chris
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: Updated RADIX web page data dir
Posted by Cameron Goodale <si...@gmail.com>.
Guys,
Sorry for being largely absent from the discussion, but I think you guys
have it well under control. My vision for RADiX was an 80% solution so
Chris if you want to be in the other 20% that is cool with me ;)
I think we should make it clear that RADiX is an OPTION, and not the ONLY
way to build and deploy OODT. Our desire is to help OODT Devs and Users by
giving them a sort of 'default' development and deployment structure. I
think the Ruby on Rails guys said it best, "Convention over configuration"
since RADiX will already be configured to use it's convention.
Great input and feedback Chris. I wonder if anyone else has given the Wiki
a look and wants to give their input, we are open to it.
https://cwiki.apache.org/OODT/radix-powered-by-oodt.html
Prost!
Cameron
On Thu, May 19, 2011 at 10:13 PM, Mattmann, Chris A (388J) <
chris.a.mattmann@jpl.nasa.gov> wrote:
> +1 to /failure/ingest and /failure/jobs, etc.
>
> That makes sense to me...though unfortunately will cause grumpy people like
> me to have to change to take advantage of the power of RADIX. I'll learn
> though (slowly) over time :)
>
> Cheers,
> Chris
>
> On May 19, 2011, at 7:40 AM, Ramirez, Paul M (388J) wrote:
>
> > Hey Chris,
> >
> > The failure was just meant to be more generic as there could be other
> items, from say workflow, that would also go in there. How about having
> "/failure/ingest"? That still does remove the files word though so
> "/failure/ingest_files" is a possibility. The reasoning behind not having
> files in the directory name is that at the highest level we talk about
> ingestion of products and not files.
> >
> > Thanks,
> > Paul
> >
> >
> >
> >
> > On May 18, 2011, at 6:21 PM, Mattmann, Chris A (388J) wrote:
> >
> >> Hi Paul,
> >>
> >> met could be for either the crawler or for the curator.
> >>
> >> As for failed_ingest_files, why the rename? Just to be shorter? I think
> failed_ingest_files, though more verbose, conveys more meaning than
> failure...
> >>
> >> Cheers,
> >> Chris
> >>
> >> On May 18, 2011, at 7:50 AM, Ramirez, Paul M (388J) wrote:
> >>
> >>> Hey Chris,
> >>>
> >>> The met directory was for generated metadata by the crawler or was it
> for the curator? I updated the page with a description of the paths and
> renamed failed_ingest_files to failure. On the next pass I'll start posting
> a description of the source structure that will be available as output from
> the RADiX archetype.
> >>>
> >>> Thanks,
> >>> Paul
> >>>
> >>> On May 17, 2011, at 7:45 PM, Mattmann, Chris A (388J) wrote:
> >>>
> >>>> Hey Guys,
> >>>>
> >>>> FYI:
> https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
> >>>>
> >>>> I updated the page to propose a:
> >>>>
> >>>> /data
> >>>> /archive
> >>>> /staging
> >>>> /work
> >>>> /met
> >>>> /failed_ingest_files
> >>>>
> >>>> Dir structure for RADIX to more closely match our existing OODT
> deployments.
> >>>>
> >>>> Cheers,
> >>>> Chris
> >>>>
> >>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>>> Chris Mattmann, Ph.D.
> >>>> Senior Computer Scientist
> >>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >>>> Office: 171-266B, Mailstop: 171-246
> >>>> Email: chris.a.mattmann@nasa.gov
> >>>> WWW: http://sunset.usc.edu/~mattmann/
> >>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>>> Adjunct Assistant Professor, Computer Science Department
> >>>> University of Southern California, Los Angeles, CA 90089 USA
> >>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>>>
> >>>
> >>
> >>
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Chris Mattmann, Ph.D.
> >> Senior Computer Scientist
> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> Office: 171-266B, Mailstop: 171-246
> >> Email: chris.a.mattmann@nasa.gov
> >> WWW: http://sunset.usc.edu/~mattmann/
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Adjunct Assistant Professor, Computer Science Department
> >> University of Southern California, Los Angeles, CA 90089 USA
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>
> >
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
--
Sent from a Tin Can attached to a String
Re: Updated RADIX web page data dir
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
+1 to /failure/ingest and /failure/jobs, etc.
That makes sense to me...though unfortunately will cause grumpy people like me to have to change to take advantage of the power of RADIX. I'll learn though (slowly) over time :)
Cheers,
Chris
On May 19, 2011, at 7:40 AM, Ramirez, Paul M (388J) wrote:
> Hey Chris,
>
> The failure was just meant to be more generic as there could be other items, from say workflow, that would also go in there. How about having "/failure/ingest"? That still does remove the files word though so "/failure/ingest_files" is a possibility. The reasoning behind not having files in the directory name is that at the highest level we talk about ingestion of products and not files.
>
> Thanks,
> Paul
>
>
>
>
> On May 18, 2011, at 6:21 PM, Mattmann, Chris A (388J) wrote:
>
>> Hi Paul,
>>
>> met could be for either the crawler or for the curator.
>>
>> As for failed_ingest_files, why the rename? Just to be shorter? I think failed_ingest_files, though more verbose, conveys more meaning than failure...
>>
>> Cheers,
>> Chris
>>
>> On May 18, 2011, at 7:50 AM, Ramirez, Paul M (388J) wrote:
>>
>>> Hey Chris,
>>>
>>> The met directory was for generated metadata by the crawler or was it for the curator? I updated the page with a description of the paths and renamed failed_ingest_files to failure. On the next pass I'll start posting a description of the source structure that will be available as output from the RADiX archetype.
>>>
>>> Thanks,
>>> Paul
>>>
>>> On May 17, 2011, at 7:45 PM, Mattmann, Chris A (388J) wrote:
>>>
>>>> Hey Guys,
>>>>
>>>> FYI: https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
>>>>
>>>> I updated the page to propose a:
>>>>
>>>> /data
>>>> /archive
>>>> /staging
>>>> /work
>>>> /met
>>>> /failed_ingest_files
>>>>
>>>> Dir structure for RADIX to more closely match our existing OODT deployments.
>>>>
>>>> Cheers,
>>>> Chris
>>>>
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>> Chris Mattmann, Ph.D.
>>>> Senior Computer Scientist
>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>> Office: 171-266B, Mailstop: 171-246
>>>> Email: chris.a.mattmann@nasa.gov
>>>> WWW: http://sunset.usc.edu/~mattmann/
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>> Adjunct Assistant Professor, Computer Science Department
>>>> University of Southern California, Los Angeles, CA 90089 USA
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>
>>>
>>
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov
>> WWW: http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: Updated RADIX web page data dir
Posted by "Ramirez, Paul M (388J)" <pa...@jpl.nasa.gov>.
Hey Chris,
The failure was just meant to be more generic as there could be other items, from say workflow, that would also go in there. How about having "/failure/ingest"? That still does remove the files word though so "/failure/ingest_files" is a possibility. The reasoning behind not having files in the directory name is that at the highest level we talk about ingestion of products and not files.
Thanks,
Paul
On May 18, 2011, at 6:21 PM, Mattmann, Chris A (388J) wrote:
> Hi Paul,
>
> met could be for either the crawler or for the curator.
>
> As for failed_ingest_files, why the rename? Just to be shorter? I think failed_ingest_files, though more verbose, conveys more meaning than failure...
>
> Cheers,
> Chris
>
> On May 18, 2011, at 7:50 AM, Ramirez, Paul M (388J) wrote:
>
>> Hey Chris,
>>
>> The met directory was for generated metadata by the crawler or was it for the curator? I updated the page with a description of the paths and renamed failed_ingest_files to failure. On the next pass I'll start posting a description of the source structure that will be available as output from the RADiX archetype.
>>
>> Thanks,
>> Paul
>>
>> On May 17, 2011, at 7:45 PM, Mattmann, Chris A (388J) wrote:
>>
>>> Hey Guys,
>>>
>>> FYI: https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
>>>
>>> I updated the page to propose a:
>>>
>>> /data
>>> /archive
>>> /staging
>>> /work
>>> /met
>>> /failed_ingest_files
>>>
>>> Dir structure for RADIX to more closely match our existing OODT deployments.
>>>
>>> Cheers,
>>> Chris
>>>
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Chris Mattmann, Ph.D.
>>> Senior Computer Scientist
>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>> Office: 171-266B, Mailstop: 171-246
>>> Email: chris.a.mattmann@nasa.gov
>>> WWW: http://sunset.usc.edu/~mattmann/
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Adjunct Assistant Professor, Computer Science Department
>>> University of Southern California, Los Angeles, CA 90089 USA
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>
>>
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
Re: Updated RADIX web page data dir
Posted by "Ramirez, Paul M (388J)" <pa...@jpl.nasa.gov>.
Hey Chris,
Thanks for port updates. Some of those values were temporary placeholders so thanks for the update. "etc" is fine to keep the evolution of deployments intact but as far as changing the way people have done things, I'm not sure that would happen as I don't know that a goal of RADiX is to have people update their existing configuration of there deployed systems. I'm going to update the overview of RADiX to touch on this. I'm also going to add some goals to the RADiX Wiki as there is stuff that Cameron and I have talked about that is not on there and it needs to be captured somewhere.
The rationale behind the change to "conf" versus "etc" was that many Java frameworks use a "conf" directory to capture configuration but I do feel your point on changing just for changing sake. If somehow this has changed your mind in favor of "conf" great, if not long live "etc".
tldr; back to "etc"
Thanks,
Paul
On May 18, 2011, at 6:59 PM, Mattmann, Chris A (388J) wrote:
> Oh, also I just updated the port #s and changed conf->etc. There's no reason to change the way that folks have been deploying things and anything other than that would be a change...
>
> Cheers,
> Chris
>
> On May 18, 2011, at 6:21 PM, Mattmann, Chris A (388J) wrote:
>
>> Hi Paul,
>>
>> met could be for either the crawler or for the curator.
>>
>> As for failed_ingest_files, why the rename? Just to be shorter? I think failed_ingest_files, though more verbose, conveys more meaning than failure...
>>
>> Cheers,
>> Chris
>>
>> On May 18, 2011, at 7:50 AM, Ramirez, Paul M (388J) wrote:
>>
>>> Hey Chris,
>>>
>>> The met directory was for generated metadata by the crawler or was it for the curator? I updated the page with a description of the paths and renamed failed_ingest_files to failure. On the next pass I'll start posting a description of the source structure that will be available as output from the RADiX archetype.
>>>
>>> Thanks,
>>> Paul
>>>
>>> On May 17, 2011, at 7:45 PM, Mattmann, Chris A (388J) wrote:
>>>
>>>> Hey Guys,
>>>>
>>>> FYI: https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
>>>>
>>>> I updated the page to propose a:
>>>>
>>>> /data
>>>> /archive
>>>> /staging
>>>> /work
>>>> /met
>>>> /failed_ingest_files
>>>>
>>>> Dir structure for RADIX to more closely match our existing OODT deployments.
>>>>
>>>> Cheers,
>>>> Chris
>>>>
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>> Chris Mattmann, Ph.D.
>>>> Senior Computer Scientist
>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>> Office: 171-266B, Mailstop: 171-246
>>>> Email: chris.a.mattmann@nasa.gov
>>>> WWW: http://sunset.usc.edu/~mattmann/
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>> Adjunct Assistant Professor, Computer Science Department
>>>> University of Southern California, Los Angeles, CA 90089 USA
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>
>>>
>>
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov
>> WWW: http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
Re: Updated RADIX web page data dir
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Oh, also I just updated the port #s and changed conf->etc. There's no reason to change the way that folks have been deploying things and anything other than that would be a change...
Cheers,
Chris
On May 18, 2011, at 6:21 PM, Mattmann, Chris A (388J) wrote:
> Hi Paul,
>
> met could be for either the crawler or for the curator.
>
> As for failed_ingest_files, why the rename? Just to be shorter? I think failed_ingest_files, though more verbose, conveys more meaning than failure...
>
> Cheers,
> Chris
>
> On May 18, 2011, at 7:50 AM, Ramirez, Paul M (388J) wrote:
>
>> Hey Chris,
>>
>> The met directory was for generated metadata by the crawler or was it for the curator? I updated the page with a description of the paths and renamed failed_ingest_files to failure. On the next pass I'll start posting a description of the source structure that will be available as output from the RADiX archetype.
>>
>> Thanks,
>> Paul
>>
>> On May 17, 2011, at 7:45 PM, Mattmann, Chris A (388J) wrote:
>>
>>> Hey Guys,
>>>
>>> FYI: https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
>>>
>>> I updated the page to propose a:
>>>
>>> /data
>>> /archive
>>> /staging
>>> /work
>>> /met
>>> /failed_ingest_files
>>>
>>> Dir structure for RADIX to more closely match our existing OODT deployments.
>>>
>>> Cheers,
>>> Chris
>>>
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Chris Mattmann, Ph.D.
>>> Senior Computer Scientist
>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>> Office: 171-266B, Mailstop: 171-246
>>> Email: chris.a.mattmann@nasa.gov
>>> WWW: http://sunset.usc.edu/~mattmann/
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Adjunct Assistant Professor, Computer Science Department
>>> University of Southern California, Los Angeles, CA 90089 USA
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>
>>
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: Updated RADIX web page data dir
Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Hi Paul,
met could be for either the crawler or for the curator.
As for failed_ingest_files, why the rename? Just to be shorter? I think failed_ingest_files, though more verbose, conveys more meaning than failure...
Cheers,
Chris
On May 18, 2011, at 7:50 AM, Ramirez, Paul M (388J) wrote:
> Hey Chris,
>
> The met directory was for generated metadata by the crawler or was it for the curator? I updated the page with a description of the paths and renamed failed_ingest_files to failure. On the next pass I'll start posting a description of the source structure that will be available as output from the RADiX archetype.
>
> Thanks,
> Paul
>
> On May 17, 2011, at 7:45 PM, Mattmann, Chris A (388J) wrote:
>
>> Hey Guys,
>>
>> FYI: https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
>>
>> I updated the page to propose a:
>>
>> /data
>> /archive
>> /staging
>> /work
>> /met
>> /failed_ingest_files
>>
>> Dir structure for RADIX to more closely match our existing OODT deployments.
>>
>> Cheers,
>> Chris
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov
>> WWW: http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Re: Updated RADIX web page data dir
Posted by "Ramirez, Paul M (388J)" <pa...@jpl.nasa.gov>.
Hey Paul,
All volunteers are welcome. Actually your timing is great as one items we were going to tackle next was UIs and services within OODT. We hadn't planned on getting to this until July as our initial delivery of crawler, filemgr, and workflow is end of June. Currently, there are a few UIs and services that are packaged as war files within the OODT code. For RADiX we need to understand how we deliver them out the box (i.e. configured and ready to go), which likely means packaging in a Tomcat or Jetty server. In addition, we need to know if there is any tailoring the end consumer would do for that UI/service and how they would do that tailoring (think skins for a web app). Here are the steps I would take to get started.
1) Join the OODT Apache community (i.e. get on our mailing lists)
2) Read the RADiX Wiki
3) Survey what UI/services are available in the OODT codebase
4) Formulate how these should be packaged into a distribution and put them into our test distribution which is being developed in a branch
5) Update the RADiX archetype to make the tested out packaging happen
6) Further UI/service development in the OODT codebase for any gaps in the current set
For items one through five you wouldn't be developing anything new in the UI/services area but it will help give you a view of what we have and the direction we are going. Generally, I would say that there are 2 classes of UIs/services that we are looking to support, a management UI for understanding what is going on behind the scenes, and a portal to deliver to an community products from the data management system. There is support for both in the codebase but help to fill in gaps and evolve would be great (long term).
At the end of the day people just want something that just works out of the box so RADiX is aiming to appeal to that group and leverage what has already been done; think wrapping paper, tape, and some bows. I'll be on vacation for a few weeks but Cameron Goodale is around if you have questions.
Thanks,
Paul
On May 18, 2011, at 6:53 PM, Paul Vee wrote:
Nice to see you again. SO...Thought Leader gave me a wink today at lunch stating that I would be able to help with RADiX...not sure how I can help (since I am a UI guy), but if you can point me some kind of direction I'll be glad to pick up a shovel.
On Wed, May 18, 2011 at 7:50 AM, Ramirez, Paul M (388J) <pa...@jpl.nasa.gov>> wrote:
Hey Chris,
The met directory was for generated metadata by the crawler or was it for the curator? I updated the page with a description of the paths and renamed failed_ingest_files to failure. On the next pass I'll start posting a description of the source structure that will be available as output from the RADiX archetype.
Thanks,
Paul
On May 17, 2011, at 7:45 PM, Mattmann, Chris A (388J) wrote:
> Hey Guys,
>
> FYI: https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
>
> I updated the page to propose a:
>
> /data
> /archive
> /staging
> /work
> /met
> /failed_ingest_files
>
> Dir structure for RADIX to more closely match our existing OODT deployments.
>
> Cheers,
> Chris
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov<ma...@nasa.gov>
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
--
Paul Vee
paul.vee@gmail.com<ma...@gmail.com>
Re: Updated RADIX web page data dir
Posted by "Ramirez, Paul M (388J)" <pa...@jpl.nasa.gov>.
Hey Chris,
The met directory was for generated metadata by the crawler or was it for the curator? I updated the page with a description of the paths and renamed failed_ingest_files to failure. On the next pass I'll start posting a description of the source structure that will be available as output from the RADiX archetype.
Thanks,
Paul
On May 17, 2011, at 7:45 PM, Mattmann, Chris A (388J) wrote:
> Hey Guys,
>
> FYI: https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
>
> I updated the page to propose a:
>
> /data
> /archive
> /staging
> /work
> /met
> /failed_ingest_files
>
> Dir structure for RADIX to more closely match our existing OODT deployments.
>
> Cheers,
> Chris
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>