You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airavata.apache.org by "Mattmann, Chris A (3980)" <ch...@jpl.nasa.gov> on 2015/09/01 01:37:07 UTC

Re: OODT File Manager - Airavata Integration Document

Great work Dimuthu!

So this means now Airavata and OODT’s File Manager are integrated?
:=)

CC/dev@oodt.a.o

Cheers,
Chris

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Chief Architect
Instrument Software and Science Data Systems Section (398)
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 168-519, Mailstop: 168-527
Email: chris.a.mattmann@nasa.gov
WWW:  http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Associate Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++





-----Original Message-----
From: DImuthu Upeksha <di...@gmail.com>
Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
Date: Saturday, August 29, 2015 at 1:27 AM
To: "dev@airavata.apache.org" <de...@airavata.apache.org>
Subject: OODT File Manager - Airavata Integration Document

>Hi all,
>
>
>Please find the document [1] that describes the steps followed in the
>attempt of integrating OODT File Manager and AIravata. This setup is
>currently working on gw77.
>
>
>[1] 
>https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP-M
>OFUDw/edit?usp=sharing
>
>
>Thanks
>Dimuthu
>
>
>-- 
>Regards
>W.Dimuthu Upeksha
>Undergraduate
>Department of Computer Science And Engineering
>University of Moratuwa, Sri Lanka
>
>
>


Re: OODT File Manager - Airavata Integration Document

Posted by "Mattmann, Chris A (3980)" <ch...@jpl.nasa.gov>.
Hey Suresh,

Define the “integration” piece :)

We have integrated with iRODS in the sense of using commands like
iRODS data transfer, and so forth, but don’t have any direct dependencies
(either way) from OODT to iRODS and vice versa. Open to discussing
them though.

What’s up?

Cheers,
Chris

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Chief Architect
Instrument Software and Science Data Systems Section (398)
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 168-519, Mailstop: 168-527
Email: chris.a.mattmann@nasa.gov
WWW:  http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Associate Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++





-----Original Message-----
From: Suresh Marru <sm...@apache.org>
Reply-To: "dev@oodt.apache.org" <de...@oodt.apache.org>
Date: Friday, September 4, 2015 at 9:18 AM
To: "dev@airavata.apache.org" <de...@airavata.apache.org>,
"dev@oodt.apache.org" <de...@oodt.apache.org>
Subject: Re: OODT File Manager - Airavata Integration Document

>OODT Dev's
>
>Does the CAS or other OODT components have irods (http://irods.org/)
>integration? I am trying to work on a use case to integrate irdos
>functionality to Airavata. If OODT components already layer over irods,
>thats probably the better way to go.
>
>Cheers,
>Suresh
>
>On Tue, Sep 1, 2015 at 1:36 AM Chris Mattmann <ch...@gmail.com>
>wrote:
>
>> Great to hear. I’ll check it out.
>>
>> —
>> Chris Mattmann
>> chris.mattmann@gmail.com
>>
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: DImuthu Upeksha <di...@gmail.com>
>> Reply-To: <de...@oodt.apache.org>
>> Date: Monday, August 31, 2015 at 9:03 PM
>> To: <de...@oodt.apache.org>, "dev@airavata.apache.org"
>> <de...@airavata.apache.org>
>> Subject: Re: OODT File Manager - Airavata Integration Document
>>
>> >Hi Chris,
>> >
>> >Thank you for your feedback. This is a POC level implementation done
>>by me
>> >and there is a lot of room for improvement. It would be great if both
>> >Airavata and OODT teams can go through the design and decide whether
>> >Airavata can be integrated with OODT File manager. But my idea is, yes
>>it
>> >is possible.
>> >
>> >Thanks,
>> >Dimuthu
>> >
>> >On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
>> >chris.a.mattmann@jpl.nasa.gov> wrote:
>> >
>> >> Great work Dimuthu!
>> >>
>> >> So this means now Airavata and OODT’s File Manager are integrated?
>> >> :=)
>> >>
>> >> CC/dev@oodt.a.o
>> >>
>> >> Cheers,
>> >> Chris
>> >>
>> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >> Chris Mattmann, Ph.D.
>> >> Chief Architect
>> >> Instrument Software and Science Data Systems Section (398)
>> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> >> Office: 168-519, Mailstop: 168-527
>> >> Email: chris.a.mattmann@nasa.gov
>> >> WWW:  http://sunset.usc.edu/~mattmann/
>> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >> Adjunct Associate Professor, Computer Science Department
>> >> University of Southern California, Los Angeles, CA 90089 USA
>> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> -----Original Message-----
>> >> From: DImuthu Upeksha <di...@gmail.com>
>> >> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> >> Date: Saturday, August 29, 2015 at 1:27 AM
>> >> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> >> Subject: OODT File Manager - Airavata Integration Document
>> >>
>> >> >Hi all,
>> >> >
>> >> >
>> >> >Please find the document [1] that describes the steps followed in
>>the
>> >> >attempt of integrating OODT File Manager and AIravata. This setup is
>> >> >currently working on gw77.
>> >> >
>> >> >
>> >> >[1]
>> >> >
>> >>
>> >>
>> 
>>https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP-
>> >>M
>> >> >OFUDw/edit?usp=sharing
>> >> >
>> >> >
>> >> >Thanks
>> >> >Dimuthu
>> >> >
>> >> >
>> >> >--
>> >> >Regards
>> >> >W.Dimuthu Upeksha
>> >> >Undergraduate
>> >> >Department of Computer Science And Engineering
>> >> >University of Moratuwa, Sri Lanka
>> >> >
>> >> >
>> >> >
>> >>
>> >>
>> >
>> >
>> >--
>> >Regards
>> >
>> >W.Dimuthu Upeksha
>> >Undergraduate
>> >Department of Computer Science And Engineering
>> >
>> >University of Moratuwa, Sri Lanka
>>
>>
>>


Re: OODT File Manager - Airavata Integration Document

Posted by "Mattmann, Chris A (3980)" <ch...@jpl.nasa.gov>.
Hey Suresh,

Define the “integration” piece :)

We have integrated with iRODS in the sense of using commands like
iRODS data transfer, and so forth, but don’t have any direct dependencies
(either way) from OODT to iRODS and vice versa. Open to discussing
them though.

What’s up?

Cheers,
Chris

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Chief Architect
Instrument Software and Science Data Systems Section (398)
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 168-519, Mailstop: 168-527
Email: chris.a.mattmann@nasa.gov
WWW:  http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Associate Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++





-----Original Message-----
From: Suresh Marru <sm...@apache.org>
Reply-To: "dev@oodt.apache.org" <de...@oodt.apache.org>
Date: Friday, September 4, 2015 at 9:18 AM
To: "dev@airavata.apache.org" <de...@airavata.apache.org>,
"dev@oodt.apache.org" <de...@oodt.apache.org>
Subject: Re: OODT File Manager - Airavata Integration Document

>OODT Dev's
>
>Does the CAS or other OODT components have irods (http://irods.org/)
>integration? I am trying to work on a use case to integrate irdos
>functionality to Airavata. If OODT components already layer over irods,
>thats probably the better way to go.
>
>Cheers,
>Suresh
>
>On Tue, Sep 1, 2015 at 1:36 AM Chris Mattmann <ch...@gmail.com>
>wrote:
>
>> Great to hear. I’ll check it out.
>>
>> —
>> Chris Mattmann
>> chris.mattmann@gmail.com
>>
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: DImuthu Upeksha <di...@gmail.com>
>> Reply-To: <de...@oodt.apache.org>
>> Date: Monday, August 31, 2015 at 9:03 PM
>> To: <de...@oodt.apache.org>, "dev@airavata.apache.org"
>> <de...@airavata.apache.org>
>> Subject: Re: OODT File Manager - Airavata Integration Document
>>
>> >Hi Chris,
>> >
>> >Thank you for your feedback. This is a POC level implementation done
>>by me
>> >and there is a lot of room for improvement. It would be great if both
>> >Airavata and OODT teams can go through the design and decide whether
>> >Airavata can be integrated with OODT File manager. But my idea is, yes
>>it
>> >is possible.
>> >
>> >Thanks,
>> >Dimuthu
>> >
>> >On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
>> >chris.a.mattmann@jpl.nasa.gov> wrote:
>> >
>> >> Great work Dimuthu!
>> >>
>> >> So this means now Airavata and OODT’s File Manager are integrated?
>> >> :=)
>> >>
>> >> CC/dev@oodt.a.o
>> >>
>> >> Cheers,
>> >> Chris
>> >>
>> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >> Chris Mattmann, Ph.D.
>> >> Chief Architect
>> >> Instrument Software and Science Data Systems Section (398)
>> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> >> Office: 168-519, Mailstop: 168-527
>> >> Email: chris.a.mattmann@nasa.gov
>> >> WWW:  http://sunset.usc.edu/~mattmann/
>> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >> Adjunct Associate Professor, Computer Science Department
>> >> University of Southern California, Los Angeles, CA 90089 USA
>> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> -----Original Message-----
>> >> From: DImuthu Upeksha <di...@gmail.com>
>> >> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> >> Date: Saturday, August 29, 2015 at 1:27 AM
>> >> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> >> Subject: OODT File Manager - Airavata Integration Document
>> >>
>> >> >Hi all,
>> >> >
>> >> >
>> >> >Please find the document [1] that describes the steps followed in
>>the
>> >> >attempt of integrating OODT File Manager and AIravata. This setup is
>> >> >currently working on gw77.
>> >> >
>> >> >
>> >> >[1]
>> >> >
>> >>
>> >>
>> 
>>https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP-
>> >>M
>> >> >OFUDw/edit?usp=sharing
>> >> >
>> >> >
>> >> >Thanks
>> >> >Dimuthu
>> >> >
>> >> >
>> >> >--
>> >> >Regards
>> >> >W.Dimuthu Upeksha
>> >> >Undergraduate
>> >> >Department of Computer Science And Engineering
>> >> >University of Moratuwa, Sri Lanka
>> >> >
>> >> >
>> >> >
>> >>
>> >>
>> >
>> >
>> >--
>> >Regards
>> >
>> >W.Dimuthu Upeksha
>> >Undergraduate
>> >Department of Computer Science And Engineering
>> >
>> >University of Moratuwa, Sri Lanka
>>
>>
>>


Re: OODT File Manager - Airavata Integration Document

Posted by Suresh Marru <sm...@apache.org>.
OODT Dev's

Does the CAS or other OODT components have irods (http://irods.org/)
integration? I am trying to work on a use case to integrate irdos
functionality to Airavata. If OODT components already layer over irods,
thats probably the better way to go.

Cheers,
Suresh

On Tue, Sep 1, 2015 at 1:36 AM Chris Mattmann <ch...@gmail.com>
wrote:

> Great to hear. I’ll check it out.
>
> —
> Chris Mattmann
> chris.mattmann@gmail.com
>
>
>
>
>
>
> -----Original Message-----
> From: DImuthu Upeksha <di...@gmail.com>
> Reply-To: <de...@oodt.apache.org>
> Date: Monday, August 31, 2015 at 9:03 PM
> To: <de...@oodt.apache.org>, "dev@airavata.apache.org"
> <de...@airavata.apache.org>
> Subject: Re: OODT File Manager - Airavata Integration Document
>
> >Hi Chris,
> >
> >Thank you for your feedback. This is a POC level implementation done by me
> >and there is a lot of room for improvement. It would be great if both
> >Airavata and OODT teams can go through the design and decide whether
> >Airavata can be integrated with OODT File manager. But my idea is, yes it
> >is possible.
> >
> >Thanks,
> >Dimuthu
> >
> >On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
> >chris.a.mattmann@jpl.nasa.gov> wrote:
> >
> >> Great work Dimuthu!
> >>
> >> So this means now Airavata and OODT’s File Manager are integrated?
> >> :=)
> >>
> >> CC/dev@oodt.a.o
> >>
> >> Cheers,
> >> Chris
> >>
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Chris Mattmann, Ph.D.
> >> Chief Architect
> >> Instrument Software and Science Data Systems Section (398)
> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> Office: 168-519, Mailstop: 168-527
> >> Email: chris.a.mattmann@nasa.gov
> >> WWW:  http://sunset.usc.edu/~mattmann/
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Adjunct Associate Professor, Computer Science Department
> >> University of Southern California, Los Angeles, CA 90089 USA
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>
> >>
> >>
> >>
> >>
> >> -----Original Message-----
> >> From: DImuthu Upeksha <di...@gmail.com>
> >> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> >> Date: Saturday, August 29, 2015 at 1:27 AM
> >> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> >> Subject: OODT File Manager - Airavata Integration Document
> >>
> >> >Hi all,
> >> >
> >> >
> >> >Please find the document [1] that describes the steps followed in the
> >> >attempt of integrating OODT File Manager and AIravata. This setup is
> >> >currently working on gw77.
> >> >
> >> >
> >> >[1]
> >> >
> >>
> >>
> https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP-
> >>M
> >> >OFUDw/edit?usp=sharing
> >> >
> >> >
> >> >Thanks
> >> >Dimuthu
> >> >
> >> >
> >> >--
> >> >Regards
> >> >W.Dimuthu Upeksha
> >> >Undergraduate
> >> >Department of Computer Science And Engineering
> >> >University of Moratuwa, Sri Lanka
> >> >
> >> >
> >> >
> >>
> >>
> >
> >
> >--
> >Regards
> >
> >W.Dimuthu Upeksha
> >Undergraduate
> >Department of Computer Science And Engineering
> >
> >University of Moratuwa, Sri Lanka
>
>
>

Re: OODT File Manager - Airavata Integration Document

Posted by Suresh Marru <sm...@apache.org>.
OODT Dev's

Does the CAS or other OODT components have irods (http://irods.org/)
integration? I am trying to work on a use case to integrate irdos
functionality to Airavata. If OODT components already layer over irods,
thats probably the better way to go.

Cheers,
Suresh

On Tue, Sep 1, 2015 at 1:36 AM Chris Mattmann <ch...@gmail.com>
wrote:

> Great to hear. I’ll check it out.
>
> —
> Chris Mattmann
> chris.mattmann@gmail.com
>
>
>
>
>
>
> -----Original Message-----
> From: DImuthu Upeksha <di...@gmail.com>
> Reply-To: <de...@oodt.apache.org>
> Date: Monday, August 31, 2015 at 9:03 PM
> To: <de...@oodt.apache.org>, "dev@airavata.apache.org"
> <de...@airavata.apache.org>
> Subject: Re: OODT File Manager - Airavata Integration Document
>
> >Hi Chris,
> >
> >Thank you for your feedback. This is a POC level implementation done by me
> >and there is a lot of room for improvement. It would be great if both
> >Airavata and OODT teams can go through the design and decide whether
> >Airavata can be integrated with OODT File manager. But my idea is, yes it
> >is possible.
> >
> >Thanks,
> >Dimuthu
> >
> >On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
> >chris.a.mattmann@jpl.nasa.gov> wrote:
> >
> >> Great work Dimuthu!
> >>
> >> So this means now Airavata and OODT’s File Manager are integrated?
> >> :=)
> >>
> >> CC/dev@oodt.a.o
> >>
> >> Cheers,
> >> Chris
> >>
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Chris Mattmann, Ph.D.
> >> Chief Architect
> >> Instrument Software and Science Data Systems Section (398)
> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> Office: 168-519, Mailstop: 168-527
> >> Email: chris.a.mattmann@nasa.gov
> >> WWW:  http://sunset.usc.edu/~mattmann/
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Adjunct Associate Professor, Computer Science Department
> >> University of Southern California, Los Angeles, CA 90089 USA
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>
> >>
> >>
> >>
> >>
> >> -----Original Message-----
> >> From: DImuthu Upeksha <di...@gmail.com>
> >> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> >> Date: Saturday, August 29, 2015 at 1:27 AM
> >> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> >> Subject: OODT File Manager - Airavata Integration Document
> >>
> >> >Hi all,
> >> >
> >> >
> >> >Please find the document [1] that describes the steps followed in the
> >> >attempt of integrating OODT File Manager and AIravata. This setup is
> >> >currently working on gw77.
> >> >
> >> >
> >> >[1]
> >> >
> >>
> >>
> https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP-
> >>M
> >> >OFUDw/edit?usp=sharing
> >> >
> >> >
> >> >Thanks
> >> >Dimuthu
> >> >
> >> >
> >> >--
> >> >Regards
> >> >W.Dimuthu Upeksha
> >> >Undergraduate
> >> >Department of Computer Science And Engineering
> >> >University of Moratuwa, Sri Lanka
> >> >
> >> >
> >> >
> >>
> >>
> >
> >
> >--
> >Regards
> >
> >W.Dimuthu Upeksha
> >Undergraduate
> >Department of Computer Science And Engineering
> >
> >University of Moratuwa, Sri Lanka
>
>
>

Re: OODT File Manager - Airavata Integration Document

Posted by Chris Mattmann <ch...@gmail.com>.
Great to hear. I’ll check it out.

—
Chris Mattmann
chris.mattmann@gmail.com






-----Original Message-----
From: DImuthu Upeksha <di...@gmail.com>
Reply-To: <de...@oodt.apache.org>
Date: Monday, August 31, 2015 at 9:03 PM
To: <de...@oodt.apache.org>, "dev@airavata.apache.org"
<de...@airavata.apache.org>
Subject: Re: OODT File Manager - Airavata Integration Document

>Hi Chris,
>
>Thank you for your feedback. This is a POC level implementation done by me
>and there is a lot of room for improvement. It would be great if both
>Airavata and OODT teams can go through the design and decide whether
>Airavata can be integrated with OODT File manager. But my idea is, yes it
>is possible.
>
>Thanks,
>Dimuthu
>
>On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
>chris.a.mattmann@jpl.nasa.gov> wrote:
>
>> Great work Dimuthu!
>>
>> So this means now Airavata and OODT’s File Manager are integrated?
>> :=)
>>
>> CC/dev@oodt.a.o
>>
>> Cheers,
>> Chris
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Chief Architect
>> Instrument Software and Science Data Systems Section (398)
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 168-519, Mailstop: 168-527
>> Email: chris.a.mattmann@nasa.gov
>> WWW:  http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Associate Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: DImuthu Upeksha <di...@gmail.com>
>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> Date: Saturday, August 29, 2015 at 1:27 AM
>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> Subject: OODT File Manager - Airavata Integration Document
>>
>> >Hi all,
>> >
>> >
>> >Please find the document [1] that describes the steps followed in the
>> >attempt of integrating OODT File Manager and AIravata. This setup is
>> >currently working on gw77.
>> >
>> >
>> >[1]
>> >
>> 
>>https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP-
>>M
>> >OFUDw/edit?usp=sharing
>> >
>> >
>> >Thanks
>> >Dimuthu
>> >
>> >
>> >--
>> >Regards
>> >W.Dimuthu Upeksha
>> >Undergraduate
>> >Department of Computer Science And Engineering
>> >University of Moratuwa, Sri Lanka
>> >
>> >
>> >
>>
>>
>
>
>-- 
>Regards
>
>W.Dimuthu Upeksha
>Undergraduate
>Department of Computer Science And Engineering
>
>University of Moratuwa, Sri Lanka



Re: OODT File Manager - Airavata Integration Document

Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi Supun,
1) Do you have a test file that you can share and I will try?
2) How long is it taking?
3) Can you make your log available with DEBUG mode turned on so I can see
what is going on?
Thanks,
Lewis

On Mon, Oct 26, 2015 at 11:52 AM, Supun Nakandala <supun.nakandala@gmail.com
> wrote:

> OODT Devs,
>
> I'm experiencing unacceptable slowness when ingesting some what large
> files(>10MB) using OODT file manager. When I check the OODT server side
> logs I see multiple attempts to overwrite the same input file again and
> again and failing. I am
> using org.apache.oodt.cas.filemgr.ingest.StdIngester.
>
> Any clue on what I am doing wrong here?
>
> Thanks
>
> On Mon, Oct 12, 2015 at 4:58 PM, Chris Mattmann <ch...@gmail.com>
> wrote:
>
> > Yep it can do either.
> >
> > 1. Use Product.STRUCTURE_HIERARCHICAL for directories.
> > This feature works, and also with data movement, but it’s preferred
> > to do option 2.
> > 2. Manage the hierarchy simply with Product.STRUCTURE_FLAT products,
> > but with versioning to place and co-locate the files according to the
> > organized hierarchy, and then link them with metadata keys.
> >
> > Make sense?
> >
> > Cheers,
> > Chris
> >
> > —
> > Chris Mattmann
> > chris.mattmann@gmail.com
> >
> >
> >
> >
> >
> >
> > -----Original Message-----
> > From: Suresh Marru <sm...@apache.org>
> > Reply-To: <de...@oodt.apache.org>
> > Date: Monday, October 12, 2015 at 1:47 PM
> > To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
> > Subject: Re: OODT File Manager - Airavata Integration Document
> >
> > >Thanks Chris this is helpful to get a clarification. The only reason we
> > >want to do at a service level so we can have more fine grain control
> based
> > >on users/groups and their roles. We will start by looking at the tomcat
> > >layer and will ask more questions along the way.
> > >
> > >Paraphrasing Supun: Seems like OODT currently supports files organized
> in
> > >a
> > >flat structure. Any suggestions on how to support data products
> organized
> > >in hierarchal directories. As an example, say an Experiment has a
> Workflow
> > >which runs bunch of simulations all organized as inputs and outputs
> under
> > >a
> > >parent experiment. Can we point the file manager to such a organization
> or
> > >is it expected that the hierarchy be managed outside (through metadata
> key
> > >value pairs or otherwise)?
> > >
> > >Thanks,
> > >Suresh
> > >
> > >On Mon, Oct 12, 2015 at 4:32 PM Chris Mattmann <
> chris.mattmann@gmail.com>
> > >wrote:
> > >
> > >> Hey Suresh,
> > >>
> > >> Sure. Right now I would recommend not trying to do auth/auth
> > >> at the File Manager Level, and instead using e.g., Tomcat or
> > >> something to set up like an OAuth realm, and doing it that way.
> > >> Is there a specific need to lock it down at the service level?
> > >> At their core they are XML-RPC, and I think it will be more difficult
> > >> to implement there than trying to do in an app server that sits
> > >> in front.
> > >>
> > >> Cheers,
> > >> Chris
> > >>
> > >> —
> > >> Chris Mattmann
> > >> chris.mattmann@gmail.com
> > >>
> > >>
> > >>
> > >>
> > >>
> > >>
> > >> -----Original Message-----
> > >> From: Suresh Marru <sm...@apache.org>
> > >> Reply-To: <de...@oodt.apache.org>
> > >> Date: Monday, October 12, 2015 at 1:09 PM
> > >> To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
> > >> Subject: Re: OODT File Manager - Airavata Integration Document
> > >>
> > >> >OODT Dev's,
> > >> >
> > >> >Can we plugin custom authentication to CAS File Manager? I see that
> you
> > >> >could potentially use the OODT single sign on package and have it
> talk
> > >>to
> > >> >a
> > >> >LDAP but wondering if we could do OAuth2 like authentication and
> > >> >authorization.
> > >> >
> > >> >Thanks,
> > >> >Suresh
> > >> >
> > >> >On Tue, Sep 1, 2015 at 12:03 AM DImuthu Upeksha
> > >> ><di...@gmail.com>
> > >> >wrote:
> > >> >
> > >> >> Hi Chris,
> > >> >>
> > >> >> Thank you for your feedback. This is a POC level implementation
> done
> > >>by
> > >> >>me
> > >> >> and there is a lot of room for improvement. It would be great if
> both
> > >> >> Airavata and OODT teams can go through the design and decide
> whether
> > >> >> Airavata can be integrated with OODT File manager. But my idea is,
> > >>yes
> > >> >>it
> > >> >> is possible.
> > >> >>
> > >> >> Thanks,
> > >> >> Dimuthu
> > >> >>
> > >> >> On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
> > >> >> chris.a.mattmann@jpl.nasa.gov> wrote:
> > >> >>
> > >> >>> Great work Dimuthu!
> > >> >>>
> > >> >>> So this means now Airavata and OODT’s File Manager are integrated?
> > >> >>> :=)
> > >> >>>
> > >> >>> CC/dev@oodt.a.o
> > >> >>>
> > >> >>> Cheers,
> > >> >>> Chris
> > >> >>>
> > >> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > >> >>> Chris Mattmann, Ph.D.
> > >> >>> Chief Architect
> > >> >>> Instrument Software and Science Data Systems Section (398)
> > >> >>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> > >> >>> Office: 168-519, Mailstop: 168-527
> > >> >>> Email: chris.a.mattmann@nasa.gov
> > >> >>> WWW:  http://sunset.usc.edu/~mattmann/
> > >> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > >> >>> Adjunct Associate Professor, Computer Science Department
> > >> >>> University of Southern California, Los Angeles, CA 90089 USA
> > >> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>> -----Original Message-----
> > >> >>> From: DImuthu Upeksha <di...@gmail.com>
> > >> >>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> > >> >>> Date: Saturday, August 29, 2015 at 1:27 AM
> > >> >>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> > >> >>> Subject: OODT File Manager - Airavata Integration Document
> > >> >>>
> > >> >>> >Hi all,
> > >> >>> >
> > >> >>> >
> > >> >>> >Please find the document [1] that describes the steps followed in
> > >>the
> > >> >>> >attempt of integrating OODT File Manager and AIravata. This setup
> > >>is
> > >> >>> >currently working on gw77.
> > >> >>> >
> > >> >>> >
> > >> >>> >[1]
> > >> >>> >
> > >> >>>
> > >> >>>
> > >>
> > https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP
> > >> >>>-M
> > >> >>> >OFUDw/edit?usp=sharing
> > >> >>> >
> > >> >>> >
> > >> >>> >Thanks
> > >> >>> >Dimuthu
> > >> >>> >
> > >> >>> >
> > >> >>> >--
> > >> >>> >Regards
> > >> >>> >W.Dimuthu Upeksha
> > >> >>> >Undergraduate
> > >> >>> >Department of Computer Science And Engineering
> > >> >>> >University of Moratuwa, Sri Lanka
> > >> >>> >
> > >> >>> >
> > >> >>> >
> > >> >>>
> > >> >>>
> > >> >>
> > >> >>
> > >> >> --
> > >> >> Regards
> > >> >>
> > >> >> W.Dimuthu Upeksha
> > >> >> Undergraduate
> > >> >> Department of Computer Science And Engineering
> > >> >>
> > >> >> University of Moratuwa, Sri Lanka
> > >> >>
> > >>
> > >>
> > >>
> >
> >
> >
>
>
> --
> Thank you
> Supun Nakandala
> Dept. Computer Science and Engineering
> University of Moratuwa
>



-- 
*Lewis*

Re: OODT File Manager - Airavata Integration Document

Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi Supun,
1) Do you have a test file that you can share and I will try?
2) How long is it taking?
3) Can you make your log available with DEBUG mode turned on so I can see
what is going on?
Thanks,
Lewis

On Mon, Oct 26, 2015 at 11:52 AM, Supun Nakandala <supun.nakandala@gmail.com
> wrote:

> OODT Devs,
>
> I'm experiencing unacceptable slowness when ingesting some what large
> files(>10MB) using OODT file manager. When I check the OODT server side
> logs I see multiple attempts to overwrite the same input file again and
> again and failing. I am
> using org.apache.oodt.cas.filemgr.ingest.StdIngester.
>
> Any clue on what I am doing wrong here?
>
> Thanks
>
> On Mon, Oct 12, 2015 at 4:58 PM, Chris Mattmann <ch...@gmail.com>
> wrote:
>
> > Yep it can do either.
> >
> > 1. Use Product.STRUCTURE_HIERARCHICAL for directories.
> > This feature works, and also with data movement, but it’s preferred
> > to do option 2.
> > 2. Manage the hierarchy simply with Product.STRUCTURE_FLAT products,
> > but with versioning to place and co-locate the files according to the
> > organized hierarchy, and then link them with metadata keys.
> >
> > Make sense?
> >
> > Cheers,
> > Chris
> >
> > —
> > Chris Mattmann
> > chris.mattmann@gmail.com
> >
> >
> >
> >
> >
> >
> > -----Original Message-----
> > From: Suresh Marru <sm...@apache.org>
> > Reply-To: <de...@oodt.apache.org>
> > Date: Monday, October 12, 2015 at 1:47 PM
> > To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
> > Subject: Re: OODT File Manager - Airavata Integration Document
> >
> > >Thanks Chris this is helpful to get a clarification. The only reason we
> > >want to do at a service level so we can have more fine grain control
> based
> > >on users/groups and their roles. We will start by looking at the tomcat
> > >layer and will ask more questions along the way.
> > >
> > >Paraphrasing Supun: Seems like OODT currently supports files organized
> in
> > >a
> > >flat structure. Any suggestions on how to support data products
> organized
> > >in hierarchal directories. As an example, say an Experiment has a
> Workflow
> > >which runs bunch of simulations all organized as inputs and outputs
> under
> > >a
> > >parent experiment. Can we point the file manager to such a organization
> or
> > >is it expected that the hierarchy be managed outside (through metadata
> key
> > >value pairs or otherwise)?
> > >
> > >Thanks,
> > >Suresh
> > >
> > >On Mon, Oct 12, 2015 at 4:32 PM Chris Mattmann <
> chris.mattmann@gmail.com>
> > >wrote:
> > >
> > >> Hey Suresh,
> > >>
> > >> Sure. Right now I would recommend not trying to do auth/auth
> > >> at the File Manager Level, and instead using e.g., Tomcat or
> > >> something to set up like an OAuth realm, and doing it that way.
> > >> Is there a specific need to lock it down at the service level?
> > >> At their core they are XML-RPC, and I think it will be more difficult
> > >> to implement there than trying to do in an app server that sits
> > >> in front.
> > >>
> > >> Cheers,
> > >> Chris
> > >>
> > >> —
> > >> Chris Mattmann
> > >> chris.mattmann@gmail.com
> > >>
> > >>
> > >>
> > >>
> > >>
> > >>
> > >> -----Original Message-----
> > >> From: Suresh Marru <sm...@apache.org>
> > >> Reply-To: <de...@oodt.apache.org>
> > >> Date: Monday, October 12, 2015 at 1:09 PM
> > >> To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
> > >> Subject: Re: OODT File Manager - Airavata Integration Document
> > >>
> > >> >OODT Dev's,
> > >> >
> > >> >Can we plugin custom authentication to CAS File Manager? I see that
> you
> > >> >could potentially use the OODT single sign on package and have it
> talk
> > >>to
> > >> >a
> > >> >LDAP but wondering if we could do OAuth2 like authentication and
> > >> >authorization.
> > >> >
> > >> >Thanks,
> > >> >Suresh
> > >> >
> > >> >On Tue, Sep 1, 2015 at 12:03 AM DImuthu Upeksha
> > >> ><di...@gmail.com>
> > >> >wrote:
> > >> >
> > >> >> Hi Chris,
> > >> >>
> > >> >> Thank you for your feedback. This is a POC level implementation
> done
> > >>by
> > >> >>me
> > >> >> and there is a lot of room for improvement. It would be great if
> both
> > >> >> Airavata and OODT teams can go through the design and decide
> whether
> > >> >> Airavata can be integrated with OODT File manager. But my idea is,
> > >>yes
> > >> >>it
> > >> >> is possible.
> > >> >>
> > >> >> Thanks,
> > >> >> Dimuthu
> > >> >>
> > >> >> On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
> > >> >> chris.a.mattmann@jpl.nasa.gov> wrote:
> > >> >>
> > >> >>> Great work Dimuthu!
> > >> >>>
> > >> >>> So this means now Airavata and OODT’s File Manager are integrated?
> > >> >>> :=)
> > >> >>>
> > >> >>> CC/dev@oodt.a.o
> > >> >>>
> > >> >>> Cheers,
> > >> >>> Chris
> > >> >>>
> > >> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > >> >>> Chris Mattmann, Ph.D.
> > >> >>> Chief Architect
> > >> >>> Instrument Software and Science Data Systems Section (398)
> > >> >>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> > >> >>> Office: 168-519, Mailstop: 168-527
> > >> >>> Email: chris.a.mattmann@nasa.gov
> > >> >>> WWW:  http://sunset.usc.edu/~mattmann/
> > >> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > >> >>> Adjunct Associate Professor, Computer Science Department
> > >> >>> University of Southern California, Los Angeles, CA 90089 USA
> > >> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>> -----Original Message-----
> > >> >>> From: DImuthu Upeksha <di...@gmail.com>
> > >> >>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> > >> >>> Date: Saturday, August 29, 2015 at 1:27 AM
> > >> >>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> > >> >>> Subject: OODT File Manager - Airavata Integration Document
> > >> >>>
> > >> >>> >Hi all,
> > >> >>> >
> > >> >>> >
> > >> >>> >Please find the document [1] that describes the steps followed in
> > >>the
> > >> >>> >attempt of integrating OODT File Manager and AIravata. This setup
> > >>is
> > >> >>> >currently working on gw77.
> > >> >>> >
> > >> >>> >
> > >> >>> >[1]
> > >> >>> >
> > >> >>>
> > >> >>>
> > >>
> > https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP
> > >> >>>-M
> > >> >>> >OFUDw/edit?usp=sharing
> > >> >>> >
> > >> >>> >
> > >> >>> >Thanks
> > >> >>> >Dimuthu
> > >> >>> >
> > >> >>> >
> > >> >>> >--
> > >> >>> >Regards
> > >> >>> >W.Dimuthu Upeksha
> > >> >>> >Undergraduate
> > >> >>> >Department of Computer Science And Engineering
> > >> >>> >University of Moratuwa, Sri Lanka
> > >> >>> >
> > >> >>> >
> > >> >>> >
> > >> >>>
> > >> >>>
> > >> >>
> > >> >>
> > >> >> --
> > >> >> Regards
> > >> >>
> > >> >> W.Dimuthu Upeksha
> > >> >> Undergraduate
> > >> >> Department of Computer Science And Engineering
> > >> >>
> > >> >> University of Moratuwa, Sri Lanka
> > >> >>
> > >>
> > >>
> > >>
> >
> >
> >
>
>
> --
> Thank you
> Supun Nakandala
> Dept. Computer Science and Engineering
> University of Moratuwa
>



-- 
*Lewis*

Re: OODT File Manager - Airavata Integration Document

Posted by Supun Nakandala <su...@gmail.com>.
OODT Devs,

I'm experiencing unacceptable slowness when ingesting some what large
files(>10MB) using OODT file manager. When I check the OODT server side
logs I see multiple attempts to overwrite the same input file again and
again and failing. I am
using org.apache.oodt.cas.filemgr.ingest.StdIngester.

Any clue on what I am doing wrong here?

Thanks

On Mon, Oct 12, 2015 at 4:58 PM, Chris Mattmann <ch...@gmail.com>
wrote:

> Yep it can do either.
>
> 1. Use Product.STRUCTURE_HIERARCHICAL for directories.
> This feature works, and also with data movement, but it’s preferred
> to do option 2.
> 2. Manage the hierarchy simply with Product.STRUCTURE_FLAT products,
> but with versioning to place and co-locate the files according to the
> organized hierarchy, and then link them with metadata keys.
>
> Make sense?
>
> Cheers,
> Chris
>
> —
> Chris Mattmann
> chris.mattmann@gmail.com
>
>
>
>
>
>
> -----Original Message-----
> From: Suresh Marru <sm...@apache.org>
> Reply-To: <de...@oodt.apache.org>
> Date: Monday, October 12, 2015 at 1:47 PM
> To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
> Subject: Re: OODT File Manager - Airavata Integration Document
>
> >Thanks Chris this is helpful to get a clarification. The only reason we
> >want to do at a service level so we can have more fine grain control based
> >on users/groups and their roles. We will start by looking at the tomcat
> >layer and will ask more questions along the way.
> >
> >Paraphrasing Supun: Seems like OODT currently supports files organized in
> >a
> >flat structure. Any suggestions on how to support data products organized
> >in hierarchal directories. As an example, say an Experiment has a Workflow
> >which runs bunch of simulations all organized as inputs and outputs under
> >a
> >parent experiment. Can we point the file manager to such a organization or
> >is it expected that the hierarchy be managed outside (through metadata key
> >value pairs or otherwise)?
> >
> >Thanks,
> >Suresh
> >
> >On Mon, Oct 12, 2015 at 4:32 PM Chris Mattmann <ch...@gmail.com>
> >wrote:
> >
> >> Hey Suresh,
> >>
> >> Sure. Right now I would recommend not trying to do auth/auth
> >> at the File Manager Level, and instead using e.g., Tomcat or
> >> something to set up like an OAuth realm, and doing it that way.
> >> Is there a specific need to lock it down at the service level?
> >> At their core they are XML-RPC, and I think it will be more difficult
> >> to implement there than trying to do in an app server that sits
> >> in front.
> >>
> >> Cheers,
> >> Chris
> >>
> >> —
> >> Chris Mattmann
> >> chris.mattmann@gmail.com
> >>
> >>
> >>
> >>
> >>
> >>
> >> -----Original Message-----
> >> From: Suresh Marru <sm...@apache.org>
> >> Reply-To: <de...@oodt.apache.org>
> >> Date: Monday, October 12, 2015 at 1:09 PM
> >> To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
> >> Subject: Re: OODT File Manager - Airavata Integration Document
> >>
> >> >OODT Dev's,
> >> >
> >> >Can we plugin custom authentication to CAS File Manager? I see that you
> >> >could potentially use the OODT single sign on package and have it talk
> >>to
> >> >a
> >> >LDAP but wondering if we could do OAuth2 like authentication and
> >> >authorization.
> >> >
> >> >Thanks,
> >> >Suresh
> >> >
> >> >On Tue, Sep 1, 2015 at 12:03 AM DImuthu Upeksha
> >> ><di...@gmail.com>
> >> >wrote:
> >> >
> >> >> Hi Chris,
> >> >>
> >> >> Thank you for your feedback. This is a POC level implementation done
> >>by
> >> >>me
> >> >> and there is a lot of room for improvement. It would be great if both
> >> >> Airavata and OODT teams can go through the design and decide whether
> >> >> Airavata can be integrated with OODT File manager. But my idea is,
> >>yes
> >> >>it
> >> >> is possible.
> >> >>
> >> >> Thanks,
> >> >> Dimuthu
> >> >>
> >> >> On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
> >> >> chris.a.mattmann@jpl.nasa.gov> wrote:
> >> >>
> >> >>> Great work Dimuthu!
> >> >>>
> >> >>> So this means now Airavata and OODT’s File Manager are integrated?
> >> >>> :=)
> >> >>>
> >> >>> CC/dev@oodt.a.o
> >> >>>
> >> >>> Cheers,
> >> >>> Chris
> >> >>>
> >> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> >>> Chris Mattmann, Ph.D.
> >> >>> Chief Architect
> >> >>> Instrument Software and Science Data Systems Section (398)
> >> >>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> >>> Office: 168-519, Mailstop: 168-527
> >> >>> Email: chris.a.mattmann@nasa.gov
> >> >>> WWW:  http://sunset.usc.edu/~mattmann/
> >> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> >>> Adjunct Associate Professor, Computer Science Department
> >> >>> University of Southern California, Los Angeles, CA 90089 USA
> >> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> >>>
> >> >>>
> >> >>>
> >> >>>
> >> >>>
> >> >>> -----Original Message-----
> >> >>> From: DImuthu Upeksha <di...@gmail.com>
> >> >>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> >> >>> Date: Saturday, August 29, 2015 at 1:27 AM
> >> >>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> >> >>> Subject: OODT File Manager - Airavata Integration Document
> >> >>>
> >> >>> >Hi all,
> >> >>> >
> >> >>> >
> >> >>> >Please find the document [1] that describes the steps followed in
> >>the
> >> >>> >attempt of integrating OODT File Manager and AIravata. This setup
> >>is
> >> >>> >currently working on gw77.
> >> >>> >
> >> >>> >
> >> >>> >[1]
> >> >>> >
> >> >>>
> >> >>>
> >>
> https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP
> >> >>>-M
> >> >>> >OFUDw/edit?usp=sharing
> >> >>> >
> >> >>> >
> >> >>> >Thanks
> >> >>> >Dimuthu
> >> >>> >
> >> >>> >
> >> >>> >--
> >> >>> >Regards
> >> >>> >W.Dimuthu Upeksha
> >> >>> >Undergraduate
> >> >>> >Department of Computer Science And Engineering
> >> >>> >University of Moratuwa, Sri Lanka
> >> >>> >
> >> >>> >
> >> >>> >
> >> >>>
> >> >>>
> >> >>
> >> >>
> >> >> --
> >> >> Regards
> >> >>
> >> >> W.Dimuthu Upeksha
> >> >> Undergraduate
> >> >> Department of Computer Science And Engineering
> >> >>
> >> >> University of Moratuwa, Sri Lanka
> >> >>
> >>
> >>
> >>
>
>
>


-- 
Thank you
Supun Nakandala
Dept. Computer Science and Engineering
University of Moratuwa

Re: OODT File Manager - Airavata Integration Document

Posted by Supun Nakandala <su...@gmail.com>.
OODT Devs,

I'm experiencing unacceptable slowness when ingesting some what large
files(>10MB) using OODT file manager. When I check the OODT server side
logs I see multiple attempts to overwrite the same input file again and
again and failing. I am
using org.apache.oodt.cas.filemgr.ingest.StdIngester.

Any clue on what I am doing wrong here?

Thanks

On Mon, Oct 12, 2015 at 4:58 PM, Chris Mattmann <ch...@gmail.com>
wrote:

> Yep it can do either.
>
> 1. Use Product.STRUCTURE_HIERARCHICAL for directories.
> This feature works, and also with data movement, but it’s preferred
> to do option 2.
> 2. Manage the hierarchy simply with Product.STRUCTURE_FLAT products,
> but with versioning to place and co-locate the files according to the
> organized hierarchy, and then link them with metadata keys.
>
> Make sense?
>
> Cheers,
> Chris
>
> —
> Chris Mattmann
> chris.mattmann@gmail.com
>
>
>
>
>
>
> -----Original Message-----
> From: Suresh Marru <sm...@apache.org>
> Reply-To: <de...@oodt.apache.org>
> Date: Monday, October 12, 2015 at 1:47 PM
> To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
> Subject: Re: OODT File Manager - Airavata Integration Document
>
> >Thanks Chris this is helpful to get a clarification. The only reason we
> >want to do at a service level so we can have more fine grain control based
> >on users/groups and their roles. We will start by looking at the tomcat
> >layer and will ask more questions along the way.
> >
> >Paraphrasing Supun: Seems like OODT currently supports files organized in
> >a
> >flat structure. Any suggestions on how to support data products organized
> >in hierarchal directories. As an example, say an Experiment has a Workflow
> >which runs bunch of simulations all organized as inputs and outputs under
> >a
> >parent experiment. Can we point the file manager to such a organization or
> >is it expected that the hierarchy be managed outside (through metadata key
> >value pairs or otherwise)?
> >
> >Thanks,
> >Suresh
> >
> >On Mon, Oct 12, 2015 at 4:32 PM Chris Mattmann <ch...@gmail.com>
> >wrote:
> >
> >> Hey Suresh,
> >>
> >> Sure. Right now I would recommend not trying to do auth/auth
> >> at the File Manager Level, and instead using e.g., Tomcat or
> >> something to set up like an OAuth realm, and doing it that way.
> >> Is there a specific need to lock it down at the service level?
> >> At their core they are XML-RPC, and I think it will be more difficult
> >> to implement there than trying to do in an app server that sits
> >> in front.
> >>
> >> Cheers,
> >> Chris
> >>
> >> —
> >> Chris Mattmann
> >> chris.mattmann@gmail.com
> >>
> >>
> >>
> >>
> >>
> >>
> >> -----Original Message-----
> >> From: Suresh Marru <sm...@apache.org>
> >> Reply-To: <de...@oodt.apache.org>
> >> Date: Monday, October 12, 2015 at 1:09 PM
> >> To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
> >> Subject: Re: OODT File Manager - Airavata Integration Document
> >>
> >> >OODT Dev's,
> >> >
> >> >Can we plugin custom authentication to CAS File Manager? I see that you
> >> >could potentially use the OODT single sign on package and have it talk
> >>to
> >> >a
> >> >LDAP but wondering if we could do OAuth2 like authentication and
> >> >authorization.
> >> >
> >> >Thanks,
> >> >Suresh
> >> >
> >> >On Tue, Sep 1, 2015 at 12:03 AM DImuthu Upeksha
> >> ><di...@gmail.com>
> >> >wrote:
> >> >
> >> >> Hi Chris,
> >> >>
> >> >> Thank you for your feedback. This is a POC level implementation done
> >>by
> >> >>me
> >> >> and there is a lot of room for improvement. It would be great if both
> >> >> Airavata and OODT teams can go through the design and decide whether
> >> >> Airavata can be integrated with OODT File manager. But my idea is,
> >>yes
> >> >>it
> >> >> is possible.
> >> >>
> >> >> Thanks,
> >> >> Dimuthu
> >> >>
> >> >> On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
> >> >> chris.a.mattmann@jpl.nasa.gov> wrote:
> >> >>
> >> >>> Great work Dimuthu!
> >> >>>
> >> >>> So this means now Airavata and OODT’s File Manager are integrated?
> >> >>> :=)
> >> >>>
> >> >>> CC/dev@oodt.a.o
> >> >>>
> >> >>> Cheers,
> >> >>> Chris
> >> >>>
> >> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> >>> Chris Mattmann, Ph.D.
> >> >>> Chief Architect
> >> >>> Instrument Software and Science Data Systems Section (398)
> >> >>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> >>> Office: 168-519, Mailstop: 168-527
> >> >>> Email: chris.a.mattmann@nasa.gov
> >> >>> WWW:  http://sunset.usc.edu/~mattmann/
> >> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> >>> Adjunct Associate Professor, Computer Science Department
> >> >>> University of Southern California, Los Angeles, CA 90089 USA
> >> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> >>>
> >> >>>
> >> >>>
> >> >>>
> >> >>>
> >> >>> -----Original Message-----
> >> >>> From: DImuthu Upeksha <di...@gmail.com>
> >> >>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> >> >>> Date: Saturday, August 29, 2015 at 1:27 AM
> >> >>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> >> >>> Subject: OODT File Manager - Airavata Integration Document
> >> >>>
> >> >>> >Hi all,
> >> >>> >
> >> >>> >
> >> >>> >Please find the document [1] that describes the steps followed in
> >>the
> >> >>> >attempt of integrating OODT File Manager and AIravata. This setup
> >>is
> >> >>> >currently working on gw77.
> >> >>> >
> >> >>> >
> >> >>> >[1]
> >> >>> >
> >> >>>
> >> >>>
> >>
> https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP
> >> >>>-M
> >> >>> >OFUDw/edit?usp=sharing
> >> >>> >
> >> >>> >
> >> >>> >Thanks
> >> >>> >Dimuthu
> >> >>> >
> >> >>> >
> >> >>> >--
> >> >>> >Regards
> >> >>> >W.Dimuthu Upeksha
> >> >>> >Undergraduate
> >> >>> >Department of Computer Science And Engineering
> >> >>> >University of Moratuwa, Sri Lanka
> >> >>> >
> >> >>> >
> >> >>> >
> >> >>>
> >> >>>
> >> >>
> >> >>
> >> >> --
> >> >> Regards
> >> >>
> >> >> W.Dimuthu Upeksha
> >> >> Undergraduate
> >> >> Department of Computer Science And Engineering
> >> >>
> >> >> University of Moratuwa, Sri Lanka
> >> >>
> >>
> >>
> >>
>
>
>


-- 
Thank you
Supun Nakandala
Dept. Computer Science and Engineering
University of Moratuwa

Re: OODT File Manager - Airavata Integration Document

Posted by Chris Mattmann <ch...@gmail.com>.
Yep it can do either.

1. Use Product.STRUCTURE_HIERARCHICAL for directories.
This feature works, and also with data movement, but it’s preferred
to do option 2.
2. Manage the hierarchy simply with Product.STRUCTURE_FLAT products,
but with versioning to place and co-locate the files according to the
organized hierarchy, and then link them with metadata keys.

Make sense?

Cheers,
Chris

—
Chris Mattmann
chris.mattmann@gmail.com






-----Original Message-----
From: Suresh Marru <sm...@apache.org>
Reply-To: <de...@oodt.apache.org>
Date: Monday, October 12, 2015 at 1:47 PM
To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
Subject: Re: OODT File Manager - Airavata Integration Document

>Thanks Chris this is helpful to get a clarification. The only reason we
>want to do at a service level so we can have more fine grain control based
>on users/groups and their roles. We will start by looking at the tomcat
>layer and will ask more questions along the way.
>
>Paraphrasing Supun: Seems like OODT currently supports files organized in
>a
>flat structure. Any suggestions on how to support data products organized
>in hierarchal directories. As an example, say an Experiment has a Workflow
>which runs bunch of simulations all organized as inputs and outputs under
>a
>parent experiment. Can we point the file manager to such a organization or
>is it expected that the hierarchy be managed outside (through metadata key
>value pairs or otherwise)?
>
>Thanks,
>Suresh
>
>On Mon, Oct 12, 2015 at 4:32 PM Chris Mattmann <ch...@gmail.com>
>wrote:
>
>> Hey Suresh,
>>
>> Sure. Right now I would recommend not trying to do auth/auth
>> at the File Manager Level, and instead using e.g., Tomcat or
>> something to set up like an OAuth realm, and doing it that way.
>> Is there a specific need to lock it down at the service level?
>> At their core they are XML-RPC, and I think it will be more difficult
>> to implement there than trying to do in an app server that sits
>> in front.
>>
>> Cheers,
>> Chris
>>
>> —
>> Chris Mattmann
>> chris.mattmann@gmail.com
>>
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: Suresh Marru <sm...@apache.org>
>> Reply-To: <de...@oodt.apache.org>
>> Date: Monday, October 12, 2015 at 1:09 PM
>> To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
>> Subject: Re: OODT File Manager - Airavata Integration Document
>>
>> >OODT Dev's,
>> >
>> >Can we plugin custom authentication to CAS File Manager? I see that you
>> >could potentially use the OODT single sign on package and have it talk
>>to
>> >a
>> >LDAP but wondering if we could do OAuth2 like authentication and
>> >authorization.
>> >
>> >Thanks,
>> >Suresh
>> >
>> >On Tue, Sep 1, 2015 at 12:03 AM DImuthu Upeksha
>> ><di...@gmail.com>
>> >wrote:
>> >
>> >> Hi Chris,
>> >>
>> >> Thank you for your feedback. This is a POC level implementation done
>>by
>> >>me
>> >> and there is a lot of room for improvement. It would be great if both
>> >> Airavata and OODT teams can go through the design and decide whether
>> >> Airavata can be integrated with OODT File manager. But my idea is,
>>yes
>> >>it
>> >> is possible.
>> >>
>> >> Thanks,
>> >> Dimuthu
>> >>
>> >> On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
>> >> chris.a.mattmann@jpl.nasa.gov> wrote:
>> >>
>> >>> Great work Dimuthu!
>> >>>
>> >>> So this means now Airavata and OODT’s File Manager are integrated?
>> >>> :=)
>> >>>
>> >>> CC/dev@oodt.a.o
>> >>>
>> >>> Cheers,
>> >>> Chris
>> >>>
>> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >>> Chris Mattmann, Ph.D.
>> >>> Chief Architect
>> >>> Instrument Software and Science Data Systems Section (398)
>> >>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> >>> Office: 168-519, Mailstop: 168-527
>> >>> Email: chris.a.mattmann@nasa.gov
>> >>> WWW:  http://sunset.usc.edu/~mattmann/
>> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >>> Adjunct Associate Professor, Computer Science Department
>> >>> University of Southern California, Los Angeles, CA 90089 USA
>> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >>>
>> >>>
>> >>>
>> >>>
>> >>>
>> >>> -----Original Message-----
>> >>> From: DImuthu Upeksha <di...@gmail.com>
>> >>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> >>> Date: Saturday, August 29, 2015 at 1:27 AM
>> >>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> >>> Subject: OODT File Manager - Airavata Integration Document
>> >>>
>> >>> >Hi all,
>> >>> >
>> >>> >
>> >>> >Please find the document [1] that describes the steps followed in
>>the
>> >>> >attempt of integrating OODT File Manager and AIravata. This setup
>>is
>> >>> >currently working on gw77.
>> >>> >
>> >>> >
>> >>> >[1]
>> >>> >
>> >>>
>> >>>
>> https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP
>> >>>-M
>> >>> >OFUDw/edit?usp=sharing
>> >>> >
>> >>> >
>> >>> >Thanks
>> >>> >Dimuthu
>> >>> >
>> >>> >
>> >>> >--
>> >>> >Regards
>> >>> >W.Dimuthu Upeksha
>> >>> >Undergraduate
>> >>> >Department of Computer Science And Engineering
>> >>> >University of Moratuwa, Sri Lanka
>> >>> >
>> >>> >
>> >>> >
>> >>>
>> >>>
>> >>
>> >>
>> >> --
>> >> Regards
>> >>
>> >> W.Dimuthu Upeksha
>> >> Undergraduate
>> >> Department of Computer Science And Engineering
>> >>
>> >> University of Moratuwa, Sri Lanka
>> >>
>>
>>
>>



Re: OODT File Manager - Airavata Integration Document

Posted by Chris Mattmann <ch...@gmail.com>.
Yep it can do either.

1. Use Product.STRUCTURE_HIERARCHICAL for directories.
This feature works, and also with data movement, but it’s preferred
to do option 2.
2. Manage the hierarchy simply with Product.STRUCTURE_FLAT products,
but with versioning to place and co-locate the files according to the
organized hierarchy, and then link them with metadata keys.

Make sense?

Cheers,
Chris

—
Chris Mattmann
chris.mattmann@gmail.com






-----Original Message-----
From: Suresh Marru <sm...@apache.org>
Reply-To: <de...@oodt.apache.org>
Date: Monday, October 12, 2015 at 1:47 PM
To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
Subject: Re: OODT File Manager - Airavata Integration Document

>Thanks Chris this is helpful to get a clarification. The only reason we
>want to do at a service level so we can have more fine grain control based
>on users/groups and their roles. We will start by looking at the tomcat
>layer and will ask more questions along the way.
>
>Paraphrasing Supun: Seems like OODT currently supports files organized in
>a
>flat structure. Any suggestions on how to support data products organized
>in hierarchal directories. As an example, say an Experiment has a Workflow
>which runs bunch of simulations all organized as inputs and outputs under
>a
>parent experiment. Can we point the file manager to such a organization or
>is it expected that the hierarchy be managed outside (through metadata key
>value pairs or otherwise)?
>
>Thanks,
>Suresh
>
>On Mon, Oct 12, 2015 at 4:32 PM Chris Mattmann <ch...@gmail.com>
>wrote:
>
>> Hey Suresh,
>>
>> Sure. Right now I would recommend not trying to do auth/auth
>> at the File Manager Level, and instead using e.g., Tomcat or
>> something to set up like an OAuth realm, and doing it that way.
>> Is there a specific need to lock it down at the service level?
>> At their core they are XML-RPC, and I think it will be more difficult
>> to implement there than trying to do in an app server that sits
>> in front.
>>
>> Cheers,
>> Chris
>>
>> —
>> Chris Mattmann
>> chris.mattmann@gmail.com
>>
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: Suresh Marru <sm...@apache.org>
>> Reply-To: <de...@oodt.apache.org>
>> Date: Monday, October 12, 2015 at 1:09 PM
>> To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
>> Subject: Re: OODT File Manager - Airavata Integration Document
>>
>> >OODT Dev's,
>> >
>> >Can we plugin custom authentication to CAS File Manager? I see that you
>> >could potentially use the OODT single sign on package and have it talk
>>to
>> >a
>> >LDAP but wondering if we could do OAuth2 like authentication and
>> >authorization.
>> >
>> >Thanks,
>> >Suresh
>> >
>> >On Tue, Sep 1, 2015 at 12:03 AM DImuthu Upeksha
>> ><di...@gmail.com>
>> >wrote:
>> >
>> >> Hi Chris,
>> >>
>> >> Thank you for your feedback. This is a POC level implementation done
>>by
>> >>me
>> >> and there is a lot of room for improvement. It would be great if both
>> >> Airavata and OODT teams can go through the design and decide whether
>> >> Airavata can be integrated with OODT File manager. But my idea is,
>>yes
>> >>it
>> >> is possible.
>> >>
>> >> Thanks,
>> >> Dimuthu
>> >>
>> >> On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
>> >> chris.a.mattmann@jpl.nasa.gov> wrote:
>> >>
>> >>> Great work Dimuthu!
>> >>>
>> >>> So this means now Airavata and OODT’s File Manager are integrated?
>> >>> :=)
>> >>>
>> >>> CC/dev@oodt.a.o
>> >>>
>> >>> Cheers,
>> >>> Chris
>> >>>
>> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >>> Chris Mattmann, Ph.D.
>> >>> Chief Architect
>> >>> Instrument Software and Science Data Systems Section (398)
>> >>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> >>> Office: 168-519, Mailstop: 168-527
>> >>> Email: chris.a.mattmann@nasa.gov
>> >>> WWW:  http://sunset.usc.edu/~mattmann/
>> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >>> Adjunct Associate Professor, Computer Science Department
>> >>> University of Southern California, Los Angeles, CA 90089 USA
>> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >>>
>> >>>
>> >>>
>> >>>
>> >>>
>> >>> -----Original Message-----
>> >>> From: DImuthu Upeksha <di...@gmail.com>
>> >>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> >>> Date: Saturday, August 29, 2015 at 1:27 AM
>> >>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> >>> Subject: OODT File Manager - Airavata Integration Document
>> >>>
>> >>> >Hi all,
>> >>> >
>> >>> >
>> >>> >Please find the document [1] that describes the steps followed in
>>the
>> >>> >attempt of integrating OODT File Manager and AIravata. This setup
>>is
>> >>> >currently working on gw77.
>> >>> >
>> >>> >
>> >>> >[1]
>> >>> >
>> >>>
>> >>>
>> https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP
>> >>>-M
>> >>> >OFUDw/edit?usp=sharing
>> >>> >
>> >>> >
>> >>> >Thanks
>> >>> >Dimuthu
>> >>> >
>> >>> >
>> >>> >--
>> >>> >Regards
>> >>> >W.Dimuthu Upeksha
>> >>> >Undergraduate
>> >>> >Department of Computer Science And Engineering
>> >>> >University of Moratuwa, Sri Lanka
>> >>> >
>> >>> >
>> >>> >
>> >>>
>> >>>
>> >>
>> >>
>> >> --
>> >> Regards
>> >>
>> >> W.Dimuthu Upeksha
>> >> Undergraduate
>> >> Department of Computer Science And Engineering
>> >>
>> >> University of Moratuwa, Sri Lanka
>> >>
>>
>>
>>



Re: OODT File Manager - Airavata Integration Document

Posted by Suresh Marru <sm...@apache.org>.
Thanks Chris this is helpful to get a clarification. The only reason we
want to do at a service level so we can have more fine grain control based
on users/groups and their roles. We will start by looking at the tomcat
layer and will ask more questions along the way.

Paraphrasing Supun: Seems like OODT currently supports files organized in a
flat structure. Any suggestions on how to support data products organized
in hierarchal directories. As an example, say an Experiment has a Workflow
which runs bunch of simulations all organized as inputs and outputs under a
parent experiment. Can we point the file manager to such a organization or
is it expected that the hierarchy be managed outside (through metadata key
value pairs or otherwise)?

Thanks,
Suresh

On Mon, Oct 12, 2015 at 4:32 PM Chris Mattmann <ch...@gmail.com>
wrote:

> Hey Suresh,
>
> Sure. Right now I would recommend not trying to do auth/auth
> at the File Manager Level, and instead using e.g., Tomcat or
> something to set up like an OAuth realm, and doing it that way.
> Is there a specific need to lock it down at the service level?
> At their core they are XML-RPC, and I think it will be more difficult
> to implement there than trying to do in an app server that sits
> in front.
>
> Cheers,
> Chris
>
> —
> Chris Mattmann
> chris.mattmann@gmail.com
>
>
>
>
>
>
> -----Original Message-----
> From: Suresh Marru <sm...@apache.org>
> Reply-To: <de...@oodt.apache.org>
> Date: Monday, October 12, 2015 at 1:09 PM
> To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
> Subject: Re: OODT File Manager - Airavata Integration Document
>
> >OODT Dev's,
> >
> >Can we plugin custom authentication to CAS File Manager? I see that you
> >could potentially use the OODT single sign on package and have it talk to
> >a
> >LDAP but wondering if we could do OAuth2 like authentication and
> >authorization.
> >
> >Thanks,
> >Suresh
> >
> >On Tue, Sep 1, 2015 at 12:03 AM DImuthu Upeksha
> ><di...@gmail.com>
> >wrote:
> >
> >> Hi Chris,
> >>
> >> Thank you for your feedback. This is a POC level implementation done by
> >>me
> >> and there is a lot of room for improvement. It would be great if both
> >> Airavata and OODT teams can go through the design and decide whether
> >> Airavata can be integrated with OODT File manager. But my idea is, yes
> >>it
> >> is possible.
> >>
> >> Thanks,
> >> Dimuthu
> >>
> >> On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
> >> chris.a.mattmann@jpl.nasa.gov> wrote:
> >>
> >>> Great work Dimuthu!
> >>>
> >>> So this means now Airavata and OODT’s File Manager are integrated?
> >>> :=)
> >>>
> >>> CC/dev@oodt.a.o
> >>>
> >>> Cheers,
> >>> Chris
> >>>
> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>> Chris Mattmann, Ph.D.
> >>> Chief Architect
> >>> Instrument Software and Science Data Systems Section (398)
> >>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >>> Office: 168-519, Mailstop: 168-527
> >>> Email: chris.a.mattmann@nasa.gov
> >>> WWW:  http://sunset.usc.edu/~mattmann/
> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>> Adjunct Associate Professor, Computer Science Department
> >>> University of Southern California, Los Angeles, CA 90089 USA
> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> -----Original Message-----
> >>> From: DImuthu Upeksha <di...@gmail.com>
> >>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> >>> Date: Saturday, August 29, 2015 at 1:27 AM
> >>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> >>> Subject: OODT File Manager - Airavata Integration Document
> >>>
> >>> >Hi all,
> >>> >
> >>> >
> >>> >Please find the document [1] that describes the steps followed in the
> >>> >attempt of integrating OODT File Manager and AIravata. This setup is
> >>> >currently working on gw77.
> >>> >
> >>> >
> >>> >[1]
> >>> >
> >>>
> >>>
> https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP
> >>>-M
> >>> >OFUDw/edit?usp=sharing
> >>> >
> >>> >
> >>> >Thanks
> >>> >Dimuthu
> >>> >
> >>> >
> >>> >--
> >>> >Regards
> >>> >W.Dimuthu Upeksha
> >>> >Undergraduate
> >>> >Department of Computer Science And Engineering
> >>> >University of Moratuwa, Sri Lanka
> >>> >
> >>> >
> >>> >
> >>>
> >>>
> >>
> >>
> >> --
> >> Regards
> >>
> >> W.Dimuthu Upeksha
> >> Undergraduate
> >> Department of Computer Science And Engineering
> >>
> >> University of Moratuwa, Sri Lanka
> >>
>
>
>

Re: OODT File Manager - Airavata Integration Document

Posted by Suresh Marru <sm...@apache.org>.
Thanks Chris this is helpful to get a clarification. The only reason we
want to do at a service level so we can have more fine grain control based
on users/groups and their roles. We will start by looking at the tomcat
layer and will ask more questions along the way.

Paraphrasing Supun: Seems like OODT currently supports files organized in a
flat structure. Any suggestions on how to support data products organized
in hierarchal directories. As an example, say an Experiment has a Workflow
which runs bunch of simulations all organized as inputs and outputs under a
parent experiment. Can we point the file manager to such a organization or
is it expected that the hierarchy be managed outside (through metadata key
value pairs or otherwise)?

Thanks,
Suresh

On Mon, Oct 12, 2015 at 4:32 PM Chris Mattmann <ch...@gmail.com>
wrote:

> Hey Suresh,
>
> Sure. Right now I would recommend not trying to do auth/auth
> at the File Manager Level, and instead using e.g., Tomcat or
> something to set up like an OAuth realm, and doing it that way.
> Is there a specific need to lock it down at the service level?
> At their core they are XML-RPC, and I think it will be more difficult
> to implement there than trying to do in an app server that sits
> in front.
>
> Cheers,
> Chris
>
> —
> Chris Mattmann
> chris.mattmann@gmail.com
>
>
>
>
>
>
> -----Original Message-----
> From: Suresh Marru <sm...@apache.org>
> Reply-To: <de...@oodt.apache.org>
> Date: Monday, October 12, 2015 at 1:09 PM
> To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
> Subject: Re: OODT File Manager - Airavata Integration Document
>
> >OODT Dev's,
> >
> >Can we plugin custom authentication to CAS File Manager? I see that you
> >could potentially use the OODT single sign on package and have it talk to
> >a
> >LDAP but wondering if we could do OAuth2 like authentication and
> >authorization.
> >
> >Thanks,
> >Suresh
> >
> >On Tue, Sep 1, 2015 at 12:03 AM DImuthu Upeksha
> ><di...@gmail.com>
> >wrote:
> >
> >> Hi Chris,
> >>
> >> Thank you for your feedback. This is a POC level implementation done by
> >>me
> >> and there is a lot of room for improvement. It would be great if both
> >> Airavata and OODT teams can go through the design and decide whether
> >> Airavata can be integrated with OODT File manager. But my idea is, yes
> >>it
> >> is possible.
> >>
> >> Thanks,
> >> Dimuthu
> >>
> >> On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
> >> chris.a.mattmann@jpl.nasa.gov> wrote:
> >>
> >>> Great work Dimuthu!
> >>>
> >>> So this means now Airavata and OODT’s File Manager are integrated?
> >>> :=)
> >>>
> >>> CC/dev@oodt.a.o
> >>>
> >>> Cheers,
> >>> Chris
> >>>
> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>> Chris Mattmann, Ph.D.
> >>> Chief Architect
> >>> Instrument Software and Science Data Systems Section (398)
> >>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >>> Office: 168-519, Mailstop: 168-527
> >>> Email: chris.a.mattmann@nasa.gov
> >>> WWW:  http://sunset.usc.edu/~mattmann/
> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>> Adjunct Associate Professor, Computer Science Department
> >>> University of Southern California, Los Angeles, CA 90089 USA
> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> -----Original Message-----
> >>> From: DImuthu Upeksha <di...@gmail.com>
> >>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> >>> Date: Saturday, August 29, 2015 at 1:27 AM
> >>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> >>> Subject: OODT File Manager - Airavata Integration Document
> >>>
> >>> >Hi all,
> >>> >
> >>> >
> >>> >Please find the document [1] that describes the steps followed in the
> >>> >attempt of integrating OODT File Manager and AIravata. This setup is
> >>> >currently working on gw77.
> >>> >
> >>> >
> >>> >[1]
> >>> >
> >>>
> >>>
> https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP
> >>>-M
> >>> >OFUDw/edit?usp=sharing
> >>> >
> >>> >
> >>> >Thanks
> >>> >Dimuthu
> >>> >
> >>> >
> >>> >--
> >>> >Regards
> >>> >W.Dimuthu Upeksha
> >>> >Undergraduate
> >>> >Department of Computer Science And Engineering
> >>> >University of Moratuwa, Sri Lanka
> >>> >
> >>> >
> >>> >
> >>>
> >>>
> >>
> >>
> >> --
> >> Regards
> >>
> >> W.Dimuthu Upeksha
> >> Undergraduate
> >> Department of Computer Science And Engineering
> >>
> >> University of Moratuwa, Sri Lanka
> >>
>
>
>

Re: OODT File Manager - Airavata Integration Document

Posted by Chris Mattmann <ch...@gmail.com>.
Hey Suresh,

Sure. Right now I would recommend not trying to do auth/auth
at the File Manager Level, and instead using e.g., Tomcat or
something to set up like an OAuth realm, and doing it that way.
Is there a specific need to lock it down at the service level?
At their core they are XML-RPC, and I think it will be more difficult
to implement there than trying to do in an app server that sits
in front.

Cheers,
Chris

—
Chris Mattmann
chris.mattmann@gmail.com






-----Original Message-----
From: Suresh Marru <sm...@apache.org>
Reply-To: <de...@oodt.apache.org>
Date: Monday, October 12, 2015 at 1:09 PM
To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
Subject: Re: OODT File Manager - Airavata Integration Document

>OODT Dev's,
>
>Can we plugin custom authentication to CAS File Manager? I see that you
>could potentially use the OODT single sign on package and have it talk to
>a
>LDAP but wondering if we could do OAuth2 like authentication and
>authorization.
>
>Thanks,
>Suresh
>
>On Tue, Sep 1, 2015 at 12:03 AM DImuthu Upeksha
><di...@gmail.com>
>wrote:
>
>> Hi Chris,
>>
>> Thank you for your feedback. This is a POC level implementation done by
>>me
>> and there is a lot of room for improvement. It would be great if both
>> Airavata and OODT teams can go through the design and decide whether
>> Airavata can be integrated with OODT File manager. But my idea is, yes
>>it
>> is possible.
>>
>> Thanks,
>> Dimuthu
>>
>> On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
>> chris.a.mattmann@jpl.nasa.gov> wrote:
>>
>>> Great work Dimuthu!
>>>
>>> So this means now Airavata and OODT’s File Manager are integrated?
>>> :=)
>>>
>>> CC/dev@oodt.a.o
>>>
>>> Cheers,
>>> Chris
>>>
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Chris Mattmann, Ph.D.
>>> Chief Architect
>>> Instrument Software and Science Data Systems Section (398)
>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>> Office: 168-519, Mailstop: 168-527
>>> Email: chris.a.mattmann@nasa.gov
>>> WWW:  http://sunset.usc.edu/~mattmann/
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Adjunct Associate Professor, Computer Science Department
>>> University of Southern California, Los Angeles, CA 90089 USA
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>
>>>
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: DImuthu Upeksha <di...@gmail.com>
>>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>>> Date: Saturday, August 29, 2015 at 1:27 AM
>>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>>> Subject: OODT File Manager - Airavata Integration Document
>>>
>>> >Hi all,
>>> >
>>> >
>>> >Please find the document [1] that describes the steps followed in the
>>> >attempt of integrating OODT File Manager and AIravata. This setup is
>>> >currently working on gw77.
>>> >
>>> >
>>> >[1]
>>> >
>>> 
>>>https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP
>>>-M
>>> >OFUDw/edit?usp=sharing
>>> >
>>> >
>>> >Thanks
>>> >Dimuthu
>>> >
>>> >
>>> >--
>>> >Regards
>>> >W.Dimuthu Upeksha
>>> >Undergraduate
>>> >Department of Computer Science And Engineering
>>> >University of Moratuwa, Sri Lanka
>>> >
>>> >
>>> >
>>>
>>>
>>
>>
>> --
>> Regards
>>
>> W.Dimuthu Upeksha
>> Undergraduate
>> Department of Computer Science And Engineering
>>
>> University of Moratuwa, Sri Lanka
>>



Re: OODT File Manager - Airavata Integration Document

Posted by Chris Mattmann <ch...@gmail.com>.
Hey Suresh,

Sure. Right now I would recommend not trying to do auth/auth
at the File Manager Level, and instead using e.g., Tomcat or
something to set up like an OAuth realm, and doing it that way.
Is there a specific need to lock it down at the service level?
At their core they are XML-RPC, and I think it will be more difficult
to implement there than trying to do in an app server that sits
in front.

Cheers,
Chris

—
Chris Mattmann
chris.mattmann@gmail.com






-----Original Message-----
From: Suresh Marru <sm...@apache.org>
Reply-To: <de...@oodt.apache.org>
Date: Monday, October 12, 2015 at 1:09 PM
To: <de...@airavata.apache.org>, <de...@oodt.apache.org>
Subject: Re: OODT File Manager - Airavata Integration Document

>OODT Dev's,
>
>Can we plugin custom authentication to CAS File Manager? I see that you
>could potentially use the OODT single sign on package and have it talk to
>a
>LDAP but wondering if we could do OAuth2 like authentication and
>authorization.
>
>Thanks,
>Suresh
>
>On Tue, Sep 1, 2015 at 12:03 AM DImuthu Upeksha
><di...@gmail.com>
>wrote:
>
>> Hi Chris,
>>
>> Thank you for your feedback. This is a POC level implementation done by
>>me
>> and there is a lot of room for improvement. It would be great if both
>> Airavata and OODT teams can go through the design and decide whether
>> Airavata can be integrated with OODT File manager. But my idea is, yes
>>it
>> is possible.
>>
>> Thanks,
>> Dimuthu
>>
>> On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
>> chris.a.mattmann@jpl.nasa.gov> wrote:
>>
>>> Great work Dimuthu!
>>>
>>> So this means now Airavata and OODT’s File Manager are integrated?
>>> :=)
>>>
>>> CC/dev@oodt.a.o
>>>
>>> Cheers,
>>> Chris
>>>
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Chris Mattmann, Ph.D.
>>> Chief Architect
>>> Instrument Software and Science Data Systems Section (398)
>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>> Office: 168-519, Mailstop: 168-527
>>> Email: chris.a.mattmann@nasa.gov
>>> WWW:  http://sunset.usc.edu/~mattmann/
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Adjunct Associate Professor, Computer Science Department
>>> University of Southern California, Los Angeles, CA 90089 USA
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>
>>>
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: DImuthu Upeksha <di...@gmail.com>
>>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>>> Date: Saturday, August 29, 2015 at 1:27 AM
>>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>>> Subject: OODT File Manager - Airavata Integration Document
>>>
>>> >Hi all,
>>> >
>>> >
>>> >Please find the document [1] that describes the steps followed in the
>>> >attempt of integrating OODT File Manager and AIravata. This setup is
>>> >currently working on gw77.
>>> >
>>> >
>>> >[1]
>>> >
>>> 
>>>https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP
>>>-M
>>> >OFUDw/edit?usp=sharing
>>> >
>>> >
>>> >Thanks
>>> >Dimuthu
>>> >
>>> >
>>> >--
>>> >Regards
>>> >W.Dimuthu Upeksha
>>> >Undergraduate
>>> >Department of Computer Science And Engineering
>>> >University of Moratuwa, Sri Lanka
>>> >
>>> >
>>> >
>>>
>>>
>>
>>
>> --
>> Regards
>>
>> W.Dimuthu Upeksha
>> Undergraduate
>> Department of Computer Science And Engineering
>>
>> University of Moratuwa, Sri Lanka
>>



Re: OODT File Manager - Airavata Integration Document

Posted by Suresh Marru <sm...@apache.org>.
OODT Dev's,

Can we plugin custom authentication to CAS File Manager? I see that you
could potentially use the OODT single sign on package and have it talk to a
LDAP but wondering if we could do OAuth2 like authentication and
authorization.

Thanks,
Suresh

On Tue, Sep 1, 2015 at 12:03 AM DImuthu Upeksha <di...@gmail.com>
wrote:

> Hi Chris,
>
> Thank you for your feedback. This is a POC level implementation done by me
> and there is a lot of room for improvement. It would be great if both
> Airavata and OODT teams can go through the design and decide whether
> Airavata can be integrated with OODT File manager. But my idea is, yes it
> is possible.
>
> Thanks,
> Dimuthu
>
> On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
> chris.a.mattmann@jpl.nasa.gov> wrote:
>
>> Great work Dimuthu!
>>
>> So this means now Airavata and OODT’s File Manager are integrated?
>> :=)
>>
>> CC/dev@oodt.a.o
>>
>> Cheers,
>> Chris
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Chief Architect
>> Instrument Software and Science Data Systems Section (398)
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 168-519, Mailstop: 168-527
>> Email: chris.a.mattmann@nasa.gov
>> WWW:  http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Associate Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: DImuthu Upeksha <di...@gmail.com>
>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> Date: Saturday, August 29, 2015 at 1:27 AM
>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> Subject: OODT File Manager - Airavata Integration Document
>>
>> >Hi all,
>> >
>> >
>> >Please find the document [1] that describes the steps followed in the
>> >attempt of integrating OODT File Manager and AIravata. This setup is
>> >currently working on gw77.
>> >
>> >
>> >[1]
>> >
>> https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP-M
>> >OFUDw/edit?usp=sharing
>> >
>> >
>> >Thanks
>> >Dimuthu
>> >
>> >
>> >--
>> >Regards
>> >W.Dimuthu Upeksha
>> >Undergraduate
>> >Department of Computer Science And Engineering
>> >University of Moratuwa, Sri Lanka
>> >
>> >
>> >
>>
>>
>
>
> --
> Regards
>
> W.Dimuthu Upeksha
> Undergraduate
> Department of Computer Science And Engineering
>
> University of Moratuwa, Sri Lanka
>

Re: OODT File Manager - Airavata Integration Document

Posted by Chris Mattmann <ch...@gmail.com>.
Great to hear. I’ll check it out.

—
Chris Mattmann
chris.mattmann@gmail.com






-----Original Message-----
From: DImuthu Upeksha <di...@gmail.com>
Reply-To: <de...@oodt.apache.org>
Date: Monday, August 31, 2015 at 9:03 PM
To: <de...@oodt.apache.org>, "dev@airavata.apache.org"
<de...@airavata.apache.org>
Subject: Re: OODT File Manager - Airavata Integration Document

>Hi Chris,
>
>Thank you for your feedback. This is a POC level implementation done by me
>and there is a lot of room for improvement. It would be great if both
>Airavata and OODT teams can go through the design and decide whether
>Airavata can be integrated with OODT File manager. But my idea is, yes it
>is possible.
>
>Thanks,
>Dimuthu
>
>On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
>chris.a.mattmann@jpl.nasa.gov> wrote:
>
>> Great work Dimuthu!
>>
>> So this means now Airavata and OODT’s File Manager are integrated?
>> :=)
>>
>> CC/dev@oodt.a.o
>>
>> Cheers,
>> Chris
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Chief Architect
>> Instrument Software and Science Data Systems Section (398)
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 168-519, Mailstop: 168-527
>> Email: chris.a.mattmann@nasa.gov
>> WWW:  http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Associate Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: DImuthu Upeksha <di...@gmail.com>
>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> Date: Saturday, August 29, 2015 at 1:27 AM
>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> Subject: OODT File Manager - Airavata Integration Document
>>
>> >Hi all,
>> >
>> >
>> >Please find the document [1] that describes the steps followed in the
>> >attempt of integrating OODT File Manager and AIravata. This setup is
>> >currently working on gw77.
>> >
>> >
>> >[1]
>> >
>> 
>>https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP-
>>M
>> >OFUDw/edit?usp=sharing
>> >
>> >
>> >Thanks
>> >Dimuthu
>> >
>> >
>> >--
>> >Regards
>> >W.Dimuthu Upeksha
>> >Undergraduate
>> >Department of Computer Science And Engineering
>> >University of Moratuwa, Sri Lanka
>> >
>> >
>> >
>>
>>
>
>
>-- 
>Regards
>
>W.Dimuthu Upeksha
>Undergraduate
>Department of Computer Science And Engineering
>
>University of Moratuwa, Sri Lanka



Re: OODT File Manager - Airavata Integration Document

Posted by Suresh Marru <sm...@apache.org>.
OODT Dev's,

Can we plugin custom authentication to CAS File Manager? I see that you
could potentially use the OODT single sign on package and have it talk to a
LDAP but wondering if we could do OAuth2 like authentication and
authorization.

Thanks,
Suresh

On Tue, Sep 1, 2015 at 12:03 AM DImuthu Upeksha <di...@gmail.com>
wrote:

> Hi Chris,
>
> Thank you for your feedback. This is a POC level implementation done by me
> and there is a lot of room for improvement. It would be great if both
> Airavata and OODT teams can go through the design and decide whether
> Airavata can be integrated with OODT File manager. But my idea is, yes it
> is possible.
>
> Thanks,
> Dimuthu
>
> On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
> chris.a.mattmann@jpl.nasa.gov> wrote:
>
>> Great work Dimuthu!
>>
>> So this means now Airavata and OODT’s File Manager are integrated?
>> :=)
>>
>> CC/dev@oodt.a.o
>>
>> Cheers,
>> Chris
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Chief Architect
>> Instrument Software and Science Data Systems Section (398)
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 168-519, Mailstop: 168-527
>> Email: chris.a.mattmann@nasa.gov
>> WWW:  http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Associate Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: DImuthu Upeksha <di...@gmail.com>
>> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> Date: Saturday, August 29, 2015 at 1:27 AM
>> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
>> Subject: OODT File Manager - Airavata Integration Document
>>
>> >Hi all,
>> >
>> >
>> >Please find the document [1] that describes the steps followed in the
>> >attempt of integrating OODT File Manager and AIravata. This setup is
>> >currently working on gw77.
>> >
>> >
>> >[1]
>> >
>> https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP-M
>> >OFUDw/edit?usp=sharing
>> >
>> >
>> >Thanks
>> >Dimuthu
>> >
>> >
>> >--
>> >Regards
>> >W.Dimuthu Upeksha
>> >Undergraduate
>> >Department of Computer Science And Engineering
>> >University of Moratuwa, Sri Lanka
>> >
>> >
>> >
>>
>>
>
>
> --
> Regards
>
> W.Dimuthu Upeksha
> Undergraduate
> Department of Computer Science And Engineering
>
> University of Moratuwa, Sri Lanka
>

Re: OODT File Manager - Airavata Integration Document

Posted by DImuthu Upeksha <di...@gmail.com>.
Hi Chris,

Thank you for your feedback. This is a POC level implementation done by me
and there is a lot of room for improvement. It would be great if both
Airavata and OODT teams can go through the design and decide whether
Airavata can be integrated with OODT File manager. But my idea is, yes it
is possible.

Thanks,
Dimuthu

On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
chris.a.mattmann@jpl.nasa.gov> wrote:

> Great work Dimuthu!
>
> So this means now Airavata and OODT’s File Manager are integrated?
> :=)
>
> CC/dev@oodt.a.o
>
> Cheers,
> Chris
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Chief Architect
> Instrument Software and Science Data Systems Section (398)
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 168-519, Mailstop: 168-527
> Email: chris.a.mattmann@nasa.gov
> WWW:  http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Associate Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
>
>
>
> -----Original Message-----
> From: DImuthu Upeksha <di...@gmail.com>
> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> Date: Saturday, August 29, 2015 at 1:27 AM
> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> Subject: OODT File Manager - Airavata Integration Document
>
> >Hi all,
> >
> >
> >Please find the document [1] that describes the steps followed in the
> >attempt of integrating OODT File Manager and AIravata. This setup is
> >currently working on gw77.
> >
> >
> >[1]
> >
> https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP-M
> >OFUDw/edit?usp=sharing
> >
> >
> >Thanks
> >Dimuthu
> >
> >
> >--
> >Regards
> >W.Dimuthu Upeksha
> >Undergraduate
> >Department of Computer Science And Engineering
> >University of Moratuwa, Sri Lanka
> >
> >
> >
>
>


-- 
Regards

W.Dimuthu Upeksha
Undergraduate
Department of Computer Science And Engineering

University of Moratuwa, Sri Lanka

Re: OODT File Manager - Airavata Integration Document

Posted by DImuthu Upeksha <di...@gmail.com>.
Hi Chris,

Thank you for your feedback. This is a POC level implementation done by me
and there is a lot of room for improvement. It would be great if both
Airavata and OODT teams can go through the design and decide whether
Airavata can be integrated with OODT File manager. But my idea is, yes it
is possible.

Thanks,
Dimuthu

On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
chris.a.mattmann@jpl.nasa.gov> wrote:

> Great work Dimuthu!
>
> So this means now Airavata and OODT’s File Manager are integrated?
> :=)
>
> CC/dev@oodt.a.o
>
> Cheers,
> Chris
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Chief Architect
> Instrument Software and Science Data Systems Section (398)
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 168-519, Mailstop: 168-527
> Email: chris.a.mattmann@nasa.gov
> WWW:  http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Associate Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
>
>
>
> -----Original Message-----
> From: DImuthu Upeksha <di...@gmail.com>
> Reply-To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> Date: Saturday, August 29, 2015 at 1:27 AM
> To: "dev@airavata.apache.org" <de...@airavata.apache.org>
> Subject: OODT File Manager - Airavata Integration Document
>
> >Hi all,
> >
> >
> >Please find the document [1] that describes the steps followed in the
> >attempt of integrating OODT File Manager and AIravata. This setup is
> >currently working on gw77.
> >
> >
> >[1]
> >
> https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP-M
> >OFUDw/edit?usp=sharing
> >
> >
> >Thanks
> >Dimuthu
> >
> >
> >--
> >Regards
> >W.Dimuthu Upeksha
> >Undergraduate
> >Department of Computer Science And Engineering
> >University of Moratuwa, Sri Lanka
> >
> >
> >
>
>


-- 
Regards

W.Dimuthu Upeksha
Undergraduate
Department of Computer Science And Engineering

University of Moratuwa, Sri Lanka