You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airavata.apache.org by Lahiru Gunathilake <gl...@gmail.com> on 2014/04/17 20:44:22 UTC
Architecture discussion about monitor and gfac integration
Hi All,
We are planning to have a hangout session to discuss/review monitoring
component and gfac integration 4/18/2014 10am EST.
I will post the hangout url soon and some documents soon.
Regards
Lahiru
--
System Analyst Programmer
PTI Lab
Indiana University
Re: Architecture discussion about monitor and gfac integration
Posted by Marlon Pierce <ma...@iu.edu>.
It would be a good check to also document what different providers need
to do. GSI-SSH, UNICORE, and a cloud provider like Whirr would be good.
Marlon
On 4/20/14 8:08 PM, Lahiru Gunathilake wrote:
> Hi All,
>
> I think after the discussion following things were concerned.
>
> GFAC execution chain is broken and all the executions became asynchronous.
>
> GFAC monitoring abstraction is not required in all the cases and when
> someone try to extend the gfac they have to extend the monitoring and
> provider interface.
>
> I think we will be able to solve the above concerns by supporting gfac
> execution chain for old synchronous mode and this will let developers to
> extend the provider functionality without using monitoring abstraction we
> have currently. If they prefer to execute the chain in asynchronous mode
> its up to them to extend the monitoring abstraction or resuse existing
> monitoring implementation.
>
> I will implement the above solution and arrange another review session.
> Thank You everyone for the inputs during the discussion.
>
> Regards
> Lahiru
>
>
> On Fri, Apr 18, 2014 at 1:55 PM, Suresh Marru <sm...@apache.org> wrote:
>
>> Incase you missed this discussion, the hangout is available at -
>> https://www.youtube.com/watch?v=nJFwGeNgtKg
>>
>> Thanks Lahiru for all your hard work on orchestrator and gfac components
>> and fielding the hard questions. I want to continue to play the devils
>> advocate in this discussion. I am hoping for the following outcomes from a
>> series of these hangouts:
>>
>> * A more illustrative architecture diagram of airavata job management
>> components
>> * A white paper describing gfac framework and how it can facilitate
>> capabilities to anchor for fault tolerance, scalability and lastly
>> performance considerations.
>> * A developer guide for writing and integrating a gfac provider.
>> * Operational/deployment recommendations for gfac
>>
>> Suresh
>>
>>
>> On Fri, Apr 18, 2014 at 10:07 AM, Suresh Marru <sm...@apache.org> wrote:
>>
>>> I created a Hangout on AIR within Airavata community page on G+.
>>>
>>>
>>> https://plus.google.com/hangouts/_/hoaevent/AP36tYfrYBCp62d8sI57yVCZdajqXfZM4Eprjf6xFf4mLSGwNbHQUQ?authuser=0&hl=en
>>>
>>>
>>> On Fri, Apr 18, 2014 at 9:57 AM, Lahiru Gunathilake <gl...@gmail.com>wrote:
>>>
>>>> Hi All,
>>>>
>>>> I will be using this document[1] to give an introduction about airavata
>>>> execution flow.
>>>>
>>>> [1]http://airavata.apache.org/architecture/overview.html
>>>> Regards
>>>> Lahiru
>>>>
>>>>
>>>> On Fri, Apr 18, 2014 at 9:53 AM, Lahiru Gunathilake <gl...@gmail.com>wrote:
>>>>
>>>>> Hi all,
>>>>>
>>>>> This will be a useful document during the discussion.
>>>>>
>>>>>
>>>>> https://docs.google.com/document/d/1127X2KpHM5cwYLyD8MG0_kKd_E7_IH9HNbz0eMGyYgs/edit?usp=sharing
>>>>>
>>>>> Regards
>>>>> Lahiru
>>>>>
>>>>>
>>>>> On Thu, Apr 17, 2014 at 2:44 PM, Lahiru Gunathilake <gl...@gmail.com>wrote:
>>>>>
>>>>>> Hi All,
>>>>>>
>>>>>> We are planning to have a hangout session to discuss/review monitoring
>>>>>> component and gfac integration 4/18/2014 10am EST.
>>>>>>
>>>>>> I will post the hangout url soon and some documents soon.
>>>>>>
>>>>>>
>>>>>> Regards
>>>>>> Lahiru
>>>>>>
>>>>>> --
>>>>>> System Analyst Programmer
>>>>>> PTI Lab
>>>>>> Indiana University
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> System Analyst Programmer
>>>>> PTI Lab
>>>>> Indiana University
>>>>>
>>>>
>>>>
>>>> --
>>>> System Analyst Programmer
>>>> PTI Lab
>>>> Indiana University
>>>>
>>>
>
Re: Architecture discussion about monitor and gfac integration
Posted by Lahiru Gunathilake <gl...@gmail.com>.
Hi All,
I think after the discussion following things were concerned.
GFAC execution chain is broken and all the executions became asynchronous.
GFAC monitoring abstraction is not required in all the cases and when
someone try to extend the gfac they have to extend the monitoring and
provider interface.
I think we will be able to solve the above concerns by supporting gfac
execution chain for old synchronous mode and this will let developers to
extend the provider functionality without using monitoring abstraction we
have currently. If they prefer to execute the chain in asynchronous mode
its up to them to extend the monitoring abstraction or resuse existing
monitoring implementation.
I will implement the above solution and arrange another review session.
Thank You everyone for the inputs during the discussion.
Regards
Lahiru
On Fri, Apr 18, 2014 at 1:55 PM, Suresh Marru <sm...@apache.org> wrote:
> Incase you missed this discussion, the hangout is available at -
> https://www.youtube.com/watch?v=nJFwGeNgtKg
>
> Thanks Lahiru for all your hard work on orchestrator and gfac components
> and fielding the hard questions. I want to continue to play the devils
> advocate in this discussion. I am hoping for the following outcomes from a
> series of these hangouts:
>
> * A more illustrative architecture diagram of airavata job management
> components
> * A white paper describing gfac framework and how it can facilitate
> capabilities to anchor for fault tolerance, scalability and lastly
> performance considerations.
> * A developer guide for writing and integrating a gfac provider.
> * Operational/deployment recommendations for gfac
>
> Suresh
>
>
> On Fri, Apr 18, 2014 at 10:07 AM, Suresh Marru <sm...@apache.org> wrote:
>
>> I created a Hangout on AIR within Airavata community page on G+.
>>
>>
>> https://plus.google.com/hangouts/_/hoaevent/AP36tYfrYBCp62d8sI57yVCZdajqXfZM4Eprjf6xFf4mLSGwNbHQUQ?authuser=0&hl=en
>>
>>
>> On Fri, Apr 18, 2014 at 9:57 AM, Lahiru Gunathilake <gl...@gmail.com>wrote:
>>
>>> Hi All,
>>>
>>> I will be using this document[1] to give an introduction about airavata
>>> execution flow.
>>>
>>> [1]http://airavata.apache.org/architecture/overview.html
>>> Regards
>>> Lahiru
>>>
>>>
>>> On Fri, Apr 18, 2014 at 9:53 AM, Lahiru Gunathilake <gl...@gmail.com>wrote:
>>>
>>>> Hi all,
>>>>
>>>> This will be a useful document during the discussion.
>>>>
>>>>
>>>> https://docs.google.com/document/d/1127X2KpHM5cwYLyD8MG0_kKd_E7_IH9HNbz0eMGyYgs/edit?usp=sharing
>>>>
>>>> Regards
>>>> Lahiru
>>>>
>>>>
>>>> On Thu, Apr 17, 2014 at 2:44 PM, Lahiru Gunathilake <gl...@gmail.com>wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> We are planning to have a hangout session to discuss/review monitoring
>>>>> component and gfac integration 4/18/2014 10am EST.
>>>>>
>>>>> I will post the hangout url soon and some documents soon.
>>>>>
>>>>>
>>>>> Regards
>>>>> Lahiru
>>>>>
>>>>> --
>>>>> System Analyst Programmer
>>>>> PTI Lab
>>>>> Indiana University
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> System Analyst Programmer
>>>> PTI Lab
>>>> Indiana University
>>>>
>>>
>>>
>>>
>>> --
>>> System Analyst Programmer
>>> PTI Lab
>>> Indiana University
>>>
>>
>>
>
--
System Analyst Programmer
PTI Lab
Indiana University
Re: Architecture discussion about monitor and gfac integration
Posted by Suresh Marru <sm...@apache.org>.
Incase you missed this discussion, the hangout is available at -
https://www.youtube.com/watch?v=nJFwGeNgtKg
Thanks Lahiru for all your hard work on orchestrator and gfac components
and fielding the hard questions. I want to continue to play the devils
advocate in this discussion. I am hoping for the following outcomes from a
series of these hangouts:
* A more illustrative architecture diagram of airavata job management
components
* A white paper describing gfac framework and how it can facilitate
capabilities to anchor for fault tolerance, scalability and lastly
performance considerations.
* A developer guide for writing and integrating a gfac provider.
* Operational/deployment recommendations for gfac
Suresh
On Fri, Apr 18, 2014 at 10:07 AM, Suresh Marru <sm...@apache.org> wrote:
> I created a Hangout on AIR within Airavata community page on G+.
>
>
> https://plus.google.com/hangouts/_/hoaevent/AP36tYfrYBCp62d8sI57yVCZdajqXfZM4Eprjf6xFf4mLSGwNbHQUQ?authuser=0&hl=en
>
>
> On Fri, Apr 18, 2014 at 9:57 AM, Lahiru Gunathilake <gl...@gmail.com>wrote:
>
>> Hi All,
>>
>> I will be using this document[1] to give an introduction about airavata
>> execution flow.
>>
>> [1]http://airavata.apache.org/architecture/overview.html
>> Regards
>> Lahiru
>>
>>
>> On Fri, Apr 18, 2014 at 9:53 AM, Lahiru Gunathilake <gl...@gmail.com>wrote:
>>
>>> Hi all,
>>>
>>> This will be a useful document during the discussion.
>>>
>>>
>>> https://docs.google.com/document/d/1127X2KpHM5cwYLyD8MG0_kKd_E7_IH9HNbz0eMGyYgs/edit?usp=sharing
>>>
>>> Regards
>>> Lahiru
>>>
>>>
>>> On Thu, Apr 17, 2014 at 2:44 PM, Lahiru Gunathilake <gl...@gmail.com>wrote:
>>>
>>>> Hi All,
>>>>
>>>> We are planning to have a hangout session to discuss/review monitoring
>>>> component and gfac integration 4/18/2014 10am EST.
>>>>
>>>> I will post the hangout url soon and some documents soon.
>>>>
>>>>
>>>> Regards
>>>> Lahiru
>>>>
>>>> --
>>>> System Analyst Programmer
>>>> PTI Lab
>>>> Indiana University
>>>>
>>>
>>>
>>>
>>> --
>>> System Analyst Programmer
>>> PTI Lab
>>> Indiana University
>>>
>>
>>
>>
>> --
>> System Analyst Programmer
>> PTI Lab
>> Indiana University
>>
>
>
Re: Architecture discussion about monitor and gfac integration
Posted by Suresh Marru <sm...@apache.org>.
I created a Hangout on AIR within Airavata community page on G+.
https://plus.google.com/hangouts/_/hoaevent/AP36tYfrYBCp62d8sI57yVCZdajqXfZM4Eprjf6xFf4mLSGwNbHQUQ?authuser=0&hl=en
On Fri, Apr 18, 2014 at 9:57 AM, Lahiru Gunathilake <gl...@gmail.com>wrote:
> Hi All,
>
> I will be using this document[1] to give an introduction about airavata
> execution flow.
>
> [1]http://airavata.apache.org/architecture/overview.html
> Regards
> Lahiru
>
>
> On Fri, Apr 18, 2014 at 9:53 AM, Lahiru Gunathilake <gl...@gmail.com>wrote:
>
>> Hi all,
>>
>> This will be a useful document during the discussion.
>>
>>
>> https://docs.google.com/document/d/1127X2KpHM5cwYLyD8MG0_kKd_E7_IH9HNbz0eMGyYgs/edit?usp=sharing
>>
>> Regards
>> Lahiru
>>
>>
>> On Thu, Apr 17, 2014 at 2:44 PM, Lahiru Gunathilake <gl...@gmail.com>wrote:
>>
>>> Hi All,
>>>
>>> We are planning to have a hangout session to discuss/review monitoring
>>> component and gfac integration 4/18/2014 10am EST.
>>>
>>> I will post the hangout url soon and some documents soon.
>>>
>>>
>>> Regards
>>> Lahiru
>>>
>>> --
>>> System Analyst Programmer
>>> PTI Lab
>>> Indiana University
>>>
>>
>>
>>
>> --
>> System Analyst Programmer
>> PTI Lab
>> Indiana University
>>
>
>
>
> --
> System Analyst Programmer
> PTI Lab
> Indiana University
>
Re: Architecture discussion about monitor and gfac integration
Posted by Lahiru Gunathilake <gl...@gmail.com>.
Hi All,
I will be using this document[1] to give an introduction about airavata
execution flow.
[1]http://airavata.apache.org/architecture/overview.html
Regards
Lahiru
On Fri, Apr 18, 2014 at 9:53 AM, Lahiru Gunathilake <gl...@gmail.com>wrote:
> Hi all,
>
> This will be a useful document during the discussion.
>
>
> https://docs.google.com/document/d/1127X2KpHM5cwYLyD8MG0_kKd_E7_IH9HNbz0eMGyYgs/edit?usp=sharing
>
> Regards
> Lahiru
>
>
> On Thu, Apr 17, 2014 at 2:44 PM, Lahiru Gunathilake <gl...@gmail.com>wrote:
>
>> Hi All,
>>
>> We are planning to have a hangout session to discuss/review monitoring
>> component and gfac integration 4/18/2014 10am EST.
>>
>> I will post the hangout url soon and some documents soon.
>>
>>
>> Regards
>> Lahiru
>>
>> --
>> System Analyst Programmer
>> PTI Lab
>> Indiana University
>>
>
>
>
> --
> System Analyst Programmer
> PTI Lab
> Indiana University
>
--
System Analyst Programmer
PTI Lab
Indiana University
Re: Architecture discussion about monitor and gfac integration
Posted by Lahiru Gunathilake <gl...@gmail.com>.
Hi all,
This will be a useful document during the discussion.
https://docs.google.com/document/d/1127X2KpHM5cwYLyD8MG0_kKd_E7_IH9HNbz0eMGyYgs/edit?usp=sharing
Regards
Lahiru
On Thu, Apr 17, 2014 at 2:44 PM, Lahiru Gunathilake <gl...@gmail.com>wrote:
> Hi All,
>
> We are planning to have a hangout session to discuss/review monitoring
> component and gfac integration 4/18/2014 10am EST.
>
> I will post the hangout url soon and some documents soon.
>
>
> Regards
> Lahiru
>
> --
> System Analyst Programmer
> PTI Lab
> Indiana University
>
--
System Analyst Programmer
PTI Lab
Indiana University