Airavata EC2 Provider

[Suresh Marru <sm...@apache.org>]

Hi Heejon and others,

As Heshan suggested can you please subscribe to Airavata users mailing =
list and post these questions to the list. These will be greatly =
beneficial to others as well.=20

Instructions to the join the mailing list are at - =
http://airavata.apache.org/community/mailing-lists.html

Thanks,
Suresh

On Apr 7, 2013, at 11:27 PM, Heejoon Chae <he...@cs.indiana.edu> wrote:

> Hi, Heshan,
> 
> This is great feature additions to handle Amazon components! Thank you for your improvements and kind explanation using Bioinformatics example. 
> 
> I have some questions based on that. Please correct me if I get confused.
> 
> Q1. For the execution result from your example, it can be only shown by monitoring panel with text like "result=xxx". As we briefly discussed previously, is it also possible to show the result from the web browser when the result contains text like "http://..." or "s3:..." in case when user click the output component? I think that feature will dramatically increase the Xbaya's output delivery ability and make more user friendly.
> 
> Q2. Since you accept credential(including private key) information through the Xbaya directly, is it stored only local machine even when you use remote Airavata server? 
> That is, in case you are the registering person on the remote server, you don't need to consider the log-in credential within application, and user(local Xbaya) creates connection to Amazon with that credential information and use registered remote apps to run the job. Am I correct? 
> 
> Q3. From the screen shots, I can see 'refresh', 'launch' and 'terminate'. It is also possible to 'stop' the instance without terminating? 
> 
> Thank you for your help!
> Heejoon.
> 
> 
> 
> On Sat, Apr 6, 2013 at 2:21 AM, Heshan Suriyaarachchi <he...@gmail.com> wrote:
> Hi Guys, 
> 
> Airavata 0.7 supports EC2 job submissions. You can refer the following posts [1] [2] and run your EC2 jobs. If you need any clarifications, please ask. 
> 
> [1] - http://heshans.blogspot.com/2013/04/run-ec2-jobs-with-airavata-part-i.html
> [2] - http://heshans.blogspot.com/2013/04/run-ec2-jobs-with-airavata-part-ii.html
> 
> Thanks, 
> Heshan. 
> 
> On Tue, Mar 12, 2013 at 7:55 PM, Sun Kim <su...@snu.ac.kr> wrote:
> Thanks munch, Suresh, Heshan, and Hyungro.
> Sun
> 
> 2013. 3. 13., 오전 12:32, Suresh Marru <sm...@iu.edu> 작성:
> 
>> Hi Hyungro,
>> 
>> Can you please share these details with Heshan? I will appreciate if you can work with Heshan and deploy this completely on Airavata, that way whenever Sun is continuing work on it, we can better support it.
>> 
>> Thanks,
>> Suresh
>> 
>> On Mar 12, 2013, at 6:42 AM, Heshan Suriyaarachchi <he...@gmail.com> wrote:
>> 
>>> Hi Heejoon, 
>>> 
>>> Just having the AMI id, won't be sufficient for me to run the application. I need the following information as well. 
>>> 
>>> 1. Access key
>>> 2. Secret key
>>> 3. Script name and input parameters. (Give me some sample inputs and expected result)
>>> 4. How the result will be printed to the standard out. (I need this to filter out the application specific result)
>>> 
>>> On Tue, Mar 12, 2013 at 12:16 AM, Heejoon Chae <he...@cs.indiana.edu> wrote:
>>> The ami number is ami-957291fc.
>>> 
>>> Sorry for the confusion.
>>> 
>>> Thank you,
>>> Heejoon.
>>> 
>>> 
>>> On Tue, Mar 12, 2013 at 1:12 PM, Heejoon Chae <he...@cs.indiana.edu> wrote:
>>> Hi, Heshan,
>>> 
>>> The MMIA ami that I used was ami-95729.
>>> 
>>> After the all the processes are done, the result 's3:xxxx' link produced from the final node and passed to output node not allow to open the result page on S3 when click the output component.
>>> 
>>> Thank you,
>>> Heejoon.
>>> 
>>> 
>>> On Tue, Mar 12, 2013 at 12:49 PM, Sun Kim <su...@snu.ac.kr> wrote:
>>> Heejoon,
>>> 
>>> Please communicate with Heshan and follow this up.
>>> 
>>> Hyungro -- I wonder if you were able to use the last application box to retrieve the MMIA analysis result?
>>> 
>>> Thank you
>>> Sun
>>> 
>>> 
>>> 2013. 3. 12., 오전 12:23, Heshan Suriyaarachchi <he...@gmail.com> 작성:
>>> 
>>>> Hi Sun, 
>>>> 
>>>> Could you ask Heejoon to send me the issue he came across? I would prefer having access to an AMI he's referring to? 
>>>> 
>>>> In Hyungro's case, what he did was to make the script call the application on an AMI (where that script would have the EC2 connection info). There he's not using the EC2Provider but the generic provider at Airavata. With the use of EC2Provider you can submit jobs to your AMI instances. 
>>>> 
>>>> Thanks, 
>>>> Heshan
>>>> 
>>>> On Mon, Mar 11, 2013 at 11:08 AM, Sun Kim <su...@snu.ac.kr> wrote:
>>>> Thanks, Heshan.
>>>> 
>>>> Heejoon also tested Airavata in Korea and it works well.
>>>> 
>>>> One important request to you and Suresh -- At the end of a workflow, we add an application to connect to S3 to display the analysis result. Heejoon told me that it did not work. I appreciate your checking on this.
>>>> 
>>>> Thanks again.
>>>> Sun
>>>> 
>>>> 
>>>> 
>>>> 
>>>> 2013. 3. 11., 오후 11:44, Heshan Suriyaarachchi <he...@gmail.com> 작성:
>>>> 
>>>>> Hi All, 
>>>>> 
>>>>> Airavata is now supporting job submissions to EC2. I have rewritten the EC2Provider in a such a way that it is no longer bound to SSHProvider. It gives us more flexibility in running cloud jobs. I am currently running some tests and evaluating the new EC2Provider and still the UI components are not added. I will start working on them shortly. 
>>>>> 
>>>>> Hi Hyungro, 
>>>>> 
>>>>> In the meantime, could you give me access to the AMI that you are using for BioVLab? Then I could start testing it with the new implementation. I will be there in the CIB during this week and you can come and meet me when you are free. 
>>>>> 
>>>>> Thanks, 
>>>>> Heshan.
>>>>> 
>>>>> On Mon, Feb 25, 2013 at 6:41 AM, Heshan Suriyaarachchi <he...@gmail.com> wrote:
>>>>> Hi Hyungro, 
>>>>> 
>>>>> Great news. I'll be around the CIB too. My skype id is heshan.suriyaarachchi. Ping me once you are there. 
>>>>> 
>>>>> Thanks, 
>>>>> Heshan.
>>>>> 
>>>>> 
>>>>> On Sun, Feb 24, 2013 at 10:12 PM, Hyungro Lee <le...@indiana.edu> wrote:
>>>>> Hi all,
>>>>> 
>>>>> During the weekend, I installed Airavata to biovlab.gateway.iu.teragrid.org which is our current gateway machine for BioVLAB-MMIA and I tested the workflow. Luckily, it was successfully finished :)
>>>>> 
>>>>> Now, I would like to hear feedback from you for testing BioVLAB-MMIA with Airavata.
>>>>> 
>>>>> I created an instruction web page which is here:
>>>>> https://sites.google.com/site/biovlab/biovlab-mmia-on-airavata-new
>>>>> 
>>>>> It may take up to 30 minutes to proceed test.
>>>>> 
>>>>> When you get errors, or want to give some opinion, please leave a comment on the page or email me. It would be really appreciated.
>>>>> 
>>>>> Also, I just want to let you know, BioVLAB project has a mailing list on google. You can join here: https://groups.google.com/d/forum/biovlab
>>>>> Email address for the list is: biovlab@googlegroups.com
>>>>> 
>>>>> No one seems to use it but this might be good time to start using it.
>>>>> 
>>>>> Heshan - I would like to have a chance to talk with you about the Airavata. I have couple of questions about the XBaya's functionality. For example, importing / exporting workflow to Registry, and opening web browser by clicking output component. I will be around PTI on Monday afternoon and Tuesday.
>>>>> 
>>>>> In the meantime, I will improve some minor things since we moved to the new framework. Thank you.
>>>>> 
>>>>> Best,
>>>>> Hyungro
>>>>> 
>>>>> -- 
>>>>> Hyungro Lee
>>>>> Pervasive Technology Institute
>>>>> School of Informatics and Computing
>>>>> Indiana University
>>>>> 
>>>>> 
>>>>> 
>>>>> -- 
>>>>> Regards,
>>>>> Heshan Suriyaarachchi
>>>>> 
>>>>> http://heshans.blogspot.com/
>>>>> http://www.linkedin.com/in/heshan
>>>>> 
>>>>> 
>>>>> 
>>>>> -- 
>>>>> Regards,
>>>>> Heshan Suriyaarachchi
>>>>> 
>>>>> http://heshans.blogspot.com/
>>>>> http://www.linkedin.com/in/heshan
>>>> 
>>>> 
>>>> 
>>>> 
>>>> -- 
>>>> Regards,
>>>> Heshan Suriyaarachchi
>>>> 
>>>> http://heshans.blogspot.com/
>>>> http://www.linkedin.com/in/heshan
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> -- 
>>> Regards,
>>> Heshan Suriyaarachchi
>>> 
>>> http://heshans.blogspot.com/
>>> http://www.linkedin.com/in/heshan
>> 
> 
> 
> 
> 
> -- 
> Regards,
> Heshan Suriyaarachchi
> 
> http://heshans.blogspot.com/
> http://www.linkedin.com/in/heshan
>