You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airavata.apache.org by Supun Nakandala <su...@gmail.com> on 2014/12/11 11:11:25 UTC
DataCat Project Progress
Hi All,
We had the mid evaluation of the project last Tuesday and the following
concerns were raised.
1. The lack of visibility of the overall solution in the project
demonstration.
2. The ability to come up with a solution where, scientist who does not
have a background in computer science can create new parsers (metadata
extraction logic)
The project was demonstrated using the web interface that we developed. For
the final evaluation we expect to demonstrate the system using laravel PHP
Reference Gateway running in a production server and demonstrate how a new
data product that gets generated will be identified, indexed and will be
available for searching and hope this will handle the first issue.
We also had a meeting with Dr. Dilum our internal supervisor where we
identified things that can be done from now to 15th January, the expected
project completion date
1. Do a proper performance test and publish a paper before final marks
for the project is finalized (marks will be finalized by the end of March).
2. Getting to work more parsers, so that Sudhakar can ask more users to
use the system. This will help to get more feedback on the system and have
a real world usage.
3. Implement the support for provenance aware workflow execution in
Airavata using our system.
We have written a draft paper which I have attached here with. We showed
this to Dr. Srinath and Dr Dilum and they suggested that we do a proper
performance testing (The one that already done is not up to the expected
standards). Given the available time we need to prioritize our work and
select a set of tasks that is doable and has the most impact. What do you
all think?
Draft Paper:
https://docs.google.com/document/d/1PLfST6hLygQpsr4RlgiDoffmDEwMOWbmb1WZ0uKTtd8/edit#heading=h.6fjqfavj2nov
Literature Review:
https://drive.google.com/file/d/0B0cLF-CLa59oaXRBazF1aURvQTg/view?usp=sharing
Supun
Re: DataCat Project Progress
Posted by Supun Nakandala <su...@gmail.com>.
Earlier we were able to log into the system using private key. But now it
asks for a password. I think our keys have been removed. My public key is
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH9Lzx8u7Bhi8GIQEBk5a9k6UROa26
OM2QawLSIHqdwwW15C8J493/jmdOsA9MuE4IXR3oVhlhkwJJhvJHap
llasaMGsED7pCltrRgumY8Tp/YKPYnUZCwt7CxzOlDh2dgq7wBn4bgwhC6/FDfYxpOeauhbaY+
rqfo1V8I62pgC8Nmb6iNHKqQBts+QRYrs0FvPwlKqD8fZeYnm8+NVvKi/
R9oDb1uwBGnxymAz1ks0yYtmGn6M5xggQFu+OdfrWOrXpVQh+RzjcGiafrJmHpeAH+
vhX7uxe0bRDqv59iZRCKVDrMN2UDpNH8fBGTLivL2LLNl0IZ08m72hQ5Xum7v
supun.nakandala@gmail.com
On Thu, Dec 11, 2014 at 10:03 PM, Pamidighantam, Sudhakar V <
spamidig@illinois.edu> wrote:
> Suresh is traveling. What issues are you facing. I have root access on
> this system.
> Let me see if I can help there.
>
> Thanks,
> Sudhakar.
>
> On Dec 11, 2014, at 10:29 AM, Supun Nakandala <su...@gmail.com>
> wrote:
>
> Hi Sudhakar,
>
> Thank you very much for your support. Suresh gave us a machine(
> gridchem.uits.iu.edu) in IU to deploy the server. But unfortunately we
> are having some ssh issues when logging to that server . I will contact
> Suresh and get the issue fixed and deploy an instance of the server there
> so that you can configure and test the parsers by your self.
>
> On Thu, Dec 11, 2014 at 7:42 PM, Pamidighantam, Sudhakar V <
> spamidig@illinois.edu> wrote:
>
>> Supun:
>> I support these goals. I am available for you to engage with you and
>> anything I can do to expedite the project please let me know. Even if you
>> think I can not, do please ask anyway.
>> I have written the original parsers in perl myself and have directed
>> others when the Cup/JFLex system was put in place. I have generated and
>> modified the CUP/JFlex code before, so I am familiar with how it works. I
>> will look at the paper and may suggest additions.
>>
>> I can not test the system now by adding more data and see if this can
>> parse the new data. How can we get to that point. This is critical first
>> step for me before I can ask friendly users to test this further. Current
>> state is a prototype only and is not interesting enough for any of our
>> users. Unless we can add parsing of more data and more salient data and
>> create products it is difficult engage end users in any meaningful way.
>>
>> Perhaps if this is deployed somewhere in Indiana it may be easier to
>> move forward. If you need more data please let me know where I should
>> locate it for you to access.
>>
>> Thanks,
>> Sudhakar.
>>
>>
>> On Dec 11, 2014, at 4:11 AM, Supun Nakandala <su...@gmail.com>
>> wrote:
>>
>> Hi All,
>>
>> We had the mid evaluation of the project last Tuesday and the following
>> concerns were raised.
>>
>> 1. The lack of visibility of the overall solution in the project
>> demonstration.
>> 2. The ability to come up with a solution where, scientist who does
>> not have a background in computer science can create new parsers (metadata
>> extraction logic)
>>
>> The project was demonstrated using the web interface that we developed.
>> For the final evaluation we expect to demonstrate the system using laravel
>> PHP Reference Gateway running in a production server and demonstrate how a
>> new data product that gets generated will be identified, indexed and will
>> be available for searching and hope this will handle the first issue.
>>
>> We also had a meeting with Dr. Dilum our internal supervisor where we
>> identified things that can be done from now to 15th January, the expected
>> project completion date
>>
>> 1. Do a proper performance test and publish a paper before final
>> marks for the project is finalized (marks will be finalized by the end of
>> March).
>> 2. Getting to work more parsers, so that Sudhakar can ask more users
>> to use the system. This will help to get more feedback on the system and
>> have a real world usage.
>> 3. Implement the support for provenance aware workflow execution in
>> Airavata using our system.
>>
>> We have written a draft paper which I have attached here with. We showed
>> this to Dr. Srinath and Dr Dilum and they suggested that we do a proper
>> performance testing (The one that already done is not up to the expected
>> standards). Given the available time we need to prioritize our work and
>> select a set of tasks that is doable and has the most impact. What do you
>> all think?
>>
>> Draft Paper:
>> https://docs.google.com/document/d/1PLfST6hLygQpsr4RlgiDoffmDEwMOWbmb1WZ0uKTtd8/edit#heading=h.6fjqfavj2nov
>>
>> Literature Review:
>> https://drive.google.com/file/d/0B0cLF-CLa59oaXRBazF1aURvQTg/view?usp=sharing
>>
>> Supun
>>
>>
>>
>
>
> --
> Thank you
> Supun Nakandala
> Dept. Computer Science and Engineering
> University of Moratuwa
>
>
>
--
Thank you
Supun Nakandala
Dept. Computer Science and Engineering
University of Moratuwa
Re: DataCat Project Progress
Posted by Marlon Pierce <ma...@iu.edu>.
Please take those details off list.
Marlon
On 12/11/14, 11:33 AM, Pamidighantam, Sudhakar V wrote:
> Suresh is traveling. What issues are you facing. I have root access on this system.
> Let me see if I can help there.
>
> Thanks,
> Sudhakar.
>
> On Dec 11, 2014, at 10:29 AM, Supun Nakandala <su...@gmail.com>> wrote:
>
> Hi Sudhakar,
>
> Thank you very much for your support. Suresh gave us a machine(gridchem.uits.iu.edu<http://gridchem.uits.iu.edu/>) in IU to deploy the server. But unfortunately we are having some ssh issues when logging to that server . I will contact Suresh and get the issue fixed and deploy an instance of the server there so that you can configure and test the parsers by your self.
>
> On Thu, Dec 11, 2014 at 7:42 PM, Pamidighantam, Sudhakar V <sp...@illinois.edu>> wrote:
> Supun:
> I support these goals. I am available for you to engage with you and anything I can do to expedite the project please let me know. Even if you think I can not, do please ask anyway.
> I have written the original parsers in perl myself and have directed others when the Cup/JFLex system was put in place. I have generated and modified the CUP/JFlex code before, so I am familiar with how it works. I will look at the paper and may suggest additions.
>
> I can not test the system now by adding more data and see if this can parse the new data. How can we get to that point. This is critical first step for me before I can ask friendly users to test this further. Current state is a prototype only and is not interesting enough for any of our users. Unless we can add parsing of more data and more salient data and create products it is difficult engage end users in any meaningful way.
>
> Perhaps if this is deployed somewhere in Indiana it may be easier to move forward. If you need more data please let me know where I should locate it for you to access.
>
> Thanks,
> Sudhakar.
>
>
> On Dec 11, 2014, at 4:11 AM, Supun Nakandala <su...@gmail.com>> wrote:
>
> Hi All,
>
> We had the mid evaluation of the project last Tuesday and the following concerns were raised.
>
> 1. The lack of visibility of the overall solution in the project demonstration.
> 2. The ability to come up with a solution where, scientist who does not have a background in computer science can create new parsers (metadata extraction logic)
>
> The project was demonstrated using the web interface that we developed. For the final evaluation we expect to demonstrate the system using laravel PHP Reference Gateway running in a production server and demonstrate how a new data product that gets generated will be identified, indexed and will be available for searching and hope this will handle the first issue.
>
> We also had a meeting with Dr. Dilum our internal supervisor where we identified things that can be done from now to 15th January, the expected project completion date
>
> 1. Do a proper performance test and publish a paper before final marks for the project is finalized (marks will be finalized by the end of March).
> 2. Getting to work more parsers, so that Sudhakar can ask more users to use the system. This will help to get more feedback on the system and have a real world usage.
> 3. Implement the support for provenance aware workflow execution in Airavata using our system.
>
> We have written a draft paper which I have attached here with. We showed this to Dr. Srinath and Dr Dilum and they suggested that we do a proper performance testing (The one that already done is not up to the expected standards). Given the available time we need to prioritize our work and select a set of tasks that is doable and has the most impact. What do you all think?
>
> Draft Paper: https://docs.google.com/document/d/1PLfST6hLygQpsr4RlgiDoffmDEwMOWbmb1WZ0uKTtd8/edit#heading=h.6fjqfavj2nov
>
> Literature Review: https://drive.google.com/file/d/0B0cLF-CLa59oaXRBazF1aURvQTg/view?usp=sharing
>
> Supun
>
>
>
>
> --
> Thank you
> Supun Nakandala
> Dept. Computer Science and Engineering
> University of Moratuwa
>
>
Re: DataCat Project Progress
Posted by "Pamidighantam, Sudhakar V" <sp...@illinois.edu>.
Suresh is traveling. What issues are you facing. I have root access on this system.
Let me see if I can help there.
Thanks,
Sudhakar.
On Dec 11, 2014, at 10:29 AM, Supun Nakandala <su...@gmail.com>> wrote:
Hi Sudhakar,
Thank you very much for your support. Suresh gave us a machine(gridchem.uits.iu.edu<http://gridchem.uits.iu.edu/>) in IU to deploy the server. But unfortunately we are having some ssh issues when logging to that server . I will contact Suresh and get the issue fixed and deploy an instance of the server there so that you can configure and test the parsers by your self.
On Thu, Dec 11, 2014 at 7:42 PM, Pamidighantam, Sudhakar V <sp...@illinois.edu>> wrote:
Supun:
I support these goals. I am available for you to engage with you and anything I can do to expedite the project please let me know. Even if you think I can not, do please ask anyway.
I have written the original parsers in perl myself and have directed others when the Cup/JFLex system was put in place. I have generated and modified the CUP/JFlex code before, so I am familiar with how it works. I will look at the paper and may suggest additions.
I can not test the system now by adding more data and see if this can parse the new data. How can we get to that point. This is critical first step for me before I can ask friendly users to test this further. Current state is a prototype only and is not interesting enough for any of our users. Unless we can add parsing of more data and more salient data and create products it is difficult engage end users in any meaningful way.
Perhaps if this is deployed somewhere in Indiana it may be easier to move forward. If you need more data please let me know where I should locate it for you to access.
Thanks,
Sudhakar.
On Dec 11, 2014, at 4:11 AM, Supun Nakandala <su...@gmail.com>> wrote:
Hi All,
We had the mid evaluation of the project last Tuesday and the following concerns were raised.
1. The lack of visibility of the overall solution in the project demonstration.
2. The ability to come up with a solution where, scientist who does not have a background in computer science can create new parsers (metadata extraction logic)
The project was demonstrated using the web interface that we developed. For the final evaluation we expect to demonstrate the system using laravel PHP Reference Gateway running in a production server and demonstrate how a new data product that gets generated will be identified, indexed and will be available for searching and hope this will handle the first issue.
We also had a meeting with Dr. Dilum our internal supervisor where we identified things that can be done from now to 15th January, the expected project completion date
1. Do a proper performance test and publish a paper before final marks for the project is finalized (marks will be finalized by the end of March).
2. Getting to work more parsers, so that Sudhakar can ask more users to use the system. This will help to get more feedback on the system and have a real world usage.
3. Implement the support for provenance aware workflow execution in Airavata using our system.
We have written a draft paper which I have attached here with. We showed this to Dr. Srinath and Dr Dilum and they suggested that we do a proper performance testing (The one that already done is not up to the expected standards). Given the available time we need to prioritize our work and select a set of tasks that is doable and has the most impact. What do you all think?
Draft Paper: https://docs.google.com/document/d/1PLfST6hLygQpsr4RlgiDoffmDEwMOWbmb1WZ0uKTtd8/edit#heading=h.6fjqfavj2nov
Literature Review: https://drive.google.com/file/d/0B0cLF-CLa59oaXRBazF1aURvQTg/view?usp=sharing
Supun
--
Thank you
Supun Nakandala
Dept. Computer Science and Engineering
University of Moratuwa
Re: DataCat Project Progress
Posted by Supun Nakandala <su...@gmail.com>.
Hi Sudhakar,
Thank you very much for your support. Suresh gave us a machine(
gridchem.uits.iu.edu) in IU to deploy the server. But unfortunately we are
having some ssh issues when logging to that server . I will contact Suresh
and get the issue fixed and deploy an instance of the server there so that
you can configure and test the parsers by your self.
On Thu, Dec 11, 2014 at 7:42 PM, Pamidighantam, Sudhakar V <
spamidig@illinois.edu> wrote:
> Supun:
> I support these goals. I am available for you to engage with you and
> anything I can do to expedite the project please let me know. Even if you
> think I can not, do please ask anyway.
> I have written the original parsers in perl myself and have directed
> others when the Cup/JFLex system was put in place. I have generated and
> modified the CUP/JFlex code before, so I am familiar with how it works. I
> will look at the paper and may suggest additions.
>
> I can not test the system now by adding more data and see if this can
> parse the new data. How can we get to that point. This is critical first
> step for me before I can ask friendly users to test this further. Current
> state is a prototype only and is not interesting enough for any of our
> users. Unless we can add parsing of more data and more salient data and
> create products it is difficult engage end users in any meaningful way.
>
> Perhaps if this is deployed somewhere in Indiana it may be easier to
> move forward. If you need more data please let me know where I should
> locate it for you to access.
>
> Thanks,
> Sudhakar.
>
>
> On Dec 11, 2014, at 4:11 AM, Supun Nakandala <su...@gmail.com>
> wrote:
>
> Hi All,
>
> We had the mid evaluation of the project last Tuesday and the following
> concerns were raised.
>
> 1. The lack of visibility of the overall solution in the project
> demonstration.
> 2. The ability to come up with a solution where, scientist who does
> not have a background in computer science can create new parsers (metadata
> extraction logic)
>
> The project was demonstrated using the web interface that we developed.
> For the final evaluation we expect to demonstrate the system using laravel
> PHP Reference Gateway running in a production server and demonstrate how a
> new data product that gets generated will be identified, indexed and will
> be available for searching and hope this will handle the first issue.
>
> We also had a meeting with Dr. Dilum our internal supervisor where we
> identified things that can be done from now to 15th January, the expected
> project completion date
>
> 1. Do a proper performance test and publish a paper before final marks
> for the project is finalized (marks will be finalized by the end of March).
> 2. Getting to work more parsers, so that Sudhakar can ask more users
> to use the system. This will help to get more feedback on the system and
> have a real world usage.
> 3. Implement the support for provenance aware workflow execution in
> Airavata using our system.
>
> We have written a draft paper which I have attached here with. We showed
> this to Dr. Srinath and Dr Dilum and they suggested that we do a proper
> performance testing (The one that already done is not up to the expected
> standards). Given the available time we need to prioritize our work and
> select a set of tasks that is doable and has the most impact. What do you
> all think?
>
> Draft Paper:
> https://docs.google.com/document/d/1PLfST6hLygQpsr4RlgiDoffmDEwMOWbmb1WZ0uKTtd8/edit#heading=h.6fjqfavj2nov
>
> Literature Review:
> https://drive.google.com/file/d/0B0cLF-CLa59oaXRBazF1aURvQTg/view?usp=sharing
>
> Supun
>
>
>
--
Thank you
Supun Nakandala
Dept. Computer Science and Engineering
University of Moratuwa
Re: DataCat Project Progress
Posted by "Pamidighantam, Sudhakar V" <sp...@illinois.edu>.
Supun:
I support these goals. I am available for you to engage with you and anything I can do to expedite the project please let me know. Even if you think I can not, do please ask anyway.
I have written the original parsers in perl myself and have directed others when the Cup/JFLex system was put in place. I have generated and modified the CUP/JFlex code before, so I am familiar with how it works. I will look at the paper and may suggest additions.
I can not test the system now by adding more data and see if this can parse the new data. How can we get to that point. This is critical first step for me before I can ask friendly users to test this further. Current state is a prototype only and is not interesting enough for any of our users. Unless we can add parsing of more data and more salient data and create products it is difficult engage end users in any meaningful way.
Perhaps if this is deployed somewhere in Indiana it may be easier to move forward. If you need more data please let me know where I should locate it for you to access.
Thanks,
Sudhakar.
On Dec 11, 2014, at 4:11 AM, Supun Nakandala <su...@gmail.com>> wrote:
Hi All,
We had the mid evaluation of the project last Tuesday and the following concerns were raised.
1. The lack of visibility of the overall solution in the project demonstration.
2. The ability to come up with a solution where, scientist who does not have a background in computer science can create new parsers (metadata extraction logic)
The project was demonstrated using the web interface that we developed. For the final evaluation we expect to demonstrate the system using laravel PHP Reference Gateway running in a production server and demonstrate how a new data product that gets generated will be identified, indexed and will be available for searching and hope this will handle the first issue.
We also had a meeting with Dr. Dilum our internal supervisor where we identified things that can be done from now to 15th January, the expected project completion date
1. Do a proper performance test and publish a paper before final marks for the project is finalized (marks will be finalized by the end of March).
2. Getting to work more parsers, so that Sudhakar can ask more users to use the system. This will help to get more feedback on the system and have a real world usage.
3. Implement the support for provenance aware workflow execution in Airavata using our system.
We have written a draft paper which I have attached here with. We showed this to Dr. Srinath and Dr Dilum and they suggested that we do a proper performance testing (The one that already done is not up to the expected standards). Given the available time we need to prioritize our work and select a set of tasks that is doable and has the most impact. What do you all think?
Draft Paper: https://docs.google.com/document/d/1PLfST6hLygQpsr4RlgiDoffmDEwMOWbmb1WZ0uKTtd8/edit#heading=h.6fjqfavj2nov
Literature Review: https://drive.google.com/file/d/0B0cLF-CLa59oaXRBazF1aURvQTg/view?usp=sharing
Supun