You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@taverna.apache.org by Kevin Benson <k....@ucl.ac.uk> on 2015/01/05 17:46:47 UTC
Quick Taverna question when accessing repositories
Hi Taverna,
Starting to get a little back into Taverna and start using the new
mailing lists.
My name is Kevin Benson and host a couple of plugins with repositories
here at MSSL. I noticed the other day that I had my Apache web server
for the 'Helio' plugin that the error_logs showing a lot of 'File does
not exist' errors. Sure enough after a fix on our MSSL server I forgot
to place the taverna_repository back on the web. This is now fixed.
I still see though numerous amounts of messages as shown below.
Mostly from this same ip address (Manchester). I think I recall that I
had my repository offline for awhile and I think Manchester you were
going to configure something where you might check when it comes back
online. Just wondering if you have a cron-job going out of control.
My repository only has libs that are more for 'Helio' so Taverna can
download the necessary jars; I don't contain everything.
Only noticed when disk space was starting to fill up (seem to have a
few of these messages every minute).
Thanks for the help,
Kevin
Some of the messages:
[Mon Jan 05 11:14:52 2015] [error] [client 130.88.198.2] File does not
exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/axlradius
[Mon Jan 05 11:15:19 2015] [error] [client 130.88.198.2] File does not
exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/buddy
[Mon Jan 05 11:15:20 2015] [error] [client 130.88.198.2] File does not
exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/net
[Mon Jan 05 11:15:29 2015] [error] [client 130.88.198.2] File does not
exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/be
[Mon Jan 05 11:15:30 2015] [error] [client 130.88.198.2] File does not
exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/servprise
[Mon Jan 05 11:15:36 2015] [error] [client 130.88.198.2] File does not
exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/mtons
[Mon Jan 05 11:15:59 2015] [error] [client 130.88.198.2] File does not
exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/weather
[Mon Jan 05 11:16:02 2015] [error] [client 130.88.198.2] File does not
exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/se
[Mon Jan 05 11:16:19 2015] [error] [client 130.88.198.2] File does not
exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/novocode
[Mon Jan 05 11:16:19 2015] [error] [client 130.88.198.2] File does not
exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/gestalt
Re: Quick Taverna question when accessing repositories
Posted by "Benson, Kevin" <k....@ucl.ac.uk>.
Hi Stian,
Great thanks for the help. Will double check tomorrow the logging is all better.
cheers,
Kevin
________________________________________
From: stian@mygrid.org.uk <st...@mygrid.org.uk> on behalf of Stian Soiland-Reyes <so...@cs.manchester.ac.uk>
Sent: 05 January 2015 17:11
To: dev@taverna.incubator.apache.org
Subject: Re: Quick Taverna question when accessing repositories
Yes, my apologies.
it must be these:
http://repository.mygrid.org.uk/artifactory/webapp/browserepo.html?3&pathId=vamdc-cache:
http://repository.mygrid.org.uk/artifactory/webapp/browserepo.html?4&pathId=helio-cache:
It would be probably proxying through anything that is not found when
requested from http://repository.mygrid.org.uk/artifactory/repo/ - as
whenever the myGrid Jenkins builds.
Several of the hits I find cached above should also be in the central
repositories - I have reduced the priority of helio and vamdc.
I was not sure which of the groupIds you host are truly needed as both
repositories contain a variety of sub-folders. I can configure
artifactory to have a restricted groupIds, e.g. only allow
org.astrogrid and org.vamdc, but we would have to then test the
Astronomy Taverna product build to see if it's still happy.
I have modified both proxies to filter on
org/helio/**/*,
org/astrogrid/**/*,
org/vamdc/**/*,
uk/ac/starlink/**/*
See
http://repository.mygrid.org.uk/artifactory/simple/vamdc/
http://repository.mygrid.org.uk/artifactory/simple/helio/
and triggered a new build of the astronomy product to see what happens.
http://build.mygrid.org.uk/ci/view/Products/job/taverna-workbench-product-astronomy/42/console
On 5 January 2015 at 16:46, Kevin Benson <k....@ucl.ac.uk> wrote:
> Hi Taverna,
>
> Starting to get a little back into Taverna and start using the new mailing
> lists.
>
> My name is Kevin Benson and host a couple of plugins with repositories here
> at MSSL. I noticed the other day that I had my Apache web server for the
> 'Helio' plugin that the error_logs showing a lot of 'File does not exist'
> errors. Sure enough after a fix on our MSSL server I forgot to place the
> taverna_repository back on the web. This is now fixed.
>
> I still see though numerous amounts of messages as shown below.
>
> Mostly from this same ip address (Manchester). I think I recall that I had
> my repository offline for awhile and I think Manchester you were going to
> configure something where you might check when it comes back online. Just
> wondering if you have a cron-job going out of control.
>
> My repository only has libs that are more for 'Helio' so Taverna can
> download the necessary jars; I don't contain everything.
>
> Only noticed when disk space was starting to fill up (seem to have a few of
> these messages every minute).
>
>
> Thanks for the help,
> Kevin
>
> Some of the messages:
> [Mon Jan 05 11:14:52 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/axlradius
> [Mon Jan 05 11:15:19 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/buddy
> [Mon Jan 05 11:15:20 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/net
> [Mon Jan 05 11:15:29 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/be
> [Mon Jan 05 11:15:30 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/servprise
> [Mon Jan 05 11:15:36 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/mtons
> [Mon Jan 05 11:15:59 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/weather
> [Mon Jan 05 11:16:02 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/se
> [Mon Jan 05 11:16:19 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/novocode
> [Mon Jan 05 11:16:19 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/gestalt
>
--
Stian Soiland-Reyes, myGrid team
School of Computer Science
The University of Manchester
http://soiland-reyes.com/stian/work/ http://orcid.org/0000-0001-9842-9718
Re: Quick Taverna question when accessing repositories
Posted by Stian Soiland-Reyes <so...@cs.manchester.ac.uk>.
Yes, my apologies.
it must be these:
http://repository.mygrid.org.uk/artifactory/webapp/browserepo.html?3&pathId=vamdc-cache:
http://repository.mygrid.org.uk/artifactory/webapp/browserepo.html?4&pathId=helio-cache:
It would be probably proxying through anything that is not found when
requested from http://repository.mygrid.org.uk/artifactory/repo/ - as
whenever the myGrid Jenkins builds.
Several of the hits I find cached above should also be in the central
repositories - I have reduced the priority of helio and vamdc.
I was not sure which of the groupIds you host are truly needed as both
repositories contain a variety of sub-folders. I can configure
artifactory to have a restricted groupIds, e.g. only allow
org.astrogrid and org.vamdc, but we would have to then test the
Astronomy Taverna product build to see if it's still happy.
I have modified both proxies to filter on
org/helio/**/*,
org/astrogrid/**/*,
org/vamdc/**/*,
uk/ac/starlink/**/*
See
http://repository.mygrid.org.uk/artifactory/simple/vamdc/
http://repository.mygrid.org.uk/artifactory/simple/helio/
and triggered a new build of the astronomy product to see what happens.
http://build.mygrid.org.uk/ci/view/Products/job/taverna-workbench-product-astronomy/42/console
On 5 January 2015 at 16:46, Kevin Benson <k....@ucl.ac.uk> wrote:
> Hi Taverna,
>
> Starting to get a little back into Taverna and start using the new mailing
> lists.
>
> My name is Kevin Benson and host a couple of plugins with repositories here
> at MSSL. I noticed the other day that I had my Apache web server for the
> 'Helio' plugin that the error_logs showing a lot of 'File does not exist'
> errors. Sure enough after a fix on our MSSL server I forgot to place the
> taverna_repository back on the web. This is now fixed.
>
> I still see though numerous amounts of messages as shown below.
>
> Mostly from this same ip address (Manchester). I think I recall that I had
> my repository offline for awhile and I think Manchester you were going to
> configure something where you might check when it comes back online. Just
> wondering if you have a cron-job going out of control.
>
> My repository only has libs that are more for 'Helio' so Taverna can
> download the necessary jars; I don't contain everything.
>
> Only noticed when disk space was starting to fill up (seem to have a few of
> these messages every minute).
>
>
> Thanks for the help,
> Kevin
>
> Some of the messages:
> [Mon Jan 05 11:14:52 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/axlradius
> [Mon Jan 05 11:15:19 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/buddy
> [Mon Jan 05 11:15:20 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/net
> [Mon Jan 05 11:15:29 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/be
> [Mon Jan 05 11:15:30 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/servprise
> [Mon Jan 05 11:15:36 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/mtons
> [Mon Jan 05 11:15:59 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/weather
> [Mon Jan 05 11:16:02 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/se
> [Mon Jan 05 11:16:19 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/novocode
> [Mon Jan 05 11:16:19 2015] [error] [client 130.88.198.2] File does not
> exist: /www/helio/web_pages/hec/helio_taverna/helio_repository/com/gestalt
>
--
Stian Soiland-Reyes, myGrid team
School of Computer Science
The University of Manchester
http://soiland-reyes.com/stian/work/ http://orcid.org/0000-0001-9842-9718