You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avalon.apache.org by Leo Simons <le...@apache.org> on 2003/09/02 09:40:13 UTC

distributions - bandwidth hog

Hi gang,

http://www.apache.org/~slive/bandwidth-hogs.txt

shows that quite a lot of people are still downloading their avalon 
releases from the main distribution directory. This is undesireable 
(there's some talks over at the infrastructure list about this atm).

We should endevaour to make our downloads page direct users more 
'forcefully' to the mirrors. Right now, it seems, many people still use 
apache.org.

One thing that we should do is fix the link that points to 
http://avalon.apache.org/%5Bpreferred%5D/avalon/ (which doesn't exist).

gotta run!

- LSD



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@avalon.apache.org
For additional commands, e-mail: dev-help@avalon.apache.org


Re: distributions - bandwidth hog

Posted by Leo Simons <le...@apache.org>.
Leo Sutic wrote:
> How do I go about adding a mirror or suggesting one?

http://www.apache.org/info/how-to-mirror.html

> The script you use picks the nearest mirror geographically, yes?

yep. Roughly speaking. I believe it uses something called GeoIP which is 
not always very accurate.

> So, I'm about to contact the admins at sunet to have the mirror listed
> with HTTP access as well - basically "hey guys, can I suggest to
> Apache that they use http to access the mirror?".
> 
> Who do I talk to here? Infrastructure?

yep.

> Leo Simons, are you on that
> team - I think you were?

nope. But I monitor the list and generally try to do what I can to 
lighten the load on these guys :D

cheers,

- Leo



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@avalon.apache.org
For additional commands, e-mail: dev-help@avalon.apache.org


Re: distributions - bandwidth hog

Posted by Leo Simons <le...@apache.org>.
Berin Loritsch wrote:
> http://avalon.apache.org/maven.cgi

cool!

> Any ideas?

something like

<project default="avalon:header">
<goal name="avalon:firstinit">
   <ant:get src="http://avalon.apache.org/maven.cgi"
       dest="${basedir}/project.properties"/>
</goal>

<preGoal name="avalon:header">
   <attainGoal name="avalon:firstinit"/>
</preGoal>
</project>

or better, a plugin that does this. I've found the use of common 
maven.xml files really screws up maven internally; essentially it 
probably will remain trial-and-error doing that. We need a plugin or two.

- LSD



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@avalon.apache.org
For additional commands, e-mail: dev-help@avalon.apache.org


Re: distributions - bandwidth hog

Posted by Berin Loritsch <bl...@apache.org>.
Leo Sutic wrote:
> 
> So, I'm about to contact the admins at sunet to have the mirror listed
> with HTTP access as well - basically "hey guys, can I suggest to
> Apache that they use http to access the mirror?".
> 
> Who do I talk to here? Infrastructure? Leo Simons, are you on that
> team - I think you were?
> 


Infrastructure is the place to ask.

-- 

"They that give up essential liberty to obtain a little temporary safety
  deserve neither liberty nor safety."
                 - Benjamin Franklin


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@avalon.apache.org
For additional commands, e-mail: dev-help@avalon.apache.org


RE: distributions - bandwidth hog

Posted by Leo Sutic <le...@inspireinfrastructure.com>.
How do I go about adding a mirror or suggesting one?

The script you use picks the nearest mirror geographically, yes? That's
what I could get from looking at the source code.

The ones I get however, are 

http://www.apache.org/dist/avalon,http://www.ibiblio.org/maven,http://ls
d.student.utwente.nl/repository 

in that order, almost all the time. I looked at the list of mirrors 
and found one that is very much closer:

    ftp://ftp.sunet.se/pub/www/servers/apache/dist/

(I get about 20kB/s from the apache.org mirror, sunet delivers
average 300kB/s, so I much prefer it.)

The problem is, I think, that the mirror is FTP. However - sunet has
an http interface:

    http://ftp.sunet.se/pub/www/servers/apache/dist/

works just as well.

So, I'm about to contact the admins at sunet to have the mirror listed
with HTTP access as well - basically "hey guys, can I suggest to
Apache that they use http to access the mirror?".

Who do I talk to here? Infrastructure? Leo Simons, are you on that
team - I think you were?

/LS

> -----Original Message-----
> From: Berin Loritsch [mailto:bloritsch@apache.org] 
> Sent: den 2 september 2003 21:07
> To: Avalon Developers List
> Subject: Re: distributions - bandwidth hog
> 
> 
> Berin Loritsch wrote:
> 
> > 
> > Hmm.  Must be the Maven builds.  Any way to derive the current best 
> > mirror for Maven?
> > 
> 
> I through together some rudimentary support to generate the 
> preferred download link on the server.  If you connect to:
> 
http://avalon.apache.org/maven.cgi

You will see the contents of a generated properties file.  The problem
is getting Maven to use that file.  The <property/> element only
supports resource, file, and environment which means that we can only
get it locally from our box.  We might be able to do a remote copy or
something like that, but no guarantees.

Any ideas?

-- 

"They that give up essential liberty to obtain a little temporary safety
  deserve neither liberty nor safety."
                 - Benjamin Franklin


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@avalon.apache.org
For additional commands, e-mail: dev-help@avalon.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@avalon.apache.org
For additional commands, e-mail: dev-help@avalon.apache.org


Re: distributions - bandwidth hog

Posted by Berin Loritsch <bl...@apache.org>.
Berin Loritsch wrote:

> 
> Hmm.  Must be the Maven builds.  Any way to derive the current best
> mirror for Maven?
> 

I through together some rudimentary support to generate the preferred download
link on the server.  If you connect to:

http://avalon.apache.org/maven.cgi

You will see the contents of a generated properties file.  The problem is
getting Maven to use that file.  The <property/> element only supports
resource, file, and environment which means that we can only get it locally
from our box.  We might be able to do a remote copy or something like that,
but no guarantees.

Any ideas?

-- 

"They that give up essential liberty to obtain a little temporary safety
  deserve neither liberty nor safety."
                 - Benjamin Franklin


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@avalon.apache.org
For additional commands, e-mail: dev-help@avalon.apache.org


Re: distributions - bandwidth hog

Posted by Leo Simons <le...@apache.org>.
Berin Loritsch wrote:
> Hmm.  Must be the Maven builds.

actually, most of the downloads are for the phoenix distro's. Some peeps 
on infrastructure made a case for how people always pick the main site.

Anyway, my guess is most downloads aren't by maven. Statistics are 
available; I bet some calculations will show most downloads are the 
common browsers (IE, moz, ...) and not a java client.

> Any way to derive the current best mirror for Maven?

Most of the world uses ibiblio, to which steve has access. The best 
setup is probably for steve to sync ibiblio with the avalon setup every 
now and then and have most people always use ibiblio.

Still, remember all downloads made by maven are by people who check out 
from CVS. That's not a big percentage. Also, remember avalon is just a 
small piece of the big apache bandwidth pie :D

cheers,

- Leo



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@avalon.apache.org
For additional commands, e-mail: dev-help@avalon.apache.org


Re: distributions - bandwidth hog

Posted by Berin Loritsch <bl...@apache.org>.
Leo Simons wrote:

> Hi gang,
> 
> http://www.apache.org/~slive/bandwidth-hogs.txt
> 
> shows that quite a lot of people are still downloading their avalon 
> releases from the main distribution directory. This is undesireable 
> (there's some talks over at the infrastructure list about this atm).
> 
> We should endevaour to make our downloads page direct users more 
> 'forcefully' to the mirrors. Right now, it seems, many people still use 
> apache.org.
> 
> One thing that we should do is fix the link that points to 
> http://avalon.apache.org/%5Bpreferred%5D/avalon/ (which doesn't exist).
> 
> gotta run!

Hmm.  Must be the Maven builds.  Any way to derive the current best
mirror for Maven?


-- 

"They that give up essential liberty to obtain a little temporary safety
  deserve neither liberty nor safety."
                 - Benjamin Franklin


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@avalon.apache.org
For additional commands, e-mail: dev-help@avalon.apache.org