You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@maven.apache.org by Ray Krueger <ra...@gmail.com> on 2008/10/28 12:06:59 UTC

repo1.maven.org is really slow

Has anyone noticed that repo1 has been really slow the past couple days?
It just took me 20 seconds to download commons-lang which is all of 237k.

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
For additional commands, e-mail: users-help@maven.apache.org


Re: repo1.maven.org is really slow

Posted by Geoffrey Wiseman <ge...@gmail.com>.
On Tue, Oct 28, 2008 at 7:06 AM, Ray Krueger <ra...@gmail.com> wrote:

> Has anyone noticed that repo1 has been really slow the past couple days?
> It just took me 20 seconds to download commons-lang which is all of 237k.
>

I always take the opportunity in this kind of scenario to recommend a local
mirror, like Nexus, if you're not already using one.  It won't change the
speed it takes to get totally new data, but it'll reduce the amount of time
that you rely on repo1, and if there's more than one Maven user in your
location, it'll reduce the overall reliance of the organization.

   - Geoffrey
-- 
Geoffrey Wiseman

Re: repo1.maven.org is really slow

Posted by Ray Krueger <ra...@gmail.com>.
On Tue, Oct 28, 2008 at 8:09 AM, Chris Helck <Ch...@us.icap.com> wrote:
> What monetary purpose is there to scraping the repo? I want to know if there is a security issue related to using Maven.
> -C. Helck
>

What possible security risk could come from someone scraping the site?

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
For additional commands, e-mail: users-help@maven.apache.org


Re: repo1.maven.org is really slow

Posted by "Brian E. Fox" <br...@reply.infinity.nu>.
They use it to provide search websites and stick ads or sell the accumulated
information about the OSS projects it contains.


On 10/28/08 9:09 AM, "Chris Helck" <Ch...@us.icap.com> wrote:

> What monetary purpose is there to scraping the repo? I want to know if there
> is a security issue related to using Maven.
> -C. Helck
> 
> -----Original Message-----
> From: Brian E. Fox [mailto:brianf@reply.infinity.nu]
> Sent: Tuesday, October 28, 2008 8:56 AM
> To: Maven Users List
> Subject: Re: repo1.maven.org is really slow
> 
> We have been getting hit really hard by people trying to scrape the repo for
> monetary purposes. We block them when it causes problems and then they get
> more sneaky about their methods.
> 
> The machine load was going through the roof so we are in the process of
> installing a balancer and an additional machine. Last night we switched the
> http server to something more suitable for static files and the cpu load is
> very low now so I think it¹s an overall improvement. The throughput I¹m seeing
> here is normal, so perhaps you had a temporary network bottleneck....but yes
> it was slow the past few days and should be normal now.
> 
> 
> On 10/28/08 7:06 AM, "Ray Krueger" <ra...@gmail.com> wrote:
> 
>> > Has anyone noticed that repo1 has been really slow the past couple days?
>> > It just took me 20 seconds to download commons-lang which is all of 237k.
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
>> > For additional commands, e-mail: users-help@maven.apache.org
>> >
>> >
> 
> 
> **********************************************************************
> This communication and all information (including, but not limited to,
>  market prices/levels and data) contained therein (the "Information") is
>  for informational purposes only, is confidential, may be legally
>  privileged and is the intellectual property of ICAP plc and its affiliates
>  ("ICAP") or third parties. No confidentiality or privilege is waived or
>  lost by any mistransmission. The Information is not, and should not
>  be construed as, an offer, bid or solicitation in relation to any
>  financial instrument or as an official confirmation of any transaction.
>  The Information is not warranted, including, but not limited, as to
>  completeness, timeliness or accuracy and is subject to change
>  without notice. ICAP assumes no liability for use or misuse of the
>  Information. All representations and warranties are expressly
>  disclaimed. The Information does not necessarily reflect the views of
>  ICAP. Access to the Information by anyone else other than the
>  recipient is unauthorized and any disclosure, copying, distribution or
>  any action taken or omitted to be taken in reliance on it is prohibited. If
>  you receive this message in error, please immediately delete it and all
>  copies of it from your system, destroy any hard copies of it and
>  notify the sender.
> **********************************************************************
> 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
> For additional commands, e-mail: users-help@maven.apache.org
> 
> 


RE: repo1.maven.org is really slow

Posted by Chris Helck <Ch...@us.icap.com>.
What monetary purpose is there to scraping the repo? I want to know if there is a security issue related to using Maven.
-C. Helck 

-----Original Message-----
From: Brian E. Fox [mailto:brianf@reply.infinity.nu] 
Sent: Tuesday, October 28, 2008 8:56 AM
To: Maven Users List
Subject: Re: repo1.maven.org is really slow

We have been getting hit really hard by people trying to scrape the repo for monetary purposes. We block them when it causes problems and then they get more sneaky about their methods.

The machine load was going through the roof so we are in the process of installing a balancer and an additional machine. Last night we switched the http server to something more suitable for static files and the cpu load is very low now so I think it¹s an overall improvement. The throughput I¹m seeing here is normal, so perhaps you had a temporary network bottleneck....but yes it was slow the past few days and should be normal now.


On 10/28/08 7:06 AM, "Ray Krueger" <ra...@gmail.com> wrote:

> Has anyone noticed that repo1 has been really slow the past couple days?
> It just took me 20 seconds to download commons-lang which is all of 237k.
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
> For additional commands, e-mail: users-help@maven.apache.org
> 
> 


**********************************************************************
This communication and all information (including, but not limited to,
 market prices/levels and data) contained therein (the "Information") is
 for informational purposes only, is confidential, may be legally
 privileged and is the intellectual property of ICAP plc and its affiliates
 ("ICAP") or third parties. No confidentiality or privilege is waived or
 lost by any mistransmission. The Information is not, and should not
 be construed as, an offer, bid or solicitation in relation to any
 financial instrument or as an official confirmation of any transaction.
 The Information is not warranted, including, but not limited, as to
 completeness, timeliness or accuracy and is subject to change
 without notice. ICAP assumes no liability for use or misuse of the
 Information. All representations and warranties are expressly
 disclaimed. The Information does not necessarily reflect the views of
 ICAP. Access to the Information by anyone else other than the
 recipient is unauthorized and any disclosure, copying, distribution or
 any action taken or omitted to be taken in reliance on it is prohibited. If
 you receive this message in error, please immediately delete it and all
 copies of it from your system, destroy any hard copies of it and
 notify the sender.
**********************************************************************



---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
For additional commands, e-mail: users-help@maven.apache.org


Re: repo1.maven.org is really slow

Posted by "Brian E. Fox" <br...@reply.infinity.nu>.
We have been getting hit really hard by people trying to scrape the repo for
monetary purposes. We block them when it causes problems and then they get
more sneaky about their methods.

The machine load was going through the roof so we are in the process of
installing a balancer and an additional machine. Last night we switched the
http server to something more suitable for static files and the cpu load is
very low now so I think it¹s an overall improvement. The throughput I¹m
seeing here is normal, so perhaps you had a temporary network
bottleneck....but yes it was slow the past few days and should be normal
now.


On 10/28/08 7:06 AM, "Ray Krueger" <ra...@gmail.com> wrote:

> Has anyone noticed that repo1 has been really slow the past couple days?
> It just took me 20 seconds to download commons-lang which is all of 237k.
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
> For additional commands, e-mail: users-help@maven.apache.org
> 
>