You are viewing a plain text version of this content. The canonical link for it is here.
Posted to infrastructure-issues@apache.org by "John Sichi (JIRA)" <ji...@apache.org> on 2010/10/28 07:10:06 UTC

[jira] Created: (INFRA-3122) a certain block of facebook.com machines is unable to access svn.apache.org

a certain block of facebook.com machines is unable to access svn.apache.org
---------------------------------------------------------------------------

                 Key: INFRA-3122
                 URL: https://issues.apache.org/jira/browse/INFRA-3122
             Project: Infrastructure
          Issue Type: Bug
      Security Level: public (Regular issues)
          Components: Subversion
            Reporter: John Sichi


Yesterday morning, Hive and Hadoop developers at Facebook started experiencing failures attempting to run svn to svn.apache.org from certain machines.  Other machines within facebook.com are not having the problem.  Facebook network engineers are investigating the problem but so far have not been able to locate a cause of the problem within Facebook's own network.  The affected machines happen to be development machines which happen to make heavy use of svn.apache.org, so we would like to know whether there's a possibility that the affected machines somehow got blacklisted by the svn servers (e.g. via some automatic defense against denial of service attacks).

The affected block of machines NAT's to the following IP address range.

69.63.179.33-35


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-3122) a certain block of facebook.com machines is unable to access svn.apache.org

Posted by "Gavin (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12925701#action_12925701 ] 

Gavin commented on INFRA-3122:
------------------------------

Hi John, 

Yes they are blackliste for being heavy abusers and causing unusual and sustained loads on svn
This is not good for the machines, not good for other users etc..

We have dump files at http://svn.apache.org/dump/ 

How about you start using a local copy of svn by downloading the latest dump file and then rsycning the remainder to keep upto date.

Would that be acceptable?

> a certain block of facebook.com machines is unable to access svn.apache.org
> ---------------------------------------------------------------------------
>
>                 Key: INFRA-3122
>                 URL: https://issues.apache.org/jira/browse/INFRA-3122
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: John Sichi
>
> Yesterday morning, Hive and Hadoop developers at Facebook started experiencing failures attempting to run svn to svn.apache.org from certain machines.  Other machines within facebook.com are not having the problem.  Facebook network engineers are investigating the problem but so far have not been able to locate a cause of the problem within Facebook's own network.  The affected machines happen to be development machines which happen to make heavy use of svn.apache.org, so we would like to know whether there's a possibility that the affected machines somehow got blacklisted by the svn servers (e.g. via some automatic defense against denial of service attacks).
> The affected block of machines NAT's to the following IP address range.
> 69.63.179.33-35

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-3122) a certain block of facebook.com machines is unable to access svn.apache.org

Posted by "John Sichi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12925892#action_12925892 ] 

John Sichi commented on INFRA-3122:
-----------------------------------

Thanks Gavin.  We'll get started on setting up a local svn mirror.  Currently at Facebook we primarily use direct svn for Hadoop/Hive development, not git.


> a certain block of facebook.com machines is unable to access svn.apache.org
> ---------------------------------------------------------------------------
>
>                 Key: INFRA-3122
>                 URL: https://issues.apache.org/jira/browse/INFRA-3122
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: John Sichi
>
> Yesterday morning, Hive and Hadoop developers at Facebook started experiencing failures attempting to run svn to svn.apache.org from certain machines.  Other machines within facebook.com are not having the problem.  Facebook network engineers are investigating the problem but so far have not been able to locate a cause of the problem within Facebook's own network.  The affected machines happen to be development machines which happen to make heavy use of svn.apache.org, so we would like to know whether there's a possibility that the affected machines somehow got blacklisted by the svn servers (e.g. via some automatic defense against denial of service attacks).
> The affected block of machines NAT's to the following IP address range.
> 69.63.179.33-35

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-3122) a certain block of facebook.com machines is unable to access svn.apache.org

Posted by "Patrick Kling (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12925968#action_12925968 ] 

Patrick Kling commented on INFRA-3122:
--------------------------------------

Did we also get blocked from repository.apache.org? I get the following error when trying to build HDFS.

[ivy:resolve] :::: ERRORS
[ivy:resolve]   Server access Error: Connection reset url=https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.22.0-SNAPSHOT/maven-metadata.xml
[ivy:resolve]   SERVER ERROR: Bad Gateway url=https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.22.0-SNAPSHOT/hadoop-common-0.22.0-SNAPSHOT.pom
[ivy:resolve]   SERVER ERROR: Bad Gateway url=https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.22.0-SNAPSHOT/hadoop-common-0.22.0-SNAPSHOT.jar


> a certain block of facebook.com machines is unable to access svn.apache.org
> ---------------------------------------------------------------------------
>
>                 Key: INFRA-3122
>                 URL: https://issues.apache.org/jira/browse/INFRA-3122
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: John Sichi
>
> Yesterday morning, Hive and Hadoop developers at Facebook started experiencing failures attempting to run svn to svn.apache.org from certain machines.  Other machines within facebook.com are not having the problem.  Facebook network engineers are investigating the problem but so far have not been able to locate a cause of the problem within Facebook's own network.  The affected machines happen to be development machines which happen to make heavy use of svn.apache.org, so we would like to know whether there's a possibility that the affected machines somehow got blacklisted by the svn servers (e.g. via some automatic defense against denial of service attacks).
> The affected block of machines NAT's to the following IP address range.
> 69.63.179.33-35

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Issue Comment Edited: (INFRA-3122) a certain block of facebook.com machines is unable to access svn.apache.org

Posted by "Gavin (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12925701#action_12925701 ] 

Gavin edited comment on INFRA-3122 at 10/28/10 2:11 AM:
--------------------------------------------------------

Hi John, 

Yes they are blackliste for being heavy abusers and causing unusual and sustained loads on svn
This is not good for the machines, not good for other users etc..

We have dump files at http://svn.apache.org/dump/ 

How about you start using a local copy of svn by downloading the latest dump file and then using svnsync on the remainder to keep upto date.

Would that be acceptable?

      was (Author: ipv6guru):
    Hi John, 

Yes they are blackliste for being heavy abusers and causing unusual and sustained loads on svn
This is not good for the machines, not good for other users etc..

We have dump files at http://svn.apache.org/dump/ 

How about you start using a local copy of svn by downloading the latest dump file and then rsycning the remainder to keep upto date.

Would that be acceptable?
  
> a certain block of facebook.com machines is unable to access svn.apache.org
> ---------------------------------------------------------------------------
>
>                 Key: INFRA-3122
>                 URL: https://issues.apache.org/jira/browse/INFRA-3122
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: John Sichi
>
> Yesterday morning, Hive and Hadoop developers at Facebook started experiencing failures attempting to run svn to svn.apache.org from certain machines.  Other machines within facebook.com are not having the problem.  Facebook network engineers are investigating the problem but so far have not been able to locate a cause of the problem within Facebook's own network.  The affected machines happen to be development machines which happen to make heavy use of svn.apache.org, so we would like to know whether there's a possibility that the affected machines somehow got blacklisted by the svn servers (e.g. via some automatic defense against denial of service attacks).
> The affected block of machines NAT's to the following IP address range.
> 69.63.179.33-35

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-3122) a certain block of facebook.com machines is unable to access svn.apache.org

Posted by "John Sichi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12925695#action_12925695 ] 

John Sichi commented on INFRA-3122:
-----------------------------------

Example failure (after hanging for a while):

[njain@devrs005 hive1]$ svn up .
svn: OPTIONS of 'http://svn.apache.org/repos/asf/hive/trunk': could
not
connect to server (http://svn.apache.org)

Attempts to telnet to the svn server (port 80 or 443) from the affected machines also hang and eventually fail.  Trying different svn mirrors did not help.

Note that there's a good chance the problem is within Facebook; we're just trying to rule out the possibility that these machines somehow got blacklisted.


> a certain block of facebook.com machines is unable to access svn.apache.org
> ---------------------------------------------------------------------------
>
>                 Key: INFRA-3122
>                 URL: https://issues.apache.org/jira/browse/INFRA-3122
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: John Sichi
>
> Yesterday morning, Hive and Hadoop developers at Facebook started experiencing failures attempting to run svn to svn.apache.org from certain machines.  Other machines within facebook.com are not having the problem.  Facebook network engineers are investigating the problem but so far have not been able to locate a cause of the problem within Facebook's own network.  The affected machines happen to be development machines which happen to make heavy use of svn.apache.org, so we would like to know whether there's a possibility that the affected machines somehow got blacklisted by the svn servers (e.g. via some automatic defense against denial of service attacks).
> The affected block of machines NAT's to the following IP address range.
> 69.63.179.33-35

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Closed: (INFRA-3122) a certain block of facebook.com machines is unable to access svn.apache.org

Posted by "Gavin (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/INFRA-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gavin closed INFRA-3122.
------------------------

    Resolution: Fixed

I have unblocked those addresses,

Be sure please to use dump + svnsync for CI services at your end, or if there are lots of git-svn going on use git.apache.org mirrors instead please.

> a certain block of facebook.com machines is unable to access svn.apache.org
> ---------------------------------------------------------------------------
>
>                 Key: INFRA-3122
>                 URL: https://issues.apache.org/jira/browse/INFRA-3122
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: John Sichi
>
> Yesterday morning, Hive and Hadoop developers at Facebook started experiencing failures attempting to run svn to svn.apache.org from certain machines.  Other machines within facebook.com are not having the problem.  Facebook network engineers are investigating the problem but so far have not been able to locate a cause of the problem within Facebook's own network.  The affected machines happen to be development machines which happen to make heavy use of svn.apache.org, so we would like to know whether there's a possibility that the affected machines somehow got blacklisted by the svn servers (e.g. via some automatic defense against denial of service attacks).
> The affected block of machines NAT's to the following IP address range.
> 69.63.179.33-35

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (INFRA-3122) a certain block of facebook.com machines is unable to access svn.apache.org

Posted by "Patrick Kling (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/INFRA-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Patrick Kling updated INFRA-3122:
---------------------------------

    Comment: was deleted

(was: Did we also get blocked from repository.apache.org? I get the following error when trying to build HDFS.

[ivy:resolve] :::: ERRORS
[ivy:resolve]   Server access Error: Connection reset url=https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.22.0-SNAPSHOT/maven-metadata.xml
[ivy:resolve]   SERVER ERROR: Bad Gateway url=https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.22.0-SNAPSHOT/hadoop-common-0.22.0-SNAPSHOT.pom
[ivy:resolve]   SERVER ERROR: Bad Gateway url=https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.22.0-SNAPSHOT/hadoop-common-0.22.0-SNAPSHOT.jar
)

> a certain block of facebook.com machines is unable to access svn.apache.org
> ---------------------------------------------------------------------------
>
>                 Key: INFRA-3122
>                 URL: https://issues.apache.org/jira/browse/INFRA-3122
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Subversion
>            Reporter: John Sichi
>
> Yesterday morning, Hive and Hadoop developers at Facebook started experiencing failures attempting to run svn to svn.apache.org from certain machines.  Other machines within facebook.com are not having the problem.  Facebook network engineers are investigating the problem but so far have not been able to locate a cause of the problem within Facebook's own network.  The affected machines happen to be development machines which happen to make heavy use of svn.apache.org, so we would like to know whether there's a possibility that the affected machines somehow got blacklisted by the svn servers (e.g. via some automatic defense against denial of service attacks).
> The affected block of machines NAT's to the following IP address range.
> 69.63.179.33-35

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.