You are viewing a plain text version of this content. The canonical link for it is here.
Posted to infrastructure-issues@apache.org by "Rey Vincent Babilonia (JIRA)" <ji...@apache.org> on 2008/01/31 04:21:34 UTC
[jira] Created: (INFRA-1506) Mirror in the Philippines
Mirror in the Philippines
-------------------------
Key: INFRA-1506
URL: https://issues.apache.org/jira/browse/INFRA-1506
Project: Infrastructure
Issue Type: Improvement
Security Level: public (Regular issues)
Components: Mirrors
Reporter: Rey Vincent Babilonia
URL of mirror: http://mirror.psigrid.gov.ph/apache
Country where the mirror is located: Philippines
Contact email address: rvincent@asti.dost.gov.ph
Update frequency: 4x a day
Rsync repository used: rsync.apache.org
Approximate bandwidth: 155Mbps
I have configured my HTTP server as requested (yes/no): yes
I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (INFRA-1506) Mirror in the Philippines
Posted by "Henk Penning (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Henk Penning reassigned INFRA-1506:
-----------------------------------
Assignee: Henk Penning
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
> Assignee: Henk Penning
>
> URL of mirror: http://mirror.psigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 4x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1506) Mirror in the Philippines
Posted by "Henk Penning (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715229#action_12715229 ]
Henk Penning commented on INFRA-1506:
-------------------------------------
Hi Rey,
You are right ; your site is still block because of an unwanted, excessivly high
rate of rsyncs ; from todays logs :
2009/06/01 04:10:54 [18888] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/06/01 04:12:59 [19368] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/06/01 04:15:03 [19803] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/06/01 04:17:07 [20234] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/06/01 04:19:43 [20844] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/06/01 04:21:46 [21315] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/06/01 04:23:51 [21713] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/06/01 04:25:56 [23443] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/06/01 04:28:25 [26583] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/06/01 04:29:39 [26860] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/06/01 04:29:59 [26931] rsync denied on module apache-dist from unknown (202.90.158.134)
Can you fix this ? If/when I see a 'normal' (2-4 times a day max) rate of attempts to rsync, I your site
will be unblocked and your mirror will be added to the list (again).
Just curious ; how exactly do you run your rsync jobs ? Apperently not just by cron.
Regards,
Henk Penning
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
> Assignee: Henk Penning
>
> URL of mirror: http://mirror.psigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 4x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1506) Mirror in the Philippines
Posted by "Rey Vincent Babilonia (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714369#action_12714369 ]
Rey Vincent Babilonia commented on INFRA-1506:
----------------------------------------------
Hi Gavin,
We have upgraded our storage server and modified our rsync scripts.
Please replace kamia.asti.dost.gov.ph (202.90.158.122) with
mirror.pscigrid.gov.ph (202.90.158.134) as the rsync client.
@ERROR: access denied to apache-dist from unknown (202.90.158.134)
rsync error: error starting client-server protocol (code 5) at
main.c(1522) [receiver=3.0.3]
Thank you very much.
Regards,
Rey
--
Import my public key from
http://ca.grid.sinica.edu.tw/publication/newCRT/newcerts/0344.crt into
your email client to send encrypted messages for me.
# Rey Vincent P. Babilonia
# Master of Information Systems
# University of the Philippines Open University
# http://www.upou.edu.ph
# Science Research Specialist I
# Advanced Science and Technology Institute
# http://www.asti.dost.gov.ph
# Team Lead
# Philippine Bioinformatics Solutions Project
# Site Administrator
# PH-ASTI Node, EUAsiaGrid Project
# http://www.euasiagrid.eu
# Temporary Team Lead
# Philippine e-Science Grid Infrastructure
# http://www.psigrid.gov.ph
# Mobile +63 917 509 3469
# Landline +63 2 426 9760 extension 1302
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
>
> URL of mirror: http://mirror.psigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 4x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1506) Mirror in the Philippines
Posted by "Rey Vincent Babilonia (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12790554#action_12790554 ]
Rey Vincent Babilonia commented on INFRA-1506:
----------------------------------------------
Hi Henk,
We are trying to revive our Apache mirror. The new FQDN is mirror.pscigrid.gov.ph and new IP address is 202.90.159.136. We're doing an initial synchronization so no cron job yet. Thanks.
Regards,
Rey
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
> Assignee: Henk Penning
> Attachments: apache_mirror.sh
>
>
> URL of mirror: http://mirror.psigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 4x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (INFRA-1506) Mirror in the Philippines
Posted by "Rey Vincent Babilonia (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rey Vincent Babilonia updated INFRA-1506:
-----------------------------------------
Description:
URL of mirror: http://mirror.pscigrid.gov.ph/apache
Country where the mirror is located: Philippines
Contact email address: rvincent@asti.dost.gov.ph
Update frequency: 1x a day
Rsync repository used: rsync.apache.org
Approximate bandwidth: 155Mbps
I have configured my HTTP server as requested (yes/no): yes
I have subscribed to the mirror maintainers mailing list (yes/no): yes
was:
URL of mirror: http://mirror.psigrid.gov.ph/apache
Country where the mirror is located: Philippines
Contact email address: rvincent@asti.dost.gov.ph
Update frequency: 4x a day
Rsync repository used: rsync.apache.org
Approximate bandwidth: 155Mbps
I have configured my HTTP server as requested (yes/no): yes
I have subscribed to the mirror maintainers mailing list (yes/no): yes
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
> Assignee: Henk Penning
> Attachments: apache_mirror.sh
>
>
> URL of mirror: http://mirror.pscigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 1x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1506) Mirror in the Philippines
Posted by "Henk Penning (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715627#action_12715627 ]
Henk Penning commented on INFRA-1506:
-------------------------------------
Hi,
1. I dubt that you need such a script ; have your tries running a straight rsync cronjob?
2. regarding your script
a. it is too complicated ; you don't need a nested loop ; this is sufficient:
while (1)
do do-the-rsync
status=$?
if status=0
then finish up ; exit
else sleep
fi
done
b. you should not try more than 'max' (say 4) times.
maintain a counter (like 'failures' ) and test before 'done'.
c. you should pick up the status directly after the rsync (in the no-debug branch) ;
now you pick it up after the `du ....`
regards,
Henk Penning
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
> Assignee: Henk Penning
> Attachments: apache_mirror.sh
>
>
> URL of mirror: http://mirror.psigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 4x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1506) Mirror in the Philippines
Posted by "Henk Penning (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12792204#action_12792204 ]
Henk Penning commented on INFRA-1506:
-------------------------------------
Hi Rey,
please set up a cronjob and let's
see how it well it works.
Regards,
HPP
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
> Assignee: Henk Penning
> Attachments: apache_mirror.sh
>
>
> URL of mirror: http://mirror.pscigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 1x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Closed: (INFRA-1506) Mirror in the Philippines
Posted by "Gavin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gavin closed INFRA-1506.
------------------------
Resolution: Later
Assignee: (was: Henk Penning)
Please re-open if you get this working under a cron job.
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
> Attachments: apache_mirror.sh
>
>
> URL of mirror: http://mirror.pscigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 1x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1506) Mirror in the Philippines
Posted by "Rey Vincent Babilonia (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722474#action_12722474 ]
Rey Vincent Babilonia commented on INFRA-1506:
----------------------------------------------
Hi Henk,
Yup, we're still working on it. Our server/mirror is down right now for
repairs due to power outages.
Regards,
Rey
--
Import my public key from
http://ca.grid.sinica.edu.tw/publication/newCRT/newcerts/0344.crt into
your email client to send encrypted messages for me.
# Rey Vincent P. Babilonia
# Master of Information Systems
# University of the Philippines Open University
# http://www.upou.edu.ph
# Science Research Specialist I
# Advanced Science and Technology Institute
# http://www.asti.dost.gov.ph
# Team Lead
# Philippine Bioinformatics Solutions Project
# Site Administrator
# PH-ASTI Node, EUAsiaGrid Project
# http://www.euasiagrid.eu
# Temporary Team Lead
# Philippine e-Science Grid Infrastructure
# http://www.psigrid.gov.ph
# Mobile +63 917 509 3469
# Landline +63 2 426 9760 extension 1302
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
> Assignee: Henk Penning
> Attachments: apache_mirror.sh
>
>
> URL of mirror: http://mirror.psigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 4x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1506) Mirror in the Philippines
Posted by "Rey Vincent Babilonia (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714969#action_12714969 ]
Rey Vincent Babilonia commented on INFRA-1506:
----------------------------------------------
Dear Henk,
Even if I do not use the daemon, I still get the same error.
mirror:~# rsync -auvHL --numeric-ids --timeout=600 --delete-after rsync.apache.org::apache-dist /var/www/apache
@ERROR: access denied to apache-dist from unknown (202.90.158.134)
rsync error: error starting client-server protocol (code 5) at main.c(1522) [receiver=3.0.3]
I believe that mirror.pscigrid.gov.ph is not yet authorized to download. Previous mirroring was made through kamia.asti.dost.gov.ph and then made available through our mirror.
Please check.
Thank you very much.
Regards,
Rey
/**
* @author Rey Vincent P. Babilonia
* @number +63 2 426 9760 local 1302
* @mobile +63 917 509 3469
* @crt http://ca.grid.sinica.edu.tw/publication/newCRT/newcerts/013B.crt
* @project Philippine Bioinformatics Solutions
* @program Philippine e-Science Grid
* @division Research and Development Division
* @agency Advanced Science and Technology Institute
* @url http://www.psigrid.gov.ph
*/
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
> Assignee: Henk Penning
>
> URL of mirror: http://mirror.psigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 4x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Reopened: (INFRA-1506) Mirror in the Philippines
Posted by "Henk Penning (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Henk Penning reopened INFRA-1506:
---------------------------------
Rey Vincent Babilonia,
Your IP was blocked because your site rsync far too often ;
from todays log:
2009/05/29 08:38:06 [20271] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:19 [20347] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:20 [20354] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:21 [20366] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:22 [20375] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:23 [20386] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:25 [20394] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:26 [20410] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:28 [20417] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:29 [20426] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:30 [20439] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:31 [20462] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:33 [20467] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:35 [20480] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:36 [20486] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:48 [20536] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:49 [20584] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:50 [20591] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/29 08:38:52 [20602] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/28 10:11:26 [23556] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/28 10:11:37 [23636] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/28 10:11:38 [23643] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/28 10:11:39 [23648] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/28 10:11:40 [23653] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/28 10:11:40 [23662] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/28 10:11:41 [23666] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/28 10:11:42 [23676] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/28 10:11:42 [23680] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/28 10:11:43 [23687] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/28 10:11:44 [23694] rsync denied on module apache-dist from unknown (202.90.158.134)
2009/05/28 10:11:45 [23705] rsync denied on module apache-dist from unknown (202.90.158.134)
Can you please fix your cron-job(s) ?
Thanks,
Henk Penning
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
> Assignee: Henk Penning
>
> URL of mirror: http://mirror.psigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 4x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1506) Mirror in the Philippines
Posted by "Henk Penning (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748715#action_12748715 ]
Henk Penning commented on INFRA-1506:
-------------------------------------
Hi,
today we had to block 202.90.158.134 again ;
that host rsynced 15482 times ; every few seconds
for hours. Please never do that again.
Please try to set up a straight cronjob, doing an
rsync once a day ; and see if that works well
enough.
Thanks,
Henk Penning
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
> Assignee: Henk Penning
> Attachments: apache_mirror.sh
>
>
> URL of mirror: http://mirror.psigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 4x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (INFRA-1506) Mirror in the Philippines
Posted by "Rey Vincent Babilonia (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rey Vincent Babilonia updated INFRA-1506:
-----------------------------------------
Attachment: apache_mirror.sh
Hi Henk,
We are using the attached bash script. Any suggestions would be appreciated.
Thanks.
Regards,
Rey
--
Import my public key from
http://ca.grid.sinica.edu.tw/publication/newCRT/newcerts/0344.crt into
your email client to send encrypted messages for me.
# Rey Vincent P. Babilonia
# Master of Information Systems
# University of the Philippines Open University
# http://www.upou.edu.ph
# Science Research Specialist I
# Advanced Science and Technology Institute
# http://www.asti.dost.gov.ph
# Team Lead
# Philippine Bioinformatics Solutions Project
# Site Administrator
# PH-ASTI Node, EUAsiaGrid Project
# http://www.euasiagrid.eu
# Temporary Team Lead
# Philippine e-Science Grid Infrastructure
# http://www.psigrid.gov.ph
# Mobile +63 917 509 3469
# Landline +63 2 426 9760 extension 1302
#!/bin/bash
## PSciGrid Apache Mirror Synchronization Script Version 1.0
##
## This shell script synchronizes the Apache projects.
## Adapted from the mirror synchronization script by Peter Noble.
## Installation:
## 1. Copy to your working directory.
## 2. Set variables.
## 3. Set mode to executable.
## 4. Prepare local folder.
## 5. Install rsync and sendmail.
## 6. Install apache_mirrord.
## Create a lock file containing the process ID's
lockfile="/var/lock/apache_mirror.lock"
if [ -f $lockfile ]; then
echo "Lock file present. Exiting."
exit
fi
pid=$$
echo $pid > $lockfile
## Create a log file
logfile="/var/log/apache_mirror.log"
touch $logfile
## Configure email notification
## Set to true if you want to receive email
sendemail="true"
## Set administrator email address
adminemail="rvincent@asti.dost.gov.ph"
## Initialize some other variables
complete="false"
failures=0
status=1
## Recursively synchronize the software set
while (true); do
while [[ "$complete" != "true" ]]; do
start=`date`
echo "$start - $pid - Started Apache Mirror Sync" >> $logfile
## If synchronization is interrupted, suspend for 2 minutes
## The server is probably handling too many concurrent connections
if [[ $failures -gt 0 ]]; then
echo "`date` - Encountered an error. Sleeping for 2 minutes..."
sleep 2m
fi
## Start synchronization and store ID to the lock file
if [[ $1 == "debug" ]]; then
echo "Working on attempt number $failures"
rsync -auvHL --numeric-ids --timeout=600 --delete-after rsync.apache.org::apache-dist /var/www/apache >> $logfile
status=$?
else
rsync -auvHL --numeric-ids --timeout=600 --delete-after rsync.apache.org::apache-dist /var/www/apache >> $logfile
## Check disk utilization of the data set
size=`du -h --max-depth=0 --time --time-style iso /var/www/apache`
status=$?
fi
if [[ $status -ne "0" ]]; then
complete="false"
(( failures += 1 ))
else
finish=`date`
## Send an email notification
if [[ -x /usr/bin/mail && "$sendemail" == "true" ]]; then
## Set the subject
subject="Summary of Apache Mirror Synchronization"
## Create the message
message="PID: $pid\nFailures: $failures\nStart Time: $start\nFinish Time: $finish\nSize: $size\n\n"
echo -e $message | mail -s "$subject" "$adminemail"
fi
complete="true"
echo $message >> $logfile
echo "$finish - $pid - Finished Apache Mirror Sync" >> $logfile
fi
done
complete="false"
done
## Quit the mirror synchronization script
exit 0
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
> Assignee: Henk Penning
> Attachments: apache_mirror.sh
>
>
> URL of mirror: http://mirror.psigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 4x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1506) Mirror in the Philippines
Posted by "Henk Penning (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722154#action_12722154 ]
Henk Penning commented on INFRA-1506:
-------------------------------------
Rey Vincent Babilonia,
just curious ; are you still working on this ?
Or should I consider your offer 'withdrawn'.
Thanks, regards,
Henk Penning
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
> Assignee: Henk Penning
> Attachments: apache_mirror.sh
>
>
> URL of mirror: http://mirror.psigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 4x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Closed: (INFRA-1506) Mirror in the Philippines
Posted by "Gavin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gavin closed INFRA-1506.
------------------------
Resolution: Fixed
Added, thanks. Will appear soon.
> Mirror in the Philippines
> -------------------------
>
> Key: INFRA-1506
> URL: https://issues.apache.org/jira/browse/INFRA-1506
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Rey Vincent Babilonia
>
> URL of mirror: http://mirror.psigrid.gov.ph/apache
> Country where the mirror is located: Philippines
> Contact email address: rvincent@asti.dost.gov.ph
> Update frequency: 4x a day
> Rsync repository used: rsync.apache.org
> Approximate bandwidth: 155Mbps
> I have configured my HTTP server as requested (yes/no): yes
> I have subscribed to the mirror maintainers mailing list (yes/no): yes
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.