You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Andrew Bayer (JIRA)" <ji...@apache.org> on 2011/08/18 23:32:27 UTC
[jira] [Created] (BIGTOP-24) Errors downloading tarballs from
dist.apache.org via curl
Errors downloading tarballs from dist.apache.org via curl
----------------------------------------------------------
Key: BIGTOP-24
URL: https://issues.apache.org/jira/browse/BIGTOP-24
Project: Bigtop
Issue Type: Bug
Components: General
Reporter: Andrew Bayer
Assignee: Andrew Bayer
Fix For: 0.1.0
We're seeing weird problems with downloading tarballs from dist.apache.org (and possibly other sites) barfing partway through. I'm going to try to use a dedicated mirror rather than dist.a.o so that we get more reliable d/ls.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-24) Errors downloading tarballs from
dist.apache.org via curl
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-24?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087341#comment-13087341 ]
Andrei Savu commented on BIGTOP-24:
-----------------------------------
We experienced a similar problem in Whirr. I suggest that rather than changing the mirror a more permanent fix would be to add a retry loop around curl (it seems like it doesn't automatically retry partial downloads).
> Errors downloading tarballs from dist.apache.org via curl
> ----------------------------------------------------------
>
> Key: BIGTOP-24
> URL: https://issues.apache.org/jira/browse/BIGTOP-24
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Reporter: Andrew Bayer
> Assignee: Andrew Bayer
> Fix For: 0.1.0
>
> Attachments: BIGTOP-24.diff
>
>
> We're seeing weird problems with downloading tarballs from dist.apache.org (and possibly other sites) barfing partway through. I'm going to try to use a dedicated mirror rather than dist.a.o so that we get more reliable d/ls.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-24) Errors downloading tarballs from
dist.apache.org via curl
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-24?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087318#comment-13087318 ]
Andrew Bayer commented on BIGTOP-24:
------------------------------------
Patch changes the download location for the various Apache tarballs to use the Makefile-defined APACHE_MIRROR variable, which I've also changed to default to use apache.osuosl.org, which I generally find to be faster than ibiblio.
I should note that this approach could cause problems if a Bigtop build is trying to find a version of one of the component projects that is no longer available in the main Apache download/mirror area, i.e., a particularly old version. But for now, I don't think that's an issue we really need to worry about, and we can cross that bridge if/when we get to it.
> Errors downloading tarballs from dist.apache.org via curl
> ----------------------------------------------------------
>
> Key: BIGTOP-24
> URL: https://issues.apache.org/jira/browse/BIGTOP-24
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Reporter: Andrew Bayer
> Assignee: Andrew Bayer
> Fix For: 0.1.0
>
> Attachments: BIGTOP-24.diff
>
>
> We're seeing weird problems with downloading tarballs from dist.apache.org (and possibly other sites) barfing partway through. I'm going to try to use a dedicated mirror rather than dist.a.o so that we get more reliable d/ls.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-24) Errors downloading tarballs from
dist.apache.org via curl
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-24?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087347#comment-13087347 ]
Andrew Bayer commented on BIGTOP-24:
------------------------------------
We do need a retry loop added, but for right now, I'm fine with just using a consistent, functional mirror, so that we can actually build in the first place. =) I've tested and all the tarballs do download via apache.osuosl.org.
> Errors downloading tarballs from dist.apache.org via curl
> ----------------------------------------------------------
>
> Key: BIGTOP-24
> URL: https://issues.apache.org/jira/browse/BIGTOP-24
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Reporter: Andrew Bayer
> Assignee: Andrew Bayer
> Fix For: 0.1.0
>
> Attachments: BIGTOP-24.diff
>
>
> We're seeing weird problems with downloading tarballs from dist.apache.org (and possibly other sites) barfing partway through. I'm going to try to use a dedicated mirror rather than dist.a.o so that we get more reliable d/ls.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (BIGTOP-24) Errors downloading tarballs from
dist.apache.org via curl
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-24?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Bayer resolved BIGTOP-24.
--------------------------------
Resolution: Fixed
> Errors downloading tarballs from dist.apache.org via curl
> ----------------------------------------------------------
>
> Key: BIGTOP-24
> URL: https://issues.apache.org/jira/browse/BIGTOP-24
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Reporter: Andrew Bayer
> Assignee: Andrew Bayer
> Fix For: 0.1.0
>
> Attachments: BIGTOP-24.diff
>
>
> We're seeing weird problems with downloading tarballs from dist.apache.org (and possibly other sites) barfing partway through. I'm going to try to use a dedicated mirror rather than dist.a.o so that we get more reliable d/ls.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-24) Errors downloading tarballs from
dist.apache.org via curl
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-24?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087354#comment-13087354 ]
Andrew Bayer commented on BIGTOP-24:
------------------------------------
Oh, definitely agreed - but the immediate problem here wasn't the internet connection, it was that dist.apache.org kept crapping out during downloads, while I had no problems downloading from anywhere else. =) And yeah, we should open another JIRA for wrapping curl calls in retry logic.
> Errors downloading tarballs from dist.apache.org via curl
> ----------------------------------------------------------
>
> Key: BIGTOP-24
> URL: https://issues.apache.org/jira/browse/BIGTOP-24
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Reporter: Andrew Bayer
> Assignee: Andrew Bayer
> Fix For: 0.1.0
>
> Attachments: BIGTOP-24.diff
>
>
> We're seeing weird problems with downloading tarballs from dist.apache.org (and possibly other sites) barfing partway through. I'm going to try to use a dedicated mirror rather than dist.a.o so that we get more reliable d/ls.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-24) Errors downloading tarballs from
dist.apache.org via curl
Posted by "Bruno Mahé (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-24?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087322#comment-13087322 ]
Bruno Mahé commented on BIGTOP-24:
----------------------------------
+1 LGTM.provided bigtop has been able to pull all the tarballs without issue with that mirror
> Errors downloading tarballs from dist.apache.org via curl
> ----------------------------------------------------------
>
> Key: BIGTOP-24
> URL: https://issues.apache.org/jira/browse/BIGTOP-24
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Reporter: Andrew Bayer
> Assignee: Andrew Bayer
> Fix For: 0.1.0
>
> Attachments: BIGTOP-24.diff
>
>
> We're seeing weird problems with downloading tarballs from dist.apache.org (and possibly other sites) barfing partway through. I'm going to try to use a dedicated mirror rather than dist.a.o so that we get more reliable d/ls.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-24) Errors downloading tarballs from
dist.apache.org via curl
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-24?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Bayer updated BIGTOP-24:
-------------------------------
Attachment: BIGTOP-24.diff
> Errors downloading tarballs from dist.apache.org via curl
> ----------------------------------------------------------
>
> Key: BIGTOP-24
> URL: https://issues.apache.org/jira/browse/BIGTOP-24
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Reporter: Andrew Bayer
> Assignee: Andrew Bayer
> Fix For: 0.1.0
>
> Attachments: BIGTOP-24.diff
>
>
> We're seeing weird problems with downloading tarballs from dist.apache.org (and possibly other sites) barfing partway through. I'm going to try to use a dedicated mirror rather than dist.a.o so that we get more reliable d/ls.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-24) Errors downloading tarballs from
dist.apache.org via curl
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-24?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087349#comment-13087349 ]
Andrei Savu commented on BIGTOP-24:
-----------------------------------
A reliable mirror will not make the internet connection reliable but I guess the solution is good enough for now.
> Errors downloading tarballs from dist.apache.org via curl
> ----------------------------------------------------------
>
> Key: BIGTOP-24
> URL: https://issues.apache.org/jira/browse/BIGTOP-24
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Reporter: Andrew Bayer
> Assignee: Andrew Bayer
> Fix For: 0.1.0
>
> Attachments: BIGTOP-24.diff
>
>
> We're seeing weird problems with downloading tarballs from dist.apache.org (and possibly other sites) barfing partway through. I'm going to try to use a dedicated mirror rather than dist.a.o so that we get more reliable d/ls.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-24) Errors downloading tarballs from
dist.apache.org via curl
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-24?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087332#comment-13087332 ]
Andrew Bayer commented on BIGTOP-24:
------------------------------------
I eyeballed all the tarballs - I'm in the process of testing pig 0.9.0 for BIGTOP-23 right now, but once I verify that, I'll do a full build of everything to make sure they fetch.
> Errors downloading tarballs from dist.apache.org via curl
> ----------------------------------------------------------
>
> Key: BIGTOP-24
> URL: https://issues.apache.org/jira/browse/BIGTOP-24
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Reporter: Andrew Bayer
> Assignee: Andrew Bayer
> Fix For: 0.1.0
>
> Attachments: BIGTOP-24.diff
>
>
> We're seeing weird problems with downloading tarballs from dist.apache.org (and possibly other sites) barfing partway through. I'm going to try to use a dedicated mirror rather than dist.a.o so that we get more reliable d/ls.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira