You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@maven.apache.org by "Lee Thompson (JIRA)" <ji...@codehaus.org> on 2009/05/01 19:38:44 UTC

[jira] Created: (WAGON-264) compressed tarball download problems

compressed tarball download problems
------------------------------------

                 Key: WAGON-264
                 URL: http://jira.codehaus.org/browse/WAGON-264
             Project: Maven Wagon
          Issue Type: Bug
          Components: wagon-http-lightweight
    Affects Versions: 1.0-beta-5, 1.0-beta-4, 1.0-beta-3, 1.0-beta-2
            Reporter: Lee Thompson


HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download


$ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
$ tar tzf openssl-0.9.8k.tar.gz 
gzip: stdin: not in gzip format
tar: Child returned status 1
tar: Error exit delayed from previous errors
$ tar tf openssl-0.9.8k.tar.gz | more
openssl-0.9.8k/apps/
openssl-0.9.8k/apps/app_rand.c



Downloading expat results in a corrupted file


mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
$ tar tf expat-1.98.8.tar.gz 
tar: This does not look like a tar archive
tar: Skipping to next header
tar: Read 1943 bytes from expat-1.98.8.tar.gz
tar: Error exit delayed from previous errors


-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Closed: (WAGON-264) compressed tarball download problems

Posted by "John Casey (JIRA)" <ji...@codehaus.org>.
     [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Casey closed WAGON-264.
----------------------------

         Assignee: John Casey
       Resolution: Not A Bug
    Fix Version/s: 1.0-beta-5

This is a server configuration issue, not a wagon problem.

> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Bug
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>            Assignee: John Casey
>             Fix For: 1.0-beta-5
>
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (WAGON-264) compressed tarball download problems

Posted by "John Casey (JIRA)" <ji...@codehaus.org>.
     [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Casey updated WAGON-264:
-----------------------------

    Fix Version/s:     (was: 1.0-beta-5)
                   1.0

> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Improvement
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>            Assignee: John Casey
>             Fix For: 1.0
>
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (WAGON-264) compressed tarball download problems

Posted by "John Casey (JIRA)" <ji...@codehaus.org>.
     [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Casey updated WAGON-264:
-----------------------------

    Fix Version/s:     (was: 1.0)
                   1.0-beta-6

fix-for: beta-6

> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Improvement
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>            Assignee: John Casey
>             Fix For: 1.0-beta-6
>
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (WAGON-264) compressed tarball download problems

Posted by "John Casey (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=181523#action_181523 ] 

John Casey commented on WAGON-264:
----------------------------------

The wagon-maven-plugin will have to adjust (and be re-released) to handle httpConfiguration, I would expect. That is, unless it deals with the WagonManager component from maven-artifact-manager, which in turn handles Wagon instances that are configured using <server> entries in the settings.xml...which IMO is probably a good practice for it to do...

> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Improvement
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>            Assignee: John Casey
>             Fix For: 1.0-beta-6
>
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Issue Comment Edited: (WAGON-264) compressed tarball download problems

Posted by "John Casey (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=179794#action_179794 ] 

John Casey edited comment on WAGON-264 at 6/25/09 12:09 PM:
------------------------------------------------------------

The following headers are set by default in the latest trunk revisions of the httpclient-driven wagon (this is the http wagon that will be used in Maven 2.2.0):

{code}
            method.addRequestHeader( "Cache-control", "no-cache" );
            method.addRequestHeader( "Cache-store", "no-store" );
            method.addRequestHeader( "Pragma", "no-cache" );
            method.addRequestHeader( "Expires", "0" );
            method.addRequestHeader( "Accept-Encoding", "gzip" );
{code}

To disable the Accept-Encoding header, you will have to disable all of these default headers, then re-add the ones you want to keep. As of the versions checked into trunk, you can do this by editing the settings.xml, like this:

{code:xml}
<server>
  <id>myrepo</id>
  <configuration>
    <httpConfiguration>
      <all>
        <useDefaultHeaders>false</useDefaultHeaders>
        <headers>
          <header>
            <name>Cache-control</name>
            <value>no-cache</value>
          </header>
          <header>
            <name>Cache-store</name>
            <value>no-store</value>
          </header>
          <header>
            <name>Pragma</name>
            <value>no-cache</value>
          </header>
          <header>
            <name>Expires</name>
            <value>0</value>
          </header>
        </headers>
      </all>
    </httpConfiguration>
  </configuration>
</server>
{code}

Note that the above configuration will work for wagons accessed through the WagonManager in maven-artifact-manager. If you're managing Wagon instances elsewhere, you may need to provide access to the new HttpConfiguration and HttpMethodConfiguration config classes in wagon-http-shared.

      was (Author: jdcasey):
    The following headers are set by default in the latest trunk revisions of the httpclient-driven wagon (this is the http wagon that will be used in Maven 2.2.0):

{code}
            method.addRequestHeader( "Cache-control", "no-cache" );
            method.addRequestHeader( "Cache-store", "no-store" );
            method.addRequestHeader( "Pragma", "no-cache" );
            method.addRequestHeader( "Expires", "0" );
            method.addRequestHeader( "Accept-Encoding", "gzip" );
{code}

To disable the Accept-Encoding header, you will have to disable all of these default headers, then re-add the ones you want to keep. As of the versions checked into trunk, you can do this by editing the settings.xml, like this:

{code:xml}
<server>
  <id>myrepo</id>
  <configuration>
    <httpConfiguration>
      <all>
        <useDefaultHeaders>false</useDefaultHeaders>
        <headers>
          <Cache-control>no-cache</Cache-control>
          <Cache-store>no-store</Cache-store>
          <Pragma>no-cache</Pragma>
          <Expires>0</Expires>
        </headers>
      </all>
    </httpConfiguration>
  </configuration>
</server>
{code}

Note that the above configuration will work for wagons accessed through the WagonManager in maven-artifact-manager. If you're managing Wagon instances elsewhere, you may need to provide access to the new HttpConfiguration and HttpMethodConfiguration config classes in wagon-http-shared.
  
> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Improvement
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>            Assignee: John Casey
>             Fix For: 1.0-beta-6
>
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (WAGON-264) compressed tarball download problems

Posted by "Brian Fox (JIRA)" <ji...@codehaus.org>.
     [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Brian Fox updated WAGON-264:
----------------------------

    Issue Type: Improvement  (was: Bug)

> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Improvement
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>            Assignee: John Casey
>             Fix For: 1.0-beta-5
>
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (WAGON-264) compressed tarball download problems

Posted by "Lee Thompson (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=175191#action_175191 ] 

Lee Thompson commented on WAGON-264:
------------------------------------

I'm reading rfc2616 and indeed, I agree with you that the openssl webserver is misconfigured deviating from HTTP spec.  The webserver in this case transmitted Content-Type of gzip with no Content-Encoding but declared in the reply Content-Encoding of gzip.  Unfortunately, it looks to me like the openssl config is following the Apache documentation to the letter....

http://httpd.apache.org/docs/2.2/mod/mod_mime.html#addencoding

specifically --> To make this long story short, you should always use x-gzip and x-compress for these two specific encodings.

The Apache docs are probably incorrect (or confusing at best) leading to this issue.  I'd have to go back to the point that wget, and curl (and I just tested firefox) will all download from these sites and get the correct file.  I'd also go back to my point that performance is worse when you ask for GZIP encoding for filetypes that are already compressed.  The only typical maven uncompressed file types are the pom XML files and the SHA1 and MD5SUM hash files and these artifacts are so small that the benefit is negligible.  While wagon might not have a bug in regards to rfc2616, it does have an issue dealing with sites who read the Apache configuration documentation.  Wagon is the only http client I know of that can't download tarballs from sourceforge and openssl.  (Lots of sourceforge mirrors have this config problem).  The internet is a cooperative media and strict compliance is often compromised when interoperability concerns are brought in.

Please make wagon defend itself from badly configured webservers.


> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Bug
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>            Assignee: John Casey
>             Fix For: 1.0-beta-5
>
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (WAGON-264) compressed tarball download problems

Posted by "Lee Thompson (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=174980#action_174980 ] 

Lee Thompson commented on WAGON-264:
------------------------------------

Looks like the client can not see the bypass behavior of mod_gzip.  If you run this little groovy program, it will dump the request headers...


URL url = new URL ( "http://prdownloads.sourceforge.net/expat/expat-1.98.8.tar.gz" );
HttpURLConnection urlConnection = (HttpURLConnection) url.openConnection();
urlConnection.setRequestProperty( "Accept-Encoding", "gzip" );
int responseCode = urlConnection.getResponseCode();
println "Response code is " + responseCode
Map<String, List<String>> hdrFields = urlConnection.getHeaderFields()
println hdrFields



output...


Response code is 200
[X-Powered-By:[PHP/5.2.8], Set-Cookie:[PHPSESSID=7f4eb0ee669a6363aa7c1e80b4980b0e; expires=Sunday, 17-May-09 13:23:42 GMT; path=/], X-SFX-Webhead:[sfs-web-7], null:[HTTP/1.1 200 OK], X-SFX-Revision:[release_20090417], Date:[Sun, 03 May 2009 13:23:42 GMT], Pragma:[no-cache], Content-type:[text/html], Cache-Control:[no-store, no-cache, must-revalidate, post-check=0, pre-check=0], Content-Encoding:[gzip], Expires:[Thu, 19 Nov 1981 08:52:00 GMT], Server:[lighttpd/1.4.19], Transfer-Encoding:[chunked], Vary:[Accept-Encoding, User-Agent]]




Suggest a "getCompressedFileExtension()" method to Resource.java which checks the file extenstion for common internet compressed file types like jar, zip, gz, tgz, bz2 and if getCompressedFileExtension() is true, don't as for the gzip encoding and don't check for it either.  This check would be needed fro http and https.

> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Bug
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (WAGON-264) compressed tarball download problems

Posted by "John Casey (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=175087#action_175087 ] 

John Casey commented on WAGON-264:
----------------------------------

This looks like a configuration issue on the openssl.org website. The first, openssl, is using content-encoding 'x-gzip' and appears not to actually be re-compressing the file, while the other two websites use no content-encoding. I'm guessing they messed up something similar to this:

{noformat}
AddType x-gzip .gz
{noformat}

Here's the output from hitting three different servers with curl:

{noformat}
Betelgeuse:wagon-plugin-tests jdcasey$ curl -X HEAD -i http://www.openssl.org/source/openssl-0.9.8k.tar.gz
HTTP/1.1 200 OK
Date: Mon, 04 May 2009 17:40:48 GMT
Server: Apache/1.3.33 (OpenPKG/2.5)
Last-Modified: Wed, 25 Mar 2009 12:21:40 GMT
ETag: "f0c99a-3ac7e3-49ca21d4"
Accept-Ranges: bytes
Content-Length: 3852259
Content-Type: application/x-tar
Content-Encoding: x-gzip

^C
Betelgeuse:wagon-plugin-tests jdcasey$ 
Betelgeuse:wagon-plugin-tests jdcasey$ 
Betelgeuse:wagon-plugin-tests jdcasey$ curl -X HEAD -i http://prdownloads.sourceforge.net/expat/expat-1.98.8.tar.gz
HTTP/1.1 301 Moved Permanently
X-Powered-By: PHP/5.2.8
Location: http://sourceforge.net/projects/expat/files
Content-type: text/html
Date: Mon, 04 May 2009 20:30:07 GMT
Server: lighttpd/1.4.19

Betelgeuse:wagon-plugin-tests jdcasey$ curl -X HEAD -i http://repo2.maven.org/maven2/org/apache/maven/apache-maven/2.0.10/apache-maven-2.0.10-bin.tar.gz
HTTP/1.1 200 OK
Server: nginx/0.7.19
Date: Mon, 04 May 2009 20:31:13 GMT
Content-Type: application/octet-stream
Content-Length: 2101451
Last-Modified: Tue, 10 Feb 2009 02:58:01 GMT
Connection: keep-alive
Accept-Ranges: bytes
{noformat}


> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Bug
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Reopened: (WAGON-264) compressed tarball download problems

Posted by "Lee Thompson (JIRA)" <ji...@codehaus.org>.
     [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lee Thompson reopened WAGON-264:
--------------------------------


If its a server config issue, its a server config issue that http transport clients know how to deal with (except wagon...)   I'll download expat with CURL, WGET, and Wagon.  Two work, one doesn't.  Same for openssl.  Wagon corrupts compressed tarballs via http/https.






$ mkdir curl wagon wget
$ cd curl
$ wget http://softlayer.dl.sourceforge.net/sourceforge/expat/expat-1.95.8.tar.gz--2009-05-05 10:02:00--  http://softlayer.dl.sourceforge.net/sourceforge/expat/expat-1.95.8.tar.gz
Resolving softlayer.dl.sourceforge.net... 74.86.229.28
Connecting to softlayer.dl.sourceforge.net|74.86.229.28|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 318349 (311K) [application/x-gzip]
Saving to: `expat-1.95.8.tar.gz'

100%[======================================>] 318,349      539K/s   in 0.6s    

2009-05-05 10:02:00 (539 KB/s) - `expat-1.95.8.tar.gz' saved [318349/318349]

$ cd ../wget
$ wget http://softlayer.dl.sourceforge.net/sourceforge/expat/expat-1.95.8.tar.gz--2009-05-05 10:02:10--  http://softlayer.dl.sourceforge.net/sourceforge/expat/expat-1.95.8.tar.gz
Resolving softlayer.dl.sourceforge.net... 74.86.229.28
Connecting to softlayer.dl.sourceforge.net|74.86.229.28|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 318349 (311K) [application/x-gzip]
Saving to: `expat-1.95.8.tar.gz'

100%[======================================>] 318,349      554K/s   in 0.6s    

2009-05-05 10:02:10 (554 KB/s) - `expat-1.95.8.tar.gz' saved [318349/318349]

$ HTTP/1.1 200 OK
-bash: HTTP/1.1: No such file or directory
$ cd ../wagon/
$ mvn wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://softlayer.dl.sourceforge.net/sourceforge/expat -Dwagon.toDir=./
[INFO] Scanning for projects...
[INFO] Searching repository for plugin with prefix: 'wagon'.
[INFO] ------------------------------------------------------------------------
[INFO] Building Maven Default Project
[INFO]    task-segment: [wagon:download-single] (aggregator-style)
[INFO] ------------------------------------------------------------------------
[INFO] [wagon:download-single]
[INFO] Downloading: http://softlayer.dl.sourceforge.net/sourceforge/expat/expat-1.98.8.tar.gz to /Users/Lee/junk/downloads/wagon/expat-1.98.8.tar.gz
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESSFUL
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2 seconds
[INFO] Finished at: Tue May 05 10:03:59 CDT 2009
[INFO] Final Memory: 4M/8M
[INFO] ------------------------------------------------------------------------
$ 
$ 
$ cd ..
$ ls -lR
total 0
drwxr-xr-x  3 Lee  Lee  102 May  5 10:02 curl
drwxr-xr-x  3 Lee  Lee  102 May  5 10:03 wagon
drwxr-xr-x  3 Lee  Lee  102 May  5 10:02 wget

./curl:
total 624
-rw-r--r--  1 Lee  Lee  318349 Jul 24  2004 expat-1.95.8.tar.gz

./wagon:
total 72
-rw-r--r--  1 Lee  Lee  34158 May  5 10:03 expat-1.98.8.tar.gz

./wget:
total 624
-rw-r--r--  1 Lee  Lee  318349 Jul 24  2004 expat-1.95.8.tar.gz
$ 


> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Bug
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>            Assignee: John Casey
>             Fix For: 1.0-beta-5
>
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (WAGON-264) compressed tarball download problems

Posted by "Lee Thompson (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=174975#action_174975 ] 

Lee Thompson commented on WAGON-264:
------------------------------------

I believe the problem is the wagon-http-lightweight is ignoring the DECLINED:FEXT_GZ status code returned by mod_gzip.  When this error code is seen, mod_gzip passed on dynamic compresson since the request is for an already compressed gzip file.

Wagon requesting mod_gzip on ZIP and JAR files doesn't seem to trigger this behavior.  It would be an optimization to not ask for compression on JAR and ZIP files as these files are compressed but mod_gzip doesn't seem to know that.  Double compressing consumes time on both the client and server with no decrease in download payload (download sometimes increases somewhat)
 

> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Bug
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Closed: (WAGON-264) compressed tarball download problems

Posted by "John Casey (JIRA)" <ji...@codehaus.org>.
     [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Casey closed WAGON-264.
----------------------------

    Resolution: Fixed

The following headers are set by default in the latest trunk revisions of the httpclient-driven wagon (this is the http wagon that will be used in Maven 2.2.0):

{code}
            method.addRequestHeader( "Cache-control", "no-cache" );
            method.addRequestHeader( "Cache-store", "no-store" );
            method.addRequestHeader( "Pragma", "no-cache" );
            method.addRequestHeader( "Expires", "0" );
            method.addRequestHeader( "Accept-Encoding", "gzip" );
{code}

To disable the Accept-Encoding header, you will have to disable all of these default headers, then re-add the ones you want to keep. As of the versions checked into trunk, you can do this by editing the settings.xml, like this:

{code:xml}
<server>
  <id>myrepo</id>
  <configuration>
    <httpConfiguration>
      <all>
        <useDefaultHeaders>false</useDefaultHeaders>
        <headers>
          <Cache-control>no-cache</Cache-control>
          <Cache-store>no-store</Cache-store>
          <Pragma>no-cache</Pragma>
          <Expires>0</Expires>
        </headers>
      </all>
    </httpConfiguration>
  </configuration>
</server>
{code}

Note that the above configuration will work for wagons accessed through the WagonManager in maven-artifact-manager. If you're managing Wagon instances elsewhere, you may need to provide access to the new HttpConfiguration and HttpMethodConfiguration config classes in wagon-http-shared.

> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Improvement
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>            Assignee: John Casey
>             Fix For: 1.0
>
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (WAGON-264) compressed tarball download problems

Posted by "John Casey (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=175089#action_175089 ] 

John Casey commented on WAGON-264:
----------------------------------

Sorry, the output for the expat download didn't seem correct, so I retried with a URL I got from browsing to the expat project:

{noformat}
Betelgeuse:wagon-plugin-tests jdcasey$ curl -X HEAD -i http://softlayer.dl.sourceforge.net/sourceforge/expat/expat-1.95.8.tar.gz
HTTP/1.1 200 OK
Date: Mon, 04 May 2009 20:42:45 GMT
Server: Apache
Last-Modified: Sat, 24 Jul 2004 05:36:30 GMT
ETag: "3136801c-4db8d-22419380"
Accept-Ranges: bytes
Content-Length: 318349
Connection: close
Content-Type: application/x-gzip
{noformat}

> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Bug
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Issue Comment Edited: (WAGON-264) compressed tarball download problems

Posted by "Lee Thompson (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=174980#action_174980 ] 

Lee Thompson edited comment on WAGON-264 at 5/3/09 8:34 AM:
------------------------------------------------------------

Looks like the client can not see the bypass behavior of mod_gzip.  If you run this little groovy program, it will dump the request headers...




URL url = new URL ( "http://prdownloads.sourceforge.net/expat/expat-1.98.8.tar.gz" );
HttpURLConnection urlConnection = (HttpURLConnection) url.openConnection();
urlConnection.setRequestProperty( "Accept-Encoding", "gzip" );
int responseCode = urlConnection.getResponseCode();
println "Response code is " + responseCode
Map<String, List<String>> hdrFields = urlConnection.getHeaderFields()
println hdrFields



output...


Response code is 200
[X-Powered-By:[PHP/5.2.8], Set-Cookie:[PHPSESSID=7f4eb0ee669a6363aa7c1e80b4980b0e; expires=Sunday, 17-May-09 13:23:42 GMT; path=/], X-SFX-Webhead:[sfs-web-7], null:[HTTP/1.1 200 OK], X-SFX-Revision:[release_20090417], Date:[Sun, 03 May 2009 13:23:42 GMT], Pragma:[no-cache], Content-type:[text/html], Cache-Control:[no-store, no-cache, must-revalidate, post-check=0, pre-check=0], Content-Encoding:[gzip], Expires:[Thu, 19 Nov 1981 08:52:00 GMT], Server:[lighttpd/1.4.19], Transfer-Encoding:[chunked], Vary:[Accept-Encoding, User-Agent]]




Suggest a "getCompressedFileExtension()" method to Resource.java which checks the file extenstion for common internet compressed file types like jar, zip, gz, tgz, bz2, mp3, etc.  If getCompressedFileExtension() is true, don't ask for the gzip encoding and don't check for it either.  This check would be needed for http and https.

      was (Author: stimpy):
    Looks like the client can not see the bypass behavior of mod_gzip.  If you run this little groovy program, it will dump the request headers...


URL url = new URL ( "http://prdownloads.sourceforge.net/expat/expat-1.98.8.tar.gz" );
HttpURLConnection urlConnection = (HttpURLConnection) url.openConnection();
urlConnection.setRequestProperty( "Accept-Encoding", "gzip" );
int responseCode = urlConnection.getResponseCode();
println "Response code is " + responseCode
Map<String, List<String>> hdrFields = urlConnection.getHeaderFields()
println hdrFields



output...


Response code is 200
[X-Powered-By:[PHP/5.2.8], Set-Cookie:[PHPSESSID=7f4eb0ee669a6363aa7c1e80b4980b0e; expires=Sunday, 17-May-09 13:23:42 GMT; path=/], X-SFX-Webhead:[sfs-web-7], null:[HTTP/1.1 200 OK], X-SFX-Revision:[release_20090417], Date:[Sun, 03 May 2009 13:23:42 GMT], Pragma:[no-cache], Content-type:[text/html], Cache-Control:[no-store, no-cache, must-revalidate, post-check=0, pre-check=0], Content-Encoding:[gzip], Expires:[Thu, 19 Nov 1981 08:52:00 GMT], Server:[lighttpd/1.4.19], Transfer-Encoding:[chunked], Vary:[Accept-Encoding, User-Agent]]




Suggest a "getCompressedFileExtension()" method to Resource.java which checks the file extenstion for common internet compressed file types like jar, zip, gz, tgz, bz2 and if getCompressedFileExtension() is true, don't as for the gzip encoding and don't check for it either.  This check would be needed fro http and https.
  
> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Bug
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (WAGON-264) compressed tarball download problems

Posted by "Lee Thompson (JIRA)" <ji...@codehaus.org>.
    [ http://jira.codehaus.org/browse/WAGON-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=180402#action_180402 ] 

Lee Thompson commented on WAGON-264:
------------------------------------

I have a question.  In the use case that opened the issue using wagon-maven-plugin to retrieve off of openssl which isn't a maven repo, how would you inject the httpConfiguration into wagon-maven-plugin?

> compressed tarball download problems
> ------------------------------------
>
>                 Key: WAGON-264
>                 URL: http://jira.codehaus.org/browse/WAGON-264
>             Project: Maven Wagon
>          Issue Type: Improvement
>          Components: wagon-http-lightweight
>    Affects Versions: 1.0-beta-2, 1.0-beta-3, 1.0-beta-4, 1.0-beta-5
>            Reporter: Lee Thompson
>            Assignee: John Casey
>             Fix For: 1.0
>
>
> HTTP wagon will uncompress tarballs it downloads, sometimes badly.  Downloading openssl results in an unpressed download
> $ mvn -X wagon:download-single -Dwagon.fromFile=openssl-0.9.8k.tar.gz -Dwagon.url=http://www.openssl.org/source -Dwagon.toDir=./
> $ tar tzf openssl-0.9.8k.tar.gz 
> gzip: stdin: not in gzip format
> tar: Child returned status 1
> tar: Error exit delayed from previous errors
> $ tar tf openssl-0.9.8k.tar.gz | more
> openssl-0.9.8k/apps/
> openssl-0.9.8k/apps/app_rand.c
> Downloading expat results in a corrupted file
> mvn -X wagon:download-single -Dwagon.fromFile=expat-1.98.8.tar.gz -Dwagon.url=http://prdownloads.sourceforge.net/expat -Dwagon.toDir=./
> $ tar tf expat-1.98.8.tar.gz 
> tar: This does not look like a tar archive
> tar: Skipping to next header
> tar: Read 1943 bytes from expat-1.98.8.tar.gz
> tar: Error exit delayed from previous errors

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira