You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cocoon.apache.org by Tuomo L <tl...@cc.hut.fi> on 2004/06/21 15:25:46 UTC

Downloading large files with Cocoon 2.1.5 + Tomcat 4.1.24

Hi,

We need to store large files (>30MB) in a database (MS SQL). The upload
seems to work, because we've compared the filesize in db to the actual
file. But when downloading, browser (IE or Mozilla) does not succeed. IE
saves 0 bytes to disk, and Mozilla doesn't even start the download
process.

We're using the modular DatabaseAddAction for upload, and the
DatabaseReader for download.

I did another test, and tried to get Cocoon to return a large zip-file
(>30MB) with the default file reader, and it didn't work either! Has
anyone tried to return any large sources with Cocoon lately?

Any help would be great, running out of ideas and time here... :(

-Tuomo

Re: Downloading large files with Cocoon 2.1.5 + Tomcat 4.1.24

Posted by Tuomo L <tl...@cc.hut.fi>.
Thank you Bruno! :)

It definitely did the trick. I remember having this working about a year
ago, without that parameter. Has the pipeline implementation changed
since, therefore requiring this parameter?

Thanks again,
Tuomo

On Mon, 21 Jun 2004, Bruno Dumon wrote:

> On Mon, 2004-06-21 at 15:25, Tuomo L wrote:
> > Hi,
> >
> > We need to store large files (>30MB) in a database (MS SQL). The upload
> > seems to work, because we've compared the filesize in db to the actual
> > file. But when downloading, browser (IE or Mozilla) does not succeed. IE
> > saves 0 bytes to disk, and Mozilla doesn't even start the download
> > process.
> >
> > We're using the modular DatabaseAddAction for upload, and the
> > DatabaseReader for download.
> >
> > I did another test, and tried to get Cocoon to return a large zip-file
> > (>30MB) with the default file reader, and it didn't work either! Has
> > anyone tried to return any large sources with Cocoon lately?
> >
> > Any help would be great, running out of ideas and time here... :(
>
> Put your pipelines in a map:pipeline element like:
>
>  <map:pipeline type="noncaching">
>    <map:parameter name="outputBufferSize" value="8192"/>
>     ...
>
> --
> Bruno Dumon                             http://outerthought.org/
> Outerthought - Open Source, Java & XML Competence Support Center
> bruno@outerthought.org                          bruno@apache.org
>
>

Re: Downloading large files with Cocoon 2.1.5 + Tomcat 4.1.24

Posted by Bruno Dumon <br...@outerthought.org>.
On Mon, 2004-06-21 at 15:25, Tuomo L wrote:
> Hi,
> 
> We need to store large files (>30MB) in a database (MS SQL). The upload
> seems to work, because we've compared the filesize in db to the actual
> file. But when downloading, browser (IE or Mozilla) does not succeed. IE
> saves 0 bytes to disk, and Mozilla doesn't even start the download
> process.
> 
> We're using the modular DatabaseAddAction for upload, and the
> DatabaseReader for download.
> 
> I did another test, and tried to get Cocoon to return a large zip-file
> (>30MB) with the default file reader, and it didn't work either! Has
> anyone tried to return any large sources with Cocoon lately?
> 
> Any help would be great, running out of ideas and time here... :(

Put your pipelines in a map:pipeline element like:

 <map:pipeline type="noncaching">
   <map:parameter name="outputBufferSize" value="8192"/>
    ...

-- 
Bruno Dumon                             http://outerthought.org/
Outerthought - Open Source, Java & XML Competence Support Center
bruno@outerthought.org                          bruno@apache.org


Re: Downloading large files with Cocoon 2.1.5 + Tomcat 4.1.24

Posted by Litrik De Roy <co...@litrik.com>.
Andrew Thornton wrote:

> Litrik De Roy wrote:
>
> > Some time ago, I wrote a page on the wiki about this : 
> http://wiki.cocoondev.org/Wiki.jsp?page=ServingLargeFiles
>
> On this wiki page is a reference to a bug which has a patch to fix it 
> attached. There are 40 bugs in the 'zilla which contain the word patch 
> and are in the NEW state. Whats the policy on getting these looked at?
>
The sad thing is that, in the meantime other changes have been made to 
the same source causing merge conflicts.
The longer it takes for a committer to apply the patch, the harder it 
will be to actually do it.

For my project I simply copied the existing ResourceReader into 
BetterResourceReader, applied the patch and stopped using the original 
ResourceReader. Not perfect because now I'm missing the latest code 
changes but at least my large files work OK.

-- 

Litrik De Roy
www.litrik.com



Re: Downloading large files with Cocoon 2.1.5 + Tomcat 4.1.24

Posted by Andrew Thornton <an...@caret.cam.ac.uk>.
Litrik De Roy wrote:

 >
 > Some time ago, I wrote a page on the wiki about this : 
http://wiki.cocoondev.org/Wiki.jsp?page=ServingLargeFiles
 >
 > Please check it out...


On this wiki page is a reference to a bug which has a patch to fix it 
attached. There are 40 bugs in the 'zilla which contain the word patch 
and are in the NEW state. Whats the policy on getting these looked at?

Thanks,

andy

PS one of them is mine... Bug id: #28973.

-- 
andrew@caret.cam.ac.uk / art27@cantab.net
"Absinthe makes the hog Jane Fonda"

Re: Regarding patches in Bugzilla was Re: Downloading large files with Cocoon 2.1.5 + Tomcat 4.1.24

Posted by Andrew Thornton <an...@caret.cam.ac.uk>.
Apologies for the double post... not sure what happened there.

andy

-- 
andrew@caret.cam.ac.uk / art27@cantab.net
"Absinthe makes the hog Jane Fonda"

Re: Regarding patches in Bugzilla...

Posted by Bertrand Delacretaz <bd...@apache.org>.
Le 22 juin 04, à 11:55, Andrew Thornton a écrit :

> ...There are 40 bugs in the 'zilla which contain the word patch and 
> are in the NEW state. Whats the policy on getting these looked at?

There's no real policy: whenever a committer has either a) enough free 
time or b) a big enough itch to scratch, they will look at the patch 
and eventually commit it.

Looking at the relatively low activity on this list these days, it 
seems like a) is fairly scarce at the moment. If you think you patch 
might qualify for b), you might want to remind us here of why you think 
so.

-Bertrand, free time counter in the red these days ;-)


Regarding patches in Bugzilla was Re: Downloading large files with Cocoon 2.1.5 + Tomcat 4.1.24

Posted by Andrew Thornton <ar...@cantab.net>.
Litrik De Roy wrote:
>
> Some time ago, I wrote a page on the wiki about this : 
> http://wiki.cocoondev.org/Wiki.jsp?page=ServingLargeFiles
> 
> Please check it out...

On this wiki page is a reference to a bug which has a patch to fix it 
attached. There are 40 bugs in the 'zilla which contain the word patch 
and are in the NEW state. Whats the policy on getting these looked at?

Thanks,

andy

PS one of them is mine... Bug id: #28973.

-- 
andrew@caret.cam.ac.uk / art27@cantab.net
"Absinthe makes the hog Jane Fonda"

Re: Downloading large files with Cocoon 2.1.5 + Tomcat 4.1.24

Posted by Litrik De Roy <co...@litrik.com>.
Tuomo L wrote:

>Hi,
>
...

>I did another test, and tried to get Cocoon to return a large zip-file
>(>30MB) with the default file reader, and it didn't work either! Has
>anyone tried to return any large sources with Cocoon lately?
>
>Any help would be great, running out of ideas and time here... :(
>  
>
Some time ago, I wrote a page on the wiki about this : 
http://wiki.cocoondev.org/Wiki.jsp?page=ServingLargeFiles

Please check it out...

>-Tuomo
>

-- 

Litrik De Roy
www.litrik.com